Microsoft Windows and web services (IIS and Tomcat), CI/CD pipelines (Azure DevOps), and generating XML files Understanding of database design techniques, optimisation, ETL best practices, and dimensional modeling BSc/BA in Computer Science, Engineering, or related field This is a change to join a brilliant, established business more »
project technical deliverables. Essential Technical Skills Minimum 2-3 years’ experience in developing & supporting Azure data focused systems Experience in traditional Data Warehouse technologies (ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks andmore »
London, England, United Kingdom Hybrid / WFH Options
Chapman Tate Associates
is an exciting opportunity to contribute to the success of a forward-thinking property management company. Responsibilities: Design, develop, and maintain data pipelines andETL processes using Azure Data Factory. Optimize data storage and retrieval processes to ensure scalability, reliability, and performance. Collaborate with cross-functional teams to understand data more »
your problem-solving skills and creativity. Google Cloud Professional Cloud Architect or Professional Cloud Developer certification Very Disrable to have hands-on experience with ETL tools, Hadoop-based technologies (e.g., Spark), and batch/streaming data pipelines (e.g., Beam, Flink etc) Proven expertise in designing and constructing data lakes andmore »
pipelines. As well as being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we are more »
to tackling one of society's greatest challenges: affordable care. What you’ll need Strong hands-on experience building and maintaining data pipelines andETL processes on a cloud platform Demonstrated experience delivering data products in a modern BI technology or open source data frameworks Strong SQL skills and experience more »
the organization. Developing and implementing data models and algorithms to support data science and machine learning initiatives. Technical Requirements Proven track record leading complex ETLand Data Infrastructure projects, as well as designing and building data intensive applications and services. Experience with data processing and distributed computing frameworks such as more »
and translate them into analytical solutions. Develop and maintain BI reports, dashboards, and visualisations using tools such as Power BI, Tableau, or similar platforms. Extract, transform, andload (ETL) data from various sources to create centralised datasets for analysis. Perform data analysis to identify trends, patterns, and opportunities for improvement. more »
role would be a great fit for you. As Data Engineer, you will: Design, develop, and maintain data processes on the Azure platform. Create ETL processes to collect, cleanse, andtransform data into usable formats. Support data migrations by extracting data from source systems, implementing data mappings and transformations, andmore »
Brentford, London, United Kingdom Hybrid / WFH Options
Kudos Partners
SQL Managed Instances o Database schema design and implementation -Relational databases, T-SQL, Stored Procedures, Functions and Views, Indexes, SQL jobs and alerts. o ETL Development and Data Warehousing experience - SSIS, SSRS, Azure Data Factory o CI & CD including Azure DevOps pipelines. o Experience in high availability databases/servers more »
experience in data analytics. Strong understanding of data science and machine learning. Proficiency in data preparation, cleansing, and transformation. Knowledge of data integration andETL processes. Skills in Excel, Python (3+ years), SQL (3+ years), MongoDB, API, JSON, and Power BI. Strong communication and project management skills. Nice To Haves more »
resourceful, independent and have a strong attention to detail Ability to face off to senior stakeholders and key decision makers Strong understanding of Data ETL tools (e.g. Alteryx) - nice to have Insurance London, UK - hybrid up to £50K Permanent more »
SQL, Python and AWS/Redshift to build features into the analytical pipelines, driving the advanced analytics techniques Design, develop and maintain data pipelines, ETL processes, and data warehouses to ensure data integrity and reliability Focused on upskilling the team through 1:1 meetings, mentoring, coaching, and performance reviews Devising more »
and security standards. Establish and uphold best practice standards, design patterns, and documentation for data management and engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows for seamless data transfer across systems and platforms. Develop system designs for integrating and managing data effectively. Experience and Qualifications more »
good knowledge of their respective language and writing production ready code that will be deployed on the cloud. 𝐑𝐨𝐥𝐞: Development of end-to-end ETL Data Pipelines Architect and build Market Data processing systems that will deal with Tick Data, Order Book data and Trade Data. Working collaboratively with the more »
Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure Data Factory Data warehouse development experience using Azure Synapse Analytics Experience with Snowflake would be desirable but not essential Excellent communication more »
Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure Data Factory Data warehouse development experience using Azure Synapse Analytics Experience with Snowflake would be desirable but not essential Excellent communication more »
Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure Data Factory Data warehouse development experience using Azure Synapse Analytics Experience with Snowflake would be desirable but not essential Excellent communication more »
Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure Data Factory Data warehouse development experience using Azure Synapse Analytics Experience with Snowflake would be desirable but not essential Excellent communication more »
City of London, London, United Kingdom Hybrid / WFH Options
Nigel Frank International
Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure Data Factory Data warehouse development experience using Azure Synapse Analytics Experience with Snowflake would be desirable but not essential Excellent communication more »
marketing business partners, teammates and leadership; implementing machine learning algorithms, working end-to-end on machine learning pipelines in production; data engineering working on ETL pipelines, crawling APIs and websites, and automating outputs (report generation, workflow automation, Google Sheet interaction); setting and meeting detailed timelines and expectations while executing projects more »
pipelines. As well as being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we are more »
efficient data ingestion, processing, storage, and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them into specific … applications. ● Lead end-to-end processes following the CRISP-DM process model to deliver high- quality datasets and their applications. ● Design and implement robust ETL/ELT pipelines from a variety of data sources, including RDBMS, texts, spreadsheets, and API endpoints, into the data warehouse. ● Utilise workflow management tools to … Azure DevOps and Data Factory is a plus. ● Experience with Docker and Kubernetes for creating portable and scalable environments is a plus. ● Experience with ETL tools like Pentaho Data Integration is a plus. Soft skills ● Analytical thinking with a keen attention to detail and a problem-solving mindset. ● Excellent communication more »
Consultants and Solution Architects from the Data Modeling or Analytics software/services industries. Experience with Data Warehouse concepts & Reporting Technologies (i.e. Tableau, PowerBI), ETL tools (i.e. Informatica, Unifi, SnapLogic) Experience working with APIs or an API testing framework such as Postman Experience with Business Requirements definition and management, structured more »
pipelines Extensive experience of data mapping and data transformation Experience in building optimised data pipelines Experience of data mapping and data transformation Experience of ETL tools (Azure Data Factory highly desirable) Experience of commercial off the shelf database packages e.g. Microsoft SQL Server Experience of Microsoft Power Platform Working knowledge more »