1 to 25 of 320 ETL Jobs in the UK

Strong consulting skills: discovery, requirements, backlog shaping, and producing clear deliverables (designs, estimates, plans, and documentation). Knowledge of designing and implementing ELT/ETL processes and integrating disparate line‐of‐business systems and databases (batch and, where required, streaming). Proven track record operating at a senior technical level ...

based data platforms (AWS, Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data ...

including performance tuning and optimisation. • Hands-on experience with Microsoft Fabric and Azure Data Factory, including orchestration and environment management. • Experience with SSIS for ETL and legacy data integration. • Strong understanding of scalable and resilient data architecture design. • Experience implementing CI/CD pipelines using tools such as Azure DevOps. ...

medallion architecture. Strong Azure Data Factory, Azure Data Lake, Python/PySpark, SQL, MS SQL/Azure SQL experience. Good understanding of data modelling, ETL/ELT, data quality, governance, and lineage. Experience working in financial services or another regulated environment. Desirable Experience Wealth management, investment management, pensions, banking ...

guidance and support to junior engineers within the team Design, develop, and test robust data pipelines for ingestion, processing, and transformation Implement and maintain ETL/ELT workflows feeding data warehouses, data lakes, or lakehouse platforms Leverage open-source and AWS-native tools to deliver scalable data solutions Apply DevOps ...

Translate the defined data architecture and standards into implemented solutions—including ingestion, transformation, storage, and performance optimisation. Pipeline Development & Orchestration Develop robust ELT/ETL pipelines using dbt and workflow/orchestration tools (e.g., Argo Workflows), ensuring reliability, maintainability, and adherence to engineering best practices. Performance & Cost Optimisation Implement Snowflake ...

value Drive best practice in data governance, cataloguing, lineage, and standards across the organisation Promote data re-use and reduce duplication across systems Oversee ETL processes, data integration, and BI architecture Manage and develop a small, high-performing data team, including mentoring, 1:1s, and continuous improvement initiatives Work closely ...

and operational decision-making. Key Responsibilities Design, build and maintain scalable data pipelines (batch and/or streaming) within secure environments Develop and optimise ETL/ELT processes for high-volume, structured and semi-structured datasets Work with stakeholders to translate complex requirements into technical data solutions Ensure data platforms ...

that tends to appeal. You will work with Building and maintaining enterprise-grade data pipelines across CRM, HR, Finance, and commercial systems Developing automated ETL/ELT pipelines using modern Azure tools Turning raw data into clean, reliable, analytics- and AI-ready datasets Working closely with data architects, analysts, and ...

projects. Leverage expertise in specific SAS technologies, solutions, and methodologies. Develop and implement data management systems to optimise data quality, focusing on best-practice ETL processes. Acquire data from primary/secondary sources and maintain databases/data systems. Utilise and communicate best-practice methodologies internally and externally. Create technical ...

Delivery Own It End-to-End: Manage and deliver BI infrastructure from initial brief and requirement gathering through to data pipeline development (APIs/ETL/ELT/SQL). Enable the Analysts: Work alongside your Data Analyst colleagues to help them generate impactful business insights and analysis. Data Platform ...

and clients. At mid‐level, we expect you to have a good grasp of core concepts of Data Engineering (data structures, databases, data manipulation, ETL, data quality), enabling you to write pipelines of moderate complexity in a consistent style. The technology we use varies between clients, so although we value ...

high-quality reporting, insight generation, and future AI/ML initiatives across the business. What You'll Do * Build & Maintain Pipelines: Develop ELT/ETL pipelines using dbt, Python, and orchestration tools. * Work with Snowflake: Design and optimise data models, manage performance, and adopt advanced Snowflake features. * Ensure Data Quality ...

data pipelines within Microsoft Fabric (Data Pipelines, Dataflows, OneLake, Lakehouse) Support the migration from SAP BW into a Fabric-based architecture Develop and optimise ETL/ELT processes using Fabric and/or Azure Data Factory Build and maintain scalable data models to support reporting and analytics Contribute ...

engineering, with at least 1 year in a people management or technical leadership role* Strong experience writing enterprise-grade Python applications (APIs, data pipelines, ETL/ELT frameworks, automation)* Deep hands-on experience with Microsoft Azure cloud services (Azure Databricks, Azure Data Factory, Azure Functions, Azure Storage, Azure SQL)* Proven ...

guide junior engineers where appropriate Key Requirements As a Data Engineer , you should have: Strong programming experience in Java (preferred) or Python Experience building ETL/ELT or streaming data pipelines Hands-on experience with Kafka, Flink, or Spark (streaming experience preferred) Good understanding of stream-processing concepts (event time ...

data platforms (Azure SQL, AWS RDS, Snowflake, BigQuery). Write and optimise complex SQL, including stored procedures, functions, views and performance‐tuned queries. Develop ETL/ELT logic using SQL‐based approaches and frameworks. Contact Centre data expertise Work with ACD, IVR and routing datasets. Define and validate Contact Centre ...

Lakes, Data Factory, Azure Synapse, Azure SQL, and Power BI. Knowledge of Microsoft Fabric. Proficiency in SQL and Python. Understanding of data integration and ETL processes. Ability to work with large datasets and optimise data systems for performance and scalability. Experience working with JSON, CSV, XML, Open API, RESTful ...

and transformation Experience working with distributed data processing frameworks (e.g. Spark) Solid understanding of data modelling and data warehousing concepts Experience building and maintaining ETL/ELT pipelines in production environments Exposure to cloud platforms such as Azure, AWS, or GCP Familiarity with modern data architectures (e.g. lakehouse or layered ...

dataset management, governance) Solid understanding of data modelling principles, including star schema design Strong SQL skills with a focus on performance optimisation Experience with ETL/ELT processes and data transformation workflows Knowledge of data warehousing concepts and architectures Understanding of data governance , including quality, security, and compliance Excellent problem ...

infrastructure. Develop and manage robust data pipelines to ingest, clean and transform data for reporting and analytics. Support and enhance the data warehouse, including ETL processes and data modelling activities. Collaborate with analysts, engineers and business stakeholders to deliver high-quality, data-led solutions. Monitor data performance and identify opportunities ...

with a preference for streaming technologies Solid understanding of real-time data processing concepts such as event time, state handling, and backpressure Experience building ETL/ELT or streaming data pipelines Good understanding of distributed systems and microservices architecture Experience working with cloud platforms, ideally AWS (Azure or GCP also ...

3+ years Databricks experience (PySpark, Delta Lake, notebooks) 2+ years Python Experience Experience working with data warehouses and structured modelling concepts Strong understanding of ETL/ELT practices and data centric engineering Desirable Exposure to metadata driven or config driven engineering practices Basic PySpark optimisation or Delta Lake performance tuning ...

using React and modern JavaScript/TypeScript. Experience designing and building APIs and distributed systems. Solid understanding of data engineering concepts, including data modelling, ETL/ELT pipelines, and performance optimisation. Experience with CI/CD, containerised systems, and modern deployment workflows. Familiarity with working alongside data science teams and ...

teamwork skills. Experience with cloud data platforms such as Databricks or Snowflake on AWS. Strong skills in Python, PySpark, and SQL. Good understanding of ETL/ELT pipelines and data transformation. Experience with data modelling and database optimisation. Strong knowledge of DBT and SQL best practices. Experience using CI/ ...