51 to 75 of 1,538 ETL Jobs in the UK

Engineer high-performance data ingestion pipelines for batch and streaming data from multiple sources, including sensor, geospatial, communications and operational systems. Design and implement ETL/ELT workflows to transform, enrich and validate data for downstream analytics and machine learning use. Build scalable, distributed data processing solutions using modern ...

datameshand domain-oriented patterns Data processing:Apache Spark,SQLand distributed processing technologies Data storage:Delta Lake, ApacheIcebergand open table formats Data pipelines:Enterprise-scale ETL/ELT,batchand streaming patterns Transformation and quality:dbt, Great Expectations and equivalent tooling Orchestration:Apache Airflow and cloud-native orchestration services Event streaming:Kafka ...

data analysis, transformation, validation and reconciliation. Hands-on experience with : Azure Data Factory (ADF) Python Azure SQL DBs Azure Data Lake and Lakehouse architectures ETL and ELT pipeline development Azure DevOps, Git and CI/CD practices Microsoft Fabric (Good to have) Strong understanding of : Data modelling Metadata management Data ...

Factory, and other data pipeline tools Experience with cloud platforms such as Azure, AWS, or GCP Solid understanding of data modeling, data warehousing, and ETL/ELT processes Familiarity with AI and machine learning concepts, with hands\u2011on experience in implementing AI-driven solutions Excellent problem-solving skills and ...

proactive awareness of industry standards, regulations, and developments. Ideally, you’ll also have: Experience of Relational Databases and Data Warehousing concepts. Experience of Enterprise ETL tools such as Informatica, Talend, Datastage or Alteryx. Project experience using the any of the following technologies: Hadoop, Spark, Scala, Oracle, Pega, Salesforce. Cross and ...

Expertise with one or more of the following technologies: AWS (Redshift, Glue, S3, Bedrock) Microsoft Azure (Synapse, Data Factory, Azure SQL) Databricks (Delta Lake, ETL pipelines, ML workloads) Snowflake Strong data modelling experience across enterprise-scale environments. Experience building modern AI-enabled data architectures. Knowledge of Retrieval-Augmented Generation ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

stream processing concepts (e.g., event time, state, backpressure). Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms, ideally AWS, but Azure/GCP also ...

data warehousing, data lakes, and lakehouse architectures. Hands-on experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise ...

across BigQuery or equivalent cloud data warehouses; familiarity with Scala or Java is a plus. Deep expertise in data pipeline design: batch vs. streaming, ETL/ELT, schema design, partitioning, and efficient storage patterns. Hands-on experience with dbt Core (or dbt Cloud) and Airflow for orchestration and transformation ...

and Data Science to review and refine designs and translate them into robust implementations. Build and operate data pipelines: design, develop, test, and deploy ETL pipelines to source, cleanse, and optimise data at scale. Automate and orchestrate data workflows: Develop and maintain orchestration solutions (e.g. Apache Airflow), implementing testing, alerting ...

technical requirements, success criteria and delivery plans. Elicit and translate business and technical requirements into data, integration and solution specifications. Design and implement scalable ETL pipelines and data models; own data quality, lineage and documentation. Build and operationalise predictive analytics and automated processes; ensure monitoring and maintainability. Develop high impact … and ability to map analytics to measurable business outcomes. Understanding of Python and SQL is not required but would be beneficial Solid knowledge of ETL, ETL design patterns, data warehousing and data governance. Problem solving mindset. Familiarity with Microsoft Azure and AI/ML platforms. Current security clearance, or ability ...

language and simple analysis techniques to profile data. Technical experience and knowledge in On‐Premise and Public Cloud Data Services focused on database architecture, ETL, data mining, business intelligence, big data, data governance, data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks ...

and best practices across enterprise data platforms. Responsibilities Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse. Develop ETL/ELT solutions using PySpark and SQL. Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric. Design scalable lakehouse and data ...

Data Governance, Data Quality, Metadata Management, and Data Lineage.* Experience designing and implementing Data Warehouses, Data Lakes, and Modern Data Platforms.* Strong understanding of ETL/ELT Architecture and Data Integration Frameworks.* Experience with Cloud Data Platforms such as Azure, AWS, or GCP.* Strong SQL and data analysis skills.* Knowledge ...

shaping the data foundation used for critical decision-making, innovative products, and future-focused services.* Own the design, development, and enhancement of scalable ETL/ELT data pipelines.* Develop data products and data platform components aligned with modern architectural principles.* Structure, integrate, and ensure data quality with a focus ...

analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud-based data platforms. The Data Architect will be a key partner in driving data-driven decisions and future-proofing Jazwares ...

power a suite of AI-enabled products and analytics solutions. Specifically, you can expect to be involved in the following: Design and develop scalable ETL and ELT pipelines across operational, analytical, and AI data environments. Build robust SQL and Python-based data solutions for production use. Develop and enhance data ...

cloud architectures, e.g. a cloud data warehouse, data lake or data platform to enable digital transformation Working with clients on data warehousing, building operational ETL/ELT data pipelines across a number of sources, and constructing relational and dimensional data models Performing maturity assessments across clients’ data capabilities and recommending ...

including performance and development plans Lead recruitment and be the engineering voice in cross-functional planning Data Engineering & Architecture Design and build high-performance ETL/ELT pipelines across operational, analytical, and AI data layers Lead schema design, model validation, scalable partitioning, and metadata-driven SQL frameworks Hands-on ownership ...

with large datasets in a data engineering or similar role. Good understanding of data warehousing concepts, data modelling (Star/Snowflake/3NF), and ETL/ELT pipelines. Experience tuning SQL/PLSQL queries and improving performance of reports and data extracts. Hands‐on experience with at least one cloud ...

and their integration within enterprise analytics platforms. Strong proficiency in Azure Data Factory, Synapse, and cloud data services. Expert‐level skills in data modelling, ETL processes, and semantic layer design. Advanced programming capabilities in SQL (T‐SQL/Spark SQL), Python, and PySpark. Hands‐on experience with Power BI (Desktop ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

business stakeholders to make data-driven decisions that shape the future of our company. Key Responsibilities Design, build, and maintain robust, scalable, and reliable ETL/ELT data pipelines . Develop data models and schemas in our data warehouse to support business analytics and reporting needs. Integrate data from ...