1 to 25 of 131 ETL Jobs in the North of England

Python for automation.Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation.Experience with SSIS for ETL processes and legacy data integration tasks.Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps.Experience with Infrastructure as Code (e.g. ...

Python for automation.Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation.Experience with SSIS for ETL processes and legacy data integration tasks.Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps.Experience with Infrastructure as Code (e.g. ...

Expertise with one or more of the following technologies: AWS (Redshift, Glue, S3, Bedrock) Microsoft Azure (Synapse, Data Factory, Azure SQL) Databricks (Delta Lake, ETL pipelines, ML workloads) Snowflake Strong data modelling experience across enterprise-scale environments. Experience building modern AI-enabled data architectures. Knowledge of Retrieval-Augmented Generation ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

RESTful APIs for generative AI applications.Familiarity with web development technologies, such as HTML, CSS, JavaScript, and React.Proficiency in database management systems and SQL.Experience developing ETL pipelines using distributed computing and parallel processing frameworks, such as Spark.Knowledge of Data Architecture & Data Modelling techniques.Experience working with modern data & AI platforms such ...

their AI/ML services.Data Engineering: Proficiency in data manipulation and analysis using SQL and big data technologies (e.g., Spark, Hadoop). Experience with ETL, data pipelines, and automated workflows for moving and processing data.Data Governance: Adherence to data governance, security, and privacy standards throughout the development lifecycle, including metadata ...

Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews Big Data Engineering Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow Optimise data storage, retrieval, and processing systems to ensure reliability, scalability, and performance Develop and fine-tune complex ...

and data productsWrite clean, maintainable, and efficient code, ensuring adherence to best practices through code reviewsBig Data EngineeringDesign, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache AirflowOptimise data storage, retrieval, and processing systems to ensure reliability, scalability, and performanceDevelop and fine-tune complex queries using ...

strong client partnerships. What will you do? Client Delivery & Technical Excellence Design, build, and implement scalable data engineering solutions on AWS, including data pipelines, ETL/ELT processes, and data integration frameworks. Develop andoptimizedata architectures using AWS services such as S3, Glue, Lambda, Redshift, Kinesis, EMR, Amazon OpenSearch Service, and ...

Engineer Key skills: Python SQL Server/SQL Data Warehousing & Data Modelling Data Architecture Data Pipelines & Integration Solutions Microsoft Fabric Azure Cloud Technologies PySpark ETL/ELT Development Data Governance & Security Source Control (Git) Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good communication skills ...

Engineer Key skills: * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * Microsoft Fabric * Azure Cloud Technologies * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good communication skills ...

technical BI solutions, and present actionable insights clearly. Data Management & Optimisation: Utilise strong SQL skills for data manipulation, querying, and validation while implementing robust ETL/ELT processes and troubleshooting performance bottlenecks across datasets. Champion Data Governance: Ensure high standards of data quality, data integrity, security, and BI platform best ...

stakeholders. Ability to work independently while collaborating effectively within a wider Data & Analytics team. Desirable knowledge: DAX and Power BI data modelling Advanced SQL ETL/ELT processes Data warehouse or DataMart environments Workflow or process automation Data-quality reporting Working with ERP, finance, payroll, HR or operational systems Requirements ...

every pipeline and dataset is discoverable, addressable, and secure by design.Data capabilities: You understand the full lifecycle of data from data discovery, storage, pipelines, ETL, streaming through to how data is managed including data quality, metadata management and how data is used for applications and core decision making through advanced ...

working with data and databases, ideally involving the development of new and existing data sources in a Data Warehouse environment.Working knowledge and experience with ETL and data integration, including exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis ...

area for us with a diverse and growing capability and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue ...

outcomes and value of their work, and have working experience in some of the following:End-to-end development experience with data pipelines, ETL processes, workflow orchestration - using core concepts that apply across tech stacks.Working with diverse data sources and types - batch, streaming, real-time, and unstructured.Systems thinking and architectural ...

analysts and stakeholders to deliver high-quality data assets YOUR SKILLS AND EXPERIENCE: Previous experience in a Data Engineering role Experience building and maintaining ETL/ELT pipelines Strong experience with Azure Data Factory (ADF) Understanding of data warehousing concepts and dimensional modelling Strong SQL skills and experience working ...

with Databricks and Delta Lakehouse architectures.Programming: Proficient in Python, Scala, and SQL for data engineering tasks.ETL Processes: Demonstrated expertise in designing, building, and maintaining ETL processes.Data Modelling: Experience in logical and physical data modelling with large datasets.Problem Solving: Strong analytical and problem-solving skills, with a focus on troubleshooting data ...

knowledge and collaborate with colleagues in an agile engineering setting. Essential Skills & Experience Strong experience in data engineering, including Python. Experience working with AWS ETL services. Experience querying and managing data held within AWS S3 Experience managing API integrations and database connectivity. Familiarity with GitLab or similar source control and ...

knowledge and collaborate with colleagues in an agile engineering setting. Essential Skills & Experience Strong experience in data engineering, including Python. Experience working with AWS ETL services. Experience querying and managing data held within AWS S3 Experience managing API integrations and database connectivity. Familiarity with GitLab or similar source control and ...

knowledge and collaborate with colleagues in an agile engineering setting. Essential Skills & Experience Strong experience in data engineering, including Python. Experience working with AWS ETL services. Experience querying and managing data held within AWS S3 Experience managing API integrations and database connectivity. Familiarity with GitLab or similar source control and ...

business teams to deliver reliable data solutions. Participating in code reviews and continuous improvement initiatives. What We're Looking For Experience in data engineering, ETL development or data platform delivery. Strong programming skills in Java or Python. Exposure to modern data technologies such as Kafka, Spark or Flink. Experience working ...