9 of 9 Permanent ETL Development Jobs in the UK

will own data architecture across our reporting, ANPR, finance and operational domains, working alongside our Solutions Architect, Head of Business Solutions and Head of Development as part of a small, high-impact architecture cluster. This is not a paper-architect role. The successful candidate will pick … flight, multi-year programme to decouple and replatform the ETL processes that sit behind every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model ...

Data Engineer Hybrid working The successful candidate will have strong experience in SQL Server Integration Services (SSIS) , data warehousing, and ETL development, with a proven ability to integrate data from multiple source systems into a unified enterprise data warehouse. You will work closely with Data Analysts, developers, subject … matter experts, and business stakeholders throughout the analysis, development, testing, and implementation lifecycle. Key Responsibilities Support analysis and design activities, including mapping source data to existing data models and contributing to the design of database schemas and SSIS packages. Redevelop and enhance ETL processes in line with technical ...

Learning solutions Experience working with Large Language Models (LLMs) Knowledge of Generative AI technologies RAG (Retrieval Augmented Generation) implementation experience NLP and Conversational AI development Model training, testing and evaluation Prompt Engineering and AI workflow optimisation Programming & Frameworks Strong Python development skills PyTorch TensorFlow Scikit-Learn LangChain LangGraph … Hugging Face FastAPI REST APIs Data Technologies SQL NoSQL Databases Data Modelling ETL Development Data Pipeline Engineering Vector Databases such as Pinecone, Weaviate or ChromaDB Cloud & DevOps Experience with at least one major cloud platform: AWS (preferred) Bedrock SageMaker Lambda ECS/EKS S3 Or experience within: Microsoft ...

Learning solutions Experience working with Large Language Models (LLMs) Knowledge of Generative AI technologies RAG (Retrieval Augmented Generation) implementation experience NLP and Conversational AI development Model training, testing and evaluation Prompt Engineering and AI workflow optimisation Programming & Frameworks Strong Python development skills PyTorch TensorFlow Scikit-Learn LangChain LangGraph … Hugging Face FastAPI REST APIs Data Technologies SQL NoSQL Databases Data Modelling ETL Development Data Pipeline Engineering Vector Databases such as Pinecone, Weaviate or ChromaDB Cloud & DevOps Experience with at least one major cloud platform: AWS (preferred) Bedrock SageMaker Lambda ECS/EKS S3 Or experience within: Microsoft ...

Microsoft Fabric | Azure | Lakehouse | Data Engineering Not all Data Engineering roles are created equal. Some involve maintaining legacy ETL processes and producing reports nobody reads. This isn't one of those roles… You will help shape and enhance a modern cloud-based data platform that's central … across the organisation. Your responsibilities will include: Building and maintaining data pipelines using Microsoft Fabric Designing and optimising Lakehouse and data storage solutions Developing ETL and data transformation processes Integrating data from multiple business-critical applications Creating scalable and efficient data models Improving data quality, governance and reliability Supporting ...

solutions within a modern AWS environment. Key Responsibilities Design and develop scalable data pipelines using AWS Glue, EMR, S3 and Athena. Build and optimise ETL/ELT workflows using PySpark, Python and SQL. Orchestrate data pipelines using Apache Airflow. Ensure data quality, performance, governance and security across cloud platforms. … business stakeholders to translate requirements into robust technical solutions. Required Skills Strong hands-on experience with PySpark and large-scale data processing. Advanced Python development skills for data engineering and automation. Extensive AWS experience including S3, Glue, Lambda, EMR and Bedrock/custom model hosting. Strong SQL and ETL ...

reporting Work collaboratively with: Developers/Data Engineers/Business Analysts Delivery teams. Informatica (Primary Requirement) Proven hands-on experience with Informatica Experience supporting: ETL development and validation Data integration testing Data transformation verification Platform configuration and testing activities Strong understanding of: Source-to-target mappings Data lineage … Data reconciliation techniques Data Project Experience Demonstrable experience working on data-focused programmes and projects Experience testing: Data pipelines/ETL processes/Data migration activities Data integration solutions Ability to: Validate complex data transformations Identify data quality issues Verify business and technical data requirements Strong understanding of: Data ...

EXPECT AS A DATA ENGINEER JOINING THE ACADEMY: 6-weektraining program internal and external on, but not limited to the following; Cloud concepts Databases ETL Flows monitoring Data visualisation QueueingSystems AI/ML Agentic AI Data monitoring MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS: Working as part … experience in someofthe following areas, with practical working knowledge across others a proven ability ofstrong teamskills, including taking direction from others, is crucial. Software development experience inat leastone ofthe following,Java, Scala, or Python. Software development experience with data-processing platforms, such as,Azure, GCP, Databricksand AWS. Experience ...

Spark. Experienced in working with the Hadoop ecosystem, including HDFS, Hive, and YARN, to process and analyze large datasets efficiently. Skilled in building robust ETL pipelines, real-time data processing, and optimizing distributed systems for performance and reliability. Proficient in SQL, data modeling, and integrating data from multiple sources … time. Your Role: Design and develop Hadoop based applications and data pipelines. Build operate monitor and troubleshoot Hadoop clusters. Write scalable ETL processes using tools like Hive Pig and Spark. Develop and maintain data ingestion processes using Sqoop Flume or Kafka. Optimize MapReduce jobs and manage HDFS storage. Collaborate ...