5 of 5 Permanent ETL Development Jobs in the UK excluding London

Data Engineer Hybrid working The successful candidate will have strong experience in SQL Server Integration Services (SSIS) , data warehousing, and ETL development, with a proven ability to integrate data from multiple source systems into a unified enterprise data warehouse. You will work closely with Data Analysts, developers, subject … matter experts, and business stakeholders throughout the analysis, development, testing, and implementation lifecycle. Key Responsibilities Support analysis and design activities, including mapping source data to existing data models and contributing to the design of database schemas and SSIS packages. Redevelop and enhance ETL processes in line with technical ...

Learning solutions Experience working with Large Language Models (LLMs) Knowledge of Generative AI technologies RAG (Retrieval Augmented Generation) implementation experience NLP and Conversational AI development Model training, testing and evaluation Prompt Engineering and AI workflow optimisation Programming & Frameworks Strong Python development skills PyTorch TensorFlow Scikit-Learn LangChain LangGraph … Hugging Face FastAPI REST APIs Data Technologies SQL NoSQL Databases Data Modelling ETL Development Data Pipeline Engineering Vector Databases such as Pinecone, Weaviate or ChromaDB Cloud & DevOps Experience with at least one major cloud platform: AWS (preferred) Bedrock SageMaker Lambda ECS/EKS S3 Or experience within: Microsoft ...

solutions within a modern AWS environment. Key Responsibilities Design and develop scalable data pipelines using AWS Glue, EMR, S3 and Athena. Build and optimise ETL/ELT workflows using PySpark, Python and SQL. Orchestrate data pipelines using Apache Airflow. Ensure data quality, performance, governance and security across cloud platforms. … business stakeholders to translate requirements into robust technical solutions. Required Skills Strong hands-on experience with PySpark and large-scale data processing. Advanced Python development skills for data engineering and automation. Extensive AWS experience including S3, Glue, Lambda, EMR and Bedrock/custom model hosting. Strong SQL and ETL ...

EXPECT AS A DATA ENGINEER JOINING THE ACADEMY: 6-weektraining program internal and external on, but not limited to the following; Cloud concepts Databases ETL Flows monitoring Data visualisation QueueingSystems AI/ML Agentic AI Data monitoring MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS: Working as part … experience in someofthe following areas, with practical working knowledge across others a proven ability ofstrong teamskills, including taking direction from others, is crucial. Software development experience inat leastone ofthe following,Java, Scala, or Python. Software development experience with data-processing platforms, such as,Azure, GCP, Databricksand AWS. Experience ...

Spark. Experienced in working with the Hadoop ecosystem, including HDFS, Hive, and YARN, to process and analyze large datasets efficiently. Skilled in building robust ETL pipelines, real-time data processing, and optimizing distributed systems for performance and reliability. Proficient in SQL, data modeling, and integrating data from multiple sources … time. Your Role: Design and develop Hadoop based applications and data pipelines. Build operate monitor and troubleshoot Hadoop clusters. Write scalable ETL processes using tools like Hive Pig and Spark. Develop and maintain data ingestion processes using Sqoop Flume or Kafka. Optimize MapReduce jobs and manage HDFS storage. Collaborate ...