276 to 300 of 503 Data Engineer Jobs in the UK

title: AWS Data Engineer Location: Ipswich (Onsite- 5 days) Type of Employment- Permanent Job Overview: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives ...

Lead Data Engineer- £75,000 Does Not Offer Sponsorship Industry: Banking and Financial Services Location : Hybrid- Basingstoke (3 Days a Week) Key Responsibilities Lead the evolution of our data engineering practice, supporting modernisation, automation, and scalability. Design and optimise Databricks architecture, data models, and deployment standards. … build and re-platform core components to handle growing data volumes and business demand. Implement better controls around change management, lineage, and deployment (DevOps for data). Introduce new tooling around change deployment and governance in partnership with external consultants. Improve data quality through robust monitoring, testing ...

Morgan Hunt are working with a public sector organisation based in Brighton to recruit two Senior Azure Data Engineers on a contract basis. The role is focused around Azure, so someone with strong knowledge of Azure would be preferred. The role is on a contract basis, but there … extended beyond the initial end date.Key Responsibilities: Owning technical delivery within an agile squad by translating user stories into robust Azure-based data engineering solutions Building scalable, cost-efficient components of the organisations Data Platform Maintaining compliance with governance policies Supporting operational reliability through monitoring and alerting Staying ...

Your new company This is a pivotal opportunity to join the Data and Innovation division of a large complex organisation leading the delivery of SAM (Supervisory Analytics and Metrics)-a transformative programme enhancing supervisory decision-making through advanced data and analytics. You will architect and implement cloud-native … data solutions aligned with the organisation's enterprise cloud strategy and SAM's Target Operating Model. This is a high-impact role where you'll shape the future of supervisory technology in a collaborative, forward-thinking environment. Your new role Define and implement the data engineering strategy aligned ...

Description: Data Engineer. 1 year Contract. Remote £490 per day. Inside IR35 Our Central Government client is looking for an experienced Data Engineer to work on a brand new AI-focused Digital project in a GDS environment. Technical Responsibilities Build and maintain data pipelines in Azure … Databricks, Key Vault). Develop ingestion workflows for APIs, structured data, and CSV sources. Implement Infrastructure as Code (Bicep) for Dev/Test environments. Deliver Bronze and Silver layer transformations using Python and SQL. Create data validation and data quality reporting processes. Support integration across systems ...

Python Data Engineer Azure & PySpark - SC Cleared Contract £400-£458pd (Inside IR35) SC Clearance is Essential Summary Were looking for a Python Data Engineer skilled in PySpark, Delta Lake, Azure services, containerized development, and Behave-based testing click apply for full job details ...

Senior Data Engineer - (AI/ML Deployment Experience Required) Location: London (Hybrid: Monday-Wednesday in office) Salary: £65,000-£75,000 DoE Job Ref: J13026 An AI-first SaaS company on a mission to help organisations unlock the full potential of their first-party data is seeking … forward-thinking Senior Data Engineer with strong deployment experience to help manage and scale its intelligent platfo click apply for full job details ...

Senior Data Engineer (Python AWS SQL) Manchester/WFH to £110k Are you a data technologist who enjoys taking ownership? You could be progressing your career in a senior, hands-on Data Engineer role at a technology start-up that is producing a software suite ...

Role title: Snr Data Engineer Security Clearance required: SC Clearance IR35 Status: Inside IR35 Pay Rates: £500/d - £525/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala … Experience: Experience working on large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven expertise with Data bricks, including hands on implementation experience and certifications. Reasonable Adjustments: Respect and equality are core values to us. ...

Role title: Snr Data Engineer Security Clearance required: SC Clearance IR35 Status: Inside IR35 Pay Rates: £500/d - £525/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/Scala … Experience: Experience working on large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven expertise with Data bricks, including hands on implementation experience and certifications. Reasonable Adjustments: Respect and equality are core values to us. ...

supporting a large-scale data programme that requires an experienced Data Engineer to help transform complex, unstructured information into clean, reliable datasets suitable for analysis and reporting. The project involves working with sizeable JSON files and other mixed-format sources, standardising them, and preparing them for downstream … across several internal systems. You'll be responsible for shaping the structure, improving data quality, and ensuring outputs can be easily consumed by non-technical teams. What You'll Work On Converting varied and unstructured data (including JSON) into well-defined relational formats. Designing data models that ...

supporting a large-scale data programme that requires an experienced Data Engineer to help transform complex, unstructured information into clean, reliable datasets suitable for analysis and reporting. The project involves working with sizeable JSON files and other mixed-format sources, standardising them, and preparing them for downstream … across several internal systems. You'll be responsible for shaping the structure, improving data quality, and ensuring outputs can be easily consumed by non-technical teams. What You'll Work On Converting varied and unstructured data (including JSON) into well-defined relational formats. Designing data models that ...

supporting a large-scale data programme that requires an experienced Data Engineer to help transform complex, unstructured information into clean, reliable datasets suitable for analysis and reporting. The project involves working with sizeable JSON files and other mixed-format sources, standardising them, and preparing them for downstream … across several internal systems. You'll be responsible for shaping the structure, improving data quality, and ensuring outputs can be easily consumed by non-technical teams. What You'll Work On Converting varied and unstructured data (including JSON) into well-defined relational formats. Designing data models that ...

Data Engineer Location: 70 Redcliff Street, BS1 6AL Start Date: ASAP Contract Duration: 3+ months Working Hours: Mon Fri, 09 00, 37 Hours per week Pay Rate: £ 200.00 per day Job Ref: (phone number removed) Job Responsibilities Analyze and document existing data pipelines, including diagrams and data ...

Data Engineer Location: 70 Redcliff Street, BS1 6AL Start Date: ASAP Contract Duration: 3+ months Working Hours: Mon – Fri, 09:00 – 17:00, 37 Hours per week Pay Rate: £ 200.00 per day Job Ref: (phone number removed) Job Responsibilities Analyze and document existing data pipelines, including diagrams … data-flow mapping. Develop and automate ETL pipelines using Python. Work with Databricks notebooks, Delta Lake, and Databricks Genie bots. Design, optimize, and debug ETL pipelines. Use SQL for querying, validation, and optimization in the Lakehouse environment. Person Specifications Must Have Advanced skills in Python for ETL pipeline development. ...

SHORT Shape the future of energy forecasting with SEFE Energy! We’re looking for a talented Forecasting Data Engineer to join our Portfolio Management team in Manchester. In this role, you’ll design and deliver accurate energy demand forecasts and analyse business operations to identify opportunities to improve … stability, scalability, and performance. If you’re passionate about data, innovation, and making an impact in the energy market, we’d love to hear from you. What Will You Do Working in collaboration with key stakeholders in IT, risk, sales and finance you will Create energy demand forecasts ...

Greetings!AdroitPeopleiscurrentlyhiring Title: AWS Data Test Engineer Location: Ipswich UK Employment Type: Permanent Key word: AWS,ETL,TELECOM,Python,sql Client :Tech M Job Description Responsibilities: Perform end-to-end testing of data ingestion, parsing, aggregation, and schema validation processes in AWS. Conduct stress testing to evaluate … performance of the entire data pipeline built on AWS. Develop and execute test plans, test cases, and test scripts to ensure data quality and integrity. Collaborate with data engineers and developers to identify and resolve data quality issues. Monitor data quality metrics and implement improvements ...

hiring a senior Data Engineer to lead the development of intelligent, scalable data platforms for Industry 4.0 initiatives. This role will drive integration across OT/IT systems, enable real-time analytics, and ensure robust data governance and quality frameworks. The engineer will collaborate with … functional teams to support AI/ML, GenAI, and IIoT use cases in manufacturing and industrial environments. Key Responsibilities Architect and implement cloud-native data pipelines on AWS or Azure for ingesting, transforming, and storing industrial data. Integrate data coming from OT systems (SCADA, PLC, MES, Historian ...

Role: Senior Data engineerLocation - Newcastle upon Tyne/Hybrid (2-3 days per week in office)Contract - 6 monthsDaily rate - £450 (outside IR35)Active SC clearance is a must have Key Responsibilities Design, build, and optimise data pipelines and solutions on the Azure platform.Implement best practices for data architecture, security, and performance.Collaborate with stakeholders to deliver robust and scalable data solutions.Troubleshoot and resolve complex data engineering challenges. Required Skills & Experience Proven experience as a Senior Data Engineer with strong Azure expertise.Strong hands-on experience with Databricks.Proficiency in Python, SQL, and data modelling.Strong ...

Role As a Data Engineer, you'll be responsible for designing, building, and maintaining robust data pipelines and architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This includes working with … batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. Key Responsibilities Develop and maintain data ingestion pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple sources, ensuring consistency and quality Design ...

Looking for an SC Cleared Data Engineer to start immediately on a 3 month part time project with a consultancy! Details- Role until end of Febuary Fully Remote Outside IR35 Part time (3 days per week) Skills- Azure Data Engineer Python Databricks GIS experience Must have ...

Looking for an SC Cleared Data Engineer to start immediately on a 3 month part time project with a consultancy! Details- Role until end of Febuary Fully Remote Outside IR35 Part time (3 days per week) Skills- Azure Data Engineer Python Databricks GIS experience Must have ...

Role : Senior Data Engineer Day Rate : £550 - £580p/d (dependant on SFIA Level experience) - OUTSIDE IR35 Location : Central London (hybrid up to 2 days a week) Clearance required : ACTIVE SC clearance Duration : Initial work package end of FY, March 26 (scope for extension as a 2 year … project) Are you a Senior Data Engineer, with the ability to successfully bring the customer user on the journey, closely c click apply for full job details ...

URGENT* - Immediate Joiner needed Location: Bournemouth Work Mode: 5 Days Onsite Type: FTE/FTC Start Date: ASAP We are hiring for a client: Data Engineer – AIML (LLM, Agentic AI) & Python We are looking for an experienced AIML-focused Data Engineer with strong expertise in LLMs … Agentic AI, Python , and hands-on experience in delivering AIML solutions for software test automation . Key Skills Required AIML, Machine Learning & Data Science Large Language Models (GPT, Claude), Generative AI, RAG Agentic AI, CoPilot, MCPs AIML Algorithms (Regression, Classification, Decision Trees, KNN, K-Means) Python (NLTK, NumPy, Scikit ...

Data Engineer - 2 month assignment Outside IR35 - £500-£600 per day - Hybrid with client visits to Southampton We're looking for an experienced contractor to support a key data project for an initial 2-month engagement, with strong potential to extend. This role is outside IR35 … hybrid working, with onsite visits to our client's office in Southampton as required. You'll be working largely independently, taking ownership of marketing data pipeline and aactivities using DBT, Snowflake and AWS. Must have: Strong SQL experience Hands-on DBT experience, including DBT administration Strong Snowflake experience, including ...