351 to 375 of 483 Data Engineer Jobs in the UK excluding London

supporting a large-scale data programme that requires an experienced Data Engineer to help transform complex, unstructured information into clean, reliable datasets suitable for analysis and reporting. The project involves working with sizeable JSON files and other mixed-format sources, standardising them, and preparing them for downstream … across several internal systems. You'll be responsible for shaping the structure, improving data quality, and ensuring outputs can be easily consumed by non-technical teams. What You'll Work On Converting varied and unstructured data (including JSON) into well-defined relational formats. Designing data models that ...

Data Engineer Location: 70 Redcliff Street, BS1 6AL Start Date: ASAP Contract Duration: 3+ months Working Hours: Mon – Fri, 09:00 – 17:00, 37 Hours per week Pay Rate: £ 200.00 per day Job Ref: (phone number removed) Job Responsibilities Analyze and document existing data pipelines, including diagrams … data-flow mapping. Develop and automate ETL pipelines using Python. Work with Databricks notebooks, Delta Lake, and Databricks Genie bots. Design, optimize, and debug ETL pipelines. Use SQL for querying, validation, and optimization in the Lakehouse environment. Person Specifications Must Have Advanced skills in Python for ETL pipeline development. ...

Role: Senior Data engineerLocation - Newcastle upon Tyne/Hybrid (2-3 days per week in office)Contract - 6 monthsDaily rate - £450 (outside IR35)Active SC clearance is a must have Key Responsibilities Design, build, and optimise data pipelines and solutions on the Azure platform.Implement best practices for data architecture, security, and performance.Collaborate with stakeholders to deliver robust and scalable data solutions.Troubleshoot and resolve complex data engineering challenges. Required Skills & Experience Proven experience as a Senior Data Engineer with strong Azure expertise.Strong hands-on experience with Databricks.Proficiency in Python, SQL, and data modelling.Strong ...

Role As a Data Engineer, you'll be responsible for designing, building, and maintaining robust data pipelines and architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This includes working with … batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. Key Responsibilities Develop and maintain data ingestion pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple sources, ensuring consistency and quality Design ...

DATA ENGINEER LOCATION: London (Remote) SALARY: £110,000 + Equity Shape the future of AI safety by building data pipelines that handle massive scale, your work will power innovation across research and production THE OPPORTUNITY The company is a fast-growing AI safety organisation focused on building … work ships quickly to production and directly influences the future of AI safety. ROLE AND RESPONSIBILITY This role focuses on designing and building scalable data pipelines and environments to handle petabytes of logs, events, and model outputs. You'll develop internal APIs and tools that enable engineering and research ...

Data Engineer - 2 month assignment Outside IR35 - £500-£600 per day - Hybrid with client visits to Southampton We're looking for an experienced contractor to support a key data project for an initial 2-month engagement, with strong potential to extend. This role is outside IR35 … hybrid working, with onsite visits to our client's office in Southampton as required. You'll be working largely independently, taking ownership of marketing data pipeline and aactivities using DBT, Snowflake and AWS. Must have: Strong SQL experience Hands-on DBT experience, including DBT administration Strong Snowflake experience, including ...

Title: Senior Data Analytics Engineer Salary: £90,000 - £95,000 (+ Equity & Benefits) Location: London (4 days on-site) Overview We are partnering with a venture-backed, high-growth technology company that is entering a critical scale-up phase and doubling the size of its data team. … Data is already core to how the business operates, powering day-to-day decision-making, product development, and long-term strategy and is now being significantly expanded to support the next stage of growth. The platform is live, complex, and scaling fast, with data sitting at the heart ...

About the RoleWe are seeking a Databricks Data Engineer with strong expertise in designing and optimising large-scale data engineering solutions within the Databricks Data Intelligence Platform. This role is ideal for someone passionate about building high-performance data pipelines and ensuring robust data governance across modern cloud environments.Key Responsibilities Design, build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning ...

Data Engineer £60,000 to £75,000 basic salary per annum plus an excellent benefits package including bonus, pension, 25 days holiday (can buy up to 10 additional days), two wellness days, two volunteering days, healthcare scheme, excellent career development plans (courses & certifications), hybrid working (12 days ...

Data Engineer £60,000 to £75,000 basic salary per annum plus an excellent benefits package including bonus, pension, 25 days holiday (can buy up to 10 additional days), two wellness days, two volunteering days, healthcare scheme, excellent career development plans (courses & certifications), hybrid working (12 days ...

West of England Combined Authority are seeking a highly skilled Data Engineer to support the optimisation, documentation, and enhancement of our existing data pipelines within the Databricks Lakehouse environment. This role will involve hands-on development, reverse-engineering of current solutions, and close collaboration with internal teams … debug Databricks notebooks, Delta Lake workflows, and Genie-bot automations Design, maintain, and enhance ETL pipelines , ensuring reliability and performance Validate, transform, and orchestrate data using Python and SQL within the Lakehouse environment Manage data ingestion and scheduling processes via Azure Data Factory Reverse-engineer, document ...

seeking an experienced Data Migration Engineer with a strong background working within a UK police force or policing environment to support a major records management system (RMS) migration programme . The role will focus on migrating data from legacy policing systems into NicheRMS (or a comparable police … platform). Role Overview You will play a critical role in the planning, execution, and delivery of complex data migrations, ensuring data accuracy, integrity, and compliance with policing and information governance standards. Working closely with technical architects, DBAs, system integrators, and policing stakeholders, you will help enable ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very strong Data ...

Join a dynamic team dedicated to leveraging data for impactful insights. We are seeking a Databricks Data Engineer to join a prominent team within a key client's Microsoft B.I. and Databricks division. This Hybrid role is based in Manchester and will afford you the chance … contribute to innovative projects that drive data-driven decision-making.Key Responsibilities and Skills Required:- Proficiency in Azure Databricks for data engineering tasks.- Strong understanding of data transformation and pipeline development.- Experience with data integration and ETL processes.- Ability to collaborate with cross-functional teams to enhance ...

Join a dynamic team dedicated to leveraging data for impactful insights. We are seeking a Databricks Data Engineer to join a prominent team within a key client's Microsoft B.I. and Databricks division. This Hybrid role is based in Manchester and will afford you the chance … contribute to innovative projects that drive data-driven decision-making. Key Responsibilities and Skills Required: - Proficiency in Azure Databricks for data engineering tasks. - Strong understanding of data transformation and pipeline development. - Experience with data integration and ETL processes. - Ability to collaborate with cross-functional teams ...

Data analytics Engineer l Analytics l Omni l Tableau l Looker l SQL l Data Modelling l Dashboarding l Github l |Terraform l Start up l Stakeholder management l £450 PD l Outside IR35 l 3 months l London - hybrid I'm currently on the lookout … Experience: Expert in dashboarding and knowledge around Business intelligence tools (Omni used internally, however, happy with experience in Tableau, Looker or PowerBI) Strong Data modelling and analytics experience Ability to write SQL Queries Worked previously with Github/Github actions Methodical thinker who can work autonomously Bonus points ...

Data Platform Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions … This is a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality ...

Technical are proud to be partnered with a leading UK data consultancy who are looking to grow their data engineering capabilities with a Senior Data Engineer on a permanent basis. You'll have the opportunity to work across a variety of client engagements, create real business … with a hybrid working arrangement. You will work across a diverse portfolio of client assignments, delivering technical solutions that address a wide spectrum of data-related challenges and enabling organisations to make informed, data-driven decisions. In this position, you'll design and implement advanced data systems ...

client, a leading financial services organisation undergoing significant growth, is seeking a Senior Data Engineer with strong Databricks expertise to drive high-value data initiatives within the reinsurance and investment domain. This role centres on building scalable data solutions, optimising analytical workflows, and partnering with senior … business experts to deliver insight-driven outcomes. Key Responsibilities Develop and optimise data pipelines on Databricks , leveraging Spark for large-scale processing. Design and implement data models, mapping, and transformation workflows across complex financial datasets. Use Python (Pandas, NumPy) and SQL to support advanced analytics and data ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities … reuse data flows where possible click apply for full job details ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities … reuse data flows where possible click apply for full job details ...

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a Security Clearance (Including BPSS) process as part of this role, which requires 5+ … with cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. Role Overview: As a Data & ML Engineer, you will design, build, and optimize scalable data pipelines and machine learning solutions. You’ll work with client teams ...

Data Platform Engineer - ADF, Terraform, Synapse, Spark £Market Rate (Inside IR35) London/Hybrid 6 months We are currently working with a client who urgently require a Data Platform Engineer with hands on expertise in Synapse Spark Architecture, ADF and Terraform (IaC), to assist in designing … delivering complex cloud solutions. Key Requirements: Proven, hands-on experience with Microsoft Azure as a Data Platform Engineer Advanced knowledge of Azure Data Factory (ADF), including network configurations and integration runtime options. Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts. ...

About the Role We are seeking a motivated Data Engineer to join our team supporting the a major digitization project. This role is ideal for a recent graduate with a strong academic background in GIS, Remote Sensing, Geomatics, or a related discipline who is eager to apply technical … skills in real-world geospatial data processing and digital mapping. Key Responsibilities Process and manage large-scale spatial datasets from local authorities and government sources. Work with tools such as ArcGIS, QGIS, FME, and Python to support data transformation and automation workflows. Perform data validation, quality assurance ...

Senior Data Engineer/Power BI Developer - sought by investment bank based in London - Contract - Hybrid *inside IR35 - umbrella* Essential: Proven experience in a Data Engineering or BI Developer Strong understanding of front-office trading , risk , or market data (not back-office finance or regulatory reporting … Python, Scala). Experience with BI tools such as Power BI, Tableau, or Qlik. Familiarity with cloud platforms (e.g., Azure, AWS, GCP) and modern data architectures. Desirable: Background in financial services, particularly within investment banking or asset management. Experience working with time-series data and real-time data ...