Data Pipeline Jobs in England

301 to 325 of 1,010 Data Pipeline Jobs in England

Scala Data Engineer

Northampton, Northamptonshire, East Midlands, United Kingdom
Hybrid / WFH Options
Data Inc. (UK) Ltd
a Fixed-Term Contract (FTC) basis we are not considering day-rate contractors. Skill Set & Experience: We are specifically looking for a Scala Data Engineer … not an application developer. The candidate must have experience migrating from Hadoop to the Cloud using Scala . Strong experience in Data Pipeline creation is essential. Candidates should have Big Data experience . Please ensure they have worked in a similar Data Engineering … role before sharing their details with us. Keywords for Search: When reviewing CVs, please look for relevant technologies such as: Spark, Hadoop, Big Data, Scala, Spark-Scala, Data Engineer, ETL, AWS (S3, EMR, Glue ETL) . Interview Process: the client will conduct an interview round that More ❯
Employment Type: Temporary, Work From Home
Posted:

Senior Data Engineer

London, United Kingdom
慨正橡扯
product operating model, involving strategic programmes to deliver innovative technology and business solutions supporting our global growth. ASOS recognizes the transformative potential of data and technology in driving business success. The Digital Data Engineering team provides high-quality, scalable data solutions across the ASOS … Digital Domain, promoting best practices, modern technologies, and team education. As a Data Engineer, you will be hands-on with critical projects, enabling digital platforms to leverage data effectively while ensuring continuous improvement, adherence to best practices, and team development through pairing. You will have the … opportunity to solve problems and innovate across various ASOS Data engineering projects. What you'll be doing: Develop solutions using Microsoft Azure and Databricks: Prioritize simplicity and maintainability, ensure thorough testing, automate deployments, and implement appropriate monitoring. Optimize Data pipelines, frameworks, and systems: Facilitate easier development More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

London, United Kingdom
Hybrid / WFH Options
Intec Select
Data Engineer - Consultancy - Up to £600 per day (Inside IR35) - 6 Month Contract - Remote Overview: Join a leading consultancy, delivering innovative data-driven solutions for global clients. You'll play a key role in developing and supporting enterprise-grade data platforms and services, ensuring … high-quality data pipelines and enabling smarter business decision-making. Key Responsibilities: Design and develop homogenous data repositories for enterprise reporting and analytics. Ingest data from SQL databases, REST APIs, Kafka streams and other sources. Apply data cleansing rules to ensure high … data quality standards. Model data into a single source of truth using Kimball methodology (star schema, snowflake, etc.). Develop high-quality code following DevOps and software engineering best practices, including testing and CI/CD. Monitor and maintain business-critical pipelines, reacting to and resolving More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer (Databricks)

London, United Kingdom
Hybrid / WFH Options
DATAPAO
We are currently looking for a Senior Data Engineer to join us remotely in the UK. We plan to set up a hub in the UK in the following 12-18 months to enable our GTM strategy, and this would be our first hire in the region. You … will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles. "As a Data Engineer at DATAPAO, you will have the unique opportunity to push the boundaries of technology and lead the way in how … track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog); You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions); You're proficient in SQL and Python , using them to transform and optimize More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer - Leading Fashion Company - London

London, United Kingdom
Hybrid / WFH Options
Noir Consulting
Data Engineer - Leading Fashion Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We're recruiting on behalf of a leading fashion brand based in London that's recognised for combining creativity with cutting-edge technology. They're … on the lookout for a talented Data Engineer to join their growing data team. This is a fantastic opportunity to work with a household name and play a key role in shaping data-driven decisions across the business. The Role As a Data Engineer, you'll be responsible for building and maintaining scalable, efficient, and reliable data pipelines. You'll work across a modern tech stack with a strong focus on Google Cloud Platform (GCP) and collaborate with various teams to ensure data flows securely and accurately More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Business Intelligence Engineer, ShipTech

London, United Kingdom
Amazon
experience by taking appropriate course corrections based on the recommendations made by our systems. The BIE plays a crucial role, building and analyzing data systems, spotting important business patterns, creating metrics that measure success, and developing ways to validate findings. The BIE will work closely with the Transportation … for the business. Key job responsibilities Manage and execute entire projects or components of large projects from start to finish, including project management, data gathering and manipulation, synthesis and modeling, problem-solving, and communication of insights and recommendations. Contribute to the design, implementation, and delivery of complex BI … Python, Java, or R). PREFERRED QUALIFICATIONS Master's degree or advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis and correlation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

LeadSoftwareEngineer-SPARK,Java,Python,AWS

London, United Kingdom
Hispanic Alliance for Career Enhancement
adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Data Pipeline Technology Engineering team, you will have the opportunity to significantly influence your career trajectory and embark on a journey where you can redefine the … boundaries of possibility. You will be instrumental in the development of our data pipeline applications on AWS, working closely with business and product teams to create robust data transformation (ETL) functionalities that cater to intricate business requirements. Your proficiency will steer our shift to the … make custom configuration changes in one to two tools to generate a product at the business or customer request. Update logical or physical data models based on new use cases. Produce architecture and design artifacts for complex applications while ensuring design constraints are met by software code development. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Solutions Architect - London Markets

London
Proactive Appointments
Data Solutions Architect Hybrid - Inside IR35 We're looking for a seasoned Data Solutions Architect with deep expertise in the Lloyd's of London Market and a strong background in Snowflake and ETL/data transformation tools. As a Data Architect, you … ll lead the design, development, and deployment of enterprise-grade data architecture using Snowflake and a modern suite of data tools. You'll work at the intersection of IT and business, collaborating closely with stakeholders to create solutions that unlock the full value of data-driving decision-making and business growth across the organisation. Key Responsibilities Architecture Design: Design and maintain enterprise data architecture models, data flows, and integrations using Snowflake. Data Governance: Manage data collection, storage, transformation, and protection across systems. Database Development: Create More ❯
Employment Type: Contract
Rate: £550 - £620
Posted:

Principal Data Engineer

London, United Kingdom
Hybrid / WFH Options
Burns Sheehan
Principal Data Engineer £120,000-£140,000 ️ Snowflake, SQL, dbt London, hybrid working Finance empowering small business We have joined forces with a leading UK fintech who help small businesses get the funds they need, when they need it. They are looking for a Principal Data Engineer who will be responsible for the data platform. In this role you'll define data strategy, drive the evolution of data infrastructure, and ensure data systems enable impactful decision-making across the business. What you'll be doing You … Snowflake platform to ensure it is a highly efficient and accessible resource for the business. You will lead the development and optimisation of data pipelines using dbt, enabling faster and more reliable data flows. You will collaborate with analysts and data scientists to design More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Business Intelligence Engineer

Woodstock, Oxfordshire, South East, United Kingdom
Ridge & Partners LLP
expanding workload in support of the broader growth of the business. Linked to the steady growth of the business, we are evolving our data architecture to offer a modern data service with new data sources coming online and redeveloping our data warehouse … our projected growth. The current team is small so the role will have exposure to colleagues across Ridge, including external clients, representing the Data and Analytics team. Therefore, the role has a broad scope of responsibility, requiring the individual to own projects themselves and delivering end-to-end … solutions, with support and discussion shared across the team. Responsibilities: Integrating new data sources into the data warehouse, and building in best-practice warehouse design Staging & shaping data from multiple data sources into reporting and analytical schemas Experience with data More ❯
Employment Type: Permanent
Posted:

AWS Data Engineer (Must hold current SC)

London, United Kingdom
amber labs
AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all … times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You … will work closely with data scientists, analysts, and software engineers to implement efficient data solutions that support business intelligence and analytics needs. Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and Kinesis. Work with More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Principal Data Engineer - REMOTE WORKING

Hampshire, South East, United Kingdom
Hybrid / WFH Options
Proactive Appointments Limited
Principal Data Engineer - REMOTE WORKING We are working with one of our biggest customers who are a leading force in the financial services sector. The company are based in Hampshire and the role is remote with occasional trips to the office when required. As a Principal Data Engineer this involves designing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. As a Principal Data Engineer, you will also mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall … data infrastructure and strategy alignment with business goals. Main Responsibilities include: Develop, design, and test data deliveries throughout the development lifecycle. Train and coach developers. Manage day-to-day data delivery tasks. Collaborate with stakeholders to align data solutions with organizational objectives. More ❯
Employment Type: Permanent, Work From Home
Salary: £85,000
Posted:

Principal Data Engineer - REMOTE WORKING

Hampshire, Christchurch, Dorset, South West
Hybrid / WFH Options
Proactive Appointments
Principal Data Engineer - REMOTE WORKING We are working with one of our biggest customers who are a leading force in the financial services sector. The company are based in Hampshire and the role is remote with occasional trips to the office when required. As a Principal Data Engineer this involves designing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. As a Principal Data Engineer, you will also mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall … data infrastructure and strategy alignment with business goals. Main Responsibilities include: ' • Develop, design, and test data deliveries throughout the development lifecycle.' • Train and coach developers.' • Manage day-to-day data delivery tasks.' • Collaborate with stakeholders to align data solutions with organizational objectives. More ❯
Employment Type: Permanent
Salary: £80,000 - £85,000
Posted:

Lead Machine Learning Engineer

London, United Kingdom
NLP PEOPLE
for our IT & Digital department. This is a hybrid role based in London. As a Lead Machine Learning Engineer on the National Grid Data Science team, you will develop data pipelines, take data science prototype models to production, fix production bugs, monitor operations, and … Machine Learning projects end-to-end. Develop platform tooling (e.g., internal conda library, CLI tool for project setup, and provisioning infrastructure) for the Data Science team. Work with data scientists to understand their data needs and put together data pipelines to ingest … data. Work with data scientists to take data science model prototypes to production. Mentor and train junior team members. Work with internal IT teams (security, Cloud, Global Active Directory, Architecture, Networking, etc.) to advance the team's projects. Enhance code deployment lifecycle. Improve model monitoring frameworks. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Machine Learning Engineer

Warwick, Warwickshire, United Kingdom
NLP PEOPLE
offers flexible working options and will require occasional visits to Warwick or London. As a Lead Machine Learning Engineer on the National Grid Data Science team, you will develop data pipelines, take data science prototype models to production, fix production bugs, monitor operations, and … Machine Learning projects end-to-end. Develop platform tooling (e.g., internal conda library, CLI tool for project setup, and provisioning infrastructure) for the Data Science team. Work with data scientists to understand their data needs and put together data pipelines to ingest … data. Work with data scientists to take data science model prototypes to production. Mentor and train junior team members. Work with internal IT teams (security, Cloud, Global Active Directory, Architecture, Networking, etc.) to advance the team's projects. Enhance code deployment lifecycle. Improve model monitoring frameworks. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead AI Solutions Engineer

Merton, London, United Kingdom
Kindred Group plc
highly skilled Lead AI Solutions Engineer to design, build, and optimize a Retrieval-Augmented Generation (RAG) system that underpins our self-serve analytics data applications. In this pivotal position, you will develop a scalable RAG platform, integrate multiple data sources, and create intuitive data … our Group's RAG Initiative, you will collaborate with a cross-functional team to implement self-service AI-driven solutions - ranging from NLP Data Analysis and Data Discovery to other analytics assistants we will be deploying to the business to streamline data access, insights … process automation. About A&I The Automation and Insights (A&I) department is at the forefront of transforming Kindred into a highly automated, data-driven powerhouse. In this dynamic environment, you'll work alongside experts in data, insights, and cutting-edge AI to build an AI More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Cloud Data Engineer

Bracknell, Berkshire, United Kingdom
Icloudxcel
company dedicated to providing innovative cloud solutions to businesses worldwide. Our mission is to empower organizations to harness the full potential of their data in the cloud, unlocking insights and driving transformation. With a commitment to cutting-edge technologies and a dynamic, inclusive work environment, we foster growth … creativity, and innovation. Overview: CloudXcel is seeking a talented and highly motivated Cloud Data Engineer with expertise in Python to join our team. In this role, you will work closely with cross-functional teams to design, develop, and optimize cloud-based data pipelines and infrastructure. The … ideal candidate is passionate about data engineering, proficient in Python, and eager to solve complex challenges in a fast-paced, collaborative environment. Key Responsibilities: Design, develop, and maintain scalable cloud-based data pipelines to collect, process, and analyze large datasets. Build and optimize ETL workflows to More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer Engineering Team Bristol Office

Bristol, Gloucestershire, United Kingdom
Hybrid / WFH Options
Duel
Data Engineer Hybrid: Remote/Bristol Salary: £70,000 - £75,000 About Us Duel is a SaaS company on a mission to make Brand Advocacy the industry standard playbook for building brilliant retail brands. It was founded by world record breaking adventurer and former brand ambassador Paul Archer … psychologists, brand experts, and community builders, combining cutting edge brand expertise with seasoned SaaS experience. The Role We are implementing a full-scale data warehouse using Snowflake and Kafka. To ensure long-term success, we're hiring a dedicated Data Engineer to own and maintain this … system. As our first dedicated Data Engineer, you will help shape how data is structured, accessed, and used at Duel. You'll work across multiple functions, ensuring that data is not only available but also meaningful and usable to engineers, product managers, and customer More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Analyst

Silverstone, England, United Kingdom
Aston Martin F1 Team
We have a new opportunity to be part of the IT team in the role of Data Analyst to work across departments excluded from the FIA Financial Regulations, primarily this will include non-F1 activities, Finance, HR, Commercial and Sustainability. As our Data Analyst, you will … of being a top three team in the FIA Constructor’s Championship. You will be responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI … Performing data mapping and modelling Developing and update technical documentation Implementing and owning a BI Centre of Excellence and driving best practices, engagement and Power BI training and education within the departments Advocating for, and ensuring adherence to data governance and security standards Handling and overseeing More ❯
Posted:

Data Analyst

Silverstone, Northamptonshire, UK
Aston Martin F1 Team
We have a new opportunity to be part of the IT team in the role of Data Analyst to work across departments excluded from the FIA Financial Regulations, primarily this will include non-F1 activities, Finance, HR, Commercial and Sustainability. As our Data Analyst, you will … of being a top three team in the FIA Constructor’s Championship. You will be responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI … Performing data mapping and modelling Developing and update technical documentation Implementing and owning a BI Centre of Excellence and driving best practices, engagement and Power BI training and education within the departments Advocating for, and ensuring adherence to data governance and security standards Handling and overseeing More ❯
Posted:

Data Analyst

silverstone, midlands, united kingdom
Aston Martin F1 Team
We have a new opportunity to be part of the IT team in the role of Data Analyst to work across departments excluded from the FIA Financial Regulations, primarily this will include non-F1 activities, Finance, HR, Commercial and Sustainability. As our Data Analyst, you will … of being a top three team in the FIA Constructor’s Championship. You will be responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI … Performing data mapping and modelling Developing and update technical documentation Implementing and owning a BI Centre of Excellence and driving best practices, engagement and Power BI training and education within the departments Advocating for, and ensuring adherence to data governance and security standards Handling and overseeing More ❯
Posted:

Analytics Manager

London, United Kingdom
Hybrid / WFH Options
Publicis Groupe UK
This role reports to the Analytics Director, Adobe.pub EMEA. The ideal candidate will possess strong analytical and communication skills and have experience analysing data to answer critical business questions. They will design and implement effective data visualizations and reports, while collaborating closely with cross-functional teams. … to create insightful solutions for business questions. Plan and execute analyses to guide campaign strategies, and produce comprehensive reports for presentations and publications. Data Transformation: Develop and maintain data pipelines for efficient data integration. Conduct data wrangling and cleaning to ensure quality … and usability. Collaborate with engineers to optimise data infrastructure, implementing checks to maintain data accuracy and integrity. Communication: Articulate complex data analysis results to diverse stakeholders and keep projects progressing by liaising directly with key stakeholders. Lead meetings and present findings clearly to facilitate More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer I, ITA - Workforce Intelligence, Core Data Acquisition

London, United Kingdom
Amazon
landscape and make a meaningful difference in people's lives. Together, we can solve the world's toughest hiring problems. Within ITA, the Data team delivers high-quality recruiting data, reusable tools, and analytics reporting to Amazon Talent Acquisition customers. The Data team is … decisions a million times over. Focused on building scalable long term solutions, the team empowers engineers and consumers to develop, access, and analyze data independently with a high degree of data privacy and integrity. As a member of the Data team, you will deliver … robust data solutions that drive fair and efficient hiring and rapidly evolve with the needs of the business. Key job responsibilities Develop and maintain end to end scalable data infrastructure and data pipelines. Work closely with business owners, developers, Business Intelligence Engineers to explore More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

Birmingham, England, United Kingdom
Apexon
Data Engineer Are you self-motivated with an innovative mind, a passion for technology, and a good understanding of Data Engineer? Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever … helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … commitment to continuous improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence. Role Overview: The Python Data Engineer will focus on designing and optimizing data pipelines, integrating data from diverse sources, and ensuring the smooth flow of More ❯
Posted:

Lead Data Engineer

England, Abbots Langley, Hertfordshire
Hybrid / WFH Options
Rise Technical Recruitment Ltd
Lead Data Engineer Remote UK £75,000 - £90,000 + Progression + Pension An excellent opportunity awaits an experienced Data Engineer/Architect looking for a hands-on lead role where you will take ownership of and lead the data solutions, with progression, autonomy … company is an established business focused on operational and management solutions, specialising in monitoring services. In this role, you will join the existing data team and lead the design, build, and delivery of the company's data solutions. You will take ownership of the data … working in the Azure Data stack, with Azure Data Factory and Azure Synapse, designing and implementing ETL/ELT pipelines, data modelling, and building scalable data architecture. The right candidate for this role will have a strong understanding of the operational and More ❯
Employment Type: Permanent
Salary: £75,000 - £90,000
Posted:
Data Pipeline
England
10th Percentile
£46,200
25th Percentile
£55,250
Median
£69,500
75th Percentile
£90,000
90th Percentile
£103,000