76 to 100 of 978 Data Pipeline Jobs in England

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great customer experience. More ❯

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great customer experience. More ❯

out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … flow across the organisation. Build efficient, fault-tolerant, and highly available data ingestion processes. Monitor and improve data pipeline performance and scalability for low-latency and high-throughput. Work closely with cross-functional teams, including software engineers, data scientists, and business … or a similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team. Comfortable in a fast-paced environment. Have excellent More ❯

We are hiring 2x Data Engineers (Bioinformatics) to join our Data Engineering Team! As a Data Engineer (Bioinformatics) at Our Future Health, you will have a solid understanding and experience of bioinformatics in particular, tools and methods associated with genomic data. You can design … products. You're a strong communicator where you're comfortable working with a multidisciplinary team of Scientists, Software Engineers, Product Managers and other Data Engineers. What You'll Be Doing: Support the build of data pipelines from data providers to our primary data … engineering across industry, research and Government and facilitating the adoption of standards. Providing technical input into the upstream parts of the data pipeline, including the specification and transfer of data from data providers. Routine ad-hoc data curation activities requiring hands More ❯

About the Machine Learning Engineer for CDAO Europe CDAO Europe is looking for a machine learning engineer to build efficient, data-driven AI systems that advance our predictive automation capabilities. The candidate should be highly skilled in statistics and programming, with the ability to confidently assess, analyze, and … reviewing use cases from around the business, and play a key role in Vanguard's model governance processes. Core Responsibilities Leverages data pipeline designs and supports the development of data pipelines to support model development. Proficient with software tools that develop data pipelines … a distributed computing environment (PySpark, GlueETL). Supports integration of model pipelines in a production environment. Develops understanding of SDLC for model production. Reviews pipeline designs, makes data model design changes as needed. Documents and reviews design changes with data science teams. Supports data More ❯

Job Title: Data Architect Location: Birmingham/Sheffield/Edinburgh (3 days per week in the office) Salary/Rate: Up to £431 per day INSIDE IR35 Start Date: 06/05/2025 Job Type: Contract Company Introduction We have an exciting opportunity now available with one … of our sector-leading financial services clients! They are currently looking for a skilled Data Architect to join their team for a contract until the end of November. Job Responsibilities/Objectives You will be a technical lead aligned to our Storage & Data Protection Services infrastructure … wide variety of data sources using API's, SQL and 'big data' technologies. Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating More ❯

Data Engineering Lead (Snowflake & AWS Environment) Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote Salary: Negotiable to 70,000 DOE plus 40 % bonus potential Job Ref: J12869 Please note we can only accept applications from those with current UK working rights for this … role, this client cannot offer visa sponsorship. An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation's data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation. This is an exciting to time to join the organisation as they are in the early stages of a major programme of work More ❯

Data Engineering Lead (Snowflake & AWS Environment) Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote Salary: Negotiable to £70,000 DOE plus 40 % bonus potential Job Ref: J12869 Please note we can only accept applications from those with current UK working rights for this … role, this client cannot offer visa sponsorship. An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation's data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation. This is an exciting to time to join the organisation as they are in the early stages of a major programme of work More ❯

out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … time querying and analytics use cases. Build efficient, fault-tolerant, and highly available data ingestion processes. Monitor and improve data pipeline performance and scalability for low-latency and high-throughput. Ensure data integrity, quality, and security across the entire pipeline. Implement monitoring, logging … or a similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent More ❯

Overview Are you ready to lead the charge in the world of data innovation? Adastra is seeking an AWS Technical Lead with a solid background in Data and Analytics to join our team. In this role, you will be at the forefront of building high-impact … scalable cloud solutions for our clients. Your expertise will be instrumental in driving successful data analytics and AI projects. As the AWS Technical Lead, you will be responsible for building and maintaining our data pipelines and ensuring the efficient and reliable extraction, transformation, and loading (ETL … Full-Time, Permanent Responsibilities: Design, develop, and maintain scalable ETL pipelines using AWS services such as Glue, Lambda, S3, and Redshift Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data availability and integrity Implement and optimize data More ❯

Principal Data Engineer - Core Systems Team Hybrid in London/Remote within UK The company Fast, flexible finance empowers small businesses to manage their cash flow better and seize opportunities - making their business and the economy stronger as a whole. At iwoca, we do just that. We help … We'll get there by continuing to make our finance ever more relevant and accessible to more businesses by combining cutting-edge technology, data science, and a 5-star customer service. The team You'll join the Core Systems team, who are responsible for driving innovation across the … business by optimising development, building data systems, and continuously improving iwoca products. We follow Agile-inspired processes, using continuous integration and delivery, so that features go live in days or weeks, not months or years. The role As the Principal Data Engineer, you'll be responsible More ❯

Data Engineer Junior to Mid-Level London - 4 Days on-site £40,000 - £65,000 DOE + Equity + Unlimited Annual Leave This is an excellent opportunity for a Junior Data Engineer to join a rapidly growing start-up offering great progression and the chance to … short-term staffing needs, this innovative solution optimises workforce efficiency. In this varied role you will be responsible for building and maintaining scalable data pipelines for data integration into customer-facing mobile and web apps, as well as internal dashboards. Responsibilities include designing and implementing data architecture to optimise data storage, retrieval, and processing, alongside developing ETL processes to ingest, transform, and load data from various sources, particularly APIs. The ideal candidate will possess strong foundations in data architecture with a degree in a relative subject or industry More ❯

this is done on a rota basis. Job Purpose The BI Lead will be responsible for shaping and maintaining the Enterprise BI and Data warehouse estate. You'll be working with both on-prem and cloud technologies, predominantly focussed on the Microsoft stack (SQL/Azure SQL databases … Data Factory, Synapse, Power BI, Power Platform) You will play a critical role in designing, developing, implementing and maintaining robust data solutions on the Azure and Power BI platforms. You will collaborate closely with cross-functional teams to gather requirements, understand business objectives, and translate them … into scalable and efficient data pipelines and reporting suites. Your expertise will be instrumental in establishing best practices and guiding the development of our data infrastructure to support our long-term data strategy. In addition, the role will be pivotal to understanding the direction More ❯

Senior Data Scientist – AI/LLM … Trading Platform Overview We are looking for an experienced Senior Data Scientist to design and implement a high-performance data pipeline for an AI/LLM-powered trading platform. This role involves handling large-scale, unstructured financial data—such as articles, books, and … and structuring it for machine learning and trading strategies. What You’ll Do Develop Scalable Data Pipelines – Design and maintain an efficient pipeline to process unstructured data for AI/LLM models. Process Unstructured Text Data – Extract and prepare data from More ❯

Senior Data Scientist – AI/LLM … Trading Platform Overview We are looking for an experienced Senior Data Scientist to design and implement a high-performance data pipeline for an AI/LLM-powered trading platform. This role involves handling large-scale, unstructured financial data—such as articles, books, and … and structuring it for machine learning and trading strategies. What You’ll Do Develop Scalable Data Pipelines – Design and maintain an efficient pipeline to process unstructured data for AI/LLM models. Process Unstructured Text Data – Extract and prepare data from More ❯

AWS Data Engineer Salary: Negotiable to £80,000 Dependent on Experience London: Hybrid working 3 days per week in the office 2 days home-based Job Ref: J12931 A leader in consumer behaviour analytics, seeks a driven AWS Data Engineer to guide data infrastructure … architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you'll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs). You'll … skills for data transformation, cleaning, and loading. ·Strong coding experience with Python and Pandas. ·Experience with any flavour of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc. ·Build processes supporting data transformation, data structures, metadata, dependency and workload management. More ❯

AWS Data Engineer Salary: Negotiable to £80,000 Dependent on Experience London: Hybrid working 3 days per week in the office 2 days home-based Job Ref: J12931 A leader in consumer behaviour analytics, seeks a driven AWS Data Engineer to guide data infrastructure … architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you’ll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs). You’ll … skills for data transformation, cleaning, and loading. Strong coding experience with Python and Pandas. Experience with any flavour of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc. Build processes supporting data transformation, data structures, metadata, dependency and workload management. More ❯

Job Title: Senior Generative AI Data Engineer ? Location: London, United Kingdom ? Salary: Negotiable ? Recruitment Agency: 167 Solutions ? Job Description: 167 Solutions is seeking an experienced Senior Generative AI Data Engineer to join our client's innovative team in London. This pivotal role offers … the opportunity to lead the development and deployment of generative AI models, driving transformative solutions across various business domains. ? Key Responsibilities: Data Pipeline Architecture: Design, develop, and maintain robust, scalable data pipelines to support generative AI models, ensuring efficient data flow and processing. … or similar. ? Data Processing: Expertise in big data technologies such as Apache Spark, Hadoop, and experience with data pipeline tools like Apache Airflow. ? Cloud Platforms: Strong experience with cloud services, particularly AWS, Azure, or Google Cloud Platform, including services like S3, EC2, Lambda More ❯

Exciting Opportunity in Health Tech! Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Reporting To: Vice President of Software Development Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with … cutting-edge technology? If so, we have an exciting new role for you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalize clinical research applications. This is your chance to make a meaningful impact on healthcare while … working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionizing clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high-performance More ❯

Based (Hybrid working model, 2 days a week office based, 3 days remote) Competitive Salary plus performance related bonus The Role: As a Data Ops Engineer, you will be responsible for enhancing the efficiency and reliability of our data management processes, supporting our advanced analytics, machine … learning, and AI initiatives. You will harness your engineering skills to develop and automate data pipelines, ensuring data is seamlessly integrated, processed, and available across our analytics platforms. Your role will include automating data workflows, improving data quality, and ensuring efficient delivery … pipelines. You will work alongside teams across the organization to address their data needs, craft agile solutions, and continuously improve the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will help design, develop, and maintain secure and scalable data … supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data … with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing More ❯

Data & Analytics Engineer 6 - 12 Months Contract Newcastle £400 - £500 per day (outside IR35) Sellick Partnership is currently assisting an organisation in Newcastle with the recruitment of a Data & Analytics Engineer. This is a contract for 6 - 12 months, this role is hybrid with 3 days … onsite and 2 from home. Responsibilities of the Data & Analytics Engineer include: Deliver the Data and Analytics service platform and methods Design and develop appropriate secure data architecture such as data warehouses and data lakes for big data, data science, data models Sourcing, accessing, manipulating and engineering ETL data pipelines and processes with data Use programming skills such as SQL, Python and others to expose data from systems Collate, cleanse, synthesise, integrate and interpret data More ❯

digital business model and diversify into other digital media products across multiple Clarion portfolios. To support this growth, Clarion requires an outstanding Azure Data Engineer to join the Data and Analytics team. You will be responsible for designing, developing, and implementing data migration solutions. … Your expertise in Azure services, data integration, and Terraform will be essential as we build innovative solutions for our transformation programmes. Key Responsibilities Data Migration: Migrate data from existing Big Data platforms into Dynamics 365, Data Verse and other Azure … data environments. Migrating from hand-rolled Code-based ETL processes to modern Azure Cloud Computing solutions Data Aggregation: Aggregate from smaller data sources and SaaS platforms into our Microsoft data environments Azure Development: Utilize Azure Data Factory, Azure Functions, and More ❯

Senior Data Engineer Hybrid working (3 days per week onsite in London) 6 Month contract initially, good scope for extension Market rates (Umbrella-PAYE) One of our blue chip clients … are looking for a number Senior Data Engineer to join the team on a long term programme of work. Key Responsibilities: * ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, and load data from various sources, ensuring high data quality. * Monitor and troubleshoot production data pipelines, ensuring their performance and reliability. * Mentor junior engineers and lead technical discussions to drive best practices and innovation within the team. * Stay up to date with the latest trends and technologies in data engineering and recommend solutions More ❯

Date: March 31, 2025 (30+ days left to apply) Job requisition id R26624 At FactSet, we're working to be the best financial data provider. We need highly motivated, talented individuals empowered to find answers through creative technology to get there. As a Software Engineer in Data Solutions Engineering, you will be part of our Digital Transformation, a mission to automate our data acquisition, quality assurance, content creation, and analytics in a scalable cloud environment. With the guidance of financial experts, you will leverage these large data sets to improve the … mapping, and company valuation. There is huge potential for machine learning, analytics, and NLP. Your responsibilities: Build and scale an automatic data pipeline Ingest and analyze various data sources to drive innovation in content creation. Automate the acquisition, relevance scoring, and storage of incoming sources. More ❯