151 to 175 of 317 Data Pipeline Jobs in England

Data Engineer Salary: £50,000 - £70,000 I am working with a leading organisation that is delivering innovative data solutions to support complex, high-impact projects. This role offers the opportunity to work on challenging and rewarding assignments where you will design and build scalable data … Python or similar programming languages. Awareness of APIs for data retrieval and integration. Experience in stakeholder management and requirements gathering. Understanding of pipeline scheduling and health checks. Some of the package/role details include: Salary up to £70,000 £5,000 annual professional development budget Wellness ...

Senior Data Engineer - Contract - Inside IR35 - London A leading global organisation is undertaking a major back-office transformation and has established a new Divisional Data Team to deliver an enterprise-wide data platform. They are now looking for two Senior Data Engineers … join on an initial 6-month contract , playing a key role in building a brand-new data warehouse from scratch. This is a high-impact role working directly with the AVP of Data Engineering, with the opportunity to shape architecture, pipelines, and delivery standards across ...

Work Location: UK Salford Hybrid: Hybrid,State: Manchester; City: Salford Zip: M50 2UE Job description: Key Responsibilities Design, develop, and maintain metadata-driven data pipelines using ADF and Databricks. Build and implement end-to-end metadata frameworks, ensuring scalability and reusability. Optimize data workflows leveraging SparkSQL … Pandas for large-scale data processing. Collaborate with cross-functional teams to integrate data solutions into enterprise architecture. Implement CI/CD pipelines for automated deployment and testing of data solutions. Ensure data quality, governance, and compliance with organizational standards. Provide technical ...

Unix/Linux , and modern job orchestration tools (Airflow preferred) . The ideal candidate will design, build, enhance, and support our enterprise master data solutions in a cloud-driven, distributed environment. Responsibilities Informatica MDM/Customer 360 Design, configure, and implement Informatica MDM/C360 modules , including Data Model, Match/Merge, Data Quality, Hierarchy Manager, and IDD. Develop and optimize SIF APIs, BDD , and Real Time integration services. Work with business stakeholders to gather requirements, design MDM solution architectures, and ensure high data quality across systems. Configure and manage C360 SaaS ...

Data Engineer Ms Dynamics 365, Azure Data Factory, SQL, SSIS We have an exciting new permanent opportunity for a dynamic Data Engineer to join a fantastic & growing team at the best timing possible as the business has just embarked on a data transformation journey. This role will give you the chance to showcase your expertise to help shape data integration methodologies, processes, and standards, driving adoption and best practices across the team. Youll be working closely with Data Architects, Developers and business stakeholders and will ...

Data Delivery and Integration Manager (Remote) - Full time permanent role - Remote/home-based - Salary up to £80,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. … This role will focus on overseeing data engineering and integration for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading the engineering and integration team - Managing 3rd party ...

Data Delivery and Integration Manager (Remote) - Full time permanent role - Remote/home-based - Salary up to £80,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. … This role will focus on overseeing data engineering and integration for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading the engineering and integration team - Managing 3rd party ...

Data Delivery and Integration Manager (Remote) - Full time permanent role - Remote/home-based - Salary up to £80,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. … This role will focus on overseeing data engineering and integration for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading the engineering and integration team - Managing 3rd party ...

Data & Development Manager - Overview: We are looking for a dynamic Data & Development Manager to lead our developers and data engineers in building and governing high-impact applications, data platforms and automation solutions. This is a hands-on role combining technical leadership with … Profile: Proven technical leader with experience managing and developing teams Strong data engineering specialist, hands on knowledge of ETL/ELT pipelines, data modelling, analytics platforms and solid grounding in software development and API-based services Cloud and DevOps expertise across Azure Technically curious and future ...

About the Client Our client is a long-established, service-focused business delivering intelligent, data-driven solutions that help organisations increase efficiency, reduce operational risk, and streamline complex logistical processes. With a strong reputation for reliability and innovation, they serve a diverse portfolio of national and regional clients … Monitor and optimise Snowflake performance and costs. Ensure version control and CI/CD best practices for dbt projects. Set up orchestration and monitor pipeline health. Troubleshoot and resolve issues to maintain smooth data operations. Collaborate with BI Analysts and Data Stewards to deliver trusted ...

believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise … Design, train, and optimise machine learning models focused on user personalisation, encompassing recommendation engines, ranking algorithms, user segmentation, and content analysis. Data Pipeline Engineering: Construct and maintain robust and scalable data pipelines for feature engineering and model training utilising both structured and unstructured large-scale ...

Role: Senior Data engineerLocation - Newcastle upon Tyne/Hybrid (2-3 days per week in office)Contract - 6 monthsDaily rate - £450 (outside IR35)Active SC clearance is a must have Key Responsibilities Design, build, and optimise data pipelines and solutions on the Azure platform.Implement best practices … data architecture, security, and performance.Collaborate with stakeholders to deliver robust and scalable data solutions.Troubleshoot and resolve complex data engineering challenges. Required Skills & Experience Proven experience as a Senior Data Engineer with strong Azure expertise.Strong hands-on experience with Databricks.Proficiency in Python ...

Robotics Software Design Engineer - C PostgreSQL Are you an experienced Software Engineer with a strong background in C++ development and data systems for robotics? Are you based in the Cambridge area, or keen to join one of the UK's leading hubs for robotics and technology innovation … acquire, report, and aggregate data in real time on constrained robotics hardware platforms Taking full ownership of the data pipeline from robot to cloud PostgreSQL databases Defining and implementing strategies for data ingestion and analysis including how, when, and where data ...

Robotics Software Design Engineer - C++/PostgreSQL Are you an experienced Software Engineer with a strong background in C++ development and data systems for robotics? Are you based in the Cambridge area, or keen to join one of the UK's leading hubs for robotics and technology innovation … acquire, report, and aggregate data in real time on constrained robotics hardware platforms Taking full ownership of the data pipeline from robot to cloud PostgreSQL databases Defining and implementing strategies for data ingestion and analysis including how, when, and where data ...

Data Engineer - Azure, ADF, Power BI, Data Pipelines, Fabric Up to £550 per day (Inside IR35 - Umbrella) London/Hybrid (Must be UK Based, 1-2 days per week onsite may be required) I am currently working with a leading consultancy who are looking … Data Engineer with strong Azure, ADF, Power BI, Data Pipelines and ideally Fabric experience, to work closely with a high profile end customer.Key Requirements: Proven experience as Data Engineer within a large Enterprise Scale organisation Demonstrable experience using Azure related tooling such as Azure ...

Data Engineer £700 - £750 per day inside IR35 6-month contract Hybrid working in London We're working with a global healthcare and AI research organisation at the forefront of applying data engineering and machine learning to accelerate scientific discovery. Their work supports large-scale, domain … specific datasets that power research into life-changing treatments. They're now looking for a GCP Data Engineer to join a multidisciplinary team responsible for building and operating robust, cloud-native data infrastructure that supports ML workloads, particularly PyTorch-based pipelines. The Role You'll focus ...

have exiting contract job opportunity for Data Engineer for leading airline client. Role Purpose The Data Engineer will design, build, and maintain robust data pipelines and architectures to enable AI-driven solutions for business, ensuring frameworks can scale across all OpCos. This role demands … Contract - 6 months Location - around Heathrow Hybrid - 2 to 3 days onsite Rate - Flexible day rate (inside IR35) Key Responsibilities Develop and optimize data pipelines for ingestion, transformation, and storage. Ensure data quality, integrity, and security across systems. Collaborate with Data Scientists and Analysts ...

Senior Data Engineer London (Hybrid) | Up to £80,000 + Equity + Bonus No Sponsorship given Stop building pipelines that just move data. Start building intelligence. Our client is a fintech company at the intersection of behavioural science and financial technology. They don't just crunch numbers—they … people make the decisions they do, and they're using AI to make those insights scale. They're looking for a Senior Data Engineer who gets excited about turning messy, multi-source data into elegant, AI-ready architectures. This person will be the architect behind ...

Role As a Data Engineer, you'll be responsible for designing, building, and maintaining robust data pipelines and architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This … includes working with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. Key Responsibilities Develop and maintain data ingestion pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple ...

Data Analyst - Tech | £45,000-£50,000 | London - Hybrid Working I'm supporting a high-growth, technology-driven consumer platform that operates across major UK and European cities. As they continue to expand, they're looking for a Data Analyst who can play a key role … shaping data quality, insights, and decision-making across the business.This is an excellent opportunity for someone who enjoys autonomy, wants to influence strategy, and thrives in a data-mature but fast-moving environment. The Opportunity As the Data Analyst ...

Data Engineer | Hybrid Role | £50k-£60k | London Route delivers world-class audience measurement for out-of-home advertising across Great Britain. We're building new data models and collection methods to better understand how people move and which OOH ads they see. You'll build … data pipelines and infrastructure that makes this happen. Note: Applicants must be eligible to work in the UK, as visa sponsorship is not available. Why this role? From day one, you'll have the freedom to innovate and make decisions that directly affect the business. This ...

Data Engineer (SC) Croydon - 2-4 days per month on site £500/day outside IR-35 Contract until the end of the financial year We are seeking an experienced AWS Data Engineer to support a major government programme delivering secure, scalable data solutions. … Responsibilities Design and implement data pipelines on AWS using services such as Glue, Lambda, S3, and Redshift. Develop ETL processes and optimise data workflows for performance and security. Collaborate with analysts and architects to ensure compliance with government security standards. Troubleshoot and resolve issues in complex ...

statistical and machine learning models using Azure ML. Optimize model performance and computational efficiency. Ensure that applications run smoothly and handle large-scare data efficiently. Implement and maintain monitoring of model drifts, data-quality alerts, scheduled r-training pipelines. Data Management and Preprocessing: Collect … clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development: Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control, testing and code review. Work ...

statistical and machine learning models using Azure ML. Optimize model performance and computational efficiency. Ensure that applications run smoothly and handle large-scare data efficiently. Implement and maintain monitoring of model drifts, data-quality alerts, scheduled r-training pipelines. Data Management and Preprocessing: Collect … clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development: Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control, testing and code review. Work ...

programming languages (e.g., Java, Python, JavaScript). Certifications in Dynatrace, AWS, Azure, or GCP. Familiarity with OpenTelemetry, FluentBit, Cribl, or similar data pipeline tools.Ability to translate technical capabilities into business value, aligning observability solutions with customer KPIs and strategic goals Excellent communication and presentation skills. Ability ...