1 to 25 of 759 Permanent Data Pipeline Jobs in England

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data … modelling, ETL (Extract, Transform, Load) processes, and big data technologies it becomes possible to develop robust and reliable data solutions. RESPONSIBILITIES Data Pipeline Development: Design, implement, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources using tools such as databricks More ❯

Job Description Job Title: Data Architect Location: London - 3 days travel to office SC Cleared: Required Job Type: Full-Time Experience: 10+ years Job Summary : We are seeking a highly experienced and visionary Data Architect to lead the design and implementation of the data architecture for our cutting-edge Azure Databricks platform focused on … economic data. This platform is crucial for our Monetary Analysis, Forecasting, and Modelling efforts. The Data Architect will be responsible for defining the overall data strategy, data models, data governance framework, and data integration patterns. This role requires a deep understanding of data warehousing principles, big data technologies, cloud computing (specifically Azure), and a strong grasp of data analysis concepts within the economic domain. Key Experience: Extensive Data Architecture Knowledge: They possess a deep understanding of data architecture principles, including data modeling, data warehousing, data integration, and data governance. Databricks Expertise More ❯

Job summary We are looking for an experienced Senior Data Engineer with … strong technical expertise and innovative mindset to drive our team forward. Main duties of the job Data Engineer will be involved in the entire data pipeline from data acquisition to data extraction, ensuring that the data is accurate, reliable, and accessible, and fit-for-purpose for business intelligence, analytics … and data science functions. Data Engineer will be collaborating with cross-functional teams to support the delivery of impactful analytics work for our clients. About us We are the official research support team for the NHS Benchmarking Network, working with over 300 healthcare organisations across the UK to identify opportunities for service development and quality improvement. More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it More ❯

Join to apply for the Data Solutions Architect -GCP role at EXL 2 days ago Be among the first 25 applicants Join to apply for the Data Solutions Architect -GCP role at EXL Get AI-powered advice on this job and more exclusive features. Senior Talent Acquisition Manager | Hiring for Data, AI, Tech & Digital … Transformation | Leadership Hiring | UK & Ireland | Driving Inclusive &... EXL (NASDAQ: EXLS) is a global data and artificial intelligence (AI) company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s … innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 59,000 employees spanning six continents. For more information, visit Role Title: Data Solutions Architect (GCP) Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary of the role: The Data Solutions Architect at EXL plays a strategic, client More ❯

Senior Analytics Engineer Location: London, Hybrid (minimum 2 days per week in office) Type: Full-Time, Permanent Reports to: Engineering Manager/Lead Data Engineer Salary: £55,000-£70,000 per annum Due to the nature of our work, candidates must be eligible for Security Clearance. Join Our Mission At QuantSpark, we're transforming how data … street brands, and premium consumer goods companies optimise inventory, enhance price competitiveness, and deliver personalised customer experiences. Asset Management: We build AI-powered investment decision support systems, alternative data integration platforms, and automated risk management solutions for prestigious asset management firms. Public Sector: We're trusted by multiple UK government departments and public sector organisations to deliver predictive … monitoring, and documentation standards that ensure our solutions are production-ready and maintainable. Mentor Rising Talent: Guide junior analytics engineers and data scientists, sharing your expertise in pipeline design, SQL optimisation, and Python development. You'll help build the next generation of analytics engineering talent at QuantSpark. Shape Client Solutions: Work directly with clients to understand their More ❯

serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering … providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. … Collaborate with data analysts data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. More ❯

consistency, and proactively collaborating with upstream and downstream teams to enable seamless data flow across the organization. In this role, you will not only troubleshoot and resolve pipeline issues but also contribute to enhancing data architecture, implementing best practices in data governance and security, and ensuring the scalability and performance of data … stakeholders This position requires client presence between 25%-50% of the time per month at the client's office, which is located in London. Key Responsibilities: Data Pipeline Development & Maintenance Build, maintain, and optimize scalable ETL/ELT pipelines using tools such as Dagster, or similar. Ensure high data availability, reliability, and consistency through rigorous … data validation and monitoring practices. Collaborate with cross-functional teams to align data pipeline requirements with business objectives and technical feasibility. Automate data workflows to improve operational efficiency and reduce manual intervention. Data Integrity & Monitoring Perform regular data consistency checks, identifying and resolvinganomalies or discrepancies. Implement robust monitoring frameworks More ❯

through the Medallion architecture in Databricks . Data Transformation : Create and manage data models and transformations using dbt , ensuring clear lineage, version control, and modularity. Pipeline Orchestration : Develop and manage workflow orchestration using Azure Data Factory , including setting up triggers, pipelines, and integration runtimes. System Maintenance : Monitor, maintain, and optimize existing data … including notebooks, cluster configuration, and Delta Lake. Proficiency in dbt for transformation logic and version-controlled data modeling. Deep knowledge of Azure Data Factory , including pipeline orchestration and integration with other Azure services. Experience with data integration (e.g. : APIs, JSON, XML, Web Services) essential Expertise in Python and SQL for data manipulation and pipeline development. Hands-on experience implementing and maintaining Medallion Architecture (Bronze/Silver/Gold). Familiarity with CI/CD, Git version control, and agile development methodologies. Strong understanding of data warehousing principles, data modeling, and performance optimization. Experience with cron jobs , job orchestration, and error monitoring tools. Good to More ❯

To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana. Job description: We are seeking a skilled and motivated Data Engineer to join a growing global team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure … cloud platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and … scalability. If you have a passion for data engineering and a desire to make a significant impact, we encourage you to apply! Job Responsibilities ETL/ELT Pipeline Development: Design, develop, and optimize efficient and scalable ETL/ELT pipelines using Python, PySpark, and Apache Airflow. Implement batch and real-time data processing solutions using More ❯

Techyard is supporting a growing Databricks-partnered consultancy in securing a Databricks Champion Solution Architect to lead the design and delivery of advanced data and AI solutions on the Databricks Lakehouse Platform. This strategic, high-impact role is ideal for a seasoned professional who can operate as both a hands-on architect and a trusted advisor—bridging business … vision with technical excellence. You’ll play a pivotal part in driving innovation, embedding best practices, and shaping the consultancy’s data engineering capabilities as they scale their team and client base. Key Responsibilities: Architect and implement end-to-end, scalable data and AI solutions using the Databricks Lakehouse (Delta Lake, Unity Catalog, MLflow). Design … and lead the development of modular, high-performance data pipelines using Apache Spark and PySpark. Champion the adoption of Lakehouse architecture (bronze/silver/gold layers) to ensure scalable, governed data platforms. Collaborate with stakeholders, analysts, and data scientists to translate business needs into clean, production-ready datasets. Promote CI/CD, DevOps More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise … our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect More ❯

Position: Data Engineer Overview of the Role An established organisation is currently undergoing a data transformation and is seeking a skilled Data Engineer to join its growing data team. This role plays a key part in building and deploying modern data solutions based on Azure Databricks, enabling faster and more … informed business decisions. You'll work hands-on with Azure Databricks, Azure Data Factory, Delta Lake, and Power BI to design scalable data pipelines, implement efficient data models, and ensure high-quality data delivery. This is a great opportunity to shape the future of data within the organisation while working … Git, Azure DevOps) for automated testing and deployment. Optimise Spark jobs, Delta Lake tables, and SQL queries for performance and cost-effectiveness. Troubleshoot and proactively resolve data pipeline issues. Partner with data architects, analysts, and business teams to deliver end-to-end data solutions. Stay current with emerging data technologies (e.g. More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Data Engineer will include: Understand the business/… Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Product Owner (Data & Analytics) Bristol Hybrid - 3 days pw onsite £60,000 to £70,000 We currently have an exciting opportunity for a Data Product Owner to join a leading and customer centric financial services company. In this role, you’ll drive the evolution and implementation of data products, ensuring high-quality, accessible, and … trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. What you'll bring... Experience as a Data Product More ❯

Peaple Talent has partnered with a global digital engineering consultancy who are recruiting for a Lead Data Engineer on a permanent basis based out of their Sunderland office. You will have a great understanding of technology consultancy services along with fantastic communication and stakeholder engagement skills as this role will be client facing. Skills and experience: Proven experience … as a Lead Data Engineer with a focus on Azure cloud services. Experience of managing small teams whilst also being hands-on. Strong database fundamentals including SQL/TSQL, performance and schema design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure … Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary documentation. Proficiency in working with APIs and integrating them into More ❯

Join to apply for the Data Architect (Trading) role at Keyrock Join to apply for the Data Architect (Trading) role at Keyrock About Keyrock Since our beginnings in 2017, we've grown to be a leading change-maker in the digital asset space, renowned for our partnerships and innovation. Data Architect About Keyrock Since … s progress with our research and governance initiatives. At Keyrock, we're not just envisioning the future of digital assets. We're actively building it. Position Overview The Data Architect is responsible for designing, implementing, and maintaining an organization's data architecture and strategy, ensuring that data is collected, stored, and processed efficiently and … securely to support business intelligence, data analytics, and machine learning operations (MLOps) practices. Key Responsibilities Designing Data Architecture: Plan and implement a robust, scalable data architecture that integrates data from various sources and supports diverse analytical needs, while optimizing costs and meeting business requirements. Implementing Data Engineering Pipelines: Design and More ❯

Role: Data Engineer Role type: Permanent Location: UK or Greece Preferred start date: ASAP LIFE AT SATALIA As an organization, we push the boundaries of data science, optimization, and artificial intelligence to solve the hardest problems in industry. Satalia is a community of individuals devoted to working on diverse and interesting projects that will challenge you … multi-year roadmap. Your contributions will directly shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. YOUR RESPONSIBILITIES Collaborate closely with data scientists, architects, and stakeholders to understand and implement business requirements. Support AI model development and deployment by providing data engineering expertise, ensuring data scientists have … access to the data they need in the required format. Implement and optimize data transformations and ETL/ELT processes using appropriate tools. Work with various databases and data warehousing solutions to store and retrieve data efficiently. Monitor, troubleshoot, and maintain data pipelines to ensure high data quality More ❯

Operations is seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. About You Strong experience as a Product Owner or Data Product Owner in Agile environments. Experience managing data products or platforms, ideally customer data platforms (CDPs), data warehouses (e.g. Snowflake, BigQuery), or data More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. About You Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be … the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places … processing tools. Stron g technical proficiency in data modelin g , SQL, NoSQL databases, and data warehousing . Hands-on experience with data pipeline development, ETL processes, and big data technolo g ies (e. g ., Hadoop, Spark, Kafka). Proficiency in cloud platforms such as AWS, Azure, or Goo g More ❯