576 to 600 of 799 Data Pipeline Jobs in England

Job Title: Data Engineer Location: London (Hybrid - 2 days in office) Type: Full-time Agency: Representing a leading digital media group We're representing a well-established digital media company with a growing portfolio of high-traffic content brands. As they expand their data capabilities, they're looking for a Data Engineer to join … their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources. Automate and optimise workflows using tools like Airflow, dbt, and Spark. Support data modelling for analytics, dashboards, and A/B testing. Collaborate with cross-functional teams to deliver data-driven insights. Work with cloud platforms (GCP preferred) and … A proactive, collaborative approach and strong communication skills. This is a fantastic opportunity to work in a fast-paced, content-rich environment and help shape the future of data in digital publishing. Diversity, equity and inclusion are at the heart of what we value as an organisation. Boston Hale is an equal opportunities employer, and all qualified applicants More ❯

INSIDE IR35 Start Date: 26/08/2025 Job Type: Contract Company Introduction We are seeking a highly skilled Hadoop Engineer to support and enhance our Operational Data Platform (ODP) deployed in an on-premises environment. The ideal candidate will have extensive experience in the Hadoop ecosystem, strong programming skills, and a solid understanding of infrastructure-level … data analytics. This role focuses on building and maintaining scalable, secure, and high-performance data pipelines within enterprise-grade on-prem systems. Job Responsibilities/Objectives Design, develop, and maintain data pipelines using Hadoop technologies in an on-premises infrastructure. Build and optimize workflows using Apache Airflow and Spark Streaming for real-time data processing. Develop robust data engineering solutions using Python for automation and transformation. Collaborate with infrastructure and analytics teams to support operational data use cases. Monitor and troubleshoot data jobs, ensuring reliability and performance across the platform. Ensure compliance with enterprise security and data governance standards. Required Skills/Experience The More ❯

We’re hiring a Data Scientist for a a data-driven business helping household brands stay ahead of shifting consumer trends. This role is ideal for someone with around 3 years’ experience in market research, analytics, or subscription-based businesses who’s ready to apply data science in a product-led environment and leading … a key part in developing analytical solutions that shape how global clients access and understand consumer insights. Working alongside product managers, analysts, and developers, you’ll help build data pipelines, explore AI-driven features, and contribute to smarter tools that enhance the user experience. Responsibilities: Supporting the design and implementation of scalable data pipelines Building predictive … models and automation tools to streamline insight delivery Exploring the use of LLMs and AI to enhance product functionality Collaborating with cross-functional teams to align data solutions with user needs Analysing platform usage and market trends to guide strategic decisions Requirements: Around 3 years of experience in data science, analytics, or advanced market research Proficient More ❯

AI-enabled workflows to prioritise investigations, surface insights, and allow teams to work collaboratively at pace to achieve successful, measurable outcomes. As a Technical Leader for AI and Data at Clue, you will play a pivotal role in accelerating automation and efficiency improvements across investigation workflows supported by our SaaS product. You will lead by example, acting as … a senior technical contributor while coordinating the work of a high-performing team. Your deep expertise in AI, data engineering, and cloud-native development will help shape the future of our platform. Key Accountabilities Lead the technical development of our AI and data initiatives, ensuring alignment with business goals and product strategy. Act as a senior … hands-on contributor (approx. 90% of your time), designing and developing scalable AI and data solutions. Mentor and support the growth of team members through technical guidance, code reviews and knowledge sharing. Coordinate and oversee the technical work of the team, ensuring high-quality delivery and adherence to best practices. Collaborate with cross-functional teams including Product, Engineering More ❯

Description Position at Choreograph WHO WE ARE Choreograph is WPP's global data products and technology company. We're on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We work with agencies and clients to transform the value of data by bringing … together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We're endlessly curious. Our team of thinkers, builders, creators and problem solvers are over 1,000 strong, across 20 markets around the world. WHO WE ARE LOOKING FOR … with serverless architectures (Lambda, Fargate, Cloud Run, et al.) and a clear understanding of when not to use them. Experience with message queues (SQS, PubSub, RabbitMQ etc.) and data pipelines (Kafka, Beam, Kinesis, etc.) You are an effective team player with effective communication, presentation and influencing skills. You have a passion for improving coding and development practices. You More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. ** Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without limitations) will be considered. ** This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance … data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap, and deliver cutting-edge solutions. The successful candidate will ideally have: Knowledge in NLP (Natural Language Processing). Knowledge in OCR (Object Character Recognition). Knowledge More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. ** Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without limitations) will be considered. ** This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance … data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap, and deliver cutting-edge solutions. The successful candidate will ideally have: Knowledge in NLP (Natural Language Processing). Knowledge in OCR (Object Character Recognition). Knowledge More ❯

Data Engineer (SC cleared) Start: ASAP Duration: 12 months Location: Mostly Remote - must have access to London or Bristol Pay: negotiable, INSIDE IR35 Responsibilities: - Design, implement robust ETL/ELT data pipelines using Apache Airflow - Build ingestion processes from internal systems and APIs, using Kafka, Spark, AWS - Develop and maintain data lakes and warehouses … AWS S3, Redshift) - Ensuring governance using automated testing tools - Collaborate with DevOps to manage CI/CD pipelines for data deployments and ensure version control of DAGs - Apply best practice in security and compliance Required Tech Skills: - Python and SQL for processing - Apache Airflow, writing Airflow DAGs and configuring airflow jobs - AWS cloud platform and services like S3 … Redshift - Familiarity with big data processing using Apache Spark - Knowledge of modelling, schema design and partitioning strategies - Understanding batch Vs streaming data paradigms - Docker or Kubernetes (containerization More ❯

cloud native technologies (e.g. AWS, GCP, Snowflake, Databricks) under the guidance of senior team members Key Skills and Experience required - A strong academic background in Computer Science, Engineering, Data Science, or a related technical discipline Proficiency in Java or Python Strong written and verbal communication skills Proactive learner with the ability to self-teach new tools and technologies … an ability to educate others Familiarity with the Linux command line and shell scripting Understanding of basic data concepts - file formats (e.g. CSV, Parquet), data pipelines, and storage layers Exposure to containers and Podman or Docker Comfortable using Git; an awareness of CI/CD practices and tools such as GitHub Actions or Azure DevOps Nice … development workflows using e.g., VSCode Basic understanding of cloud platforms like AWS or GCP Experience contributing to open-source or internal code templates, demos, or accelerators Familiarity with data catalog services (e.g. Hive, Polaris, Glue) This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required. More ❯

Location: London OR Bristol 2- days per week Pay: negotiable, INSIDE IR35 We're looking for an experienced Integration Engineer to join our team and ensure seamless, secure data flow across systems, APIs, and backend services. You'll play a key role in connecting platforms, optimizing data pipelines, and maintaining integration health across our architecture. What … You'll Do: - Design and implement integrations between internal systems and third-party platforms via APIs and other technologies - Build and manage scalable data pipelines for data ingestion, transformation, and delivery - Collaborate with engineering, DevOps, and product teams to define and deliver integration solutions - Troubleshoot and resolve issues such as data inconsistencies, auth errors … of both SQL and NoSQL databases - Familiarity with AWS and its integration services - Strong problem-solving, communication, and collaboration skills - Agile team experience Nice to Have: - Awareness of data privacy and compliance standards (e.g., GDPR) - Exposure to CI/CD pipelines and DevOps practices More ❯

offices), and career development resources, all to fuel our employees' passion for travel and ensure a rewarding career journey. We're building a more open world. Join us. Data Scientist II, Analytics - Landing Introduction to the Team: At Expedia Group, our mission is to power global travel for everyone, everywhere. The Landing Analytics team plays a pivotal role … in shaping the traveler experience by leveraging data to inform decisions, optimize performance, and uncover opportunities for innovation. We work cross-functionally with product, engineering, and business stakeholders to deliver actionable insights and scalable solutions that drive impact across our platforms. As a Data Scientist II, you'll join a collaborative and curious team that values … transparency, continuous learning, and data-driven storytelling. This is a fantastic opportunity to grow your analytics career while contributing to meaningful projects that influence millions of travelers worldwide. In this role, you will: Apply analytics principles and playbooks to solve business problems with moderate guidance. Extract, transform, and analyze data from multiple sources to build models More ❯

remote. Key Requirements: Strong experience with Server-Side Tag Management Google Tag Manager (GTM) - Server-Side essential Google Meridian - MUST HAVE Google Cloud Platform (GCP) Experience setting up data pipelines, event tracking, and tag execution environments Bonus Experience: Experience working with travel or airline clients (huge plus) eCommerce or Shopify knowledge is an advantage Timeline: Start Date: September More ❯

strategies on Solana and adjacent ecosystems. While you'll work within a Solana-first environment, most of your contributions will be in architectural design, APIs, smart contract integrations, data pipelines, and compliance flows rather than low-level Rust development (though familiarity is a plus). What you'll do: Design tokenization architectures for RWAs on Solana as well More ❯

the delivery of seamlessly integrated digital user experiences at scale in collaboration. Core Responsibilities: Working with Engineering colleagues to ensure the rapid release of embedded systems, data pipeline, and mobile applications.development of software with a dedicated focus on testing methods to ensure scalability. Collaborating closely with Corporate Quality teams to streamline end-to-end system test processes More ❯

the delivery of seamlessly integrated digital user experiences at scale in collaboration. Core Responsibilities: Working with Engineering colleagues to ensure the rapid release of embedded systems, data pipeline, and mobile applications.development of software with a dedicated focus on testing methods to ensure scalability. Collaborating closely with Corporate Quality teams to streamline end-to-end system test processes More ❯

A great marketing digital client based in Old Trafford is looking for a Data Scientist to help build and mature our monitoring and alerting infrastructure, centralising current efforts and enabling scalable, standardised approaches across multiple projects. This is a pivotal role for someone who thrives in autonomous environments and enjoys owning solutions from concept to deployment. The role … training programs, and all the support you need to keep growing. · Giving Back: Join us in supporting local charities and making a positive impact. The Role: As a Data Scientist in this role, you will lead the design, development, and deployment of systems that monitor the health and integrity of our data. You will work with stakeholders across … a hands-on role that requires both analytical thinking and strong engineering practices. You will take full ownership of projects - from discovering and defining problems, cleaning and preparing data in the warehouse, developing and testing models and logic, and deploying solutions into production environments. Key Responsibilities: · Design and implement monitoring and alerting systems to ensure the reliability and More ❯

by leading investors, we recently raised $16M in Series A funding to accelerate our vision of helping 1 billion people learn. The Role We're hiring our first Data Scientist to help us turn raw data into smart decisions, powerful product features, and personalised learning experiences. You'll work closely with the founders and engineers to … unlock insights, build production-ready models, and help shape the future of how people learn. This role sits at the intersection of product, data and engineering. If you're excited by high ownership, greenfield challenges, and making data a core part of a product people already love - this is the role for you. Key Responsibilities Analyse … data to inform product decisions Work with product and engineering to design data experiments and analyse user behaviour Develop scalable data pipelines and automate insights generation Create predictive models, segmentation logic, or recommendation engines as needed Communicate findings clearly to technical and non-technical stakeholders Drive the development of internal analytics tools and dashboards More ❯

manages all of Allica's savings account propositions. As Product Owner, you will lead a dedicated squad on Financial Crime, across products, with skills such as Engineering and Data, as well as work closely with peers in functions such as Operations, Compliance and Risk. The squad delivers via simple, elegant solutions to our customers' complex problems, driving innovation … the end to end strategy, delivery and continuous optimisation of our FinCrime detection, prevention and monitoring solutions. The role balances strategic vision with hands on execution, requiring deep data expertise, strong technical acumen with vendor platforms, and a passion for getting into the details of rule calibration, model performance and emerging typologies. Principal Accountabilities Define & Evolve FinCrime Strategy … APP, ATO, internal), AML transaction monitoring and screening (sanctions, PEP, adverse media). Continuously assess threat landscapes and regulatory change to ensure controls stay ahead of new typologies. Data Driven Detection & Analytics Leverage advanced analytics, SQL/Python and machine learning techniques, supported by Engineers and Data Scientists and Data Analysts to surface anomalies More ❯

Senior Power BI Developer Holborn, London – Hybrid (3 days in office) Up to £70,000 + benefits The Company A growing data consultancy delivering AI-powered customer analytics solutions across a wide range of industries. With a strong focus on insight automation and platform-led delivery, their work sits at the intersection of product, data science … BI Developer, you’ll play a hands-on role in designing and building client-facing dashboards that surface key customer and commercial metrics. You’ll work closely with data engineers and stakeholders to transform raw data into clear, actionable insight—with DAX modelling at the heart of it. Key Responsibilities: Design and deliver Power BI dashboards … for external clients Build scalable data models using DAX and SQL Run stakeholder workshops to define dashboard requirements Optimise performance using DAX Studio and best-practice modelling Support broader data integration and delivery with cross-functional teams What You’ll Bring Extensive BI development experience in a client-facing or consultancy setting Strong command of DAX More ❯

Senior Power BI Developer Holborn, London – Hybrid (3 days in office) Up to £70,000 + benefits The Company A growing data consultancy delivering AI-powered customer analytics solutions across a wide range of industries. With a strong focus on insight automation and platform-led delivery, their work sits at the intersection of product, data science … BI Developer, you’ll play a hands-on role in designing and building client-facing dashboards that surface key customer and commercial metrics. You’ll work closely with data engineers and stakeholders to transform raw data into clear, actionable insight—with DAX modelling at the heart of it. Key Responsibilities: Design and deliver Power BI dashboards … for external clients Build scalable data models using DAX and SQL Run stakeholder workshops to define dashboard requirements Optimise performance using DAX Studio and best-practice modelling Support broader data integration and delivery with cross-functional teams What You’ll Bring Extensive BI development experience in a client-facing or consultancy setting Strong command of DAX More ❯

Job Title: Software Engineer – (AI Automation & LLM ) Location: London- Hybrid role Duration: 31st December 2025- possible extension Role: We're looking for a skilled Data Engineer/Software Engineer to support a pioneering AI research project focused on Large Language Model (LLM) agents and intelligent automation. You’ll play a central role in preparing and filtering text, image … and video datasets used to train advanced AI systems, helping to ensure data quality, relevance, and safety.. Key Responsibilities Data Onboarding: Convert raw datasets into structured formats suitable for automated processing. Filtering: Apply data … cleaning, quality checks, and filtering pipelines to identify and mitigate risks in datasets. Post-Processing: Integrate filtering results to modify original datasets, repackage them, and prepare for re-ingestion. Pipeline Engineering: Design, build, and maintain scalable and efficient data pipelines. Collaboration: Work closely with researchers and technical teams to refine processes and contribute to ongoing AI automation More ❯

daily to our panel of over 24 million registered members to understand opinion and behaviors around the world. We have a strong reputation as a source of accurate data and we're trusted by the world's biggest brands to get it right, making us the most quoted market research source in the world. With operations in the … India and Asia Pacific, YouGov has one of the world's largest research networks. About Brandindex BrandIndex is YouGov's flagship brand intelligence platform that transforms consumer survey data into insights for businesses: it monitors thousands of brands globally to deliver a comprehensive view of brand health. Through continuous data collection and analysis, BrandIndex enables customers … YouGov's "Be Fast" value through rapid adaptation and delivery. When joining us, you'll find colleagues who are committed to "Getting it Right," making decisions based on data and best practices while never compromising on quality or integrity. We embrace diverse perspectives and backgrounds, and we prioritize a positive atmosphere where effective work and quick thinking are More ❯

Two Circles is a global sports agency. We drive growth for sports properties by delivering deeper connections with fans, through the intelligent use of data and technology. We work with some of the world's biggest sports organisations - including the NFL, Premier League, Formula 1, AFL, Wimbledon and UEFA - and have been named Sport Industry Agency of the … back-end development patterns. Nice to Have Experience with platforms like Braze, Google Analytics, Adobe Analytics, Contentful, or Sitecore. Experience across technology domains including CMS, CRM, Martech platforms, data pipelines, analytics, and cloud services. Exposure to CDPs (e.g., Bloomreach, Segment, BlueConic, Tealium) and data integration pipelines. Understanding of data modelling, ETL processes, and basic More ❯

those looking to make a severe impact and are excited about working in a high-growth startup. We ship fast, continuously, and iteratively, learning each step. We are data-informed. And are ok with finding the data when it's missing. Our products We have a suite of API products that automate tax-related workflows for … any internet company. Those products are Lookup , Tax , Returns , Data sharing and E-Invoicing . We may discover novel customer needs as we learn and spin up new products as required. Our API docs For you as an engineer, API documentation is probably an important part when considering a new career move. Thanks to the API docs, you … features across the stack, from back-end business logic implementation to front-end customer-facing interfaces. You would be a great fit if You have experience working with data scientists and data engineers. You have a good understanding of how machine learning works and can bring this expertise to Fonoa. You have experience working with LLMs More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯