301 to 325 of 525 Data Pipeline Jobs in England

variety of technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining … Personal Learning & Development budget Wellbeing days What's required to be successful in this role? Demonstrable programming ability in Python, preferably within a data context A STEM-related degree Some experience with the Python scientific stack (NumPy, Pandas, SciPy, etc.) is preferred Experience with Docker, GIT and Linux ...

Senior Data Engineer (Python/PySpark & SQL) London (Hybrid - 3 days in office | Monday, Tuesday, Wednesday) Up to £85,000 dependent on experience Ref: J13073 We're working with a fast-growing AI SaaS business where data sits at the core of everything they build. They … looking for a Senior Data Engineer to take ownership of the pipelines that power their platform. You'll be working with real-world, messy data and shaping it into reliable, decision-ready datasets used across product, analytics, and machine learning. Python/PySpark ...

Senior Data Engineer - Anti-Fraud Technology Location: Manchester or London (Hybrid, 3 days per week onsite) Contract: 12 months Rate : up to £600 p/d (DOE) Join a forward-thinking cybersecurity and fraud prevention team working at the cutting edge of technology. This role offers the opportunity … design and build innovative data solutions that help detect and prevent financial crime, protecting hundreds of thousands of users across the UK and Europe. As a Senior Data Engineer, you will design and implement robust, scalable data pipelines that power real-time analytics ...

scalable, secure AI/ML architectures aligned with enterprise strategy, Omnia principles, and hybrid cloud environments. Design end-to-end AI solutions, including data pipelines, feature engineering, model development, deployment, and operational monitoring. Provide architectural leadership across the full lifecycle, ensuring alignment with DevSecOps, security, and engineering best … mission first. Essential Skills and Experience: Proven experience architecting AI solutions in secure or classified environments, with strong knowledge of data governance and access control. Proven experience designing and delivering enterprise-scale AI/ML solutions from concept through to production. Strong expertise in AI/ML architecture ...

Head of Data & AI Engineering London (Hybrid: 3 days office/2 days remote) Permanent | Leadership | Data, AI & Cloud Engineering Overview An exciting opportunity for a Head of Data & AI Engineering to lead a core technology function within a digital-first financial services organisation. … This role is central to a major transformation programme, focused on building cloud-native data platforms and embedding AI-driven automation to improve decision-making, operational efficiency, and customer outcomes. The Role You will lead teams delivering data pipelines, analytics platforms, and AI-powered solutions ...

Azure & Databricks Data Engineer | Reading/Hybrid | 3-Month Contract | Data Consultancy | £450-£500 Employer: UK-based Data Consultancy delivering modern cloud solutions for enterprise clients Contract: 3 months (with potential extension) Location: Reading/Hybrid (UK-based) Role Summary: Join client projects … help enterprise organisations modernise their data platforms. Hands-on work with Azure and Databricks to build and maintain scalable pipelines, warehouses, and transformation layers. Ideal for someone with strong Azure and Databricks skills who enjoys delivering practical, high-quality solutions. Responsibilities: Build and optimise Azure data ...

Azure & Databricks Data Engineer | Manchester/Hybrid | 3-Month Contract | Data Consultancy | £450-£500 Employer: UK-based Data Consultancy delivering modern cloud solutions for enterprise clients Contract: 3 months (with potential extension) Location: Manchester/Hybrid (UK-based) Role Summary: Join client projects … help enterprise organisations modernise their data platforms. Hands-on work with Azure and Databricks to build and maintain scalable pipelines, warehouses, and transformation layers. Ideal for someone with strong Azure and Databricks skills who enjoys delivering practical, high-quality solutions. Responsibilities: Build and optimise Azure data ...

Azure & Databricks Data Engineer | Bristol/Hybrid | 3-Month Contract | Data Consultancy | £450-£500 Employer: UK-based Data Consultancy delivering modern cloud solutions for enterprise clients Contract: 3 months (with potential extension) Location: Bristol/Hybrid (UK-based) Role Summary: Join client projects … help enterprise organisations modernise their data platforms. Hands-on work with Azure and Databricks to build and maintain scalable pipelines, warehouses, and transformation layers. Ideal for someone with strong Azure and Databricks skills who enjoys delivering practical, high-quality solutions. Responsibilities: Build and optimise Azure data ...

small, high‐impact team building AI systems that power decision‐making across a global investment platform. You’ll work alongside experienced AI engineers, data scientists, and technologists to deliver real products used by investment teams and portfolio companies. This role is ideal for: PhD graduates in a STEM … computational experience; or Bachelor’s/Master’s graduates with 1–2 years of industry experience or relevant internships in machine learning, data engineering, or software engineering. You’ll contribute to designing, implementing, and deploying production-grade ML systems—ranging from NLP pipelines to model‐driven workflow automation. ...

modern engineering best practices. Build and maintain microservices-based systems , with a strong focus on scalability, resilience, and performance. Develop and optimise scalable data pipelines , supporting both batch and streaming workloads, using technologies such as Apache Spark . Work extensively with data technologies , leveraging Python … deliver high-quality analytical and data-driven solutions. Lead the design and delivery of data-centric applications , translating complex business and analytical requirements into well-architected technical solutions. Implement and integrate large language models (LLMs) , including: Utilising both proprietary and open-source models Fine-tuning models ...

looking for experienced Data Engineers to join a long-standing, high-impact public sector partnership. This isn't just about moving data; it's about modernizing essential services and delivering secure, reliable data products at scale. You will play a pivotal role in shaping … engineering design, mentoring talent, and helping our clients reimagine what's possible through technology. Data Engineer (AWS) Location: Telford/Worthing Base Locations (Hybrid 2-3 days onsite) Salary: £55,000 - £70,000 + Bens, Perks, Healthcare Options, Unlimited Training Budget Security Clearance: Must be eligible ...

IR35 We're supporting a major transformation programme within a global business, building out a brand-new engineering team to modernise critical financial data systems. This is a key role sitting between data, finance and engineering, helping ensure data flowing into … environment is accurate, compliant and fit for purpose. What you'll be doing Building and enhancing Java-based backend services supporting financial data flows Designing and improving end-to-end data pipelines across multiple product domains Ensuring data is correctly structured, validated and compliant ...

DataStage Developer - Manchester and remote - 8 months+/RATE £297 per day inside IR35 (Datastage, Data stage, ETL) One of our Blue Chip Clients is urgently looking for a DataStage Developer. For this role you will need to be onsite in Manchester 2 days per week. Please find … Developer, you will be responsible for designing, developing, enhancing, and supporting ETL solutions using IBM DataStage. You will work closely with business analysts, data architects, and downstream consumers to deliver reliable, scalable, and high-quality data integration solutions in a regulated banking environment. Key Responsibilities Design ...

Developer, you will be responsible for designing, developing, enhancing, and supporting ETL solutions using IBM DataStage. You will work closely with business analysts, data architects, and downstream consumers to deliver reliable, scalable, and high-quality data integration solutions in a regulated banking environment. Key Responsibilities Design … develop, and maintain ETL jobs and sequences using IBM DataStage Develop end-to-end data pipelines from source systems to data warehouse/downstream platforms Create and maintain ETL design documents, mapping specifications, and technical documentation Perform data profiling, validation, and reconciliation to ensure ...

reliability, scalability, and operational integrity of our machine-learning systems in research & production. This role sits at the intersection of data engineering and ML infrastructure: youll design and operate data pipelines that feed models, and youll build the tooling that trains, deploys, monitors, and retrains them. … lifecycle infrastructure Productionizing models: packaging, deployment, versioning, and rollback Designing CI/CD pipelines for ML (training --> validation --> deployment) Implementing model monitoring (data drift, prediction drift, performance decay) Managing experiment tracking and reproducibility Data engineering foundations Building and maintaining batch and nearreal-time data ...

product improvements and investigating new improvement and product ideas, translating identified needs into practical, deta-led enhancements. Working closely with Product Managers and Data Analysts, this role is responsible for analysing requirements, prototyping solutions and converting data assets, models and pipelines into incremental, scalable product features. … Product Analyst bridges day-to-day product priorities and technical feasibility, ensuring improvements are designed with platform capabilities, data quality, performance and scalability in mind, and can be delivered efficiently into live products. Product Improvement & Delivery Own and maintain a prioritised backlog of data-led product ...

Looking for a hands-on Business Systems Analyst who thrives at the intersection of insurance, data, and technology. This role covers the full London Market insurance value chain—so if you get a kick out of figuring out how underwriting, exposure management, pricing, and policy admin all link … actuaries) and tech teams, translating real-life insurance problems into practical system solutions. You’ll own, configure, and support core insurance platforms, keep data flowing smoothly, and make sure everything stays compliant with the latest market initiatives. Along the way, you’ll get your hands dirty with data ...

Title: Data Analyst (SQL) Location: Hybrid, North Yorkshire (2-3 days pw in the office) Overview We are seeking a Data Analyst (SQL) to support the development and maintenance of SQL databases, data pipelines, and reporting datasets. You will work closely with … reporting teams to ensure data is accurate, reliable, and ready for analytics. Key Responsibilities Develop and maintain SQL code (views, stored procedures, functions) in SQL Server Support ETL/data pipelines (e.g. SSIS or similar tools) Assist with data modelling for reporting and analytics ...

experience doesn't quite match the specification, we'd still really love to hear from you Your new Role Working closely with the Data Analytics Manager and wider Marketing Team, this role will be responsible for turning audience data and customer intelligenceinto real-world outcome-driven … marketing activations across paid media, CRM, and emerging channels across the DFS Group. This role sits at the heart of our Group Customer Data Strategy so the successful candidate will be responsible for the deployment and activation of our FirstParty Data (1PD) audiences, enriching audience data ...

will be responsible for: Designing, implementing, and maintaining scalable data pipelines and ETL processes Developing and optimising databases and data storage solutions for structured and unstructured data Collaborating with data scientists and analysts to deliver reliable, high-quality data for analytics and reporting Ensuring data quality, integrity, and compliance with security and governance click apply for full job details ...

Lead Data Platform Engineer £75,000 - £85,000 Remote You are a well-experienced Lead Data Platform Engineer, looking to take ownership of a modern lakehouse platform and shape best-in-class data engineering practices. THE COMPANY This industry-leading organisation serves specialist, people … first knowledge to its clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically ...

Lead Data Platform Engineer £75,000 - £85,000 Remote You are a well-experienced Lead Data Platform Engineer, looking to take ownership of a modern lakehouse platform and shape best-in-class data engineering practices. THE COMPANY This industry-leading organisation serves specialist, people … first knowledge to its clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically ...

Lead Data Platform Engineer £75,000 - £85,000 Remote You are a well-experienced Lead Data Platform Engineer, looking to take ownership of a modern lakehouse platform and shape best-in-class data engineering practices. THE COMPANY This industry-leading organisation serves specialist, people … first knowledge to its clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically ...

Title: Data Tech Lead Location: Leeds/Hybrid Duration: 6 months initially Contract: Competitive daily rate, Outside IR35 Why Apply? This is a high-impact contract opportunity for an experienced Data Tech Lead to play a key role in a major data platform initiative … depth and strategic architectural decision-making, working across both engineering teams and senior stakeholders to bring clarity, structure, and direction to an evolving data landscape. Job Responsibilities Lead a comprehensive discovery and assessment of an existing data platform and architecture Map current-state data ...

area . Core areas AI Engineering LLM orchestration, prompting, and workflows Evaluation systems and feedback loops Reliable deployment of AI systems in production Data Engineering Data ingestion from heterogeneous sources Data modelling, transformation, and pipelines PostgreSQL, vector databases, medallion architectures Enterprise Infrastructure Multi-tenant … infrastructure and deployment Security, authentication, and system reliability The role 🧠 Build and deploy AI systems using LLMs (prompting, orchestration, evaluation) 📊 Design and scale data pipelines across diverse sources (APIs, scraping, structured data) ⚙️ Develop core SaaS infrastructure, including multi-tenant architecture 🔧 Take ownership of system design across ...