1,051 to 1,075 of 1,160 Data Pipeline Jobs in the UK

based tech company helping clients engage in marketing strategies with audiences in virtual worlds. Your Focus: As a Senior Backend Engineer focused on Data Pipelines and API Optimisation, you’ll be central to our platform's performance and scalability. You’ll design, build, and iterate on the systems … that handle data ingestion, transformation, and delivery - ensuring they are scalable, reliable, and performant. You should have a strong background in backend engineering, particularly around distributed systems, database optimisation, and API development. You’ll work with technologies like JavaScript and TypeScript to build robust services that meet high … standards for performance and reliability. This role is ideal for someone experienced, self-driven, and excited about leading backend projects involving large-scale data handling and API improvements. Your technical leadership will help evolve our infrastructure and mentor other engineers as we scale. Skills, Knowledge, and Expertise Experience More ❯

decisions about the technological stack and system design, considering all trade-offs. Work on ML model development with our team to build robust data pipelines and deploy ML models. Analyse large corpora of data and build real-time recommendation systems. Scale backend and web frontend development … teams. Deliver numerous new, useful, and interesting features. Work with large amounts of data in different modalities: Texts Videos Images Audio Work in a very cross-functional team, side by side with mobile developers, product managers, ML engineers, and designers. Skills needed: Build high-load applications from scratch. More ❯

decisions about the technological stack and system design, considering all trade-offs. Work on ML model development with our team to build robust data pipelines and deploy ML models. Analyse large corpora of data and build real-time recommendation systems. Scale backend and web frontend development … teams. Deliver numerous new, useful, and interesting features. Work with large amounts of data in different modalities: texts, videos, images, audio. Lead the full-stack development of a high-scale system designed for millions of users. Work in a very cross-functional team, side by side with mobile More ❯

Development, deploy and maintain AI systems and services in the healthcare domain to find more untreated patients London Technical share this Pangaea Data (Pangaea) is a South San Francisco and London based business founded by Dr Vibhor Gupta and Prof Yike Guo (Director Data Science Institute … and the life sciences, including Lord David Prior (former chairman, NHS England) and Mr. Andy Palmer (former CIO, Novartis). The Role Pangaea Data is looking for talented engineers to join its technical team and focus on the development, deployment, and maintenance of AI systems and services in … AI-based solutions. Key Responsibilities Technical Responsibilities : Design and develop backend systems that integrate healthcare AI/LLM modules for tasks such as data extraction, summarization or decision support. Design and implement systems that integrate with the client side such as Web UI or EHR system. Implement and More ❯

Financial engineering or related finance-related degree. Experience with equity or fixed income derivatives volatility models for risk and trading systems. Experience with data engineering frameworks like Airflow, Luigi or Dagster. Experience developing financial model libraries in Python, Java, or C++ Experience with risk and optimization tools such … assets and their markets, both spot & derivatives products. Responsibilities: Building quantitative models for risk management, asset valuation, derivatives pricing, and simulations. Collaborating with data engineers and infrastructure team to incorporate quantitative functions into data pipelines and services. Automating number & regression testing and backtests to ensure top More ❯

Certain Advantage are recruiting on behalf of our growing London based Data & AI consulting client who specialist in providing best in class support to clients who use Palantir's Foundry, Gotham, and AIP as part of their architecture. A large proportion of projects involve solving problems in the … defence domain, so SC clearance is required, and we can only consider candidates eligible and willing to obtain this. We're looking for data professionals who get excited about engaging with users to understand and break down complex novel problems, and design and deliver data solutions … frameworks like React would also be advantageous. As a Consultant Engineer your responsibilities will include Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs. Build and edit operational workflows, including front More ❯

passion for deploying AI/ML models into real-world, production-grade applications. Apply if: You have strong foundational software engineering knowledge, including data structures, algorithms, system design, and OOP. You have advanced knowledge of LLM architectures and ML/DL frameworks (e.g. TensorFlow, PyTorch, LangChain, Keras, scikit … and cost-effectiveness in a production environment. Implement and manage the infrastructure for MLOps, including fine-tuning, deployment, monitoring and versioning. Develop robust data pipelines for ingestion, cleaning, model training, and continuous deployment. Build retrieval-aware repositories for model training, evaluation, and real-time context-rich inference. Collaborate More ❯

passion for deploying AI/ML models into real-world, production-grade applications. Apply if: You have strong foundational software engineering knowledge, including data structures, algorithms, system design, and OOP. You have advanced knowledge of LLM architectures and ML/DL frameworks (e.g. TensorFlow, PyTorch, LangChain, Keras, scikit … and cost-effectiveness in a production environment. Implement and manage the infrastructure for MLOps, including fine-tuning, deployment, monitoring and versioning. Develop robust data pipelines for ingestion, cleaning, model training, and continuous deployment. Build retrieval-aware repositories for model training, evaluation, and real-time context-rich inference. Collaborate More ❯

Job Description: A Data Engineer specializing in Python and PySpark to be part of data efforts from on-premises systems to AWS. The candidate will design, build, and optimize data pipelines using Python, PySpark, and DBT onto Snowflake on AWS, ensuring a secure and … efficient framework. This role requires expertise in Python, PySpark, DBT, Airflow, and hands-on experience with exposure to Snowflake and the Big Data tech stack Technical Skills: Python PySpark DBT Airflow AWS, especially S3 and Glue Apache Iceberg SQL Git Kubernetes and Docker Shell Snowflake and Big Data More ❯

Job Description: A Data Engineer specializing in Python and PySpark to be part of data efforts from on-premises systems to AWS. The candidate will design, build, and optimize data pipelines using Python, PySpark, and DBT onto Snowflake on AWS, ensuring a secure and … efficient framework. This role requires expertise in Python, PySpark, DBT, Airflow, and hands-on experience with exposure to Snowflake and the Big Data tech stack Technical Skills: Python PySpark DBT Airflow AWS, especially S3 and Glue Apache Iceberg SQL Git Kubernetes and Docker Shell Snowflake and Big Data More ❯

My client is a quantitative hedge fund: they combine deep expertise in trading, technology, and data science to drive uncorrelated, high-quality investment returns. Their team of software developers and engineers work globally to deliver next-gen data pipelines. If you're a skilled Python developer … of the best quants, traders, and engineers in the industry. At the cutting-edge of technology, they are building high-performance, large-scale data analysis pipelines. A data-driven culture, leveraging advanced statistical and machine learning techniques. Global collaboration with offices in major financial hubs worldwide More ❯

My client is a quantitative hedge fund: they combine deep expertise in trading, technology, and data science to drive uncorrelated, high-quality investment returns. Their team of software developers and engineers work globally to deliver next-gen data pipelines. If you're a skilled Python developer … of the best quants, traders, and engineers in the industry. At the cutting-edge of technology, they are building high-performance, large-scale data analysis pipelines. A data-driven culture, leveraging advanced statistical and machine learning techniques. Global collaboration with offices in major financial hubs worldwide More ❯

Graduate Software Engineer (Data & Infrastructure) London, United Kingdom At Modo Energy, we're on a mission to build the information architecture for the energy transition - we want to be the only place to come to for information on the global journey to net zero. Take a look at … of a rapidly growing team. The role As a software engineer you will be trusted with responsibility day one, adding value to our data and infrastructure team. You will be responsible for developing new features and ensuring they are scalable, reliable, and efficient to meet future demands. We … hungry to learn quickly. This position requires a proactive approach and readiness to introduce modern practices to development, monitoring, maintaining, and improving our data pipelines and infrastructure. We offer multiple career progression paths based on your interests and experience, whether that be in data engineering or More ❯

Python Engineer – Distributed Systems & Big Data Location: London (Hybrid or Remote within the UK) Type: Full-time | Competitive Salary + Equity Options We’re looking for a talented Python Engineer to join one of our premier clients based out of London. You’ll play a key role in … next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … Python programming skills (5+ years preferred). Deep experience with distributed systems (e.g., Kafka, Spark, Ray, Kubernetes). Hands-on work with big data technologies and architectures. Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in a fast-paced, highly collaborative environment. Bonus Points More ❯

Python Engineer – Distributed Systems & Big Data Location: London (Hybrid or Remote within the UK) Type: Full-time | Competitive Salary + Equity Options We’re looking for a talented Python Engineer to join one of our premier clients based out of London. You’ll play a key role in … next-generation platform. What You’ll Do: Design, build, and optimise distributed systems for high throughput and low latency. Work with large-scale data pipelines (terabytes to petabytes). Collaborate closely with product and data teams to solve complex engineering challenges. Write clean, maintainable Python code … Python programming skills (5+ years preferred). Deep experience with distributed systems (e.g., Kafka, Spark, Ray, Kubernetes). Hands-on work with big data technologies and architectures. Solid understanding of concurrency, fault tolerance, and data consistency. Comfortable in a fast-paced, highly collaborative environment. Bonus Points More ❯

Full-time £70k WeDo has partnered with a Fintech Scale-Up on the hunt for an Analytics Engineer who knows their way around data pipelines, loves clean code, and isn’t afraid of the occasional rogue null value. You’ll join a fast-paced fintech team helping them … turn messy data into insights people can actually use. What you’ll do: Build and maintain data models using dbt and Coalesce Write clean, efficient SQL and Python Work with analysts and stakeholders to turn questions into answers Keep their data pipelines flowing smoothly … and reliably What They're looking for: Strong SQL skills Solid experience with dbt , Python , and ideally Coalesce Background in data or analytics engineering Bonus points if you’ve worked in financial services Good communicator, team player, and general data nerd What’s in it for More ❯

IMServ is one of the UKs leading data collection and energy metering experts, delivering award winning services to more customers in more places, meeting industry targets and becoming a benchmark for excellence. We offer a range of specialist metering technology for electricity, gas and water along with highly … accurate energy data collection services. All this is wrapped up with an easy-to-view online data management analysis and reporting software. PURPOSE OF ROLE: Software Engineers are the main creators of our new line of software products, helping us achieve our ambition to deliver highly … the code throughout the entire product lifecycle, building an understanding of the market intent and tuning our outputs in conjunction with customer usage data to ensure success Senior Engineers also undertake more complex works including technical design, plus coach and guide more junior team members Our Team Leaders More ❯

IMServ is one of the UK s leading data collection and energy metering experts, delivering award winning services to more customers in more places, meeting industry targets and becoming a benchmark for excellence. We offer a range of specialist metering technology for electricity, gas and water along with … highly accurate energy data collection services. All this is wrapped up with an easy-to-view online data management analysis and reporting software. PURPOSE OF ROLE: Software Engineers are the main creators of our new line of software products, helping us achieve our ambition to deliver … the code throughout the entire product lifecycle, building an understanding of the market intent and tuning our outputs in conjunction with customer usage data to ensure success Senior Engineers also undertake more complex works including technical design, plus coach and guide more junior team members Our Team Leaders More ❯

Senior Software Engineer | Tech for good | C# .Net Do you want to join a pioneering software house dedicated to transforming industries through data analysis and management? They harness cutting-edge solutions to enable businesses to harness the power of data for the greater good of humanity. … development team. In this role, you will design, develop, and maintain scalable, high-performance backend systems. You will work on integrating systems managing data pipelines, and ensuring system reliability and security in a cloud environment. Key Responsibilities You will play a key role in designing, developing, and deploying … high-performance software solutions Manage and wrangle large scale data sets Optimise cloud based architecture Deliver value at every point of the SDLC Required Skills & Qualifications 4+ years of professional experience in C# .NET Experience with cloud platforms such as AWS, Azure, or Google Cloud Experience in data More ❯

Senior Software Engineer | Tech for good | C# .Net Do you want to join a pioneering software house dedicated to transforming industries through data analysis and management? They harness cutting-edge solutions to enable businesses to harness the power of data for the greater good of humanity. … development team. In this role, you will design, develop, and maintain scalable, high-performance backend systems. You will work on integrating systems managing data pipelines, and ensuring system reliability and security in a cloud environment. Key Responsibilities You will play a key role in designing, developing, and deploying … high-performance software solutions Manage and wrangle large scale data sets Optimise cloud based architecture Deliver value at every point of the SDLC Required Skills & Qualifications 4+ years of professional experience in C# .NET Experience with cloud platforms such as AWS, Azure, or Google Cloud Experience in data More ❯

team's mission-real world incarnations of some of the most difficult academic problems. An Applied Scientist in the team drives innovation through data-driven insights building advanced data pipelines and applying machine learning techniques such as computer vision, LLM and foundation models. An Applied Scientist … Key job responsibilities - Work on research projects in machine learning and related fields to create highly innovative customer experiences; - Analyze large amounts of data to discover patterns, find opportunities, and develop highly innovative, scalable algorithms to seize these opportunities; - Validate models via statistically rigorous experiments across millions of … peer-reviewed conferences or journals - Experience programming in Java, C++, Python or related language - Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing - Experience building machine learning models or developing algorithms for More ❯

release process of PDBe. To support the development and deployment of PDBe and PDBe-KB web services, including microservice deployment Developing and maintaining data pipelines to process and manage large-scale structural biology data Working with workflow orchestration tools like Apache Airflow and Nextflow To liaise … is an opportunity for the right person to bring IT skills and innovative ideas to help sustain the growing amount of structural biology data in the PDB and ensure that PDBe and PDBe-KB services remain sustainable. You have MSc in computer science, IT or a related field … IT expertise Expert in Python (3.x) Expert Linux scripting Proficiency in containerisation Proficiency in relational databases (Oracle, PostgreSQL) Experience in developing and maintaining data pipelines Hands-on experience with workflow orchestration tools (e.g., Apache Airflow, Nextflow) Strong interpersonal and communication skills Proficiency in oral and written English You More ❯

success of business-critical systems? We’re looking for a skilled Integrations Engineer to lead the development, support, and optimisation of enterprise-wide data integration solutions—and to act as a trusted deputy to the Integration Manager . 🔍 About the Role You’ll take ownership of maintaining and … improving integration pipelines, proactively resolving issues, and leading design and development initiatives using SSIS and Azure Data Factory . You'll also be the technical point of contact across multiple teams and act as 3rd line support for escalated incidents. 🧠 What You'll Do ✅ Configure and manage SSIS … integrations, ensuring accurate and secure data transfers ✅ Monitor, troubleshoot, and resolve integration issues, managing a ticket queue (e.g., via ServiceNow) ✅ Lead the design of new and existing data pipelines, adhering to change control processes ✅ Collaborate with stakeholders—including BAs, PMs, Architects, and Infrastructure teams ✅ Deputise for More ❯

Swagger . Mobile Testing Focus on mobile app quality across Android/iOS devices. Manual and automation testing using Appium , XCUITest , TestFairy . Data/ETL Testing Ensures accurate data flow, transformation, and validation in data pipelines. Works with SQL, Informatica , Talend , SSIS , Snowflake More ❯

wed love to hear from you. What Youll Do Design, build, and maintain Python services that power critical financial workflows. Work with modern data processing tools like pandas and polars to transform and analyze large datasets. Build async Python services using asyncio , and develop event-driven systems integrating … speed with long-term maintainability. Work closely with product and business stakeholders to deliver high-impact features. Support and evolve our PostgreSQL -based data storage and querying layers. What Were Looking For 36+ years of professional software development experience, primarily with Python . Solid experience with Pythons standard … library and familiarity with modern idioms (e.g., dataclasses , type annotations , async/await ). Experience with data transformation and analysis libraries like pandas or polars. Comfortable writing unit and integration tests with pytest . Practical experience with PostgreSQL (or another relational database), and understanding of schema design and More ❯