551 to 575 of 799 Data Pipeline Jobs in England

model? We are seeking a Senior Backend Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture click apply for full job details More ❯

maintainable solutions What We're Looking For: Deep expertise in core Python development Strong foundation in OOP and software design patterns and multithreading Experience working with large-scale data pipelines and ETL workflows Experience working on Time Series systems Proven track record building Fixed Income trading systems Exposure to portfolio optimisation and pricing analytics Please submit your CV More ❯

Trading & Shipping industry - a must! Experience in Product Management within B2B SaaS companies. Proven experience managing AI/ML-based products, with a solid grasp of model workflows, data pipelines, and the tradeoffs between performance and explainability. Extensive customer-facing experience , including running discovery sessions, field interviews, and roadmap presentations with enterprise clients. Excellent communication skills, with a More ❯

Trading & Shipping industry - a must! Experience in Product Management within B2B SaaS companies. Proven experience managing AI/ML-based products, with a solid grasp of model workflows, data pipelines, and the tradeoffs between performance and explainability. Extensive customer-facing experience , including running discovery sessions, field interviews, and roadmap presentations with enterprise clients. Excellent communication skills, with a More ❯

Trading & Shipping industry - a must! Experience in Product Management within B2B SaaS companies Proven experience managing AI/ML-based products , with a solid grasp of model workflows, data pipelines, and the tradeoffs between performance and explainability. Extensive customer-facing experience , including running discovery sessions, field interviews, and roadmap presentations with enterprise clients. Excellent communication skills , with a More ❯

Experienced building SaaS products that delight customers, from conception to production. Experienced with building and operating production distributed systems. Experienced with cloud native, containers, Kubernetes. Confident working with data pipelines and a variety of databases. You'llstand out if you: Haveexperience building cyber security products. Haveexperience working in startups. Have experience as a site reliability engineer or similar More ❯

problem that you're solving, and you will have the opportunity to shape the direction of the product. You will evaluate your own work, leveraging our data pipeline and frameworks that we have established to understand the impact your features have on our commercial objectives and pivoting where necessary. You will consider the long-term direction of More ❯

Multilingual team, you will play a crucial role in developing and enhancing our language models to support a wide range of languages. Your primary focus will be on data engineering tasks, including data collection, cleaning, and preparation, to ensure our models perform exceptionally across various linguistic contexts. You will work closely with our research scientists, machine … friendly! Applicants for this role may work anywhere between UTC 06:00 and UTC:00. As a Member of Technical Staff for Multilingual you will: Design and implement data pipelines to process and prepare multilingual datasets. Collaborate with researchers to understand data requirements and model performance. Develop tools and scripts to automate data-related … tasks and improve efficiency. Ensure data quality and integrity through rigorous testing and validation. Stay updated on the latest advancements in multilingual data processing and contribute to the team's knowledge base. You may be a good fit if you have: A Bachelor's degree in Computer Science, Data Science, or a related field More ❯

Front Office Data & Analytics Engineer - Crude & Products Apply locations: London, United Kingdom Type: Full time Posted: Yesterday Main Purpose: We are recruiting a software engineer to work directly with traders and research analysts in our trading teams. This role offers the opportunity to work in a fast-paced, data-driven trading environment, collaborating with global teams … in Geneva, Houston, and Singapore. The engineer will be part of the global data science and engineering team responsible for market and fundamental data ingestion, management, modeling, and analytics applications. The software engineer will lead the development of applications and software using modern cloud and technology stacks, building end-to-end software platforms in an innovative … business setting. Knowledge, Skills, Abilities, and Responsibilities: Develop software components, frameworks, and micro-services Build core infrastructure and shared services for DnA applications Create cloud-native big data platforms and analytics solutions Maintain time-critical data pipelines (ETL/ELT) Implement SDLC and agile practices Apply domain-driven design principles Solve problems and automate complex business More ❯

equity strategies across a variety of geographies, investment styles and risk/return profiles. The team is experiencing strong asset and account growth, requiring further investment into people, data, and tools. Quantitative Developer, Investment Management Unit, Quantitative Investment Management, London SEI is seeking to hire a Quantitative Developer to develop, enhance and support platforms and tools that facilitate … SOLID principles, and design patterns where applicable. Enhance and optimize systems for equity factor modelling, portfolio construction, trading, and reporting. Pipelines (20%): Identify and implement performance optimizations for data pipelines and processing workflows. Production (20%): Oversee the maintenance and operational stability of investment process systems and production jobs. Communication (20%): Ensure comprehensive documentation for applications, including system architecture … of experience with SQL, including query optimization and execution plan analysis. Experience with auditing, and CI CD processes, Bitbucket (Github), Team City, setup and create pipelines. Proficiency in data modelling, data management processes, and data profiling. Experience in developing APIs and working with WebSockets. Knowledge of React, Django, FastAPI, or equivalent technologies. Previous experience More ❯

Analytics Engineer (VC Eco-System) Salary: £75K - £90K Location: London - Hybrid (3 days in Farringdon office, 2 days remote) Data Idols are working with a leading UK-based venture capital firm to find an Analytics Engineer who will play a pivotal role in advancing their data origination platform. This platform ingests data from multiple … and helps the investment team identify the most promising early-stage B2B technology businesses. The Opportunity As an Analytics Engineer, you will take ownership of the platform's data pipelines, models, and reporting layers, delivering high-impact insights that directly influence investment decisions. You'll work autonomously to execute a defined roadmap, but also contribute to the longer … thrives in environments where shipping products quickly is valued over building infrastructure for infrastructure's sake. This is an opportunity to shape the future of a high-impact data platform in the VC ecosystem and work directly with decision-makers in a fast-paced, data-driven investment environment. What You'll Be Doing Designing and building More ❯

LOVE using Data Analytics & AI to improve organisational performance, apply now! Lead the Data Analytics team for this large business in Digital Transformation About Our Client This is a well-established public sector organisation based in London, known for its vital role in serving the community. The organisation operates at a significant scale, leveraging data … responsibilities in the role are to: Lead the design, development and continual improvement of the analytics products, with a focus on Oracle Analytics Cloud (OAC)/Oracle Fusion Data Intelligence. Own the product roadmap for analytics, AI and Machine Learning aligning with the Head of Product and peers in Finance, HR, Logistics, Operations and Commercial teams. Manage and … of evidence-based delivery and user-focused design. Engage with stakeholders to understand their analytical needs, translating these into dashboards, reports, and automated solutions. Champion a culture of data governance, literacy, and evidence-based decision-making across the organisation. Analyse user feedback and data to uncover pain points, improve decision-making tools, and maximise the value More ❯

solutions and consultancy projects to clients across a range of sectors (travel, manufacturing, microfinance, engineering, services etc.). Typical responsibilities will include: Manage both scheduled and ad hoc data harvesting processes. Write efficient regular expressions to extract data from raw HTML, JSON, and XML. Clean and validate harvested data using automated processes. Troubleshoot and … resolve complex data processing issues. Maintain and enhance existing data pipelines and services. Improve automation for data processing and delivery. Core Requirements: Solid understanding of HTTP protocols and request/response architecture. Proficiency in writing Regular Expressions for data extraction. Working knowledge of Python, SQL, and either C# or Java. Strong problem … solving and debugging skills. Effective communication skills for understanding project needs and working with the team. Advantageous: Experience with automated data harvesting using Python, C#, or Java. Familiarity with front-end technologies (JavaScript, React). Experience with cloud platforms like AWS or GCP (especially BigQuery). Exposure to Big Data tools such as Elasticsearch. Background in More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and … support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with … the industrial and/or defence sector. The successful candidate must have: SQL technologies skills (e.g. MS SQL, Oracle). noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J). Data exchange and processing skills (e.g. ETL, ESB, API). Development skills (e.g. Python). Big data technologies knowledge (e.g. Hadoop stack). This position offers a lucrative More ❯

Looking for a new challenge? Take a look at our current vacancies. If you see a vacancy that is right for you, we encourage you to apply! Azure Data Engineer Are you passionate about developing and delivering AI and Gen AI based optimizations? Do you enjoy building data pipelines? Contract 12-month FTC, Remote or Hybrid … the Financial Ombudsman Service, is developing and delivering AI and Gen AI based optimizations that provide benefits to the business. The team designs and develops Azure applications and data processing pipelines for various AI projects, as well as working on Gen AI development projects. The AI tech stack we use include: Copilot Studio, D365, M365 Copilot, Agentic workflow … skills and capabilities. You'll have to meet the following minimum criteria: Minimum Criteria At least 2 to 3 years of experience in developing and deploying large scale data transformation/processing pipelines in Azure. Tech stack Azure Data Factory Logic Apps SQL, Cosmos DB Azure Batch, Azure Functions Azure Dev Ops - CI/CD Working More ❯

and push boundaries, then CAVU is the place for you. Together, we can reach new heights. Together, we are CAVU. The role We're looking for a Lead Data Engineer to join our growing tech team. In this senior technical role, you'll lead the design and implementation of scalable data infrastructure and robust ETL pipelines … to enable data-driven decision-making across the business. Working closely with analysts, data scientists, and stakeholders across the business, you'll ensure we extract maximum value from our data assets. You'll be at the heart of our mission to make our global single platform the best in the market - a tech-first … travel. This is a hands-on, delivery-focused leadership role-perfect for someone who thrives on innovation, collaboration, and making things happen. Projects range from client integrations and data warehousing to machine learning and real-time reporting. If you're excited about building systems from the ground up in a supportive, forward-thinking environment, this is your opportunity More ❯

Your new company Working for a globally renowned bank. Your new role You will be working as a Senior Bi Engineer in a newly formed data product team. In this role you will be supporting Front Office operations possessing strong expertise in Power Bi and Data Engineering, with good stakeholder management experience. You will be: Designing … and maintaining Power BI dashboards for trading, risk, and regulatory reporting as well as building data pipelines for real-time financial data. Partnering with the front office to deliver analytics solutions and optimising data models for front office reporting. What you'll need to succeed Strong business intelligence/data engineering experience with strong … Power BI expertise. Data engineering experience building production pipelines - with Databricks Business experience working around the Front Office/Risk is a must! Understanding of regulatory reporting processes. Financial product knowledge e.g. - equities, fixed income, derivatives. Experience on Azure cloud platforms. What you'll get in return Flexible working options available. What you need to do now If More ❯

Project Management, IT, Change & Transformation London Reference: HH/RF-13221 Data Manager (BI) A specialty insurer is seeking a Data Manager (BI) to lead and develop their enterprise data platform. This role involves hands-on technical work combined with leadership responsibilities, focusing on data engineering, BI architecture, and business strategy. You … will collaborate with senior stakeholders and technical teams to deliver scalable data solutions, develop and manage data pipelines, and convert complex requirements into actionable insights, primarily using the Microsoft tech stack. Requirements: Extensive experience with the Microsoft BI stack - SQL Server, Power BI, SSAS, SSIS Solid understanding of data engineering principles, including automated testing More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Scientist to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning, then this could be the perfect opportunity and … the start of something incredible! What will you be doing? As a Mid-Level Data Scientist, you will play a critical role within a multidisciplinary team of data scientists, analysts, and domain experts, developing advanced AI and analytics solutions for the Insurwave platform. This self-sufficient team is responsible for the entire delivery lifecycle—from design … analytics, and model asset behaviour for the commercial insurance market. Responsibilities Design, build, and deploy machine learning models that meet defined performance and business requirements Develop production-ready data science solutions and maintain high-quality, testable code using modern development practices Build and maintain APIs, data pipelines, and automated workflows to support model deployment, monitoring, and More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Scientist to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning, then this could be the perfect opportunity and … the start of something incredible! What will you be doing? As a Mid-Level Data Scientist, you will play a critical role within a multidisciplinary team of data scientists, analysts, and domain experts, developing advanced AI and analytics solutions for the Insurwave platform. This self-sufficient team is responsible for the entire delivery lifecycle—from design … analytics, and model asset behaviour for the commercial insurance market. Responsibilities Design, build, and deploy machine learning models that meet defined performance and business requirements Develop production-ready data science solutions and maintain high-quality, testable code using modern development practices Build and maintain APIs, data pipelines, and automated workflows to support model deployment, monitoring, and More ❯

models, we build the driving intelligence that feeds them. Our mission is to drive safer roads and fairer insurance through data. The Telematics team transforms raw phone sensor data into meaningful insights about how people drive. Using advanced signal processing and machine learning, we process high-frequency data to extract behavioural signals that power our understanding … of driving quality, context, and risk. About the Role As a Senior Data Scientist, you'll help define the future of behaviour-based insurance. You'll own the development of features and algorithms that detect driving patterns from sensors, test new hypotheses, and bring the most impactful insights into production. You'll work at the intersection of data science and engineering, generating scalable, real-world insights from GPS, accelerometer, and other data What you will be doing Design and build robust behavioural features and factors from telematics data. Develop end-to-end pipelines in Python and SQL, from quick heuristics to full ML models. Prioritise simple, robust solutions that scale, whether rule-based or More ❯

Data Engineer – Manchester (Hybrid) Up to £55K to £65,000 + Bonus, 10% pension, 25+ Days HolidayPyspark | Databricks | SQL Shape the future of travel with data. Join a tech-led company that’s reimagining how millions experience travel. This is your chance to work on high-impact data projects that drive smarter decisions across product, operations … and commercial teams — all while growing your skills in a modern, cloud-first environment. Why This Role Stands Out: You’ll build scalable, production-grade data pipelines using PySpark , SQL , and Databricks Your work will directly power analytics, BI, and data science across the business You’ll be part of a collaborative, forward-thinking data … values experimentation and clean engineering You’ll get space to grow, learn new tools, and make a real impact What You’ll Bring: 2–5 years’ experience in data engineering or similar Strong PySpark and advanced SQL skills Hands-on experience with Databricks and building ETL/ELT pipelines Familiarity with CI/CD and version control Bonus More ❯

today and tomorrow's problems with the companies who need their help to do it. AND WITH AI. An opportunity to get your hands down and dirty with data to help companies find the best talent. Specifically focusing on research, innovation, science, and engineering. There is a huge and complex database, using AI to provide quantitative insights that … are unmatched. These insights highlight underrepresented talent, particularly women. Day to day, you'll design and develop data pipelines, ensuring data is clean, transformed, and integrated efficiently into the database. The environment is collaborative, working closely with machine learning engineers and data scientists to facilitate seamless data analysis. You'll work within … a dynamic team to support and enhance our AI-driven talent platform. Your background is in a heavy data environment, with a natural inclination towards statistical analysis. A STEM degree is beneficial but not necessary. You should be comfortable in the cloud, preferably AWS, with good experience building, managing, and enhancing data pipelines. Proficiency in Python More ❯

that handle generative AI inference/training and video/audio processing. Design and implement user interfaces that make complex generative AI capabilities intuitive and accessible. Develop robust data pipelines for ingesting, processing, and storing large-scale media content. Design and maintain database schemas, caching layers, and data storage solutions for multimedia content. Build authentication, authorisation … or other graphics programming technologies. Familiarity with big data technologies (Kafka, Spark, Hadoop) and data engineering practices. Background in computer graphics, media processing, or VFX pipeline development. Experience with performance profiling, system monitoring, and observability tools. Understanding of network protocols, security best practices, and compliance requirements. Open-source contributions or technical writing experience. Entrepreneurial mindset More ❯

Job Title: Data Engineer Location: London (Hybrid - 2 days in office) Type: Full-time Agency: Representing a leading digital media group We're representing a well-established digital media company with a growing portfolio of high-traffic content brands. As they expand their data capabilities, they're looking for a Data Engineer to join … their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources. Automate and optimise workflows using tools like Airflow, dbt, and Spark. Support data modelling for analytics, dashboards, and A/B testing. Collaborate with cross-functional teams to deliver data-driven insights. Work with cloud platforms (GCP preferred) and … A proactive, collaborative approach and strong communication skills. This is a fantastic opportunity to work in a fast-paced, content-rich environment and help shape the future of data in digital publishing. Diversity, equity and inclusion are at the heart of what we value as an organisation. Boston Hale is an equal opportunities employer, and all qualified applicants More ❯