701 to 725 of 1,495 Data Pipeline Jobs in England

PySpark Data Engineer | up to £450/day Inside | Remote with occasional London travel We are seeking a PySpark Data Engineer to support the development of a modern, scalable data lake for a new strategic programme. This is a greenfield initiative to replace fragmented legacy reporting solutions, offering the opportunity to shape a long … term, high-impact platform from the ground up. Key Responsibilities: * Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices … delivery workflows. * Manage configurations and workflows using YAML, Git, and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage More ❯

PySpark Data Engineer | up to £450/day Inside | Remote with occasional London travel We are seeking a PySpark Data Engineer to support the development of a modern, scalable data lake for a new strategic programme. This is a greenfield initiative to replace fragmented legacy reporting solutions, offering the opportunity to shape a long … term, high-impact platform from the ground up. Key Responsibilities: * Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices … delivery workflows. * Manage configurations and workflows using YAML, Git, and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage More ❯

Data Engineer with 1-3 years experience gained in a Hedge Fund, Investment Bank, FinTech or similar sought to join a market-leading Quantitative Hedge Fund. You will join a 5-strong Data Engineering team covering the ingestion, storage, transformation and distribution of tick, timeseries, reference and alternative datasets. The technology stack is similarly varied including … a range of legacy and modern systems, across on-premises and cloud infrastructure with technologies and tooling such as Python, dbt, KDB+, Snowflake, SQL and interfacing with Market Data vendors such as Bloomberg, Refinitiv, Factset and MorningStar. This is an exciting time for you to join the team they consolidate our technology estate, revamp how they process and … filter data, and overhaul the way data is accessed by their consumers, while continuing to onboard new datasets that enhance their strategies. They are a lean team owning end-to-end delivery from initial design through to operational support in production. The firm work on a hybrid working schedule, with a minimum of three-days-per More ❯

deep technical expertise. Using your strong Python backend skills, you'll create intuitive tools that enable non-technical users to build robust MLOps pipelines, focusing on platform maturation, data scale, quality, and automation. Working alongside experienced senior engineers, you'll bring a data engineering mindset to the team, building sophisticated systems that parallel orchestration tools like … Airflow or Temporal. Rather than creating individual pipelines, you'll develop the frameworks and tools that allow users to create their own pipelines efficiently, while advocating for data engineering best practices across the team. As a key member of our engineering team, you'll shape the future of our platform's data capabilities during a crucial … growth phase. Success in this role means creating robust, user-friendly systems that democratize data engineering, allowing our clients to build and maintain sophisticated data pipelines without requiring deep technical expertise. What would set you up for success coming into this role: You have a minimum of seven years experience working in Software Engineering, with at More ❯

A leading, technology-focused, multi-strategy Hedge Fund are seeking a Senior Data Engineer (Front Office) to join their innovative and highly experienced team Essential Skills: 5+ years of experience with a proven track records of building data platforms Expert-level Python and SQL skills (C++ experience is a plus, but not essential) Interest in contributing … merging technology and research to solve some of the most complex challenges and deliver high-quality returns. This flexible role (2 days WFH) involves building and supporting bespoke data solutions for Quants and Traders, and developing a scalable, global Data Lakehouse used by multiple trading desks. You’ll design and implement data pipelines in … Python within an AWS cloud environment, working on data modelling for large-scale Data Lake and OLAP systems. Key responsibilities will include optimising performance in cross-region setups, ensuring data completeness and quality, and contributing to the software and infrastructure design. This intellectually stimulating and fast-paced role provides a unique opportunity to work More ❯

A leading, technology-focused, multi-strategy Hedge Fund are seeking a Senior Data Engineer (Front Office) to join their innovative and highly experienced team Essential Skills: 5+ years of experience with a proven track records of building data platforms Expert-level Python and SQL skills (C++ experience is a plus, but not essential) Interest in contributing … merging technology and research to solve some of the most complex challenges and deliver high-quality returns. This flexible role (2 days WFH) involves building and supporting bespoke data solutions for Quants and Traders, and developing a scalable, global Data Lakehouse used by multiple trading desks. You’ll design and implement data pipelines in … Python within an AWS cloud environment, working on data modelling for large-scale Data Lake and OLAP systems. Key responsibilities will include optimising performance in cross-region setups, ensuring data completeness and quality, and contributing to the software and infrastructure design. This intellectually stimulating and fast-paced role provides a unique opportunity to work More ❯

Data Engineer – Leeds– SQL | Power BI | Azure | ETL Ready to drive innovation with T-SQL and BI, shaping a cutting-edge data platform? Do you have the expertise to build and maintain complex data warehouses and Power BI solutions? Excited to solve BI challenges and support data-driven decision-making across the … business? A fantastic new opportunity has arisen with a professional services company for an experienced Data Engineer. You'll be joining a growing team with offices across the UK, committed to ambitious growth and employee wellbeing. This role is based in their Leeds office, offering hybrid working. What's in it for you? Salary up to … Factory to ensure the warehouse can support large-scale reporting and analytics needs. Your T-SQL expertise will be crucial for managing complex queries and troubleshooting data pipeline issues. Key Skills: SQL/T-SQL Power BI or Tableau Experience with data warehousing and ETL/ELT processes Azure If you're passionate about shaping More ❯

purpose is to radically accelerate the clean-energy revolution - starting withsmarter, safer, and more efficient homes.We're focused on improving experiences for people through the application of technology, data, and a deep understanding of human behaviour. Why? As a society, we need to decarbonise and accelerate the transition to alternative energy sources. Existing solutions are expensive and disparate … and puts people at its core, then we'd love to hear from you! The Role We're looking to grow our quality and test coverage in our data space. In this Intermediate-Senior role,you'll be helping us to implement processes, architectures and test coverage for validating our data backend with your excellent software … skills and guidance. We have an existing small team working and building the data backend and we need a QA engineer to work with the team to verify and validate this part of our product. Some of the things that you might be involved in include: Lead Data Quality Assurance: Develop and implement comprehensive testing for More ❯

Mid-Level Data Engineer London - 4 Days on-site £50,000 - £70,000 DOE + Equity + Unlimited Annual Leave This is an excellent opportunity for a Junior Data Engineer to join a rapidly growing start-up offering great progression and the chance to further enhance your skills. This company is a platform designed to simplify … businesses with skilled professionals for short-term staffing needs, this innovative solution optimises workforce efficiency. In this varied role you will be responsible for building and maintaining scalable data pipelines for data integration into customer-facing mobile and web apps, as well as internal dashboards. Responsibilities include designing and implementing data architecture to optimise … data storage, retrieval, and processing, alongside developing ETL processes to ingest, transform, and load data from various sources, particularly APIs. The ideal candidate will possess strong foundations in data architecture with a degree in a relative subject or industry experience. Scalable data solutions, coupled with a solid understanding of data More ❯

We’re hiring: Data Engineer | Cloud-first | SQL + Python | AWS At Reward, data is at the core of everything we do — from powering real-time insights to driving smarter customer loyalty. As we scale globally, we’re on the lookout for a curious, driven Data Engineer to help us shape the future of … our data platform. 💡 What you’ll be doing: Building and optimising data pipelines in a cloud-first environment (AWS) Collaborating with business stakeholders (tech & non-tech) to deliver smart, scalable reporting and data solutions Migrating and modernising ETL processes and data warehouses for reporting and monetisation Creating well-documented, efficient code in … SQL and Python Implementing QA processes and supporting the business with both regular and ad hoc data deliverables 🛠 Tech you’ll work with: SQL Server (SSIS, SSRS, SSAS) Python AWS stack – Glue, Lambda, S3, EC2, Jupyter Power BI or Tableau (bonus) Excel (PowerPivot, VBA, lookups, advanced formulas) 🌱 You’ll also: Collaborate closely with our Data Engineers More ❯

We’re hiring: Data Engineer | Cloud-first | SQL + Python | AWS At Reward, data is at the core of everything we do — from powering real-time insights to driving smarter customer loyalty. As we scale globally, we’re on the lookout for a curious, driven Data Engineer to help us shape the future of … our data platform. 💡 What you’ll be doing: Building and optimising data pipelines in a cloud-first environment (AWS) Collaborating with business stakeholders (tech & non-tech) to deliver smart, scalable reporting and data solutions Migrating and modernising ETL processes and data warehouses for reporting and monetisation Creating well-documented, efficient code in … SQL and Python Implementing QA processes and supporting the business with both regular and ad hoc data deliverables 🛠 Tech you’ll work with: SQL Server (SSIS, SSRS, SSAS) Python AWS stack – Glue, Lambda, S3, EC2, Jupyter Power BI or Tableau (bonus) Excel (PowerPivot, VBA, lookups, advanced formulas) 🌱 You’ll also: Collaborate closely with our Data Engineers More ❯

We’re hiring: Data Engineer | Cloud-first | SQL + Python | AWS At Reward, data is at the core of everything we do — from powering real-time insights to driving smarter customer loyalty. As we scale globally, we’re on the lookout for a curious, driven Data Engineer to help us shape the future of … our data platform. What you’ll be doing: Building and optimising data pipelines in a cloud-first environment (AWS) Collaborating with business stakeholders (tech & non-tech) to deliver smart, scalable reporting and data solutions Migrating and modernising ETL processes and data warehouses for reporting and monetisation Creating well-documented, efficient code in … SQL and Python Implementing QA processes and supporting the business with both regular and ad hoc data deliverables Tech you’ll work with: SQL Server (SSIS, SSRS, SSAS) Python AWS stack – Glue, Lambda, S3, EC2, Jupyter Power BI or Tableau (bonus) Excel (PowerPivot, VBA, lookups, advanced formulas) You’ll also: Collaborate closely with our Data Engineers More ❯

use cutting-edge technology to link our clients' systems, departments and sites. We provide an open technology platform that's shaping the industry for the future. We use data to help clients become more efficient, increase profitability and give more customers an amazing experience. Want to be part of it? Position Summary We are hiring a AI & Data Science Lead to head our AI Centre of Excellence. This role consolidates responsibilities across Generative AI (GenAI) , traditional Machine Learning (ML) , and early-stage Data Science . You will shape and deliver the technical strategy for our AI initiatives, while also acting as a hands-on engineer, mentor, and leader. You will be responsible for delivering … high-impact GenAI use cases, establishing core AI platform capabilities, supporting a Machine Learning Engineer on classical ML projects, and building the foundation for a future Data Science function. You will also define LLMOps and MLOps practices and ensure the infrastructure is in place to support long-term AI success across the business. Key Responsibilities: Strategy & Leadership Collaborate More ❯

Are you a talented Data Scientist looking for a new challenge? Be part of the engine room team within an established business with the financial support of a FTSE listed organisation. Our client is a leading IT solutions provider who are going through exciting and promising times, and this Data Scientist role will allow you to … become a key contributor to future business changes. You will receive coaching and mentorship to support your growth, so that you can perform at your best. In this Data Scientist role, you will be analsying and identifying insights, developing and deploying data-driven solutions, and building and maintaining data pipelines. The key skills required … for the Data Scientist role are: A strong education foundation from a Bachelors or Masters degree in Engineering/Statistics/Mathematics/Computer Science/Finance Experience of working in a Data Scientist role for 1+ years Experience with PowerBI/Qlik or similar style technologies for building pipelines for visualisation Experience working with SAP More ❯

Data Analyst 📍 West London (3 days a week on-site) 💸 £55,000 – £60,000 About the Company A leading name in the UK property sector is on the hunt for a mid-level Data Analyst to join their growing data team. With a strong foundation in Business Intelligence and a forward-thinking approach to … tech, this company has spent the last five years investing heavily in their data infrastructure and are now gearing up to take things even further — including AI implementation over the next 6–12 months. 🚀 They're working on internal data projects with real commercial impact and are looking for someone who can not only crunch the … numbers, but also tell the story behind them. The Role You’ll take the lead on key analytics initiatives, working end-to-end across data pipelines, visualisation, and stakeholder communication. It’s a hands-on role with plenty of variety — perfect for someone who enjoys making sense of messy data and translating that into insight that More ❯

Job Profile We are seeking a highly experienced and strategic Principal Product Manager - Data Science & Machine Learning to drive the vision, strategy, and execution of AI/ML-powered products. You will work closely with data scientists, engineers, and cross-functional teams to build scalable machine learning solutions that enhance user experience and drive business impact. … FLIGHT CREW, EMPLOYEES and Members, while fostering a culture of innovation and excellence. Your Responsibilities Define and own the product vision, strategy, and roadmap for machine learning and data science initiatives. Collaborate with engineering and data science teams to develop and deploy scalable AI/ML models. Identify customer and business problems that can be addressed … related field; MBA or relevant advanced degree is a plus. 8+ years of experience in product management, with at least 3 years focused on AI/ML or data science products. Strong understanding of machine learning concepts, data pipelines, and AI-driven applications. Experience working closely with data science and engineering teams to bring More ❯

Principal Data Engineer Department: Intel Employment Type: Permanent Location: Newcastle-upon-Tyne Reporting To: Head of Data Description We're looking for a Principal Data Engineer to join the team responsible for delivering trusted, high-quality data products that power decisions across Bede. Reporting to the Head of Data, you … ll be a respected technical authority, owning the design, integrity, and ongoing improvement of our data architecture. You'll set the standard for engineering excellence in your product area, guiding teams on best practices, system health, documentation, and long-term technical direction. This is a high-impact role suited to someone who thrives on solving complex problems, collaborating … across disciplines, and shaping scalable, resilient data platforms. This is a hybrid role that requires you to be in our Newcastle-upon-Tyne office two days a week. Please apply only if you're comfortable with this arrangement. What you'll be doing Core Responsibilities Own and evolve the technical roadmap for the data product area More ❯

Certifications That Can Boost Your Data Science Career in 2024 In today's data science landscape, how does one set themselves apart from the competition? Let's take a look at seven of the best certifications out there. In today's data science landscape, how does one set themselves apart from the competition? Certifications … in data science can greatly enhance your career by proving your skills and creating new job opportunities in 2024. Data science certificates help to gain knowledge about data science. They also help to validate our skills in this field. Let's take a look at some of the best certifications out there. Certified Analytics … write this exam. A master's degree and three years of experience or seven years of non-analytics experience are also sufficient. The exam includes topics such as data preparation and model building. Cost: $375 for members, $575 for non-members Validity: 3 years Google Certified Professional Data Engineer The Google Certified Professional Data More ❯

We're Hiring: Senior Data Analyst | Fully Remote (UK) | Google-Partnered Consultancy Are you a data-driven thinker with a passion for building scalable, insightful solutions? Want to join a remote-first company where innovation, flexibility, and professional growth are part of everyday life? We’re representing a Google-partnered data consultancy going through … an exciting period of growth following a string of recent client wins. To support their expanding project portfolio, we’re looking for an experienced Senior Data Analyst to help them deliver top-tier data solutions that make a real impact. 🌍 About The Client As a specialist consultancy at the forefront of the modern data … reusable business logic. Writing clean, high-performance SQL to support data transformation and reporting. Working closely with Data Engineers to ensure smooth data pipeline operations and integrations. Translating business needs into technical solutions that deliver real value. Supporting dashboard creation and analytics tools to provide clear, actionable insights. Promoting data quality More ❯

We're Hiring: Senior Data Analyst | Fully Remote (UK) | Google-Partnered Consultancy Are you a data-driven thinker with a passion for building scalable, insightful solutions? Want to join a remote-first company where innovation, flexibility, and professional growth are part of everyday life? We’re representing a Google-partnered data consultancy going through … an exciting period of growth following a string of recent client wins. To support their expanding project portfolio, we’re looking for an experienced Senior Data Analyst to help them deliver top-tier data solutions that make a real impact. 🌍 About The Client As a specialist consultancy at the forefront of the modern data … reusable business logic. Writing clean, high-performance SQL to support data transformation and reporting. Working closely with Data Engineers to ensure smooth data pipeline operations and integrations. Translating business needs into technical solutions that deliver real value. Supporting dashboard creation and analytics tools to provide clear, actionable insights. Promoting data quality More ❯

Sr. Data Scientist, WW Insurance & Claim Job ID: Services LLC The DSP (Delivery Service Partner) Offer & Expansion team is part of the Last Mile Product and Technology organization and is responsible for designing, launching, and managing the strategy of the Delivery Service Partner (DSP) program around the world across all of its various use cases. As a critical … member of the actuarial data science team, this position will be responsible for driving our capabilities around pricing, performance drivers, and portfolio economics. You will work backwards from business problems to create models and solutions to define the pricing and structure of our global product offerings. Partnering with our single-threaded leader product leads, help to develop and … Create comprehensive economic analyses to inform strategic product decisions Design and implement advanced statistical methodologies to evaluate and optimize product offerings Collaborate with product leads to translate complex data insights into actionable business strategies Build robust monitoring processes to track market dynamics and competitive intelligence A day in the life Your day will be a dynamic blend of More ❯

Location: London About RAPP We are RAPP - world leaders in activating growth with precision and empathy at scale. As a global, next-generation precision marketing agency we leverage data, creativity, technology, and empathy to foster client growth. We champion individuality in the marketing solutions we create, and in our workplace. We fight for solutions that adapt to the … individual's needs, beliefs, behaviours, and aspirations. We foster an inclusive workplace that emphasizes personal well-being. Role Are you a data scientist eager to broaden your impact across the full stack of data science? Do you enjoy fast-paced environments, wearing multiple hats, and turning ideas into production-ready solutions? At RAPP, we're looking … for a Data Scientist with a growth mindset, a generalist toolkit, and an appetite to grow within a world-class marketing agency. You'll work alongside senior data scientists, engineers, strategists, and creatives to design, build, and deploy models that make a real difference for global clients like Ralph Lauren, KFC, and Mercedes. This role is More ❯

risk. As part of the Moody's Insurance Solutions Graduate Program, you'll work with the people, teams, and companies leading the way in the use of models, data, analytics, and technology to derive relevant insights across the insurance lifecycle. Our insurance customers use our models, data, analytics, and technology to assess catastrophe, climate, actuarial, economic … part of this mission you are crucial to our future, and we are committed to supporting yours as well. Skills and Competencies: Applied experience collecting, processing, and using data to solve a problem or answer a question. Working knowledge of a computer programming language (examples include SQL, R/tidyverse, Python, Microsoft Excel, Julia, and Fortran) with an … the Re/Insurance business domain/catastrophe modeling, Database management/working with relational databases (SQL), Moody's RMS products (e.g. RiskLink, Risk Modeler, Intelligent Risk Platform), Data engineering, data analytics, data science, using a programming language, Collaborative code development using version control software (e.g., GitHub), Kubernetes. Education: Bachelor's/undergraduate degree. More ❯

mission dedicated to driving positive change. Read on to learn more about the opportunity and how you can have a positive impact! About the Role The Insight and Data team is a recently formed team focusing on analytics, data extraction, transformation, and load, as well as governance and stewardship. The team is primarily responsible for enabling … access to all data within EcoOnline rapidly and consistently to end users as well as ensuring data governance is implemented and data quality is properly monitored and improved over time. The Insight and Data team is involved in some of our largest systems initiatives, ensuring data is considered often, and … as a priority as we continue to scale our business. This is an opportunity to join a fast moving team building out data infrastructure from scratch and establish best practice methodology for ETL and data consumption at a global company that is quickly growing. Key Responsibilities: Oversee a team of 2 ETL Developers to ensure all More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Scientist to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning, then this could be the perfect opportunity and … the start of something incredible! What will you be doing? As a Mid-Level Data Scientist, you will play a critical role within a multidisciplinary team of data scientists, analysts, and domain experts, developing advanced AI and analytics solutions for the Insurwave platform. This self-sufficient team is responsible for the entire delivery lifecycle—from design … analytics, and model asset behaviour for the commercial insurance market. Responsibilities Design, build, and deploy machine learning models that meet defined performance and business requirements Develop production-ready data science solutions and maintain high-quality, testable code using modern development practices Build and maintain APIs, data pipelines, and automated workflows to support model deployment, monitoring, and More ❯