151 to 175 of 978 Data Pipeline Jobs in England

and research across shipping, trade, offshore and energy. Respected worldwide, the Clarksons Research team of over 150 experts provides powerful analysis, insight and data through a range of online platforms, reports, valuations and consultancy work. Clarksons Research is currently offering exciting opportunities for experienced data analysts … of the Clarksons Group, the world’s leading integrated shipping services provider and a FTSE 250 company. Clarksons Research is looking for experienced data analysts that are keen to take responsibility for delivering insights to clients based on wide ranging, interesting data sets using the latest … data science and analytical techniques, and building data pipelines to facilitate analysis. The Role - Use the latest data processing/analysis techniques and visualisation tools to deliver insights and develop an in-depth understanding of a dynamic and fast-paced industry central to the More ❯

care homes, placing independence and community at the heart of what we do. The Opportunity You will be the first person in our data team, giving you complete ownership of our data function. You will lead our data strategy and infrastructure, with the freedom … to start fresh or build on our early efforts. Our data is almost entirely in cloud-based systems (e.g. HubSpot, Xero), which we have begun integrating via Fivetran into a Snowflake data warehouse. We have three data critical systems that do not integrate with … we are open to your expertise. Hybrid role (based Cobham, Surrey & London)Over seven years of operating, we have collected a wealth of data that is just waiting to be fully harnessed. Now, we need you to lead the charge in transforming this data into something More ❯

bring deep domain knowledge to help our clients drive business change and address the most pressing compliance, regulatory, and operational challenges. We provide data-driven, technology-enabled advisory and consulting, implementation, staffing and managed services solutions to the regulatory compliance, risk, financial crimes, and capital markets functions of … Design and implement Databricks-based solutions for managing, processing, and analyzing large datasets within the financial services sector. Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to develop and optimize data pipelines, workflows, and data models. Guide and support the migration of … educational background - Degree in a relevant field. 2+ years of experience working with Databricks in a production environment. Strong background in ETL/ELT pipeline design and implementation within Databricks. Proficiency in SQL, Python, and PySpark for data processing and analysis. Experience with streaming technologies such as More ❯

be the cornerstones of our organization and these values are upheld only because of our people. Role Essential Responsibilities Design and implement Azure data engineering solutions (Ingestion & Curation) Create and maintain Azure data solutions including Azure SQL Database, Azure Data Lake, and Azure Blob … Storage. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations Use Azure Data Factory and Databricks to assemble large, complex data sets Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Ensure data quality/security and compliance. Optimize Azure SQL databases for efficient query performance. Collaborate with data engineers, and other stakeholders to understand requirements More ❯

broking houses and 22 insurers. We're targeting $1B of premium to flow through our Exchange by the end of 2027 . Our data and technical capabilities have grown rapidly to support this ambition. The next challenge is unlocking their full commercial potential by embedding data into sale, account management and trading operations. To do this, we're looking for a Data Product Manager (DPM) with fintech, InsurTech, or scale-up experience to help transform strong analytical foundations into commercially impactful products. This role will sit at the intersection of data … DPM will champion product thinking and execution velocity, ensuring we focus on high-impact initiatives that accelerate GWP growth, improve indexation, and make data an indispensable part of our go-to-market engine. Responsibilities Productise Data to drive GWP growth Own and develop data More ❯

Data Architect Salary: £80-£90,000 plus generous bonus & benefits package Location: London, Hybrid (weekly onsite days) Position: Permanent Are you ready to join a leading organisation dedicated to creating experiences for customers across the globe? With an established history and a commitment to creativity and cutting-edge … technology, they are seeking an experienced Data Architect to come in and design, build and enhance data products. As a Data Architect, you will work alongside teams such as Product, Data Engineering/Analytics and Business Stakeholders to design data solutions that enable the business to analyse and report more accurately and lead to improved decision making. Key Responsibilities as a Data Architect: Create and update an architectural vision and roadmap for data products. Define the structure, flow and integration of data More ❯

Data Architect Salary: £80-£90,000 plus generous bonus & benefits package Location: London, Hybrid (weekly onsite days) Position: Permanent Are you ready to join a leading organisation dedicated to creating experiences for customers across the globe? With an established history and a commitment to creativity and cutting-edge … technology, they are seeking an experienced Data Architect to come in and design, build and enhance data products. As a Data Architect, you will work alongside teams such as Product, Data Engineering/Analytics and Business Stakeholders to design data solutions that enable the business to analyse and report more accurately and lead to improved decision making. Key Responsibilities as a Data Architect: Create and update an architectural vision and roadmap for data products. Define the structure, flow and integration of data More ❯

Snowflake Data Engineer I am working with a hugely successful organisation based in Leeds who are looking for a Snowflake Data Engineer to join their newly formed data practice. You will join a business to work on their exciting Greenfield data platform … project, where you will have the opportunity to create the data warehouse from scratch and shape the ongoing direction of the data platform. You will work to build and maintain a robust and scalable data platform and will support the organisation's BI and … analytics goals. You will work closely with developers to transform data ready for reporting purposes to deliver accurate information to key business stakeholders. As part of this role you will be responsible for - Design and develop data pipelines ensuring the successful integration of data More ❯

Snr Data Engineer - Global Accounts, Professional Services, AWSI-SDT-APJ-Japan Our AWS Professional Services consultants deliver IT infrastructure and application architecture guidance, lead proof-of-concept projects, perform enterprise portfolio assessments, review operational best practices and conduct skills transfer workshops. AWS consultants collaborate with customers and partners … to address security and compliance, performance and scale, availability and manageability. They advise customers on data platforms using the full range of AWS services. They also assist with the non-technical change management work on policies, processes and people changes. At AWS, we're looking for technical architects … tools and SQL Experience leading large-scale data warehousing and analytics projects, including using AWS technologies - Redshift, S3, EC2, Data-pipeline and other big data technologies Linux/UNIX including to process large data sets Our inclusive culture empowers Amazonians to More ❯

Join Our Team as an Analytics Engineer! Are you passionate about turning complex data into actionable insights? Do you thrive on solving problems and enabling data-driven decision-making in the dynamic world of payments? If so, we want to hear from you! As anAnalytics Engineerspecializing … in the payments space, you'll be at the forefront of analysing payment transaction data, uncovering trends, and optimizing card issuance operations. Your work will directly shape strategic initiatives and improve business outcomes. Key Responsibilities Analyze large datasets related to payment processing and customer transactions to uncover trends … and actionable insights. Develop dashboards and reports to track KPIs and support decision-making. Work with stakeholders to understand data needs and provide insights through presentations and reports. Deliver data-driven recommendations to support business objectives. Build and optimize data pipelines using dbt, ensuring More ❯

Data Engineer - Global Accounts, Professional Services, AWSI-SDT-APJ-Japan Job ID: Amazon Web Services Japan GK Our AWS Professional Services consultants deliver IT infrastructure and application architecture guidance, lead proof-of-concept projects, perform enterprise portfolio assessments, review operational best practices and conduct skills transfer workshops. AWS … consultants collaborate with customers and partners to address security and compliance, performance and scale, availability and manageability. They advise customers on data platforms using the full range of AWS services. They also assist with the non-technical change management work on policies, processes and people changes. At AWS … tools and SQL Experience leading large-scale data warehousing and analytics projects, including using AWS technologies - Redshift, S3, EC2, Data-pipeline and other big data technologies Linux/UNIX including to process large data sets. Our inclusive culture empowers Amazonians to More ❯

We are looking for a Senior Data Engineer, to collaborate closely with our business and engineering teams to design, implement, and maintain data engineering solutions while ensuring security and data best practices. You will work need to be able to work independently and will … engineers. Experience of working within the Insurance/Insurtech/Payments sector would be highly advantageous. Duties & Responsibilities: Design, build, and maintain scalable data pipelines for batch and real time data handling large volumes of structured and unstructured data. Develop, enhance, and optimize ELT processes to … ingest, transform, enrich and publish data. Build quality, trusted, secure data products for consumption in reporting, analytics and science. Optimise data pipelines and queries for better performance and cost-efficiency. Integrate data pipelines with monitoring and observability to proactively detect and resolve issues before More ❯

We are looking for a Senior Data Engineer, to collaborate closely with our business and engineering teams to design, implement, and maintain data engineering solutions while ensuring security and data best practices. You will work need to be able to work independently and will … engineers. Experience of working within the Insurance/Insurtech/Payments sector would be highly advantageous. Duties & Responsibilities: Design, build, and maintain scalable data pipelines for batch and real time data handling large volumes of structured and unstructured data. Develop, enhance, and optimize ELT processes to … ingest, transform, enrich and publish data. Build quality, trusted, secure data products for consumption in reporting, analytics and science. Optimise data pipelines and queries for better performance and cost-efficiency. Integrate data pipelines with monitoring and observability to proactively detect and resolve issues before More ❯

a real impact in the financial services industry, we would love to hear from you. About this role We are seeking a skilled Data Engineer - Data Lakehouse to join our team. The ideal candidate should be experienced in designing and building data pipelines, performing … ETL operations, and managing databases. The candidate will also need to have knowledge and experience in using AWS services for data processing, storage, and analysis. Responsibilities Design, build and maintain efficient and scalable data pipelines to support data processing and analysis. Develop and implement … ETL processes to ensure data quality and integrity. Manage and optimize databases, including designing schema and indexing strategies, data partitioning and data archival. Work closely with data scientists and business analysts to understand data requirements and translate them into technical More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and enhancing real-time reporting. … At Dufrain we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have a great opportunity for a … engineering experience. Strong understanding of SQL and NoSQL databases, SQL, CosmosDB and Kusto Query Language (KQL). Solid experience of data pipeline development using both cloud and on-premises data sources. Excellent problem-solving, analytical, and communication skills. Strong desire to learn and adapt More ❯

About The Role We have an exciting opportunity for a Lead Data Engineer to join our fast-growing team and support us in building the next generation of data infrastructure that will power our growth. As Lead Data Engineer, you will lead the development … of data pipelines across NHS Professionals (NHSP) with your extensive experience architecting enterprise data solutions on Azure cloud platform and SSIS. You can demonstrate deep expertise in designing and implementing ETL pipelines using Azure services (Synapse Analytics, Data Factory, Data bricks, and … SQL Database) and SSIS package development. You should have a proven track record of leading teams, migrating legacy systems to cloud, implementing data governance, and optimizing costs. You have high proficiency in SQL, Python, Spark, and SSIS scripting, along with 6+ years of hands-on data More ❯

Job Title: Data Lead 💰 Salary: up to ~£110k + very generous equity ( of the same value as your salary !) 🌴 Benefits include : unlimited AL, 2 company trips/year, contribution towards your own holiday 📍 Location: Shoreditch (2 office days/week) 💵 Industry: FinTech/Payments Company overview Having raised … company is causing the biggest change to how businesses access card payments in over two decades. Role overview As the company's first data hire , you’ll be tasked with designing, building and owning their data stack. You’ll also be responsible for applying your expertise … in quantitative analysis to understand how their users behave. Your insights will feed into data products that you’ll own, as well as into the wider product strategy. Reporting directly to the CTO/founder and working alongside the founding employees, you'll have a huge impact on More ❯

Job Title: Data Lead 💰 Salary: up to ~£110k + very generous equity (of the same value as your salary!) 🌴 Benefits include : unlimited AL, 2 company trips/year, contribution towards your own holiday 📍 Location: Shoreditch (2 office days/week) 💵 Industry: FinTech/Payments Company overview Having raised … company is causing the biggest change to how businesses access card payments in over two decades. Role overview As the company's first data hire, you’ll be tasked with designing, building and owning their data stack. You’ll also be responsible for applying your expertise … in quantitative analysis to understand how their users behave. Your insights will feed into data products that you’ll own, as well as into the wider product strategy. Reporting directly to the CTO/founder and working alongside the founding employees, you'll have a huge impact on More ❯

Data Engineer (SQL/AWS/Python or Java) Remote-first/London HQ - £50-70K + enhanced benefits Our client is focused on transforming their investment banking niche by providing a single global solution that replaces legacy technology and systems. They are seeking a skilled Data Engineer to join their team. The ideal candidate should be experienced in designing and building data pipelines, performing ETL operations, and managing databases. The candidate will also need to have knowledge and experience in using AWS services for data processing, storage, and analysis. Qualifications … Bachelor's degree in computer science, engineering or related field. Minimum of 3 years of experience in data engineering roles. Strong proficiency in SQL, ETL processes and database management systems (e.g., MySQL, PostgreSQL, MongoDB). Hands-on experience with AWS services for data processing, storage and More ❯

Data Lead Senior Data Engineer/Scientist Judge.me Role: Data Lead Senior Data Engineer/Scientist Location: Remote with hybrid option (2 days in Shoreditch office near Old Street) Salary: £90-115k (includes comprehensive benefits package) Our Mission: Fixing Trust in … digital interfaces separate buyers and sellers, we're building the definitive trust infrastructure that enables global trade to flourish. The Opportunity As our Data Lead, you'll lead the development of our Trust Optimisation Platform-a critical initiative to unlock insights from our vast review dataset to help … data into actionable merchant insights NLP/ML Development : Create models that analyse review content, identify trust patterns, and establish merchant benchmarks Pipeline Architecture : Build scalable systems that efficiently process our extensive review and merchant data Cross-Functional Collaboration : Work with product and design teams More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap … to maximize long-term business value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap … to maximize long-term business value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and More ❯

our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec's new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with … others passionate about solving business problems. Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management … data architectures, such as Corporate DataLake, Medallion Architecture, Metadata Driven Platform, Event-driven architecture. Proven experience of ETL/ELT, including Lakehouse, Pipeline Design, Batch/Stream processing. Strong working knowledge of programming languages, including Python, SQL, PowerShell, PySpark, Spark SQL. Good working knowledge of data More ❯

retail and institutional entities globally, monitoring over a trillion events each day. The Role We're looking for a strong Software Engineer with Data Engineering experience. Someone proficient in building robust, scalable, maintainable, and thoroughly monitored data pipelines on cloud environments. As a young and ambitious … ingestion and transformation from various sources. Enrich financial data through third-party data integrations. Maintain our data pipeline primarily written in Java and running on K8S within a micro-service architecture. Coordinate with other teams to ensure seamless data integration … university or equivalent. At least 2+ years of experience with Java as a software engineer. Over 5 years in data engineering and pipeline development in high-volume production environments. Experience with monitoring systems such as Prometheus, Grafana, Zabbix, or Datadog. Experience in fintech or trading industries. Strong More ❯

hire an enthusiastic and talented mid-weight PHP developer to join our tech team and help us further develop our data processing pipeline and web platforms. We deploy daily, and you'll be making changes customers can see from day one. Some key projects on our roadmap … legacy code to Laravel and React, and working with our data team to integrate machine learning models into our data pipeline and front end. You'll be joining us at an exciting stage of development, and there'll be lots of opportunities to try out … to search them through the web app. The majority of our code is written in PHP, but some parts of the data pipeline are written in Python, which is what we use for our data science work. We need you to be familiar with PHP More ❯