101 to 125 of 702 Data Pipeline Jobs in England

Our Commodities and Global Markets data analytics team within technology is building a leading data and analytics platform. We partner and build batch and real-time analytics solutions for traders, quants, desk analysts, and central data teams across the business. At Macquarie, our advantage is bringing together diverse people and empowering them to shape … ll be part of a friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes. What role will you play? As a Senior Data Engineer, you will work with traders, quants, desk analysts, and central data teams to provide data and analytics solutions across our Commodities and Global Markets … business lines. You will provide technical direction and be hands-on with the development of data analytics capabilities such as the evolution of our data pipeline architecture, data science workbench, visualisation tools, and real-time analytics. Your role will involve working with our public-cloud-based data lake, data More ❯

Are you a Data Engineer who would like to work with Microsoft Fabric supporting a companys digital transformation by building robust and scalable data infrastructure? Our client will move from legacy to Microsoft Fabric with OneLake, Azure Data Factory and Azure Data Lake and you can be a key part of this … move. THE OPPORTUNITY In this role of Data Engineer, youll ensure data is efficiently collected, transformed, and made available for analytics and decision-making across the business. To do this role, youll: Liaise with the business to understand data requirements and define data needs. Identify the data then design and … maintain data pipelines using Microsoft Fabric (OneLake etc) and Azure Data Factory that integrate to other applications including ERP. This data will be provided to a BI Analyst to create dashboards etc with Power BI. Integrate data from various applications such as ERP, IoT devices and external sources Implement data More ❯

About Us Makutu designs, builds and supports Microsoft Azure cloud data platforms. We are a Microsoft Solutions Partner (Azure Data & AI) and are busy building a talented team with relevant skills to deliver industry leading data platforms for our customers. The Role The Data Engineer role is key to building and growing … technical team at Makutu. The role will provide the successful applicants with the opportunity for significant career development while working with a range of large businesses to whom data is critical to their success. Working as part of the team and with the customer, you'll require excellent written and verbal English language and communication skills. Big growth … plans are in place to build a broader and deeper technical capability with a focus on the Microsoft Azure technology stack. The position of Data Engineer is a key role in the wider capability of our team. Occasional visits to our Head Office and customers sites will be required. Key responsibilities: Identify, design, and implement working practices across More ❯

employee exit rate is astonishingly low. Join us on our journey Let's create something awesome, together, today. About the role and team: We're looking for a Data Engineer to join our growing Data Practice. You'll work as part of a multidisciplinary team … delivering data solutions for some of the UK's best-known brands. You'll have a hand in everything from data ingestion and transformation to pipeline automation and data platform optimisation - always with a strong focus on quality, scalability, and value. What you'll be doing: Designing, building and maintaining robust, cloud-native … deliver value-focused data solutions We'd love to talk to you if: You've got solid experience working with Python, SQL, Spar and data pipeline tools such as dbt or Airflow You're comfortable working across cloud platforms - especially AWS (Glue, Lambda, Athena), Azure (Data Factory, Synapse), or GCP (Dataflow, BigQuery, Cloud More ❯

Additional Job Description As a Product Taxonomy Lead at Barclays, you will be at the forefront of designing and delivering enterprise-grade data solutions that support Product Taxonomy adoption across front-to-back processes, regulatory reporting, and business insights. This role sits at the intersection of data architecture, data analytics, and regulatory transformation, ensuring … that product taxonomies, data structures, and analytical frameworks are aligned with both operational execution and strategic goals. To be successful as a Product Taxonomy Lead, you should have experience … with: Deep understanding of investment banking products and its application in regulatory and operational contexts. Strong technical expertise in data modelling, logical design, and data pipeline development. Familiarity with reference and master data management Proven experience in data architecture, data analytics, or engineering within financial services or investment banking. More ❯

Job Title: AWS Data Engineer Contract: 6 Months Location: Remote, UK Skills: Advanced knowledge of data management tools including SQL/DBMS, MongoDB, Hadoop and/or other big data technologies. Advanced programming skills in Java, Python, R, C++, C#, etc. Knowledge of statistical and data mining techniques (regression, decision trees, clustering … neural networks, etc.). Experience with data visualization tool is plusExposure to online, mobile, and social data is a plus. Intellectual curiosity, along with excellent problem-solving and quantitative skills, including the ability to disaggregate issues, identify root causes and recommend solutions. Ability to independently own and drive model development, balancing demands and deadlinesStrong people skills … a deep understanding of industry dynamics and corporate functions to help clients create the most value from data. Must Have: Enterprise Knowledge Data Management, Data pipeline, Python, SQL, AWS Centralising data stored in RDBMS, Data Ingestion, and Uploading data into the database. Education: Bachelor's degree in quantitative field More ❯

Job Title: Data Analyst - Data Engineering Location: Remote/Reading, UK (Hybrid - Office & Remote) Type: 12 months Fixed-Term Contract (FTC) Our client is a market leader in land and property data solutions across the UK, empowering the property sector with powerful digital tools and data-driven insights. From government bodies and … legal firms to mortgage providers and environmental consultants, their work is transforming how land information is accessed and utilised nationwide. We're now looking for a talented Data Analyst to join their Data Engineering team, contributing to a high-profile national digital transformation programme. If you're passionate about uncovering insights from complex datasets and thrive … to define data needs and deliver insights. Build dashboards and reports using tools like Power BI or Tableau. Support ETL workflows and contribute to data pipeline development. Ensure accuracy and consistency of data throughout transformation. Present findings clearly to both technical and non-technical stakeholders. Play a key role in the HM Land More ❯

Azure Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central London. They are seeking an experienced Azure Data … contract, with strong potential for extension. This role is Outside IR35 and offers £450/day, requiring 2 days onsite per week in Central London. Key Responsibilities - Azure Data Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that’s tackling one of modern medicine’s biggest challenges. They … scaling fast and now looking for their very first Data Engineer. You’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. You’ll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models, you’ll be the go-to person. You More ❯

Job Description Job Title: Data Engineer Level:Associate Manager CL8 Locations: London, Bristol or Manchester Salary: Competitive salary and package (Depending on level of experience) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more … with the communities in which we work and live. It is personal to all of us." - Julie Sweet, Accenture CEO Qualification Key responsibilities Implement ETL pipelines and orchestrate data flows using batch and streaming technologies based on software engineering best practice Define, document and iterate data mappings based on concepts and principles of data … least one programming language (Python, Java, or Scala) Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control. Strong understanding of data More ❯

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions. You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure … and aligned with the strategic goals of the energy business. In addition to hands-on engineering, you will play a pivotal role supporting the data architecture roadmap, mentoring junior engineers, and driving innovation in data-driven decision-making across the Natural Gas and Power value chain. This role reports to the Data Engineer Lead. … Main Responsibilities Data Architecture & Engineering Leadership Architect and implement robust, scalable, and secure data pipelines and platforms tailored to the needs of Natural Gas and Power trading, including real-time market data ingestion, time-series storage, and high-frequency analytics. Lead the design and governance of data models that support complex trading More ❯

Data Scientist or Junior Data Scientist - Hybrid (Bristol-based 2-3 days a week) Insurance £40,000 - £45,000 (up to £50,000 for exceptional candidates) Strong skills in Python & Pandas with at least 2 years experience in a commercial Data Driven role Are you passionate about data and ready to make … of cyber risk? We're working with a forward-thinking company that's pioneering cyber risk using advanced stochastic techniques, and they're on the lookout for a Data Scientist or Junior Data Scientist to join their growing team. This is a brilliant opportunity for someone with a sharp analytical mind and solid Python skills, who … enjoys building efficient data pipelines and uncovering insights from complex datasets. The Role You'll play a key role in cleaning, enriching, and preparing insurance portfolio data that feeds into cutting-edge risk models. From day one, you'll work closely with modellers, data scientists, and engineering experts to ensure high data More ❯

Data Engineer - Manager x5 There are data teams and then there are data teams! Our customer puts enterprise at a new scale, not only with the size of their client engagements, but also with their own size as one of the big 4 and one of the first ever Microsoft Global Alliance Partners ( all … data technologies will be delivered (GCP/AWS/Big data) although Microsoft Azure is at the forefront of some roles). As a result of insane customer wins, they are now looking to expand the teams by 5 experienced Data Engineering Managers who can be at the level to lead and assist them … As the successful Data Engineering Manager you will be responsible for: Building and maintaining data pipelines Identifying and patching issues and bugs identified in the pipeline/architecture Working as part of a data specialist team to deliver quality service Providing access and identity management to onboard new customers onto the pre-existing More ❯

Job Title: Data Engineer Associate Manager Locations: London/Bristol/Manchester Salary: Competitive salary and package (Depending on level of experience) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more spent outside of … and with the communities in which we work and live. It is personal to all of us.” – Julie Sweet, Accenture CEO Key responsibilities Implement ETL pipelines and orchestrate data flows using batch and streaming technologies based on software engineering best practice Define, document and iterate data mappings based on concepts and principles of data … least one programming language (Python, Java, or Scala) Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control. Strong understanding of data More ❯

Like data and love solving problems? Want to work on a number of new and exciting data projects and help deliver a BI & Data strategy for a growing organisation? You're probably looking for a role that challenges you daily, a role where your efforts aren't focused mostly on maintenance and support. You … want to be working on varied data projects and utilising the full set of your technology skills whilst driving new areas like Azure/cloud, and all the new tools to play with - Azure Data Factory, Azure Databricks - what about AI? In this predominantly remote you will help create, mature, and grow, a data … Azure data solution to release the power and potential of the data across the organisation. We need a few basics from you: Data pipeline creation Strong ETL development experience with Azure Data Factory Datawarehouse and data storage concepts - star schema/snowflake/Kimball Azure Databricks and AI Power More ❯

passionate about helping our people get more out of life too; building careers with real growth, a sense of purpose, belonging and wellbeing. About the role This Principal Data Engineer role will work exclusively within our AdTech business unit whilst ensuring alignment to best practices, standards, and policies. The strategic direction is led by the Data … and input from this role. This role will work within the AdTech squad focusing on their priorities that will enable a consistent, efficient, and effective use of the Data Lake, Enterprise Data Warehouse, and marketing tools. Any experience with automating process and embedding re-useable patterns is interesting. As our AdTech Principal Data Engineer … includes technically managing AdTech priorities across various technologies and collaborate with architecture, product owners and delivery lead to ensure timely, efficient solution creation/maintenance. The AdTech Principal Data Engineer will interact with the core Data Engineering team, and collaborate and align with agreed solutions, policies, and delivery mechanisms. In this space we run daily stand More ❯

Data Operations Manager. Duration 6 months We are seeking a dynamic and driven Data Operations Manager to lead a team of data engineers. You will oversee the daily operations of our data infrastructure and ensure the accuracy, availability, and security of data across the organization. This role will lead a … team of data engineers and analysts, manage data workflows, and collaborate with cross-functional teams to support data-driven decision-making. You will support the Head of Data in the delivery of the data operations roadmap. Key Responsibilities for the Data Operations Manager: Data Infrastructure Management … Oversee the design, implementation, and maintenance of data pipelines, databases, and data warehouses. Process Optimization: Develop and refine data operations processes to improve efficiency, scalability, reliability and observability. Drive Engineering Excellence: Lead and manage all engineering activities across internal and external teams, ensuring high productivity and quality of execution. AWS Expertise: Strong expertise across More ❯

Data Operations Manager. Duration 6 months We are seeking a dynamic and driven Data Operations Manager to lead a team of data engineers. You will oversee the daily operations of our data infrastructure and ensure the accuracy, availability, and security of data across the organization. This role will lead a … team of data engineers and analysts, manage data workflows, and collaborate with cross-functional teams to support data-driven decision-making. You will support the Head of Data in the delivery of the data operations roadmap. Key Responsibilities for the Data Operations Manager: Data Infrastructure Management … Oversee the design, implementation, and maintenance of data pipelines, databases, and data warehouses. Process Optimization: Develop and refine data operations processes to improve efficiency, scalability, reliability and observability. Drive Engineering Excellence: Lead and manage all engineering activities across internal and external teams, ensuring high productivity and quality of execution. AWS Expertise: Strong expertise across More ❯

Milan, Edinburgh and Madrid. With our focus on growth in the UK and Europe, now is the perfect time to join us on this high-speed journey. Introducing Data Engineering at Trainline At the heart of our Data Team, Data Engineers play a pivotal role by creating pipelines and tables that power impactful dashboards … enable self-service via SQL, and support innovative machine learning models and real-time data products. As a Data Engineer, you will be involved in engineering pipelines that will drive key decisions and give data science powerful datasets to enable and drive new business insights. Data Engineers work alongside Machine learning engineers … BI Developers and Data Scientists in cross-functional teams with key impacts and visions. Using your skills with SQL, Python, data modelling and Spark to ingest and transform high volume complex raw event data into user-friendly high impact tables. As a department we strive to give our Data Engineers have high More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … Integrate data management technologies and software tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. As the selected Data Engineer, your background will include: 3+ years industry More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data More ❯

Job Title: Senior Data Engineer Location: Hybrid – 1 day per fortnight in the Wilmslow offices Working hours 0900 to 1730 The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong data engineer to … work in the data engineering team, to expand and maintain the data infrastructure that provides the foundations from which our BI, Data Science and Operational Data teams deliver insights and revenue to the functions across the wider group. We’re looking for an individual who has experience working with enterprise grade data pipelines and infrastructure, who can implement processes on our modern tech stack with robust, pragmatic solutions. Responsibilities develop, and maintain ETL/ELT data pipelines using AWS services Data, Databricks and dbt Manage and optimize data storage solutions such as Amazon S3, Redshift, RDS, and DynamoDB. Implement and manage infrastructure-as-code More ❯

complexity manageable and insight actionable - supporting everything from premium and ads growth to forecasting, experimentation, and global reporting. Location London Job type Permanent As engineers in the Financial Data Platform team, we turn messy, fragmented realities into clean, reusable foundations. We build core datasets that represent key financial domains like Premium, Ads, and Royalties. We create libraries and … tools that empower others to produce and trust financial data at scale. We collaborate deeply with Finance, Product, and Data teams to unlock clarity and drive Spotify's ambitions forward. We are looking for engineers who are excited to shape the future of financial data at Spotify. You will design and operate scalable pipelines … that process billions of records. You will apply product thinking to financial data - managing the full lifecycle from sourcing to documentation to exposure. You will define abstractions that simplify complexity and create intuitive paths for our consumers. Together, we advocate for standards, champion quality, and build systems that others can rely on with confidence. If you thrive on More ❯