76 to 100 of 344 Data Pipeline Jobs in London

Senior Data Engineer 6 month fixed term contract – 2 x a week in London £80,000 - £90,000 per annum + excellent benefits I am very excited to be partnering with a well-known fintech company! We're seeking a talented Senior Data Engineer to join … the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. Role Overview: As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse. You'll … collaborate closely with various stakeholders to gather business requirements and translate them into scalable data pipelines. Your expertise in Azure will be crucial in building robust infrastructure to support our data-driven initiatives. Key Responsibilities: with stakeholders to understand business requirements and translate them into technical more »

Data Architect (Azure) Our client, a leading analytics and consulting firm, is seeking an experienced Data Architect to join their dynamic team. In this role, you will be responsible for designing and implementing robust data solutions leveraging the power of Microsoft Azure. Key Responsibilities … Analyse business requirements and translate them into scalable, secure, and efficient data architectures Design and implement data pipelines, data lakes, and data warehouses on the Microsoft Azure platform Ensure data integrity, reliability, and performance through the effective use of Azure … services such as Data Factory, Synapse Analytics, Cosmos DB, and more Collaborate with cross-functional teams to identify and address data-related challenges Stay up-to-date with the latest Azure technologies and best practices, and recommend innovative solutions to drive business value Qualifications: Bachelor's more »

Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed. Modern tech stack - Python, AWS more »

Senior Data Engineer London (Hybrid Role) £80,000 per annum About: We are partnering with a hyper-growth financial services firm. This firm, highly regarded in the industry, is seeking a Senior Data Engineer to join their dynamic IT team and play a pivotal role in … shaping the future Role Overview: As a Senior Data Engineer, you will contribute significantly to the development and maintenance of data infrastructure and analytics solutions, driving data-based decision-making across the organisation. Working in collaboration with cross-functional teams, including Heads of Departments … Analysts, and Product Managers, you will be at the forefront of designing and implementing scalable, efficient, and reliable data pipelines and systems. Responsibilities: Design, build, and maintain scalable data pipelines and systems. Develop and optimize data integration, transformation, and cleansing processes. Collaborate with cross more »

Senior Data Engineer London (Hybrid Role) £80,000 per annum About: We are partnering with a hyper-growth financial services firm. This firm, highly regarded in the industry, is seeking a Senior Data Engineer to join their dynamic IT team and play a pivotal role in … shaping the future Role Overview: As a Senior Data Engineer, you will contribute significantly to the development and maintenance of data infrastructure and analytics solutions, driving data-based decision-making across the organisation. Working in collaboration with cross-functional teams, including Heads of Departments … Analysts, and Product Managers, you will be at the forefront of designing and implementing scalable, efficient, and reliable data pipelines and systems. Responsibilities: Design, build, and maintain scalable data pipelines and systems. Develop and optimize data integration, transformation, and cleansing processes. Collaborate with cross more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the … Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data … that improve the services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the … Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data … that improve the services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering end to end data requirements and designing data pipelines/warehouses to ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects, advising on data and data more »

Data Engineer Paddington, London (Hybrid) Overview Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on this ambition set by this OGSM we require the very highest level of technical/… engineering expertise within Global Petcare Data & Analytics. There is a need to expand this high performing team of creative, skilled individuals – to help build out new capabilities and bring fresh ideas to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment … in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data more »

Data Engineer Paddington, London (Hybrid) Overview Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on this ambition set by this OGSM we require the very highest level of technical/… engineering expertise within Global Petcare Data & Analytics. There is a need to expand this high performing team of creative, skilled individuals – to help build out new capabilities and bring fresh ideas to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment … in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data more »

Data Engineer/Scientist London (Hybrid) £50,000-£60,000 (+bens) 83DATA are partered with a leading Internet provider seeking the skills of a Data Engineer/Scientist. The successful candidate can expect to be tasked to connect data sources to pre-existing Azure … data infrastructure. You will lead projects with a data centric approach, for this reason, a passion and aptitude for critical analysis of large and complex datasets is vital. The role will directly report to the Head of Data - a high degree of resilience is … required to provide solutions to the executive board thus enabling data driven decisions. Responsibilites: Build data engineering pipelines to ingest, transform, store, and serve high quality data for Data Scientists Writing and tuning complex data pipelines, workflows, and data more »

Data Engineer/Scientist London (Hybrid) £50,000-£60,000 (+bens) 83DATA are partnered with a leading Internet provider seeking the skills of a Data Engineer/Scientist. The successful candidate can expect to be tasked to connect data sources to pre-existing Azure … data infrastructure. You will lead projects with a data centric approach, for this reason, a passion and aptitude for critical analysis of large and complex datasets is vital. Responsibilities: Build data engineering pipelines to ingest, transform, store, and serve high quality data for Data Scientists Writing and tuning complex data pipelines, workflows, and data structures. Identify opportunities for increasing performance, minimising costs and increase platform monitoring. Experience with components such as Azure Active Directory, Management Groups, Subscriptions, vNets, Route Tables, NSG’s and Azure more »

Data Engineer/Scientist London (Hybrid) £50,000-£60,000 (+bens) 83DATA are partnered with a leading Internet provider seeking the skills of a Data Engineer/Scientist. The successful candidate can expect to be tasked to connect data sources to pre-existing Azure … data infrastructure. You will lead projects with a data centric approach, for this reason, a passion and aptitude for critical analysis of large and complex datasets is vital. Responsibilities: Build data engineering pipelines to ingest, transform, store, and serve high quality data for Data Scientists Writing and tuning complex data pipelines, workflows, and data structures. Identify opportunities for increasing performance, minimising costs and increase platform monitoring. Experience with components such as Azure Active Directory, Management Groups, Subscriptions, vNets, Route Tables, NSG’s and Azure more »

Job title: Lead Data Engineer Client: Hyper Scaling AI/FinTech Startup Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. … Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead … based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data engineering and AI space and implement these best practices. Requirements and Skills: Bachelor more »

Job title: Lead Data Engineer Client: Hyper Scaling AI/FinTech Startup Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. … Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead … based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data engineering and AI space and implement these best practices. Requirements and Skills: Bachelor more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of … Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … Azure ML. Data Engineering: Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of … Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … Azure ML. Data Engineering: Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead … Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven … that improve the services the client provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and … for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company, to design and deliver new components of … to the traditional data engineering type! Significant hands-on experience with AWS, especially AWS services focused on data flow, pipelines, data transformation, storage and streaming. Excellent data engineering skills, for example with SQL, Python, DBT and Airflow. Good understanding of service-oriented more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and … for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company, to design and deliver new components of … to the traditional data engineering type! Significant hands-on experience with AWS, especially AWS services focused on data flow, pipelines, data transformation, storage and streaming. Excellent data engineering skills, for example with SQL, Python, DBT and Airflow. Good understanding of service-oriented more »

New 1 year contract opportunity for a mid-senior (outside IR35) Data Engineer to join an independent Civil Society with immediate effect. Data Engineer Responsibilities Design and implement scalable data architectures for large-scale web-scraping tools. Develop and optimize data pipelines … for ETL from online platforms, including textual and unstructured data, and REST APIs. Test, validate, and secure acquired data to ensure accuracy and quality. Work closely with the AI/ML Engineer to ensure seamless integration and alignment of data and AI … models. Data Engineer Required Experience Data engineering experience (2+ years) Cloud platform proficiency (e.g., AWS, Azure, GCP) Data pipeline development (e.g., Airflow, Apache Spark) SQL proficiency, database design Visualization tools knowledge (e.g., Tableau, PowerBI, Looker) Data Engineer Application Process This is more »