1 to 25 of 53 Data Pipeline Jobs in London with Remote Work Options

Lead Data Engineer/Lead Data Developer - Azure, SQL What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and … Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to … the continuous improvement of data-driven decisions that improve the services the client provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide more »

The role: In this role, you will play a lead role in the conception, planning, and execution of Brompton Bicycle's data infrastructure. You will be working directly with diverse data sets from multiple systems, orchestrating their seamless integration and optimisation to enable our business to … derive valuable insights. This process will encompass everything from the raw development of data pipelines to the management and optimisation of these pipelines using all tools available in the Azure Cloud. A significant aspect of your role will be the migration of our existing on-premises databases to … Cloud, a complex project requiring a deep understanding of cloud architecture and database management, as well as change management, ensuring the continuation of data as a product to your stakeholders through a smooth data infrastructure transition As a vital part of our team, you will collaborate more »

Senior Azure Data Engineer UK Home-based with occasional travel into the office National: £37,694 - £45,092 per annum London (within the M25): £42,712 - £50,110 per annum Plus, up to £15k allowance for exceptional candidates Job Ref: J12718 Our client is implementing a new strategy … safe, effective care. Becoming an insight-driven organisation is a critical component of their new operating model. The role of the Senior Azure Data Engineer is to create and mature a service-focused data and insight function. The aim is to modernise the technology they use … to manage and analyse data; formalise the governance, processes and ways of working around data; drive new data culture, behaviours and skills to enable them to maximise the use of data and insight in their activities. What you will bring You will more »

Data Engineer £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Data Engineer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … ideal candidate will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Data Engineer your key responsibilities will be: Design, develop, and … maintain robust ETL/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL more »

will need as much of the following as possible. Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Assess, analyse, data ingestion, transformation & storage layers (RAW, Exploratory, Curated application) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD pipelines more »

Job Role: Principal Data Engineer Job Type: Contract IR35 : Inside IR35 Day Rate: £600/Day Contract Duration: 6 months Working Hours: 5 days per week Remote Working : 4 days remote working. 1 day on-site in London Location: Hybrid Remote/London (UK only) Reference : BH-299c … Role Overview: We are seeking an experienced Principal Data Engineer to join our client's team. You will lead the Data Engineering Acceleration initiative, designing, building, and transitioning a robust data management system that optimises data lifecycle management. Key Responsibilities: A cross … discipline professional who can collaborate with multiple teams, such as DataOps, Data Analytics, Software Development teams, to design solutions with them Provide expert advice and support in designing efficient processes for data discovery, profiling, quality, encryption, and pipelines. Document compliance, security, and data sovereignty more »

Senior Data Engineer £65,000 - £75,000 + 10% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful … change is seeking to add a Senior Data Engineer to the team based in London. Requirements of a Senior Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift … Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and more »

Principal Data Engineer £80,000 - £103,000 + 15% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful … change is seeking to add a Principal Data Engineer to the team based in London. Requirements of a Principal Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift … Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and more »

knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. … Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data more »

and Oaktree Capital. Find out more about us by visiting our website at: http://www.hartreepartners.com/JOB OVERVIEW: As a Senior Data Scientist at Hartree, you will play a pivotal role in shaping our data strategy and driving the development of advanced machine learning … time series forecasting solutions, specifically focused on the European Power Markets. You will collaborate with cross-functional teams to design, implement, and optimize data pipelines and predictive models that inform trading decisions and enhance operational efficiency. JOB RESPONSIBILITIES: Market Data Analysis: Conduct comprehensive analysis of data … Python and its data science libraries (e.g., Pandas, NumPy, Scikit-Learn, TensorFlow, PyTorch). Solid understanding of ML and data pipeline architectures and best practices. Experience with big data technologies and distributed computing (e.g., Spark, Hadoop) is a plus. Proficient in SQL and more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to … innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with … Hadoop, Spark, and other platforms for large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance more »

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … ideal candidate will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL …/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering … team within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments more »

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists … and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive actionable insights and recommendations. Research and Innovation: Stay abreast of the latest advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance more »

London & Edinburgh Work Mode: Mostly WFH, candidates should be open to travel as required. Job Description: We are seeking a highly skilled Senior Data Engineer with expertise in SAS to join our team and contribute to the transformation of our data pipelines. The successful candidate will … play a crucial role in rewriting existing pipelines from SAS, Info, pearl, and shell scripts to Python and DBT-based solutions, ultimately loading data into Snowflake and Salesforce on Azure. Key Responsibilities: Lead the conversion of existing SAS-based modules to Python-based solutions. Design, develop, and implement … Python and DBT-based pipelines for efficient data transformation and loading. Collaborate with cross-functional teams to understand requirements and ensure successful pipeline migration. Utilize expertise in SAS, pearl, and shell scripts to seamlessly transition to Python and DBT technologies. Implement best practices for data more »

Our client are a renowned name in the Property Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis. Key Skills/Requirements: Must have Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience … Have built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be mostly remote more »

InstaDeep is looking for an Applied Research Scientist to join our expanding team. Applied Research Scientists at InstaDeep develop algorithms and data pipelines focused mainly, but not exclusively, on physics-based methods. As part of the BioAI team, you will be contributing to the development of new approaches … Keywords: Computational molecular Physics, Structural Biology, Computational Chemistry, Protein Interactions, Protein Design, Molecular Dynamics, Monte Carlo, Enhanced Sampling, Machine Learning, Deep Learning, Statistics, Data Science Responsibilities Design, implement and deliver complex pieces of research in the area of computational molecular physics/biology. Implement and test pioneering enhanced more »

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … ideal candidate will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL …/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the … Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data … that improve the services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Description Who we are At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. … and you can bring your dog to the office! Job Description The job at a glance As a Director of Product Analytics and Data Science, you will responsible for leading an organisation comprising several Product Analytics, Data Analytics and Data Science teams, covering the … Analytics and Data Science needs in the Product organisation at Stepstone. You will be working closely with Senior Leaders in Product, Tech, Marketing and other areas to ensure we turn our data and product strategy into reality. Equally important, you will enable the managers to foster more »

This is an exciting opportunity to join one of Europe's fastest growing health-tech startups, working in a Data team that has made huge steps in moving our innovative platform forwards This role is Hybrid but only requires 1-2 days a month in our London office … the UK leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we’ll get there. About Data at Cera Data has a critical role to play … in two distinct areas. First, data about our operations, covering everything from hiring and retaining carers to the delivery of care, helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Finance Analytics technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, Informatica, and Azure to improve our data capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines … use within our subsidized onsite canteen Must have skills Experience as a Data Engineer, with a solid background in data pipeline construction and data architecture using Snowflake, Python, and Informatica Familiarity with Azure and other cloud-native technologies Understanding of finance industry data more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … to see the strategic impacts of any cross-team dependencies and escalate where necessary. You will require strong teamwork skills. The distribution data space is in a transition period. Significant data assets are located in on-premise hardware and software, such as Oracle, Informatica, Autosys, and more »