19 Data Pipeline Jobs in Central London

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

About the role: My client is seeking an experienced Senior Data Engineer with a specialisation in Snowflake to own and evolve the company's data stack. The ideal candidate for this role will be a self-starter with a knack for problem-solving and a strong … ability to learn new skills quickly. Key responsibilities include designing and developing scalable data models and warehouses, creating and maintaining database objects, and ETL processes for loading data into Snowflake. Proven proficiency in SQL, database optimisation, and effective database security implementation is a must (working closely … with Data Science team). The candidate should also have good communication skills, an approachable personality, and prior knowledge/experience of the media industry will be beneficial. The role provides personal and professional development opportunities for an individual who can take on ownership and responsibility while integrating more »

to join our teams in London, Newcastle and Salford. We are looking for a range of programming languages including Node.js (backend) and Python (Data and Machine Learning). We offer a warm welcome with full support settling in and foster a culture where everyone has an opportunity to … on cloud based environments like AWS and Azure Solid understanding of software development principles, design patterns and best practices Experience in feature engineering, data pre-processing, data pipelines Experience building ranked retrieval algorithms to support end users querying for data Practical experience of writing more »

Test Architect - Automation of Data & Analytics London (Hybrid) 6 Month Contract £5 50 - 625/day (Outside IR35) A highly skilled Test Architect needed with active SC Security Clearance for a 6 Month Outside IR35 contract. Hybrid working with the expectation of 2 days/week on-site … large-scale IT modernisation programmes for Government clients. Key skills, experience + tasks will include: Architect and design the automation framework for testing data and analytics projects, including data pipelines, data warehouses, and analytics applications. Expertise in Total Landscape, Banking experience, Cloud Testing, Data … with scripting and programming languages such as Python, Java, SQL. Must offer a solid background in banking and financial experience, COTS products, and Data Modernization/transformation programs. Designing and implementing testing strategies and solutions. A deep understanding of the testing landscape, banking industry, cloud technologies, data more »

Senior Data Analyst Health-tech Company Remote (anywhere in Europe) €65,000 + benefits The Company This is an exciting role for someone to join an incredibly innovative health-tech business who are leading the way in digital mental healthcare and revolutionising society's perception and knocking down … opportunity to drive innovation in the mental health landscape, leading solutions to create a real difference to the industry. You will be a data & analytics expert, someone who is always looking to push boundaries and create real change for good using the latest data and analytics … from ANYWHERE in the EU or UK Work closely with the Head of Analytics to propel the business into a new age of data decisioning Access to the latest tools and technology and working with some of the brightest minds in the industry Salary is €65,000 per more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … As a Senior Data Engineer, you will support the Lead Data Engineer to mentor and lead the Data Engineering team, undertaking a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … to build a brand-new Snowflake data warehouse, which brings a huge scope of work for you to lead on internally, including the development of scalable data pipelines, overseeing the integration of new data management technologies, and implementing data storage solutions. This more »

Contract Data Analyst Length: 6 Months (Possible Extention) Rate: Up to £400 per day (Outside IR35) Location: Central London (Hybrid 2/3 Days) I am seeking a skilled Data Analyst to join my clients Digital & Tech team for a contract role. You will aid in … supporting a system implementation and data migration project, collaborating closely with project members, including the Senior Data Analyst, to navigate data challenges and suggest optimal approaches. Ideal candidates have expertise in data collation, profiling, scripting, and report writing, with agility in deploying … Dynamic Tables, and Tasks (in SQL and/or JavaScript) Understand the purpose, functionality and deployment of unit tests in a data pipeline Python skills; be able to write scripts for data processing, cleaning, transformation and analysis Knowledge of various python packages; pandas, SQLite Power more »

Harnham's engineering contract team is looking for multiple Data Engineers for our leading FTSE 100 client for their digitalization project. THE ROLE Throughout this role, you would work with a wider team helping migrate a number of data applications over to GCP/BigQuery. For … a contractor with experience in some of the following areas YOUR SKILLS AND EXPERIENCE SQL/Python programming skills BigQuery/GCP experience Data Pipelines CI/CD pipelines in Terraform Experience with Data Modelling Experience with personalization projects would be a big bonus This is more »

DBT you will paly a crucial role in assisting the financial team In this role you will be: Designing, building and maintaining scalable data pipelines for ingesting, processing and analysing large volumes of transactional and user data Collaborating with stakeholders to understand the business requirements and … translate them into technical solutions Developing and maintaining data models in DBT, dashboards and reports to provide actionable insights Optimising the data infrastructure and workflows for performance, reliability and cost-effectiveness Conducting through testing and validation of data pipelines and analytical models to ensure more »

Senior Software Engineer - £110k - Hybrid Working Opportunity for a tech-savvy innovator with a passion for data-driven solutions to join a global data-centric company as a Senior Software Engineer, helping to shape the future of clients' data strategies and engineering practices. They … specialise in providing cutting-edge data solutions to various clients across the globe. Their tech stack includes Kotlin, React, Kafka, Kubernetes, and AWS, and they are on a mission to make data work smarter for businesses across various industries. £110,000 depending on experience. Requirements: Experience … with a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please more »

building products that are performant, scalable, and robust to support critical transportation processes. You build web applications that delight our customers, and complex data pipelines to process the data that serves them. We will give you the space to explore new technologies and approaches, and apply … job responsibilities working with AWS technologies such as Lambda, ECS Fargate, API Gateway, RDS, DynamoDB, EMR building customer-facing applications and APIs building data pipelines using Spark + Scala that process Tb of data per day working with customers to understand the business context of new more »

DATA ANALYST LONDON HYBRID - 3X IN OFFICE UP TO £50K This role does not offer sponsorship THE COMPANY A leading provider of business information focused on the legal sector and legal news. They are focused on providing up-to-date content through the analysis of market trends and … identifying patterns for strategic recommendations and content development THE ROLE AND RESPONSIBILITIES This role is crucial for using data to optimise growth, being able to see the reward of your work In this role you will be: Collaborate across multiple internal teams to identify key business questions and … leverage data to provide strategic recommendations Create visually compelling dashboards in Power BI for all strategic insight channels Present findings to internal stakeholders at all seniority levels Collaborate with central data teams to design and maintain scalable data pipelines for efficient data more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

EU. We are looking for a Sr. DSP Insights Manager who is ready to roll up their sleeves and help us develop actionable, data-driven insights, using various quantitative tools and core project management skills. Key job responsibilities Core responsibilities include : Managing our organizations AWS account, including a … data warehouse in Redshift. Manage permissions structure by eg administrating IAM settings. Owning reporting for strategic roadmaps by working with business leaders; driving expansion and optimization of new business units in our DSP program. Developing and maintaining performance dashboards with key metrics for review with senior leadership and … business teams; synthesizing large quantities of data to help create new, step-change initiatives for the organization. Onboarding data to our data warehouse by building automated data pipelines utilizing eg Python in Lambda or Sagemaker to invoke API calls. Using statistical techniques more »

We're on a mission to empower experts with groundbreaking knowledge discovery tools. If you're a seasoned Software Engineer - Data with a passion for building AI-native data processing pipelines, we want you on our team! Your Role: Design, optimize, and maintain robust data pipelines for complex knowledge-intensive documents. Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Implement end-to-end encryption and data isolation for secure data handling. Collaborate with a diverse team to … integrate search infrastructure for large language models. Your First 3 Months: Enhance data ingestion framework, boosting efficiency and scalability. Improve scalability and performance of data infrastructure, setting new benchmarks. Mentor team members and promote best practices in data engineering. What You Bring: Experience building more »

Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »