17 Data Pipeline Jobs in Central London

A global organisation are looking for an experienced professional to take ownership of their data architecture & future data strategy, as they look to leverage the latest Microsoft Azure data technologies. They've recently had the support of a Microsoft Partner to launch a brand … new Azure Data Platform with use of Databricks, and are now looking for an experienced Data Architect to own and further develop this! Please note that this is a hybrid role, requiring you to come into their Central London office 3 days per week to collaborate … with colleagues. This role will involve designing, developing and implementing first-class data architectures to meet business needs, and leading the Data Engineering team who are responsible for building the data pipelines, data solutions and data infrastructure. You will also more »

A global organisation are looking for an experienced professional to take ownership of their data architecture & future data strategy, as they look to leverage the latest Microsoft Azure data technologies. They've recently had the support of a Microsoft Partner to launch a brand … new Azure Data Platform with use of Databricks, and are now looking for an experienced Data Architect to own and further develop this! Please note that this is a hybrid role, requiring you to come into their Central London office 3 days per week to collaborate … with colleagues. This role will involve designing, developing and implementing first-class data architectures to meet business needs, and leading the Data Engineering team who are responsible for building the data pipelines, data solutions and data infrastructure. You will also more »

A global organisation are looking for an experienced professional to take ownership of their data architecture & future data strategy, as they look to leverage the latest Microsoft Azure data technologies. They've recently had the support of a Microsoft Partner to launch a brand … new Azure Data Platform with use of Databricks, and are now looking for an experienced Data Architect to own and further develop this! Please note that this is a hybrid role, requiring you to come into their Central London office 3 days per week to collaborate … with colleagues. This role will involve designing, developing and implementing first-class data architectures to meet business needs, and leading the Data Engineering team who are responsible for building the data pipelines, data solutions and data infrastructure. You will also more »

A global organisation are looking for an experienced professional to take ownership of their data architecture & future data strategy, as they look to leverage the latest Microsoft Azure data technologies. They've recently had the support of a Microsoft Partner to launch a brand … new Azure Data Platform with use of Databricks, and are now looking for an experienced Data Architect to own and further develop this! Please note that this is a hybrid role, requiring you to come into their Central London office 3 days per week to collaborate … with colleagues. This role will involve designing, developing and implementing first-class data architectures to meet business needs, and leading the Data Engineering team who are responsible for building the data pipelines, data solutions and data infrastructure. You will also more »

Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

Contract Data Analyst Length: 6 Months (Possible Extention) Rate: Up to £400 per day (Outside IR35) Location: Central London (Hybrid 2/3 Days) I am seeking a skilled Data Analyst to join my clients Digital & Tech team for a contract role. You will aid in … supporting a system implementation and data migration project, collaborating closely with project members, including the Senior Data Analyst, to navigate data challenges and suggest optimal approaches. Ideal candidates have expertise in data collation, profiling, scripting, and report writing, with agility in deploying … Dynamic Tables, and Tasks (in SQL and/or JavaScript) Understand the purpose, functionality and deployment of unit tests in a data pipeline Python skills; be able to write scripts for data processing, cleaning, transformation and analysis Knowledge of various python packages; pandas, SQLite Power more »

JOB DESCRIPTION Due to my clients recent growing demand for their Infrastructure Digital - Data and Analytics services, we are seeking to recruit an Associate Director to drive data excellence with our team and clients. We are looking for a commercially and technically minded manager with a … track record of delivering successful client engagements. An ability to manage relationships and give technical guidance across a multidisciplinary team of data visualisation, automation, infrastructure and data science experts. The Role As part of the role you will: Have a very strong technical background interfacing with … clients and technical teams Lead client engagements, delivery strategy and provide technical delivery and assurance of projects Design, develop and deliver data-driven solutions in collaboration with clients and other business units to drive insights and performance Produce design documents and technical specifications, including functional and nonfunctional requirements more »

EU. We are looking for a Sr. DSP Insights Manager who is ready to roll up their sleeves and help us develop actionable, data-driven insights, using various quantitative tools and core project management skills. Key job responsibilities Core responsibilities include : Managing our organizations AWS account, including a … data warehouse in Redshift. Manage permissions structure by eg administrating IAM settings. Owning reporting for strategic roadmaps by working with business leaders; driving expansion and optimization of new business units in our DSP program. Developing and maintaining performance dashboards with key metrics for review with senior leadership and … business teams; synthesizing large quantities of data to help create new, step-change initiatives for the organization. Onboarding data to our data warehouse by building automated data pipelines utilizing eg Python in Lambda or Sagemaker to invoke API calls. Using statistical techniques more »

We're on a mission to empower experts with groundbreaking knowledge discovery tools. If you're a seasoned Software Engineer - Data with a passion for building AI-native data processing pipelines, we want you on our team! Your Role: Design, optimize, and maintain robust data pipelines for complex knowledge-intensive documents. Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Implement end-to-end encryption and data isolation for secure data handling. Collaborate with a diverse team to … integrate search infrastructure for large language models. Your First 3 Months: Enhance data ingestion framework, boosting efficiency and scalability. Improve scalability and performance of data infrastructure, setting new benchmarks. Mentor team members and promote best practices in data engineering. What You Bring: Experience building more »

EU. We are looking for a Sr. DSP Insights Manager who is ready to roll up their sleeves and help us develop actionable, data-driven insights, using various quantitative tools and core project management skills. Key job responsibilities Core responsibilities include : Managing our organizations AWS account, including a … data warehouse in Redshift. Manage permissions structure by eg administrating IAM settings. Owning reporting for strategic roadmaps by working with business leaders; driving expansion and optimization of new business units in our DSP program. Developing and maintaining performance dashboards with key metrics for review with senior leadership and … business teams; synthesizing large quantities of data to help create new, step-change initiatives for the organization. Onboarding data to our data warehouse by building automated data pipelines utilizing eg Python in Lambda or Sagemaker to invoke API calls. Using statistical techniques more »

to join our dynamic team. This role requires an individual with excellent statistical and analytical abilities, deep knowledge of business intelligence solutions and data engineering practices as well as proficiency in hypothesis testing, including parametric and non-parametric tests and is familiar with A/B testing, understanding … statistical power, p-values, confidence intervals, potential biases along with strong grasp of frequentist statistics. The ideal candidate will help us to build data pipelines and robust metrics decks, perform advanced statistical analysis, and measure the success of our model deployments. If you have a knack for translating … complex data insights into actionable strategies and can communicate these effectively to both technical and non-technical audiences, we'd love to hear from you! Key job responsibilities Your responsibilities will include: Collaborate with cross-functional teams to understand business needs and provide data-driven recommendations. more »

Harnham's engineering contract team is looking for multiple Data Engineers for our leading FTSE 100 client for their digitalization project. THE ROLE Throughout this role, you would work with a wider team helping migrate a number of data applications over to GCP/BigQuery. For … a contractor with experience in some of the following areas YOUR SKILLS AND EXPERIENCE SQL/Python programming skills BigQuery/GCP experience Data Pipelines CI/CD pipelines in Terraform Experience with Data Modelling Experience with personalization projects would be a big bonus This is more »

DBT you will paly a crucial role in assisting the financial team In this role you will be: Designing, building and maintaining scalable data pipelines for ingesting, processing and analysing large volumes of transactional and user data Collaborating with stakeholders to understand the business requirements and … translate them into technical solutions Developing and maintaining data models in DBT, dashboards and reports to provide actionable insights Optimising the data infrastructure and workflows for performance, reliability and cost-effectiveness Conducting through testing and validation of data pipelines and analytical models to ensure more »

building products that are performant, scalable, and robust to support critical transportation processes. You build web applications that delight our customers, and complex data pipelines to process the data that serves them. We will give you the space to explore new technologies and approaches, and apply … job responsibilities working with AWS technologies such as Lambda, ECS Fargate, API Gateway, RDS, DynamoDB, EMR building customer-facing applications and APIs building data pipelines using Spark + Scala that process Tb of data per day working with customers to understand the business context of new more »

Senior Software Engineer - £110k - Hybrid Working Opportunity for a tech-savvy innovator with a passion for data-driven solutions to join a global data-centric company as a Senior Software Engineer, helping to shape the future of clients' data strategies and engineering practices. They … specialise in providing cutting-edge data solutions to various clients across the globe. Their tech stack includes Kotlin, React, Kafka, Kubernetes, and AWS, and they are on a mission to make data work smarter for businesses across various industries. £110,000 depending on experience. Requirements: Experience … with a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please more »