Data Pipeline Jobs in the City of London

15 Data Pipeline Jobs in the City of London

Data Engineer

City Of London, England, United Kingdom
Harnham
DATA ENGINEER LONDON HYBRID - 3 DAYS IN THE OFFICE UP TO £60K This role does not have the ability to sponsor THE COMPANY A leading provider in accommodation focused on taking advantage of their raw data sources to provide a nurturing environment facilitating personal growth and … vibrant communities THE ROLE AND RESPONSIBILITIES You will be responsible for bringing together all data sources into an Azure Cloud Data Warehouse to be leveraged for BI reporting and analytics In this role you will: Designing, implementing, and maintaining data pipelines across multiple data pipelines across multiple cloud SQL environments to ensure data integrity, security, and performance are maintained to a high standard Work with the BI team to design and build best-in-class data warehouse components Designing, building, and maintaining quality ETLs and ELTs to make more »
Posted:

Senior Insights Manager

City of London, London, United Kingdom
Amazon
EU. We are looking for a Sr. DSP Insights Manager who is ready to roll up their sleeves and help us develop actionable, data-driven insights, using various quantitative tools and core project management skills. Key job responsibilities Core responsibilities include : Managing our organizations AWS account, including a … data warehouse in Redshift. Manage permissions structure by eg administrating IAM settings. Owning reporting for strategic roadmaps by working with business leaders; driving expansion and optimization of new business units in our DSP program. Developing and maintaining performance dashboards with key metrics for review with senior leadership and … business teams; synthesizing large quantities of data to help create new, step-change initiatives for the organization. Onboarding data to our data warehouse by building automated data pipelines utilizing eg Python in Lambda or Sagemaker to invoke API calls. Using statistical techniques more »
Employment Type: Permanent
Posted:

Senior Data Engineer (Java/Python) - CDO

London (city), London, England
T Rowe Price
The work we do matters. We invite you to explore the opportunity to join us and grow your career with us. Overview The Data Office team at T. Rowe Price is playing a key role in helping build the future of financial services, working together with business partners … view to the table—because that is how we help our clients succeed. You will be an individual contributor on the Analytics and Data Platform engineering team responsible for architecting, building, testing, and maintaining the data platform. You will be responsible for: Contributing to the … platform's architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata more »
Employment Type: Permanent
Salary: Competitive
Posted:

SENIOR DATA ENGINEER

City Of London, England, United Kingdom
Hybrid / WFH Options
Harnham
SENIOR DATA ENGINEER FULLY REMOTE (UK BASED) UP TO £80,000 PERMANENT Do you have experience using cloud technologies? Are you passionate about Data Engineering and have a strong background working cross-functionally? This role is an amazing chance to work with some experienced and talented … paced environment. THE COMPANY The company is a lead art tech company. They are looking for an engineer that can help manage their data pipelines and optimise them. They are also looking to build more exciting data products and apps that they want you to be … a part of. THE ROLE You will be: Managing and developing data pipelines and making sure the scraping data is good. Working closely with data team to develop products. Spearheading data changes and driving business impact. Using Terraform and the AWS stack. more »
Posted:

Senior Software Engineer - £110k - Hybrid Working

City of London, London, United Kingdom
Hybrid / WFH Options
Oliver Bernard Ltd
Senior Software Engineer - £110k - Hybrid Working Opportunity for a tech-savvy innovator with a passion for data-driven solutions to join a global data-centric company as a Senior Software Engineer, helping to shape the future of clients' data strategies and engineering practices. They … specialise in providing cutting-edge data solutions to various clients across the globe. Their tech stack includes Kotlin, React, Kafka, Kubernetes, and AWS, and they are on a mission to make data work smarter for businesses across various industries. £110,000 depending on experience. Requirements: Experience … with a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please more »
Employment Type: Permanent, Work From Home
Salary: £80,000
Posted:

Data Analyst

City Of London, England, United Kingdom
Harnham
DATA ANALYST LONDON HYBRID - 3X IN OFFICE UP TO £50K This role does not offer sponsorship THE COMPANY A leading provider of business information focused on the legal sector and legal news. They are focused on providing up-to-date content through the analysis of market trends and … identifying patterns for strategic recommendations and content development THE ROLE AND RESPONSIBILITIES This role is crucial for using data to optimise growth, being able to see the reward of your work In this role you will be: Collaborate across multiple internal teams to identify key business questions and … leverage data to provide strategic recommendations Create visually compelling dashboards in Power BI for all strategic insight channels Present findings to internal stakeholders at all seniority levels Collaborate with central data teams to design and maintain scalable data pipelines for efficient data more »
Posted:

Senior Azure Data Engineer - £85,000

City of London, London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … to build a brand-new Snowflake data warehouse, which brings a huge scope of work for you to lead on internally, including the development of scalable data pipelines, overseeing the integration of new data management technologies, and implementing data storage solutions. This more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Athena - Data Consultant

City of London, London, United Kingdom
Hybrid / WFH Options
Sparta Global Limited
our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »
Employment Type: Permanent, Work From Home
Salary: £24,000
Posted:

Data Engineer - Azure Data Factory, Databricks, Power BI

City of London, London, United Kingdom
Nigel Frank International
A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Business Intelligence Developer

City of London, London, United Kingdom
Nigel Frank International
A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Software Dev Engineer

City of London, London, United Kingdom
Amazon
building products that are performant, scalable, and robust to support critical transportation processes. You build web applications that delight our customers, and complex data pipelines to process the data that serves them. We will give you the space to explore new technologies and approaches, and apply … job responsibilities working with AWS technologies such as Lambda, ECS Fargate, API Gateway, RDS, DynamoDB, EMR building customer-facing applications and APIs building data pipelines using Spark + Scala that process Tb of data per day working with customers to understand the business context of new more »
Employment Type: Contract
Posted:

Senior Data Engineer - Databricks

City of London, London, United Kingdom
Nigel Frank International
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … As a Senior Data Engineer, you will support the Lead Data Engineer to mentor and lead the Data Engineering team, undertaking a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Senior Data Engineer - Azure

City of London, London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … to build a brand-new Snowflake data warehouse, which brings a huge scope of work for you to lead on internally, including the development of scalable data pipelines, overseeing the integration of new data management technologies, and implementing data storage solutions. This more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Data Engineer - Azure Databricks & Data Factory - FTC

City of London, London, United Kingdom
Nigel Frank International
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »
Employment Type: Permanent
Salary: £50000 - £70000/annum
Posted:

Azure Data Engineer - Fixed Term Contract

City of London, London, United Kingdom
Nigel Frank International
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »
Employment Type: Permanent
Salary: £50000 - £70000/annum
Posted:
Data Pipeline
the City of London
10th Percentile
£52,500
25th Percentile
£63,750
Median
£70,000
75th Percentile
£90,000
90th Percentile
£105,000