Data Pipeline Jobs in the UK

176 to 200 of 462 Data Pipeline Jobs in the UK

Lead Data Engineer

London Area, United Kingdom
Tredence Inc
About Tredence­: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision … strategically and execute methodically Develop and manage capacity and growth projection forecasts of the environment within budgets Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements Drive optimization, testing and tooling to improve quality … years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project more »
Posted:

Lead Data Engineer

South East London, England, United Kingdom
Tredence Inc
Job DescriptionAbout Tredence­: -Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve … methodology; think strategically and execute methodicallyDevelop and manage capacity and growth projection forecasts of the environment within budgetsCreate and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirementsDrive optimization, testing and tooling to improve quality of … Skills:8+ years of relevant experienceAt least two years of experience building and leading highly complex, technical engineering teams.Strong hands-on experience in Data bricksExperience managing distributed teams preferred.Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills more »
Posted:

Senior Data Engineer - Databricks

London, United Kingdom
Nigel Frank International
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … As a Senior Data Engineer, you will support the Lead Data Engineer to mentor and lead the Data Engineering team, undertaking a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Senior Data Engineer - Databricks

City of London, London, United Kingdom
Nigel Frank International
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … As a Senior Data Engineer, you will support the Lead Data Engineer to mentor and lead the Data Engineering team, undertaking a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Azure Data Engineer - Fixed Term Contract

City of London, London, United Kingdom
Nigel Frank International
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »
Employment Type: Permanent
Salary: £50000 - £70000/annum
Posted:

Head of Business Intelligence

London Area, United Kingdom
The React Hub
Title: Head of Business Intelligence and Analytics Company Description: A leading company in the property sector with a strong focus on innovation and data driven decision making seeks a highly experienced professional to lead its Business Intelligence and Analytics team. Job Summary: We are searching for a talented … to spearhead our Business Intelligence and Analytics team. You will play a pivotal role in driving organizational growth and development by transforming raw data into actionable insights that inform strategic decision-making across various departments. Responsibilities: In this role, you'll find yourself equally split between hands-on … team with 50% devoted to hands-on tasks and 50% to management and leadership responsibilities' Oversee the construction and maintenance of a central data repository, ensuring alignment with organizational needs and data strategy. Collaborate with the data engineering team to gather and transform data more »
Posted:

Azure Data Platform Engineer - Fixed Term Contract

London, United Kingdom
Nigel Frank International
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »
Employment Type: Permanent
Salary: £50000 - £70000/annum
Posted:

Senior Data Engineer (Java/Python) - CDO

London (city), London, England
T Rowe Price
The work we do matters. We invite you to explore the opportunity to join us and grow your career with us. Overview The Data Office team at T. Rowe Price is playing a key role in helping build the future of financial services, working together with business partners … view to the table—because that is how we help our clients succeed. You will be an individual contributor on the Analytics and Data Platform engineering team responsible for architecting, building, testing, and maintaining the data platform. You will be responsible for: Contributing to the … platform's architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata more »
Employment Type: Permanent
Salary: Competitive
Posted:

Lead Data Engineer

Greater London, England, United Kingdom
Xcede
LEAD DATA ENGINEER London x2 days a month in office OVERVIEW Xcede are delighted to be partnered with one of the UK's most impactful HealthTech brands. The organisation have won numerous awards for their data-led approach to designing an impactful B2C product that has … entirely disrupted their domain and outperformed their competitors. With a well-established analytics, data science, and data engineering function already in place, the team is looking for a Lead Data Engineer to come in act primarily as a Principal IC while also helping with … management of junior engineers (we'd like to see some experience of this). RESPONSIBILITIES Manage and assist a team of data engineers. Design and continue to build essential data infrastructure for the organisation alongside data pipelines & ETLs. Collaborate with data scientists more »
Posted:

Power BI Specialist - London (SW1)

London, United Kingdom
Hybrid / WFH Options
In Technology Group
Power BI Specialist - London (SW1) My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They is an innovation centre … and standards for managing Power BI artifacts, including reports, datasets, and dataflows within workspaces. Configure and manage dataflows to ingest, transform, and prepare data from various sources for analysis within Power BI. Develop and implement strategies for automating data refresh processes to keep Power BI reports … deploying numerous dashboards at scale. Power BI development Develop advanced Power BI reports, dashboards, and interactive visualizations that provide actionable insights and drive data-driven decision-making. Design and implement efficient and scalable data models using Power BI Desktop and SQL Server Analysis Services (SSAS). more »
Employment Type: Permanent
Salary: £50000 - £100000/annum Benefits
Posted:

Data Analyst

Harlow, England, United Kingdom
AutoProtect
We're embarking on an exciting journey here at AutoProtect, and we're on the lookout for a skilled and motivated Data Analyst to join our team and play a pivotal role in our data-driven journey. Your objective will be to provide the business and … its clients with a trusted, single source of data, with outputs that are easy to use and understand; integrated across all our products and services. The role will be based in our Harlow office and the working pattern will be Monday-Friday, 9am-5pm. The role The key … could be looking after include: Analyse different performance metrics across a range of products to support customer acquisition and engagement; Present and explain data in non-technical terms and engaging with stakeholders at any level; Work with stakeholders, both technical and non-technical to design, spec and build more »
Posted:

Power Automate Developer

London Area, United Kingdom
Levy Professionals
Power BI and Power Automate Developer - Hybrid - Contract - London Key Responsibilities: Collaborate with business and data engineer stakeholders to gather requirements and understand business needs for data visualisation and process automation. Design, develop, and maintain Power BI reports, dashboards, and visualisations within CLUK. Collaborate with our … Data Engineers to manage data connections to various data sources, ensuring accuracy and reliability of data within our enterprise and metadata technologies (Unity Catalog and Purview). Develop end-to-end automation workflows using Power Automate to streamline business processes, encapsulate data pipelines (ADF/DataBricks) and increase operational efficiency. Integrate Power Automate workflows with ADF/Data Bricks and encapsulate applications like MatLab to enable seamless data exchange and process automation. Troubleshoot and resolve issues related to data visualisation, automation workflows, and data more »
Posted:

Solution Architect

England, United Kingdom
Hybrid / WFH Options
Parser
subject matter experts, solving interesting problems, and building the products of tomorrow, this opportunity is for you. On our mission to revolutionize the Data Strategy & Management space, we are seeking a dynamic and seasoned Solution Architect with a stellar track record in Data Products. As our … client navigates the complexities of a legacy IT landscape, we need someone who can not only conceptualize, design and build robust data platforms but also provide strategic guidance and stakeholder management expertise. Leveraging your software engineering expertise, you'll play a pivotal role in ensuring the integrity, efficiency … and compliance of the data architecture while spearheading the migration from legacy systems to modern solutions. What you'll bring to us: At least 5 years of experience in a similar role, with 10 years in software engineering and solution architecture. Extensive knowledge of database structure systems, data more »
Posted:

Software Engineer (Data)

London Area, United Kingdom
Gloo
Software Engineer (Data) £110,000-£120,000 London, Hybrid (2x days) Permanent role I am seeking an experienced Software Engineer (Data) who can be passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust … data pipelines across diverse sources, enhancing the quality of data for our systems, and readiness to meet the challenges of scale. Responsibilities: Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and … reliability. Design robust data processing and indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Curate and manage large-scale data ingestion and indexing pipelines, ensure data quality and error handling. Ensure the secure handling of data more »
Posted:

Senior Data Engineer

Glasgow, Scotland, United Kingdom
Hybrid / WFH Options
MBN Solutions
Senior Data Engineer Glasgow Based/Hybrid working 1 day a week in office. About the Opportunity: MBN are partnered with a growing Glasgow based company to find them a Senior data Engineer. They are entering a new phase of development aimed at refining their product … platform for the future as part of a long-term business expansion strategy. They are looking for a Data Engineer to join and lead the development and strategy of their platform and functionality. You new role : Act as the Subject Matter Expert for Data Engineering, helping … to set the standards for data engineering and analytics best-practice for the business. Lay the foundations of the new data platform as a hands-on practitioner, building on the rich data sets we have in the business for both automation and analytics. Design more »
Posted:

Lead Data Engineer

London Area, United Kingdom
FullCircl
since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We pride … amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will require more »
Posted:

Data Scientist - Lead Generation & Prospecting

London, United Kingdom
LHH Recruitment
Data Scientist - Lead Generation & Prospecting Contract Role - Inside IR35 via umbrella Our client, a London based Financial Services/Payements Solutions provider is seeking a Data Scientist to join the team on contract with experience within new business/prospecting - Please only aply if you have … demonstrable experience in these areas. Responsibilities: Utilise advanced data analytics and machine learning techniques to identify high-value prospects and generate leads in the payments industry. Design and implement propensity models to predict potential client engagement and conversion rates, optimising our prospecting strategies. Analyse transactional and financial data … or Master's degree in Statistics, Mathematics, Computer Science, Finance, or a related field. Experience working with Salesforce from a data/pipeline management perspective along with Snowflake Data Connectors a plus. If you are a results-oriented Data Scientist with a passion more »
Employment Type: Contract
Rate: £450 - £500/day Paid via umbrella
Posted:

Senior AWS Data Engineer

London Area, United Kingdom
Xcede
Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and … implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams more »
Posted:

Senior Data Engineer - Contract (Inside IR35)

South East London, England, United Kingdom
Hybrid / WFH Options
McGregor Boyall
Job DescriptionSenior Data Engineer (Inside IR35) - £700 to 825 per dayLocation: Remote/Hybrid (London)Rate: £825 per dayContract: Inside IR35Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution.Key Responsibilities:Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions.Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines.Distributed Processing: Work with Hadoop, Spark, and other platforms … for large-scale data processing.Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark.Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL.Data Governance: Ensure data quality, security, and compliance with best practices.Ideal Candidate:Significant experience in data more »
Posted:

Data Engineer

London Area, United Kingdom
Harrington Starr
Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. In order to support … further growth, we are looking for a Data Engineer skilled in the following. What will you be doing? Work on a web scraping platform for one of the firm’s largest clients Develop solutions to parse and process tabular data from PDF and HTML documents Maintain … support and expand existing data pipelines using DBT, Snowflake and S3 Implement standardised data ingress/egress pipelines Onboard new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time Liaise more »
Posted:

Lead Data Engineer

Greater London, England, United Kingdom
GCS
Lead Data Engineer Permanent – Hybrid Salary up to £70,186 p/year, 35 hours p/week Join our dynamic public sector client based in Central London, where you will spearhead the technical design and implementation of transformative data integration projects. They are committed to … leveraging cutting-edge technologies and cloud components to enhance the data capabilities. As the Lead Data Engineer, you will be responsible for guiding the Engineering Team in developing and implementing data and integration solutions utilising Microsoft Azure and Integration Services, among other cloud technologies. … You will ensure the quality, performance, and security of their data integration solutions while adhering to best practices and project deadlines. Key Responsibilities the Engineering Team in developing data and integration solutions using the latest technologies and best practices. and deliver data products within more »
Posted:

Data Architect

United Kingdom
Chaptr Ltd
Data Architect - AWS Digital Consultancy £650-£700 per day (outside IR35) UK remote This is an exciting opportunity to join a digital consultancy that operate throughout Europe, predominately working with technology led businesses to build new products and platforms. They're about to embark on a project for … a customer in the automotive/EV industry and so are looking for a Data Architect to help lead on the design and build of a customer data platform. The platform will sit on AWS and they plan on using Snowflake as the data … there will be the occasional requirement to meet with the team in London. What you'll do: Plan architecture and build infrastructure for data ingestion, processing, analytics, visualisations and business intelligence systems. Integrate AI/Machine learning inference as part of a data platform. Data more »
Posted:

Senior Data Engineer

Manchester Area, United Kingdom
SR2 | Socially Responsible Recruitment | Certified B Corporation™
Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This role involves leveraging Azure … s diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable … operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work closely with Data Scientists within the Operational Analytics team to understand data needs and deliver solutions more »
Posted:

Data Team Lead

London Area, United Kingdom
InterEx Group
About: You will lead a team of data analysts, BI business process experts and BI analysts, who will benefit from your experience in coaching and your knowledge of the data and analytics domain. The Data Fabric team will ensure that your team has access … to all relevant information and their skilled data engineers will develop the data pipelines for the projects in your team. Your team can further rely on a central competence and assistance of data science and business intelligence. Do you like new challenges that test … and analysis roadmap of your team reflects their requirements. Your team will mainly be using SAS and PowerBI, in combination with data pipeline development and analysis on the Azure cloud, using Databricks. The coding language used is Python. An earlier experience with these tools and languages will more »
Posted:

Azure Data Engineer

Bristol, United Kingdom
CPS Group (UK) Limited
Azure Data Engineer I am currently working with a client in Bristol who is looking for an experienced Azure Data Engineer to provide assistance on an ongoing project for the next 6 months! Role: Azure Data Engineer Rate: £500 - £650 per day Duration … Months Location: Bristol - 5 days a week onsite work Status: Inside IR35 Role Overview: As a Azure Data Engineer, you'll be at the forefront of crafting, innovating, and sustaining data solutions within the Azure ecosystem. Your mastery will be instrumental in steering data initiatives towards success, ensuring they're finely tuned for performance, scalability, and dependability. Key Responsibilities: Craft, refine, and deploy data pipelines and ETL workflows within Azure's expansive framework. Leverage Azure's suite of services, including Azure Data Factory, Azure Databricks, and Azure Synapse more »
Employment Type: Contract
Rate: £500 - £650/day
Posted:
Data Pipeline
10th Percentile
£36,775
25th Percentile
£49,750
Median
£67,500
75th Percentile
£85,000
90th Percentile
£105,000