1 to 25 of 424 Data Pipeline Jobs in the UK

Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically … many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … s leading Publisher when it comes to the sophisticated application of data – to power relentless growth. DMG:Media is seeking an experienced and talented Data Platform Manager to evolve its Big Data Platform and advance its overall data proposition. The successful candidate more »

Job Description: Data Engineer Location: [UK] SC Cleared: Required Job Type: Full-Time Experience: 12-14 years Job description: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, building, and … successful candidate will work closely with cross-functional teams to ensure efficient data processing, storage, and analysis. Key Responsibilities: Data Pipeline Development: Design, develop, and maintain scalable data pipelines to ingest, process, and transform large volumes of data. Implement data integration … Platform. Excellent analytical, problem-solving, and communication skills. Ability to work independently and collaboratively in a fast-paced environment. Key Competencies: Data pipeline development and optimization Data infrastructure management Data modeling and schema design Data quality and governance Tools and technologies more »

Our client, a prominent multi-strategy hedge fund, is seeking a talented Data Engineer to join their dynamic team in the London office. In this role, you will be a key contributor to building a robust data platform that services a wide range of investment teams … and internal clients. You will collaborate with data sourcing experts, data specialists, data scientists, and fellow data … engineers to manage and deliver a diverse set of financial and alternative datasets and insights across asset classes and strategies. Responsibilities: Data Pipeline Design: Partner with the data strategy and sourcing team to understand data requirements and design efficient data pipelines more »

promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first … that pipelines run effectively. Set up and maintaining health checks on different data pipelines Respond, Triage, and debug the data pipeline when broken. Reading code and writing code changes and/or modifying the monitoring set-up Knowing and understanding how to navigate the data … providers when data is incorrect or not received on time. Communicating outages with the end users of a data pipeline What We Value Comfortable reading and writing code in Python, Pyspark and Java. Basic understanding of Spark and interested in learning the basics of more »

experience we're looking for, please go ahead and apply. We'd love to hear from you! About the role As the Senior Data Management Analyst, you will be responsible for continuous evolution of the data quality life cycle practices. This includes defining and proposing data … and their current levels under each dimension. You will take a leading role in supporting the organisation in improving the quality of its data by acquiring data to be brought under governance and perform data profiling analysis to understand it's origination, definition, lineage … into wider data management subjects e.g. Data Quality Insight, Data Quality Management, Data Quality in the pipeline, Master Data Management etc. Design, implement & maintain data quality technology Partner with key project initiatives and act as escalation point more »

Purpose of Job We are seeking an experienced and skilled Data Platform Delivery Lead to join our EMEA Data & Analytics Technology team. They will be responsible for leading a team of talented professionals in the successful delivery of and long-term viability of the Data Platform for SMBC EMEA. The ideal candidate should have a strong background in data platform delivery, data engineering, project management, and leadership skills to drive the team towards achieving strategic objectives. They should be curious about the technology and design of the platform as … and robust designs for delivery. Determining the scope of projects. Ensure timely and high-quality delivery of solutions. Aligning the implementation of the Data Platform to the agreed strategy of the platform. Collaborating with stakeholders in EMEA Data & Analytics Tech and outside. Especially the rest of more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within … our data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »

Two driven and experienced Azure Data Engineering Specialists with proven experience as data engineers are needed to join our team at Central Bedfordshire Council based in Bedfordshire on a full-time, hybrid working, 24-month contract basis. As part of our talented team, you'll collaborate … and improvements that will make it easier for residents to access the services they need. We are seeking two driven, knowledgeable, experienced Azure Data Engineers to support a variety of data-related projects over the next two years. You will have an opportunity to work with … Platform Engineer, Cloud Data Architect, Azure Data Solutions Engineer, Azure Data Integration Engineer, Cloud Data Pipeline Engineer, Azure Data Warehouse Engineer, Cloud Data Infrastructure Specialist, Azure Data Analytics Engineer will also be considered. more »

shift, built for a new era of data driven decisions, predictive modelling, modern data framework, so the data pipeline is use in collective efficient decisions making. A team of two, movingly to scale our platform the technology that powers BULLISHIER , growing data … volumes of data, modernising our data platforms and removing bottlenecks to produce better outcomes for analytics and data pipeline workflows. Areas to cover will include: Quantum cloud-native disaggregated architecture (Machine learning and deep learning algorithms, AI , modern analytics, streaming data … and supporting internal and external data pipelines for complex data-based systems to the vast ecosystem of data pipeline tools. Areas to focus attention: The ability to move workloads back and forth, cost performance with simplicity factors appropriate for each application. In the more »

We are seeking a highly skilled and motivated Data Engineer. The ideal candidate will have extensive experience in data engineering, particularly with Snowflake, ETL processes, and Power BI. The Data Engineer will be responsible for designing, developing … and maintaining our data infrastructure, ensuring seamless data integration and delivery of high-quality insights. Key Responsibilities: Data Pipeline Development: Design, build, and maintain efficient and reliable ETL processes to move data from various sources into our Snowflake data warehouse. Data Modelling: Develop and maintain data models and schemas to support business needs and ensure data integrity and quality. Data Integration: Integrate data from multiple sources, including APIs, databases, and flat files, into Snowflake. Performance Optimization: Optimize more »

Senior Data Engineer opportunity to join a well-known financial services company working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £66,000 + Great Benefits Purpose of Job … Advise on and ensure the maximum return of value from the company's data assets; through use of best practice data engineering techniques that aid the delivery of the company's data management strategy and roadmap and align to regulatory requirements. Contribute towards the … support, maintenance, and improvement of the company's platform inc data pipelines, and ensure data quality and governance. Responsibilities Advise on the Design, implementation, and maintenance of complex data engineering solutions. Ensure the implementation, and maintenance of complex data engineering solutions to more »

Data Engineer Remote working (1 day per month on-site) Competitive salary plus an industry leading bonus and pension scheme My client is looking for a Data Engineer to work on innovative projects that balance essential services, optimise cutting-edge technologies, and safeguard valuable assets. As … a Data Engineer, you will develop future-proof pipelines and uncover deep insights from diverse datasets, collaborating with technical teams and clients to design, build, and leverage data architectures for ambitious projects. Why You Should Apply Work on impactful and diverse projects. Flexible working hours and … Architecture, Data Insights, Cloud Platforms, Python Programming, Linux, Windows, Version Control, Git, Unit Testing, Integration Testing, Relational Databases, SQL, ETL Pipelines, Data Cleaning, Data Merging, Data Visualisation, Exploratory Data Analysis, Technology Readiness, Proofs-Of-Concept, Data-Driven more »

Job Title: Data Engineer Location: London Job Type: Permanent Work Type: Hybrid Salary : £50,000 to £55,000 per annum Are you a sports enthusiast with a passion for working in the sports industry? Whether you're interested in the dynamic world of professional sports, the business of … possibilities for those eager to immerse themselves in this thrilling and fast-paced environment. Databuzz is presently seeking an experienced candidate for a Data Engineer role with one of our clients located in London. About the Client: Our client is a sports tech company that leverages AI and … manipulation libraries, and the integration of Python with AWS components. Demonstrated experience in the data domain, encompassing the entire data pipeline from ingestion and mastering to management and distribution of large datasets. Mandatory Skills: 6+ Years of experience in Design, build, and maintain data more »

Location : London, Must have SC Clearance Certificate Mode: Hybrid Salary: Competitive Overview: We are seeking a talented Data Engineer with expertise in Azure to join our team. The ideal candidate will be responsible for developing data pipelines, building and maintaining data warehouses and data lakes, implementing data integration and transformation solutions, ensuring data quality and integrity, and optimizing data performance. Responsibilities: Proven track … record in the development and management of an Azure cloud-based data & analytics platform. • Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, and ETL processes. • Profound understanding of best practices in data governance more »

SIEM environment, utilizing OpenSearch. The SIEM Onboarding Engineer will work closely with business units to identify devices for onboarding, manage the data pipeline, and assist other engineers in configuring their data sources to provide a resilient pipeline.The SIEM Onboarding Engineer will approach each system to … to identify devices and data sources that need to be onboarded to our SIEM (OpenSearch with Security Analytics). Data Pipeline Management: Configure and manage data collection agents to ensure data is reliably ingested into the SIEM. Automation: Leverage automation scripts … with security engineers and other stakeholders to ensure seamless integration and optimal performance of the SIEM. Monitoring and Troubleshooting: Monitor the data pipeline for issues, troubleshoot problems, and implement fixes to maintain data integrity and system reliability. Documentation: Maintain comprehensive documentation on the onboarding processes more »

GCP Data Engineer - Insight & Data Services - Permanent - Hybrid ( Cardiff HQ ) Salary guideline: £85,000 - £95,000 pa Base Location: Cardiff required in once or twice a month The Client: Our client is a global leader in Systems Integration and IT Consultancy. They have built out a … super advanced and respected industry-wide Insights & Data Practice. The Data Engineering, Architecture and Platform practice is part of global Insights & Data group. The Focus of the Role: Build and deliver GCP data engineering solutions as part of a larger project: Use … Google Data Products tools (e.g. BigQuery, Dataflow, DataProc, AI Building Blocks, Looker, Cloud Data Fusion, Data prep, etc.) to build solutions for our customers Experience in Spark (Scala/Python/Java) and Kafka. Experience in MDM, Metadata Management, Data Quality and more »

This is an exciting opportunity to join one of Europe's fastest growing health-tech startups, working in a Data team that has made huge steps in moving our innovative platform forwards This role is Hybrid but only requires 1-2 days a month in our London office … the UK leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we’ll get there. About Data at Cera Data has a critical role to play … in two distinct areas. First, data about our operations, covering everything from hiring and retaining carers to the delivery of care, helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry. As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »

Job description: hands-on experience in business intelligence development or data engineering experience,Solid experience with data modelling, data warehouse design and data lake concepts and practices; Exposure working in a Microsoft Azure Data Platform environment. Exposer inAzure Data Factory Azure Storage Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics • Building new data pipelines and optimizing data flows using … the Azure cloud stack. • Building data products from scratch. • Support Business Analysts and Data Architects with discovery and best practices. • Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? • Advanced Azure knowledge and experience working and more »

Engineer to spearhead their Data Engineering team in London Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects Great scope for career progression & you ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline. Preferably someone who is capable of wearing many hats and getting hands on in other areas across the Data Engineering pipeline if necessary Experience leading team of Data Engineers/Scientists. Min. Bachelors degree in STEM subject (ideally from UK university). THE more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Finance Analytics technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, Informatica, and Azure to improve our data capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines … use within our subsidized onsite canteen Must have skills Experience as a Data Engineer, with a solid background in data pipeline construction and data architecture using Snowflake, Python, and Informatica Familiarity with Azure and other cloud-native technologies Understanding of finance industry data more »

Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline. Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary! Experience leading team of Data Engineers/Scientists. Min. Bachelors’ degree in STEM subject (ideally from UK university). THE more »

working with one of the biggest financial services organisations in the world. The successful candidate will be responsible for designing, building, and maintaining data pipelines using Apache Spark and Scala. This includes tasks like: Extracting data from various sources (databases, APIs, files) Transforming and cleaning the … data … Loading the data into data warehouses or data lakes (e.g., BigQuery, Amazon Redshift) Automating the data pipeline execution using scheduling tools (e.g., Airflow) Work with Big Data technologies: You'll likely work with various Big Data technologies more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

are a tech for good business dedicated to promoting transparency in the corporate world they are seeking a highly skilled and experienced Lead Data Engineer. You will be the first hire in the Data Engineering team allowing you to take the drivers seat regarding the direction … taken by the data team to follow. Key Responsibilities: Platform Development: Design, develop, maintain, test, and optimise a scalable and reliable data platform for collecting, processing, and transforming large volumes of company data from various sources. Collaboration: Work with cross-functional teams to understand … comprehensive documentation for data processes, schemas, and data dictionaries. Process Improvement: Identify and implement enhancements to improve data pipeline efficiency and reliability. Cloud Management: Actively manage cloud-based data services to balance performance and cost. Mentorship: Mentor and guide junior data more »