1 to 25 of 116 Data Pipeline Jobs in London

Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically … many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … s leading Publisher when it comes to the sophisticated application of data – to power relentless growth. DMG:Media is seeking an experienced and talented Data Platform Manager to evolve its Big Data Platform and advance its overall data proposition. The successful candidate more »

promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first … that pipelines run effectively. Set up and maintaining health checks on different data pipelines Respond, Triage, and debug the data pipeline when broken. Reading code and writing code changes and/or modifying the monitoring set-up Knowing and understanding how to navigate the data … providers when data is incorrect or not received on time. Communicating outages with the end users of a data pipeline What We Value Comfortable reading and writing code in Python, Pyspark and Java. Basic understanding of Spark and interested in learning the basics of more »

shift, built for a new era of data driven decisions, predictive modelling, modern data framework, so the data pipeline is use in collective efficient decisions making. A team of two, movingly to scale our platform the technology that powers BULLISHIER , growing data … volumes of data, modernising our data platforms and removing bottlenecks to produce better outcomes for analytics and data pipeline workflows. Areas to cover will include: Quantum cloud-native disaggregated architecture (Machine learning and deep learning algorithms, AI , modern analytics, streaming data … and supporting internal and external data pipelines for complex data-based systems to the vast ecosystem of data pipeline tools. Areas to focus attention: The ability to move workloads back and forth, cost performance with simplicity factors appropriate for each application. In the more »

We are seeking a highly skilled and motivated Data Engineer. The ideal candidate will have extensive experience in data engineering, particularly with Snowflake, ETL processes, and Power BI. The Data Engineer will be responsible for designing, developing … and maintaining our data infrastructure, ensuring seamless data integration and delivery of high-quality insights. Key Responsibilities: Data Pipeline Development: Design, build, and maintain efficient and reliable ETL processes to move data from various sources into our Snowflake data warehouse. Data Modelling: Develop and maintain data models and schemas to support business needs and ensure data integrity and quality. Data Integration: Integrate data from multiple sources, including APIs, databases, and flat files, into Snowflake. Performance Optimization: Optimize more »

SIEM environment, utilizing OpenSearch. The SIEM Onboarding Engineer will work closely with business units to identify devices for onboarding, manage the data pipeline, and assist other engineers in configuring their data sources to provide a resilient pipeline.The SIEM Onboarding Engineer will approach each system to … to identify devices and data sources that need to be onboarded to our SIEM (OpenSearch with Security Analytics). Data Pipeline Management: Configure and manage data collection agents to ensure data is reliably ingested into the SIEM. Automation: Leverage automation scripts … with security engineers and other stakeholders to ensure seamless integration and optimal performance of the SIEM. Monitoring and Troubleshooting: Monitor the data pipeline for issues, troubleshoot problems, and implement fixes to maintain data integrity and system reliability. Documentation: Maintain comprehensive documentation on the onboarding processes more »

This is an exciting opportunity to join one of Europe's fastest growing health-tech startups, working in a Data team that has made huge steps in moving our innovative platform forwards This role is Hybrid but only requires 1-2 days a month in our London office … the UK leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we ll get there. About Data at Cera Data has a critical role to play … in two distinct areas. First, data about our operations, covering everything from hiring and retaining carers to the delivery of care, helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry. As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »

Engineer to spearhead their Data Engineering team in London Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects Great scope for career progression & you ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline. Preferably someone who is capable of wearing many hats and getting hands on in other areas across the Data Engineering pipeline if necessary Experience leading team of Data Engineers/Scientists. Min. Bachelors degree in STEM subject (ideally from UK university). THE more »

Job Title: Junior Data Engineer Location : London (Anywhere in UK) Pay Rate : £150/Day We are looking to hire a Junior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures on AWS. You will work closely … with senior data engineers … data scientists, and other stakeholders to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, and load data from various sources into AWS data more »

the forefront of innovation to address the entire breadth of opportunities in the evolving world of cloud, digital and platforms. Context program: The Data & Analytics team's vision is to: Help answer complex questions quickly but bringing the right data and insights to the people that … need them Build a culture of using data with speed and agility to drive decisions. The goal of our 2024 program is to improve Global Procurement's data analytics capability and maximise value creation from HSBC's supply chain data. The program is a success when … Modernising Procurement's data & analytics platforms: extending our Data Management Platform (Google Cloud) and the associated data products Deliver Next Generation Insights: enabling data-driven decision making through both brand new and improved insights across Global Procurement domains Enable Supplier Mastering & Normalisation more »

Job Responsibilities The Data Analytics Tester works closely with business stakeholders and the technology team to review and test Business Intelligence (BI) solutions firmwide including but not limited to validating the quality accuracy, reliability, compliance and performance of reports, dashboards, data pipelines, and general data analysis solutions. Develop and execute comprehensive test scenarios for BI reports and dashboards. Ensure data accuracy, security and compliance around legal performance metrics are accurately presented on BI reports and dashboards. Verify, validate, and analyse accuracy of data models used in reports to ensure … data synchronization and consistency across different platforms. Review data specifications and requirements with data analytics developers, business analysts and enterprise architects, and develop test plans, test cases, and test scripts. Perform functional, regression, integration and performance testing of reports, dashboards and data more »

The role: In this role, you will play a lead role in the conception, planning, and execution of Brompton Bicycle's data infrastructure. You will be working directly with diverse data sets from multiple systems, orchestrating their seamless integration and optimisation to enable our business to … derive valuable insights. This process will encompass everything from the raw development of data pipelines to the management and optimisation of these pipelines using all tools available in the Azure Cloud. A significant aspect of your role will be the migration of our existing on-premises databases to … Cloud, a complex project requiring a deep understanding of cloud architecture and database management, as well as change management, ensuring the continuation of data as a product to your stakeholders through a smooth data infrastructure transition As a vital part of our team, you will collaborate more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax , Axtria InsightsMax , Axtria SalesIQ , and Axtria MarketingIQ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Data Architect We are searching for an experienced Data Architect About RSM Consulting brings together multiple teams across Transactions, Risk & Consulting, ABA, and Outsourcing to provide client-centric solutions for RSM s current and future clients within the middle market. Our Consulting team has a major … empower our people to make an impact and develop their own unique career path. About the team and your role Our Digital and Data Advisory practice, as part of our broader Business Transformation client offering, consists of three teams: Digital Finance team working with clients to understand how … from defining a digital strategy and roadmap, creating a business case, selecting the right software, documenting user stories, to managing and assuring projects. Data analytics and insights team working with clients to help them understand their level of data analytics maturity and to develop a data more »

Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in … data assessment and profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in Data … Engineering or Data Warehousing (Data Engineer/DW Developer) with robust DW development and ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL more »

Data Engineer Consultant - Data & AI (DV Cleared/Eligible)65,000 – 75,000 + packageLocation: United Kingdom (London – London) Type: PermanentData Engineer Consultant - Data & AI (DV Cleared/Eligible)Location: LondonSalary: 65k - 75kAbout the Role:Our client, a leading consultancy in the Defence & Security … sector, is seeking a skilled Data Engineer to join their AI & Data Engineering team. This pivotal role offers the opportunity to be at the forefront of advanced technology projects aimed at enhancing national security. The position is perfect for individuals who are passionate about leveraging their … data security and quality across projects.Qualifications and Skills:Proven experience in data engineering, particularly with ETL processes, data pipeline construction, and workflow orchestration.Familiarity with distributed computing techniques, such as parallel processing and batch data management.Strong foundation in data system more »

html Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? Position: Lead Data Engineer Lead Data Management and Architecture: Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »

Dive into a pivotal role leading data management and analytics transformation. We're on the hunt for an SC Cleared Azure Data Lead with a knack for innovation and a comprehensive skill set: MUST HAVE ACTIVE SC CLEARANCE Key Responsibilities Oversee the evolution of the data platform, encompassing data pipelines, storage, and processing. Establish and nurture robust relationships with stakeholders to guarantee a positive user experience and to identify any potential opportunities for additional services or products. Play a key role in the formulation and execution of the data management … record in the development and management of an Azure cloud-based data & analytics platform. Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, and ETL processes. Profound understanding of best practices in data governance more »

Data Engineer - Python - SQL - London - Up to £65k I'm currently working with an organisation who are globally recognised due to the nature of their work, despite only having a presence within the UK. My client are directly involved and help to organise annual events which attract every … provide career progression plans as well as extensive opportunities to gain industry recognised certifications. Experience required Python & SQL experience is essential Extensive experience in pipeline building, ideally using Azure Data Factory Background in Data Engineering Additional experience of Snowflake is advantageous This is a great … removed). Keywords: Azure, Azure Data Factory, MS Business Intelligence, MS Power BI, MS SQL Server, Snowflake, Python, SQL, Data Pipeline, Data Modelling, MDM, T-SQL, Data Lake, Logic Apps, Function App, London more »

Lead Data Engineer Salary: Up to £50,000 National/Up to £60,000 London Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for a highly skilled data engineer with significant experience of … snowflake. As well as being an expert in the snowflake cloud platform, you’ll have a strong background in data ingestion and integration, designing and implementing data pipelines on various technologies, data modelling, and a rounded understanding of data warehousing. Aviva believes … strongly in experimentation leading to industrialisation and we are searching for passionate, energetic data engineers who are focussed on using their skills to drive out real business value for our customers. A bit about the job: An exciting opportunity within one of our data engineering teams more »

ValueDriven is a leading Artificial Intelligence and Data Consulting company dedicated to providing credible, reliable, and value-driven outcomes for transformative impact. We specialize in the development of AI and data-driven solutions, helping organizations of all sizes make data-informed decisions and optimize … innovation, collaboration, and the delivery of outstanding results for our clients. We are currently seeking an experienced and highly skilled Senior Consultant in Data Engineering to join our team at ValueDriven. The Senior Consultant will play a crucial role in designing, implementing, and optimizing data solutions … for our clients, ensuring that their data infrastructure meets their unique needs and requirements. The ideal candidate will have extensive knowledge of data engineering best practices, technologies, and tools, as well as a passion for solving complex data challenges. Responsibilities: Collaborate with clients to more »

Lead Data Engineer/Lead Data Developer - Azure, SQL What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and … Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to … the continuous improvement of data-driven decisions that improve the services the client provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide more »

Lead Data Engineer - Snowflake/DBT/Python - ecommerce - £95k Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client s data function, delivering … end to end data requirements and designing data pipelines/warehouses to ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a … new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to influence overall business decisions. Streamline our client s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects more »

knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. … Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data more »