26 to 50 of 540 Data Pipeline Jobs in the UK

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of … Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »

Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office My client is looking for a Data Lead to take responsibility for the technical design and implementation of data integration projects using Azure and Integration Services. Core duties will … the team whilst ensuring the overall performance of the solutions utilising the latest technologies, processes and best practice. You will design and build data pipelines, ETL processes and data workflows that enable data to be transferred seamlessly across a variety of platforms Required Skills … Effective experience leading, motivating and developing a team - Demonstrable experience in designing and deploying Azure Integration Services solutions - Proven experience of building data solutions and products in Azure - Data pipelines - SQL knowledge - Agile/Scrum Lead Data Engineer (Azure/SQL) - London - £70k more »

My client is hiring for a Data Architect on a permanent basis. This role is working with Defence and does require SC/DC clearance, it is essential. This role is hybrid - 2 days in the office and 3 days working from home. They have 2 locations, one … will be driven by solving varied and interesting client problems. You will be responsible for the strategy, architecture and high-level design of data intensive solutions, and will also support Client Managers directly in a pre-sales capacity to develop relationships and solutions that can support future business … growth. Skills: Experience of building specifying Data Pipelines in a Cloud environment (Azure, AWS, GCP) Knowledge of commercial and contractual frameworks SC/DV clearance is essential for this role Please apply for immediate interview more »

Job Purpose As a Data Engineer, you'll be at the forefront of enhancing our client's data capabilities, ensuring every bit is optimised for success. You will be collaborating closely with their visionary Data Scientists, crafting intricate data models and stunning … visualisations that will drive strategic decision-making to new heights. Your expertise in programming languages and data analysis tools will be the key to unlocking their data's full potential. Your contributions will be pivotal in driving strategic decision-making, fueling various impactful use cases. Harness … your prowess in programming languages and data analysis tools, while showcasing your formidable analytical and communication skills. Responsibilities Support the design and maintenance of data integrity checks across our client's various systems. Collaborate with the Data Scientists to understand data needs more »

Australia. It’s official: Bazaarvoice is a Great Place to Work in the US , Australia, India, Lithuania, France, Germany and the UK! Staff Data Engineer (P7) - Global Data Platform (Enablement) team What is the BV Data team at Bazaarvoice? Authentic data is … the lifeblood of the Bazaarvoice business. It is imperative that our data is consumable, interpretable, and instantly available to fuel insights across our brand, retailer and consumer customers. The BV Data team works closely with Product, Engineering, Business Development, and Account teams to consistently find new … ways to use data across the business. Who We Want Are you ready to combine your talent for crafting solid data systems and enthusiasm for cutting-edge technology to harness the power of data at Bazaarvoice? We’re looking for a strong data more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and … implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams more »

companies to GPs and individuals to get people the support they need to feel better. We are looking for an expert in cloud data solutions to Lead our Data Team as part of a 6 month fixed term contract. As a Senior Data Engineer … together a single view of the client journey spanning a number of sources. You will be responsible for implementing the right architecture and data pipelines to enable the company to utilise its data assets. To be successful in this role you will need to: Ensure that … the business’s information architecture, entity modelling, intersystem data consolidation at an enterprise level and pipelines are well designed and fulfil current and future business requirements Ensure that good development and architectural practices are adhered to Monitor and refine data pipelines to ensure adherence to expected more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

their way to becoming a billion dollar organisation. Key Responsibilities: Oversee the creation, implementation, and maintenance of scalable analytic solutions, working closely with data scientists, software engineers, and other team members. Provide strategic technical direction, support, and mentorship, fostering a culture of continuous learning and innovation. Lead the … improvement initiatives, and address any customer-related challenges. Desirable Technical Experience: Proficiency in Java, Kotlin, or Python. Experience with NLP, ML-Ops, and data pipelines. Familiarity with ML frameworks such as TensorFlow or PyTorch Strong understanding of ML algorithms, statistical techniques, and data analysis. Experience with more »

A Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team. This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applications The Lead Data Engineer will … also collaborate with cross-functional teams, including data scientists, software engineers, an product managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage … processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies. Other core duties include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services more »

Founding Data Engineer Role update - this role is now contract only. And really a mix of data science and engineering... Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer … have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for someone … that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

in the firm's technological evolution. The company are looking for a python developer who can design and develop their innovative AWS-native data analytics platform. Using Python, to build high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. This platform incorporates … real-time extraction, transformation and analysis of data from hundreds of diverse sources, some generating up to 100,000 transactions per minute The ideal candidate should have the majority of the following … Experience Developing and maintaining data pipelines for a company's analytics platform. Knowledge of how to collaborate with various teams to meet pipeline requirements. Be able to Troubleshoot and resolve pipeline issues. Strong experience in cloud-based development (AWS). Experience Optimizing pipelines for performance and more »

based projects, alongside deep learning and neural networks to support core clients Part of a team of 9 reporting to the Head of Data Science - working closely with a wider Data Engineering function Focusing on end-to-end data pipelines, for training, evaluating and … deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience in data pipelines and deploying ML models Preference for experience in retail/… marketing but not required Tech across: Python, AWS, Databricks, PySpark, AB Testing, MLFlow, APIs Experience in feature engineering and third-party data Apply below more »

Senior Data Engineer £80k-£90k Hybrid working 2 days in Glasgow office a week Your New … Role: Platform Development: Build the foundations of the new data platform, leveraging extensive business data for both automation and analytics. Pipeline Design: Create and develop data processing pipelines to support the ingestion, enrichment, and quality control of client and partner data. Data Warehouse Design: Design and develop a data warehouse to facilitate reporting and analytics. Team Development: Coach and mentor team members, enhancing their technical skills and knowledge of the platform. Process Improvement: Identify and implement internal process improvements, automate manual processes, and optimize data delivery. more »

Title: Head of Business Intelligence and Analytics Company Description: A leading company in the property sector with a strong focus on innovation and data driven decision making seeks a highly experienced professional to lead its Business Intelligence and Analytics team. Job Summary: We are searching for a talented … to spearhead our Business Intelligence and Analytics team. You will play a pivotal role in driving organizational growth and development by transforming raw data into actionable insights that inform strategic decision-making across various departments. Responsibilities: In this role, you'll find yourself equally split between hands-on … team with 50% devoted to hands-on tasks and 50% to management and leadership responsibilities' Oversee the construction and maintenance of a central data repository, ensuring alignment with organizational needs and data strategy. Collaborate with the data engineering team to gather and transform data more »

Role: Data Insights Manager ( SQL ) Salary: £45,000 - £55,000 Location: Peterborough – onsite. Our client, a leading retail fashion brand, are looking to recruit a Data Insights Manager into the team. With Data at the core, they are looking for someone to really help … drive forward the data strategy for the business. Having recently implemented Snowflake, this role will be well suited to those comfortable with creating data pipelines, using various ETL tools, testing data and writing queries, whilst managing and growing small teams. Please take look at … some of the core requirements below and apply for a more detailed conversation. **No sponsorship is offered with this role** Key Responsibilities: Data Warehousing Lead the team in building out reports. Use extensive SQL skills to extract and analyse data at a deeper level Move buying more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

As people increasingly move across channels and platforms, Kantar Media’s data and audience measurement, targeting, analytics and advertising intelligence services unlock insights to inform powerful decision-making. Working with panel and first-party data in over 80 countries, we have the world’s fastest growing … East, Asia Pacific, North America, and Africa to understand audiences and help the world’s leading organisations succeed and grow. Job Title: Senior Data Scientist Location: London, Grays Inn Road Salary: Competitive Full time/Permanent Kantar is the leader in providing audience and advertising measurement tools and … the forefront of technological developments in audience measurement in the media industry, working with broadcasters and advertisers, media agencies and industry committees. The data science team provides research and technical expertise, support, oversight, and methodological development to our global operating services and sits within the Global Product team. more »

DATA ANALYST LIVERPOOL STREET - HYBRID (2 DAYS A WEEK) £35,000 - £40,000 THE COMPANY The company specialises in designing, developing, and building innovative solutions, ranging from applications to websites, tailored for recruitment and onboarding purposes. Their main success is their expertise in direct-sourcing solutions, alongside creative … marketing strategies, to align employer brands with digital platforms, thus expanding their reach to a wider audience. ABOUT THE ROLE In this Data Analyst role, you will play a pivotal role in bridging the gap between cross-functional teams, ensuring seamless communication between data engineers and … GMT and GA4. Assume ownership of the reporting platform in Tableau, collaborating with a Tableau Engineer (contractor) for development. Oversee the correctness of data pipelines, particularly within Adverity. Translate data requirements from various business units for data engineers. YOUR EXPERIENCE To qualify for this more »

energy and commodities markets. They provide a wide range of services to a substantial and diversified customer base. They are seeking a skilled, data focused Python Developer who can design and develop their innovative AWS-native data analytics platform. As a Python Developer, you will be … building high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. The ideal candidate should have the majority of the following: Bachelor's degree in Computer Science, Engineering, or a related field. Strong Python development. Experience with Pandas is desirable. 3+ years of experience in … data engineering. Experienced in building ETL data pipelines. Relational database experience w/PostgreSQL. Understanding of tech within our stack: AWS/Apache beam/Kafka. Experience with Object Orientated Programming A desire to work in the commodities/trading sector. Permanent/Full-Time Employment. more »

be your next challenge! Must have experience: Working in Python on AWS AWS Serverless application (Lambda, Step Functions, S3, Amazon Glue, SNS, SQS) Data products, transforming, harmonising data, messages, etc. Desired experience: Building integration solutions Experience in designing application databases Experience in designing and building data more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax™, Axtria InsightsMax™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … to see the strategic impacts of any cross-team dependencies and escalate where necessary. You will require strong teamwork skills. The distribution data space is in a transition period. Significant data assets are located in on-premise hardware and software, such as Oracle, Informatica, Autosys, and more »