1 to 25 of 368 Data Pipeline Jobs in the UK

x1 day a week in the office (Thursday)Salary 90,000 - 95,000 per annumAbout the roleWhich? is currently seeking an exceptional Lead Data Engineer to take the helm in driving our innovative data strategy forward. In this role, you'll be at the forefront of … crafting and executing our data vision, operating within a dynamic Greenfield environment. The successful candidate will have the unique opportunity to form a diverse, talented team, while also spearheading the development of our data function from inception to fruition across various projects.Our forthcoming data … experience designing and implementing scalable data models for both relational and NoSQL databases.Strong Python skills with a focus on data pipeline development and automation of data-related tasks.Extensive experience designing, building, optimising, and monitoring complex ELT pipelines, ensuring data quality and more »

Principal Data Engineer - Hybrid (Bristol or London) - 80 - 110kSpinks are working with an established, rapidly growing digital consultancy who are looking to bolster their awesome Data Team with another experienced Principal Data Engineer. As a Principal Data Engineering Consultant, you will be … they occur.Be a strong communicator and presenter, presenting prototypes, solutions, and progress to internal/external stakeholders in a clear concise manner.Building reliable Data Pipelines.Promoting Test-Driven Development and/or Behaviour Driven Development.Continuously review and prioritise the delivery team's workload and anticipate the need for realignment more »

days on-site. Key Responsibilities: Design and implement integration solutions using Azure, M365, Active Directory and Intune. Develop and maintain APIs, services, and data pipelines. Collaborate with stakeholders to ensure integration solutions meet business needs. Troubleshoot and resolve integration issues. Perform system monitoring, performance tuning, and optimisation. Document more »

About The RoleHippo is recruiting for a Senior Data Architect to join our Hippo Herd. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior Data Architect, you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated with … technical strategyBuild and maintain appropriate Enterprise Architecture artefacts including Entity Relationship Models, Data Dictionary, ETL/ELT definitions and Data Pipeline/Lineage ModelsBe accountable to the client for the rationale of the architecture and detailed solutionDefine the methods of governance to ensure ongoing integrity more »

About The RoleHippo is recruiting for a Senior Data Architect to join our Hippo Herd. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior Data Architect, you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated with … technical strategyBuild and maintain appropriate Enterprise Architecture artefacts including Entity Relationship Models, Data Dictionary, ETL/ELT definitions and Data Pipeline/Lineage ModelsBe accountable to the client for the rationale of the architecture and detailed solutionDefine the methods of governance to ensure ongoing integrity more »

Senior Data Engineer Contractor £700 inside IR35 9-12 months duration. Hybrid with a London based office. This Senior Data Engineer will be spearheading the technical evolution of a cutting-edge retail platform. A highly reputable client of ours is searching for an experienced Data Engineer to deliver a transition into a Snowflake Data Warehouse and will be responsible for the creation of robust data pipelines. This role is a contract position inside IR35, designed for a leader who thrives in a product-centric environment and is passionate about … utilisation of advanced features, validated by Snowflake certification (e.g., SnowPro Core). - DBT expertise coupled with advanced Python skills, specifically in data pipeline development and data task automation. - Mastery of SQL (PostgreSQL, MySQL) for intricate queries and performance tuning. Demonstrated ability in designi... more »

Software Engineer– LondonSports Analytics & Statistics CompanyFulltime onsite*Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship*A Data Engineer is required for an exciting and innovative Software sports betting company based in London. The successful candidates will be working closely with the … researchers and alongside other extremely talented and driven engineers to build and support systematic trading models. You will be working on real-time data pipelines for live sports events where your expertise will help the company advance their in-play sports analytics and pricing function. Your day-to … day will involve developing robust and scalable data pipelines, implementing new feeds into the business, and integrating them with their quantitative decision models.Essential SkillsProven experience as a data engineer or similar, with a track record of handling mid to large scale data projects.Strong proficiency more »

report to the VP of Software who reports to the CEO. There are four R&D groups in the Software department:Cloud Infrastructure (data and ML training infra)Onboard Software (the car computer system software)Embodied AI Products (the AI+Robotics autonomy software and data)Evaluation and … the self-driving problem in order to enable the creation of new training and validation datasets), Experiments (essentially the Embodied AI development toolkit), Data Science (measurement reliability and accuracy in noisy self-driving environments). You will need to develop additional capabilities to evaluate model performance and validate … experience in Robotics, particularly related to simulating robotsIndustry experience with Computer Vision with real-world product impactExperience with cloud platforms, databases, large scale data pipelinesWhat we offer youThe chance to be part of a truly mission driven organisation and an opportunity to shape the future of autonomous driving. more »

INFOSENIOR DATA ENGINEER FULLY REMOTE (UK BASED)UP TO 80,000PERMANENTDo you have experience using cloud technologies? Are you passionate about Data Engineering and have a strong background working cross-functionally? This role is an amazing chance to work with some experienced and talented individuals in … a fast-paced environment.THE COMPANYThe company is a lead art tech company. They are looking for an engineer that can help manage their data pipelines and optimise them. They are also looking to build more exciting data products and apps that they want you to be … a part of.THE ROLEYou will be:Managing and developing data pipelines and making sure the scraping data is good.Working closely with data team to develop products.Spearheading data changes and driving business impact.Using Terraform and the AWS stack.YOUR SKILLS AND EXPERIENCEMinimum 4-years more »

About The RoleHippo is recruiting for a Senior Data Architect to join our Hippo Herd. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior Data Architect, you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated with … technical strategyBuild and maintain appropriate Enterprise Architecture artefacts including Entity Relationship Models, Data Dictionary, ETL/ELT definitions and Data Pipeline/Lineage ModelsBe accountable to the client for the rationale of the architecture and detailed solutionDefine the methods of governance to ensure ongoing integrity more »

mission by providing a hugely diverse set of technical solutions and platforms. From supporting critical systems which underpin the UK economy, to evolving data analytics, reinventing our online presence, and introducing a fully digital workplace. Be part of a team that’s constantly evolving, just like our industry.We … deliver services to both the Bank and external users. These include critical systems and services that underpin the UK economy, financial supervision, evolving data analytics, collaboration and research.This role sits within the Technology Strategy and Architecture (TSA) division in the Technology Directorate who are accountable for technical strategy … level.As a senior member of the Team, you will be:Taking a leading role on programmes and projects, understanding business imperatives and developing data solutions that deliver against the requirements aligned to business and technology strategiesResponsible for translating business strategic goals and objectives into supporting enterprise-wide technology more »

Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with … business activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the … integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data. Key Requirements Good understanding and competency in technologies currently used (and available in the marketplace more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

a dynamic and experienced Business Intelligence Developer to join their innovative team. This role presents an exciting opportunity for individuals passionate about leveraging data to drive business insights and decisions. With a salary range of up to £70,000 per annum, this position offers competitive compensation and ample … room for professional growth. Key Responsibilities: Engineering: Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks, ensuring the seamless flow of data across various systems and platforms. BI Reporting: Utilize Power BI to create visually appealing and insightful reports and … dashboards that provide actionable insights to stakeholders across the organization. Collaborate closely with cross-functional teams, including data scientists, business analysts, and IT professionals, to understand business requirements and translate them into technical solutions. Optimization: Implement performance tuning techniques to enhance the efficiency and scalability of data more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … implementing cloud solutions for different applications, automating cloud operations and cloud deployments Assume responsibility for the architecture of solutions that leverage advanced analytics, data pipelines, web portals, statistical models, Machine Learning and AI, through our technology platform Draw on the strength and experience of a wider team of more »

The ideal candidate will have a strong background in MLOps, with experience in deploying models on multiple GPUs, scaling, load balancing, and managing data pipelines. This role is critical in ensuring the high performance and reliability of our AI-driven solutions. Responsibilities: Deploy LLMs using platforms like Huggingface … or similar. Manage deployment on multiple GPUs, ensuring optimal performance. Implement scaling and load balancing to handle varying loads efficiently. Design and maintain data pipelines for model training, preferably using Kubeflow. Establish continuous integration and delivery pipelines using Docker, Kubernetes, or AWS counterparts (e.g., ECR). Visualise fine … grained MLOps data using industry standard tools and platforms Ensure system security through triaging, log analysis, and infrastructure debugging. Implement Infrastructure as Code using tools like Terraform or CloudFormation. Requirements: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field or equivalent experience. Solid more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … implementing cloud solutions for different applications, automating cloud operations and cloud deployments Assume responsibility for the architecture of solutions that leverage advanced analytics, data pipelines, web portals, statistical models, Machine Learning and AI, through our technology platform Draw on the strength and experience of a wider team of more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

LEAD DATA ENGINEER London x2 days a month in office OVERVIEW Xcede are delighted to be partnered with one of the UK's most impactful HealthTech brands. The organisation have won numerous awards for their data-led approach to designing an impactful B2C product that has … entirely disrupted their domain and outperformed their competitors. With a well-established analytics, data science, and data engineering function already in place, the team is looking for a Lead Data Engineer to come in act primarily as a Principal IC while also helping with … management of junior engineers (we'd like to see some experience of this). RESPONSIBILITIES Manage and assist a team of data engineers. Design and continue to build essential data infrastructure for the organisation alongside data pipelines & ETLs. Collaborate with data scientists more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future! With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry. As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »