1 to 25 of 387 Data Pipeline Jobs in the UK

means providing exceptional service and using state-of-the-art tech to do it. We're on the lookout for two accomplished Senior Data Analysts to join our dynamic team! Specifically, we're recruiting one Senior Data Analyst with operational expertise, and another with a regulatory … focus, ideally with experience in the energy sector. Both roles require exceptional Tableau skills and proficiency in Databricks. As a Senior Data Analyst, you'll bring over six years of hands-on experience to the table, leveraging your mastery of Tableau to provide actionable insights crucial for strategic … and Python. Experience with advanced analytics techniques, including modeling and segmentation. Strong visualisation skills, particularly with Tableau. Familiarity with cloud-based data pipeline architectures, such as Databricks, and platforms like AWS. Excellent communication and presentation skills. Proven track record of translating technical findings into actionable business insights. more »

means providing exceptional service and using state-of-the-art tech to do it. We're on the lookout for two accomplished Senior Data Analysts to join our dynamic team! Specifically, we're recruiting one Senior Data Analyst with operational expertise, and another with a regulatory … focus, ideally with experience in the energy sector. Both roles require exceptional Tableau skills and proficiency in Databricks. As a Senior Data Analyst, you'll bring over six years of hands-on experience to the table, leveraging your mastery of Tableau to provide actionable insights crucial for strategic … and Python. Experience with advanced analytics techniques, including modeling and segmentation. Strong visualisation skills, particularly with Tableau. Familiarity with cloud-based data pipeline architectures, such as Databricks, and platforms like AWS. Excellent communication and presentation skills. Proven track record of translating technical findings into actionable business insights. more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Kubernetes) and Workflow orchestration (Temporal) .Strong skills in distributed architecture – local and cross site resiliency and failover .Achieving scalability on Apache Nifi based data pipelines to run several concurrent data movement feeds .Being able to visualize and integrate the platform and application architecture .Own and manage more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future! With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry. As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

About: You will lead a team of data analysts, BI business process experts and BI analysts, who will benefit from your experience in coaching and your knowledge of the data and analytics domain. The Data Fabric team will ensure that your team has access … to all relevant information and their skilled data engineers will develop the data pipelines for the projects in your team. Your team can further rely on a central competence and assistance of data science and business intelligence. Do you like new challenges that test … and analysis roadmap of your team reflects their requirements. Your team will mainly be using SAS and PowerBI, in combination with data pipeline development and analysis on the Azure cloud, using Databricks. The coding language used is Python. An earlier experience with these tools and languages will more »

for quant research and trading communities Design and build Portfolio Performance Attribution, Risk, Pricing and Analytics tools Design and build Backtesting solutions Build Data Pipelines for collection of new alternate datasets Design and Build Market Data APIs Implementation of Fundamental Trading strategies Technical Skills required – Excellent more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … implementing cloud solutions for different applications, automating cloud operations and cloud deployments Assume responsibility for the architecture of solutions that leverage advanced analytics, data pipelines, web portals, statistical models, Machine Learning and AI, through our technology platform Draw on the strength and experience of a wider team of more »

The ideal candidate will have a strong background in MLOps, with experience in deploying models on multiple GPUs, scaling, load balancing, and managing data pipelines. This role is critical in ensuring the high performance and reliability of our AI-driven solutions. Responsibilities: Deploy LLMs using platforms like Huggingface … or similar. Manage deployment on multiple GPUs, ensuring optimal performance. Implement scaling and load balancing to handle varying loads efficiently. Design and maintain data pipelines for model training, preferably using Kubeflow. Establish continuous integration and delivery pipelines using Docker, Kubernetes, or AWS counterparts (e.g., ECR). Visualise fine … grained MLOps data using industry standard tools and platforms Ensure system security through triaging, log analysis, and infrastructure debugging. Implement Infrastructure as Code using tools like Terraform or CloudFormation. Requirements: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field or equivalent experience. Solid more »

Senior Data Engineer Global Tech Business Paying up to £65k Hybrid – 2 days a week in Belfast La Fosse have partnered with a standout tech business, which has been at the heart of driving innovation and transformation in some of the biggest brands globally. They're currently hiring … across the board for Mid, Senior & Principal Data Engineers into their Belfast office, which has a headcount of 110 in the team already. As part of the Digital team, you’ll be tasked to deliver transformative digital solutions to complex business challenges. If you’re looking to work … centric service design, and agile engineering practices, then this is the opportunity for you! Requirements: Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python or Scala and SQL. Previous experience with cloud computing more »

DATA ENGINEER LONDON HYBRID - 3 DAYS IN THE OFFICE UP TO £60K This role does not have the ability to sponsor THE COMPANY A leading provider in accommodation focused on taking advantage of their raw data sources to provide a nurturing environment facilitating personal growth and … vibrant communities THE ROLE AND RESPONSIBILITIES You will be responsible for bringing together all data sources into an Azure Cloud Data Warehouse to be leveraged for BI reporting and analytics In this role you will: Designing, implementing, and maintaining data pipelines across multiple data pipelines across multiple cloud SQL environments to ensure data integrity, security, and performance are maintained to a high standard Work with the BI team to design and build best-in-class data warehouse components Designing, building, and maintaining quality ETLs and ELTs to make more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Data Scientist Consulting firm London UK £50k - £60k About Them Part of the digital innovation and data division within a leading global consultancy, they create fresh ventures and products for clients in the professional services space. Their efforts are focused on propelling forward exciting and innovative … service offerings in recent years, you'll be at the forefront of shaping this vibrant expansion. About You You will serve as a Data Scientist within their growing AI & Data Studio. Responsibilities include contributing to new and ongoing projects, providing actionable insights to clients, and harnessing … data to enhance decision-making processes. You'll spearhead data mining endeavours, conduct statistical analyses, implement state-of-the-art machine learning methodologies, and derive insights while constructing predictive models from both structured and unstructured data sets. You will actively participate in the delivery more »

with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our dynamic team. Responsibilities: Experience designing data models and developing industrialized data pipelines. Strong knowledge of database … and data lake systems, with proficiency in Python and SQL (any flavor). Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers, preferably GCP or AWS. Experience creating DataOps pipelines. Adept at working in an Agile environment, actively participating in approaches such as more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/… Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML … Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache Flink. Experience scaling an “API-Ecosystem ”, designing, and implementing “API-First” integration patterns. Experience working with authentication and authorisation protocols more »

An opportunity for an experienced product manager to join a leading organisation focused on the product lifecycle of a range of monitoring/data products. You will be focused on discovery, long term strategy, and ensuring released products are constantly monitored and roadmaps are up to date and … understanding user requirements, converting these into products whilst driving development and strategy alongside Business Development. We are seeking a Product Manager experienced in data collection and visualization products with knowledge on how and what data is collected in challenging environments by low power, remote and diverse … sensors; how this collected data flows through standard data pipelines and to understand how and why the data collected data aids the user in interpreting the subsea environment. To be successful in your application you will have worked in a product Management more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Graduate Data Engineer - Fast Growing FinTech A very fast scaling FinTech in London are looking for a talented Data Engineer to join their team. In this role as a Data Engineer you’ll work with extremely high calibre engineers and hit the ground running … with where you have the most experience and then gaining exposure to the rest of their services to build out your expertise. Graduate Data Engineer - About You On track for a First from a Top Russel Group University Self-starter who thrives in challenging environments A background in … a relevant field (Computer Science, Physics, Mathematics) with Software internships or projects Demonstrable experience in Python and SQL Data Engineer Desirable Qualities: Ability to communicate effectively to technical and non technical people Nice to haves includes: Kubernetes, Docker, BigQuery, Cloud, Databases Interest in FinTech Data Engineer more »

SENIOR DATA ENGINEER FULLY REMOTE (UK BASED) UP TO £80,000 PERMANENT Do you have experience using cloud technologies? Are you passionate about Data Engineering and have a strong background working cross-functionally? This role is an amazing chance to work with some experienced and talented … paced environment. THE COMPANY The company is a lead art tech company. They are looking for an engineer that can help manage their data pipelines and optimise them. They are also looking to build more exciting data products and apps that they want you to be … a part of. THE ROLE You will be: Managing and developing data pipelines and making sure the scraping data is good. Working closely with data team to develop products. Spearheading data changes and driving business impact. Using Terraform and the AWS stack. more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to understand the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

stakeholders can utilise. Key duties as PowerBI Developer: Design and development of a PowerBI platform for stakeholder reporting, visualisations, and dashboards Extracting raw data and setting up automated reporting functions Requirements gathering from stakeholders Developing relationships with finance, HR, IT, and Operations teams Requirements to be successful as … PowerBI Developer: Degree or similar level qualification in Computer Science, Data Analysis, or IT Subject Matter Expert in PowerBI Confident working with multiple data sources and types Data engineering experience, building data pipelines and automation Technical skills with SQL, DAX, and cloud more »

Data Engineer: Full time permanent role Fully remote working Key Responsibilities: • Design and construct dependable, resilient, and precise data pipelines in accordance with established best practices. • Establish the necessary infrastructure to ensure efficient extraction, transformation, and loading of data from diverse origins using SQL … integration workflows, and oversee data loading operations to accommodate routine and on-demand tasks. • Establish and uphold an efficient data pipeline framework, potentially incorporating integration with Dataverse via cloud flows or external data sources. • Devise, create, and manage data warehouse environments … to ensure their functionality and longevity. • Identify, devise, and enact internal process enhancements, including the automation of manual tasks, optimization of data delivery, and redesigning infrastructure to enhance scalability. Skills & Experience: - Dynamics CRM - Power Automate & Dataverse - ETL & ELT - SQL Server - Experience with low code/no-code solutions more »

Data Engineer Leeds - on site 2x per week up to £55,000 Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. Working closely with the Senior Data … whilst maintaining a core SAS user base. Requirements: Demonstratable proficiency with SAS platforms Strong commercial experience with SQL Hands on experience with Azure Data Factory and the build of data pipelines Proficiency in Python for data manipulation, transformation and analysis Experience with Azure Synapse more »