551 to 575 of 1,167 Data Pipeline Jobs in the UK

and installing automation. As a Senior Process Mining Consultant, you play a key role in shaping our clients' strategic goals by transforming raw data into actionable insights. You collaborate closely with the project team to deliver impactful, data-driven solutions that maximize value for clients. Leveraging … levels. Passionate about understanding and interpreting business processes. Known for your analytical mindset, organizational skills, and ability to learn quickly. Excited about Big Data, Data Mining, Business Intelligence, and Process Mining, with a desire to continuously expand your expertise. Preferred Qualifications: Experience with setting up data pipelines (configuring source connections, using flat files, SQL for data transformation, and defining data models). Motivated and forward-thinking, ready to contribute to the evolution of Process Mining technology. Eager to tackle challenges and embrace a steep learning curve to grow and expand More ❯

re on a mission to create a virtual sales agent that performs better than a human sales agent. We’re looking for a Data Engineering Manager to lead a small team in building a key part of our data infrastructure - evolving and scaling the ingestion of … internal systems. This role blends people management, individual contribution, and technology leadership. People Management: You will lead and mentor a small team of Data Engineers, fostering a high-performance culture by guiding their professional growth and ensuring effective communication within the team and with stakeholders. Your strong interpersonal … Python and Docker in our pipelines. You’ll need to be highly proficient in these or similar tools and comfortable navigating a modern data ecosystem. The person we’re looking for Passionate about designing and delivering solutions to complex problems Curious with a desire for continuous learning Friendly More ❯

Role: Data Engineers Location: Reading, Hybrid working 2-3 days a week Salaries: £40,000-£55,000 We're seeking a number of skilled Data Engineers to join one of our growing clients based in Reading! In this role, you'll play a key part in … designing, developing, and maintaining data solutions that drive digital transformation for our clients. Key Responsibilities: Design and implement data solutions using SQL and cloud-based technologies. Manage data migration and transformation projects. Collaborate across teams to integrate data solutions. Build scalable, secure … data architectures using Azure services. Required Skills: Advanced proficiency in SQL (MS SQL Server/PostgreSQL), with strong experience in query optimisation and performance tuning. 3years+ commercial experience Expertise in Azure services like Data Factory, SQL Database, and Synapse Analytics. Strong knowledge of ETL/ELT More ❯

Lead Data Engineer | Build and Lead a New Data Team I am looking for a Lead Data Engineer to establish and lead a new Data Engineering team. This is a unique opportunity to shape data architecture from the ground up … working with cutting-edge technology to drive business performance. The Role As the first Data Engineering hire, you will: Design and implement scalable data architectures for efficient storage and access. Build and maintain data pipelines handling terabyte-scale datasets. Work closely with data scientists, analysts, and stakeholders to optimize data solutions. Own the reliability, performance, and scalability of data infrastructure. Recruit and lead a growing team of data engineers. Tech Stack Python (3.10+), Pandas, NumPy PostgreSQL (TimescaleDB), SQL optimization RabbitMQ, ZeroMQ, Linux servers Prometheus, Grafana More ❯

Lead Data Engineer | Build and Lead a New Data Team I am looking for a Lead Data Engineer to establish and lead a new Data Engineering team. This is a unique opportunity to shape data architecture from the ground up … working with cutting-edge technology to drive business performance. The Role As the first Data Engineering hire, you will: Design and implement scalable data architectures for efficient storage and access. Build and maintain data pipelines handling terabyte-scale datasets. Work closely with data scientists, analysts, and stakeholders to optimize data solutions. Own the reliability, performance, and scalability of data infrastructure. Recruit and lead a growing team of data engineers. Tech Stack Python (3.10+), Pandas, NumPy PostgreSQL (TimescaleDB), SQL optimization RabbitMQ, ZeroMQ, Linux servers Prometheus, Grafana More ❯

JOB SUMMARY Senior Data Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure … data solutions, ensuring compliance with strict security standards and regulations. This is a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. … Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring More ❯

and open-minded individual with an interest in state-of-the-art machine learning engineering and research? Thomson Reuters Labs is seeking a Data Engineer with a passion for solving challenging machine learning problems in a data-rich, complex and innovative environment. What does Thomson Reuters …/Applied ML, as well as Research, to drive the company's leading internal AI model development, fueled by an unprecedented wealth of data and powered by cutting-edge technical infrastructure. About the Role: In this opportunity as a Research Engineer - Data, you will: Innovate: Work … system design skills. Excellent communication skills. Curious and innovative disposition. Self-driven attitude. Experience with relational and NoSQL databases. Experience with data pipeline orchestration tools. Experience with cloud-based data platforms. Comfortable working in fast-paced, agile environments. Preferred qualifications: Additional legal knowledge. Ability to More ❯

Sr. Product Mgr, Business Data Technologies At Amazon, data is critical to everything we do, from understanding product inventories across our global fulfillment centers to predicting what products to recommend to customers. Data ceaselessly informs our flywheel, helping us to understand customer needs, onboard … new sellers and selection, and identify opportunities for cost savings. Business Data Technologies (BDT) provides trustworthy, intuitive, and cost-efficient solutions for Amazonians to secure, store, analyze, and transform this data at unparalleled scale. BDT owns, develops, and operates Andes, one of the largest data lakes in the world, storing more than 2 exabytes of data, read/written to by 100k+ data pipelines, with >60k monthly active users. To do this, we need extraordinary individuals to build the next generation of data analytics, machine learning, and More ❯

team We are the central Amazon Business Marketing Analytics (ABMA) team for WW AB Marketing team. Our vision is to simplify and accelerate data driven decision making for AB Marketing by providing cost effective, easy & timely access to high quality data. Our core responsibilities towards AB marketing include … the speed of business decision-making by reducing the effort & time to access actionable data. Minimum Requirements 2+ years of analyzing and interpreting data with Redshift, Oracle, NoSQL etc. experience. Experience with data visualization using Tableau, Quicksight, or similar tools. Experience with one or more industry … Python, Java, or R). Preferred Qualifications Master's degree, or Advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis, co-relation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯

Our client, a top systematic hedge fund, are seeking an experienced Python developer to join their Data Team (Alpha Data), which is responsible for delivering vast quantities of data to users worldwide. Heavily responsible for data pipelines. This role involves becoming a … technical subject matter expert and developing strong relationships with quant researchers, traders, and colleagues across the Technology organisation. The Data teams deploy valuable data quickly, ensuring ingestion pipelines and data transformation jobs are resilient and maintainable, with data models designed in collaboration … code quality. They value teamwork, collaboration, excellence, diversity of thought, and creative solutions, emphasizing a culture of learning, development, and growth. Responsibilities: Manage Data Pipelines: Take part ownership of the expanding estate of data pipelines, ensuring they are robust, efficient, and scalable. Innovate and Improve: Propose More ❯

Our client, a top systematic hedge fund, are seeking an experienced Python developer to join their Data Team (Alpha Data), which is responsible for delivering vast quantities of data to users worldwide. Heavily responsible for data pipelines. This role involves becoming a … technical subject matter expert and developing strong relationships with quant researchers, traders, and colleagues across the Technology organisation. The Data teams deploy valuable data quickly, ensuring ingestion pipelines and data transformation jobs are resilient and maintainable, with data models designed in collaboration … code quality. They value teamwork, collaboration, excellence, diversity of thought, and creative solutions, emphasizing a culture of learning, development, and growth. Responsibilities: Manage Data Pipelines: Take part ownership of the expanding estate of data pipelines, ensuring they are robust, efficient, and scalable. Innovate and Improve: Propose More ❯

Staff Data Engineer Joining one of the best-known retail brands in the UK as a Staff Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and … maintaining data pipelines and to collaborate with the wider data teams. The Opportunity For this role as Staff Data Engineer, they are looking for this person to have extensive experience with data pipelines, data warehousing and to play a key … role in driving high standards across the data function. You will support the team in building pipelines to deliver insights enabling the company to be more data-driven with their decision making. Within this role as a Staff Data Engineer, they'd also be More ❯

Data Engineer – Azure Location: Birmingham, UK Amtis is delighted to recruit for an exciting opportunity for a Data Engineer to join a brilliant company based in Birmingham. Key Responsibilities Collaborating with internal customers to document requirements. Integrating and modelling data from multiple sources for … analytics. Developing and testing complex BI apps. Creating data pipelines and migrating existing solutions to Microsoft Fabric. Supporting business users in self-service app development. Enhancing BI services with advanced data science capabilities. Providing routine BI service support and incident resolution. Ensuring data quality … and completeness. Adhering to governance requirements and handling ad-hoc requests. Required Skills Extensive experience in data analytics development. Proficiency in data engineering and complex data modelling using Fabric/Azure. Expertise in app/DWH development and support with Microsoft Azure/Power More ❯

Data Engineer – 12 MONTH FTC Opportunity for a Data Engineer to join a collaborative business operating in the Reproductive sector in Nottingham Salary up to £40,000 + some fantastic benefits including remote working, purchase additional holiday scheme, pension contribution, and more Apply online or contact … additional holidays Pension contribution Life Insurance Flexible working arrangements Employee discount – nursery benefit scheme And more… WHAT WILL YOU BE DOING? As a Data Engineer, you’ll be responsible for developing and maintaining robust data pipelines and integrations to support the organisation’s reporting and analytics … needs. You’ll design and manage ETL processes, ensuring seamless data extraction, transformation, and loading into reporting systems. Working with cloud-based platforms and relational databases, you’ll optimise data workflows for performance, scalability, and reliability. You’ll collaborate with IT and data teams More ❯

Job Title: AWS Data Engineer Location: UK Wide Travel Frequency: Hybrid (Need to travel on-site 2-3 days per week to any nearby Capgemini office) Working Pattern: Full-time Permanent The Job You're Considering The Cloud Data Platforms team is part of the Insights … and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers' digital … and data transformation journey using the modern cloud platforms. We specialise in using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP. Your role We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to More ❯

you'll grow both professionally and personally. Community: Join a diverse, passionate team that values collaboration . We're looking for a Senior Data Engineer based in London to join our Data Team to help shape the future of the data infrastructure that powers … their work on the life sciences industry, and this fuels their passion. The core skills we seek: Expertise in Python and SQL for data processing, analysis and automation. Proficiency in building and maintaining batch and streaming ETL/ELT pipelines at scale, employing tools such as Airflow, Fivetran … Production experience across the core technology stack of Python and SQL for data scripting and transformation, data engineering tools for pipeline development and orchestration and running on cloud infrastructure such as AWS. Delivery-focused and pragmatic in ensuring customer value is delivered efficiently, with necessary More ❯

ASAP About The Company: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that … into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing … from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up More ❯

Azure Data Engineer | Work From Home 🚀 📍 Location: Work From Home - Need to be based around either London or the Midlands 💰 Salary: £60,000 - £70,000 (Basic) 🏢 Company: Managed Service Provider Role: As an Azure Data Engineer within a managed service provider, you will design, develop, and … maintain modern data solutions leveraging the Microsoft Azure ecosystem. Your responsibilities include building robust data pipelines, integrating diverse data sources, and enabling advanced analytics using services like Azure Data Factory, Synapse Analytics, Data Lake, and Microsoft Fabric. You'll play … a key role in helping clients unlock the value of their data through scalable, secure, and efficient solutions, while supporting ongoing data platform operations in a managed services environment. Responsibilities: Working for one of their end clients supplying a resource that can help this client from More ❯

Data Scientist (Mid Level) - Maidenhead We are looking for a mid-level Data Scientist to join our client's growing team. You will use your skills in data analysis and machine learning to uncover insights, build predictive models, and support decision-making across various … projects. You’ll also work closely with engineers, product teams, and other stakeholders to deliver data-driven solutions. Benefits: Pension Health insurance Employees will be receiving a quarterly stipend to spend Employee Assistance programme – wellbeing 25 days holidays Group Life assurance scheme Long Term Disability Scheme Key Responsibilities … identify patterns and insights Build and improve machine learning models to solve business problems Design and analyze experiments (A/B testing, etc.) Data Engineering Support Work with data engineers to ensure clean, usable data Build and maintain data pipelines for model More ❯

and retaining talent - and yet so many companies struggle to get it right. They simply have no choice but to rely on poor data and unsophisticated tools for their pay decisions. That's why we created Ravio. We help many of the world's most innovative and ambitious … companies build stronger teams and reach their goals through better compensation. Our real-time data platform brings compensation into the modern age, tracking the market across all compensation types from salary to equity and benefits. We're passionate about ensuring everyone is paid what they deserve, no matter … and maintaining Ravio's data pipelines and infrastructure - the core of our business. Shape and implement the data roadmap, improving pipeline structure, robustness, testing, and continuous development as well as helping oversee the team's cloud infrastructure. Ensure data quality, governance, and security More ❯

Job Title: Data Science Internship Location: London, United Kingdom (Remote) Stipend: £1800 - £2500 Pimlico Enterprises is dedicated to helping organizations unlock smarter, faster decisions through data-driven strategies. As we expand our impact, we’re looking for a Data Science Intern to join our … innovative analytics team and support our digital consultancy and transformation initiatives. This internship offers a valuable entry point for recent graduates or aspiring data professionals ready to launch their careers in data science. You'll gain chance to work with our senior AI and ML Engineers … assist in projects, and grow within a collaborative, forward-thinking environment that encourages learning and exploration. Key Responsibilities As a Data Science Intern , you’ll collaborate with experienced team members on impactful projects, helping to support data-informed decisions across both internal operations and client engagements. More ❯

Spark, Apache Beam, Google Cloud Dataflow We're working with a forward-thinking consultancy that helps top companies build and scale high-performance data platforms . They take an engineering-first approach , and more than half of their team consists of hands-on engineers. If you love working … with large-scale data processing and cutting-edge cloud technologies, this one’s for you. What You’ll Be Doing: 🔹 Building data pipelines and ETL workflows that process huge datasets 🔹 Designing, optimizing, and maintaining high-throughput reporting solutions 🔹 Working with Apache Spark for large-scale data … Terraform ✔ Deep understanding of Apache Spark for large-scale data processing ✔ Knowledge of Apache Beam & Google Cloud Dataflow for data pipeline orchestration ✔ A team-first mindset with strong communication skills This is a contract role outside IR35 , so you must be UK-based and have More ❯

Lead to join a leading enterprise client on an initial 6-month contract. This is a fantastic opportunity to work on business-critical data integration and cloud transformation initiatives, leveraging cutting-edge Informatica and cloud technologies within a complex data landscape. This hybrid role offers a … high-impact environment focused on architecture, implementation, and optimisation of data pipelines and analytics infrastructure. Key Responsibilities: Provide hands-on technical leadership using Informatica Intelligent Cloud Services (IDMC) and PowerCenter across integration and data quality initiatives. Design and implement scalable data pipelines and applications … to process high volumes of structured and semi-structured data. Develop and support robust data solutions that align with cloud architecture standards (IaaS, PaaS, SaaS). Optimise performance of complex SQL queries and ETL workflows. Lead infrastructure architecture design, hardware sizing, and security configuration for data More ❯

problems as well as ability to think abstractly Experience with Natural Language Processing: Java or Python, and ML, AI, Labeling, Annotation, Data Pipeline, Big Data, AWS, or Cloud Services Experience with Computer Vision: Kernel, Hardware Accelerator, TVM, or Code-gen Experience with Deep Learning: C++ … on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Posted: October 18, 2024 (Updated 4 days ago More ❯

Data Product Engineer At Sense Street, we are developing natural language understanding systems for capital markets. Our premise is simple: markets are conversations, and we aim to help investment banks and asset managers have better, more efficient conversations. Through our partnerships with global banks, we have access to … company founded by professionals with experience spanning machine learning, trading, and quantitative research. This is a new and evolving role, ideal for a data or software engineer who wants to work at the intersection of data engineering, ML infrastructure, and product integration. We don't expect … with all of these-this role is a great opportunity for someone who wants to grow into and shape the intersection of AI, data, and product development. You'll collaborate closely with ML engineers, data scientists, and product & UX design to bring AI models into production More ❯