76 to 100 of 428 Data Pipeline Jobs in the UK

Senior Data Engineer £65,000 - £75,000 + 10% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful … change is seeking to add a Senior Data Engineer to the team based in London. Requirements of a Senior Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift … Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and more »

Principal Data Engineer £80,000 - £103,000 + 15% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful … change is seeking to add a Principal Data Engineer to the team based in London. Requirements of a Principal Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift … Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and more »

Lead Data Engineer Salary: Up to £50,000 National/Up to £60,000 London Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for a highly skilled data engineer with significant experience of … snowflake. As well as being an expert in the snowflake cloud platform, you’ll have a strong background in data ingestion and integration, designing and implementing data pipelines on various technologies, data modelling, and a rounded understanding of data warehousing. Aviva believes … strongly in experimentation leading to industrialisation and we are searching for passionate, energetic data engineers who are focussed on using their skills to drive out real business value for our customers. A bit about the job: An exciting opportunity within one of our data engineering teams more »

Complexio is Foundational AI. This works to automate business activities by ingesting whole company data – both structured and unstructured – and making sense of it. Using proprietary models and algorithms, Complexio forms a deep understanding of how humans are interacting and using it. Automation can then replicate and improve … Management, C Transport Maritime, Trans Sea Transport and BW Epic Kosan. Key Responsibilities 👥 Collaborate with cross-functional teams to design and build scalable data solutions that support product innovations and business insights. 🔨 Develop and maintain robust data pipelines that support complex data collection, ingestion … engineering or a related field. Proficient in and experience with relational databases (e.g., MySQL, PostgreSQL) as well as Strong experience with data pipeline and workflow management tools (e.g. sbt, Nifi). Familiarity with big data technologies, such as Spark. Especially when to use or not. more »

Senior Data Engineer Hybrid (flexible) Scotland £45 - 60K + 10% Bonus Are you ready to play a pivotal role as a Data Engineer in a major greenfield project? A FTSE 100 energy company, dedicated to becoming a leader in the low carbon world, is investing … them on their ambitious journey towards net zero and help create a sustainable and inclusive future for everyone. The Role: As a Senior Data Engineer, you will develop and optimise data pipelines within the Microsoft data capability stack, focusing on the new Fabric data platform. Reporting to the Lead Data Engineer, you'll be part of a dynamic team driving innovation and enhancing data-driven decision-making. Key Responsibilities: Lead the design and implementation of sophisticated data models and pipelines. Collaborate with data management more »

GCP Data Engineer Remote, but UK based up to £600pd - Outside IR35 I'm working with a great organisation to source a GCP Data Engineer for a new project. Your Knowledge & Experience 5+ years experience in Data Engineering/Architecture (or similar). Broad … knowledge of different technical areas (DevOps, Engineering, Architecture, Various Datastores, etc). Strong proficiency in SQL & Python . Experience working with Spark (Pyspark) , data streaming, and big data solutions. Experience with Databricks would be great. Designing and building data warehouses … data lakes in BigQuery, including data modeling and mapping using techniques such as medallion and star schema. Data pipeline/ETL Development , building ingestion pipelines that produce scalable data products as outputs for analytics. Orchestration frameworks such as Dataform , Airflow, and more »

ValueDriven is a leading Artificial Intelligence and Data Consulting company dedicated to providing credible, reliable, and value-driven outcomes for transformative impact. We specialize in the development of AI and data-driven solutions, helping organizations of all sizes make data-informed decisions and optimize … innovation, collaboration, and the delivery of outstanding results for our clients. We are currently seeking an experienced and highly skilled Senior Consultant in Data Engineering to join our team at ValueDriven. The Senior Consultant will play a crucial role in designing, implementing, and optimizing data solutions … for our clients, ensuring that their data infrastructure meets their unique needs and requirements. The ideal candidate will have extensive knowledge of data engineering best practices, technologies, and tools, as well as a passion for solving complex data challenges. Responsibilities: Collaborate with clients to more »

Data Engineer - Exchange trading platform Location: London, 3 days per week in the office Salary range: £60,000-£65,000 + benefits Purpose: Design, build, and maintain scalable data architectures Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake, Airflow, BigQuery, PowerBI/… consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing … ETL Processes: Deep expertise in developing and optimising ETL pipelines. Version Control: Experience with Git for code collaboration and change tracking. Data Pipeline Tools: Proficiency with tools such as Apache Airflow. Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP. Visualisation: Tableau or PowerBI Delivery Tools: Familiarity more »

Lead Data Engineer/Lead Data Developer - Azure, SQL What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and … Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to … the continuous improvement of data-driven decisions that improve the services the client provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide more »

Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data … verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and … SQL queries. • Proficient in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and more »

Lead Data Engineer - Snowflake/DBT/Python - ecommerce - £95k Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering … end to end data requirements and designing data pipelines/warehouses to ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a … new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects more »

Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds. Your role will be essential in helping customers build … and maintain data pipelines and applications, using proprietary commercial software, ensuring data projects can be rapidly prototyped and delivered for customer needs. You will Design, develop and maintain bespoke full end-to-end data projects Work closely with data scientists, analysts, product … end/user-facing application development Build ontologies to aid in the creation and management of structured data assets Data pipeline building for the creation of data pipelines Utilise PySpark for large scale data pipelines Collaborate on software development practices within more »

About the job Role: Data Engineer Location: London, UK (Hybrid) Harmonic is delighted to partner with a cutting-edge central London fast-growth media agency, in its search for a Data Engineer. They are looking for someone with proven experience in the development, maintenance, and testing … of data pipelines and most importantly passionate about all things data! To hit the ground running in this role, you will possess solid data warehousing experience, ideally with cloud-based data storage systems such as Google Cloud Platform (GCP), Azure, or AWS. … Imagine being at the forefront of a media revolution, where data is the key to unlocking unprecedented insights. This agency is experiencing explosive growth, and as it accumulates vast amounts of data from diverse sources, the role of Data Engineer becomes absolutely pivotal to more »

knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. … Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data more »

A Data Engineer is sought to drive impactful data initiatives within a high performing organisation. The Data Engineer will spearhead data strategies and foster innovation across the operations. The organisation is a premier provider of essential products and services across Europe, dedicated … to improving quality and reliability in the sector. In this role, the data engineer will be pivotal in designing and executing solutions for the entire data lifecycle, including data acquisition, storage, modeling, transfer, hosting, visualisation, analysis, and consumption. The Data Engineer will … also be responsible for guiding and developing the skills of team members. Key Responsibilities: Architect and implement comprehensive data pipelines for efficient data acquisition, storage, processing, and interface creation. Generate both machine-readable interfaces and user-friendly data products, encompassing standard and custom reports. more »

Data Engineer £55,000 - £65,000 per annum + benefits London Hybrid (3 days a week in office) Data Engineer | ETL | Data Pipelines | HealthTech | Beauty | Python | SQL | GCP | Azure | AWS | BigQuery | Cloud Functions | Pub/Sub | DataFlow | Data Studio | Shopify | Migration | Data Architect This HealthTech scale-up is looking for a Data Engineer to support them as a no.2 within the department and manage their biggest migration to date. Core experience required: Python SQL GCP, Azure, or AWS cloud experience Problem solver Bonus experience required: GCP (BigQuery, Cloud … Functions, etc.) Migration experience to Shopify Interest in Data Architecture Exposure to Analytics of Data Science Data Engineer | ETL | Data Pipelines | HealthTech | Beauty | Python | SQL | GCP | Azure | AWS | BigQuery | Cloud Functions | Pub/Sub | DataFlow | Data Studio | Shopify | Migration | Data more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite … your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing … storage, and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them more »

Australia. It s official: Bazaarvoice is a Great Place to Work in the US , Australia, India, Lithuania, France, Germany and the UK Staff Data Engineer (P7) - Global Data Platform (Enablement) team What is the BV Data team at Bazaarvoice? Authentic data is … the lifeblood of the Bazaarvoice business. It is imperative that our data is consumable, interpretable, and instantly available to fuel insights across our brand, retailer and consumer customers. The BV Data team works closely with Product, Engineering, Business Development, and Account teams to consistently find new … ways to use data across the business. Who We Want Are you ready to combine your talent for crafting solid data systems and enthusiasm for cutting-edge technology to harness the power of data at Bazaarvoice? We re looking for a strong data more »

Learning Engineer (NLP & LLM) Up to £90,000 LONDON Ready to elevate your career to new heights? Join a team of experienced Data Scientists and Data Engineers to create impactful LLM s models and work with cutting-edge NLP technologies. The Role: Work end-to … performance, and make informed solution selections. Conduct comprehensive work spanning the entire data lifecycle, including data exploration, data pipeline development, insights and feature extraction, machine learning model creation, and deployment. Collaborate on consulting-style pilot projects aimed at helping clients gain a deep … understanding of their data and identifying problems that can be addressed through the platform. Collaborate closely with data scientists and data engineers to construct and implement machine learning models. Take an active role in leading team meetings and client workshops. Assist in establishing software more »

Data Engineer - London - £65,000 I am working with a London based company who specialise in the organisation of large-scale events who are looking to add a Data Engineer to their growing data team. You will join the organisation at a significant point … in their data journey as they have redesigned their data platform so they can better deliver data to stakeholders across the business. In this role you will work alongside the Data Architect, Data Engineers and Data Analyst as … will join a business who are passionate about the development of its people. You will also be encouraged to be involved in the data community with the opportunity to attend conferences and events to broaden your knowledge! In this role you will be responsible for the development and more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed. Modern tech stack - Python, AWS more »

aspirations for strategic expansion and growth to be achieved through both organic and acquisitive means. The Role: We are currently hiring for a Data Architect, who will be accountable for architecting, enhancing, managing, and supporting a highly available, distributed, cloud data platform for Sysco International business … units and enterprise data. The Architect will collaborate with the International business units, US architecture team and Sysco 3rd party Vendors to create data solution andl ensure alignment between the international businesses in the deployment of initiatives. The role will also be the point of escalation for the … Expertise in both leading and hands-on experience in data engineering and management activities such as Data Integration, Building Pipelines, Data ingestion, warehousing, modelling and reporting. Hands-on experience in designing and managing large-scale, distributed data platforms, particularly using data more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »