576 to 600 of 925 Data Pipeline Jobs in the UK

scale-up thats reshaping how financial institutions manage transaction reporting and reconciliation . Our platform helps financial services firms meet complex regulatory obligations with automation, AI, and smart data pipelines. We're looking for a hands-on leader to help us scale, improve quality, and innovate faster. Key Responsibilities Team Leadership: Lead, coach, and grow a talented team More ❯

you the chance to help make the UK a safer place through innovation, working in partnership with government and law enforcement organisations on some of the most challenging data and technology problems out there. We strongly encourage candidates of all different backgrounds and identities to apply. We are committed to building an inclusive, safe and supportive environm ent … Here are some things we've worked on recently that might give you a better sense of the kind of work you could be leading on: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight generation. A search and … reporting system backed by an ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-end An AI assurance capability Orchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. Accountabilities: Understands the technical aspects of the project and the wider customer business model. More ❯

on Python-based AI/ML development, automation, and general software engineering. The successful candidate will play a key role in building and deploying machine learning features and data-driven applications. You will work on end-to-end solutions - from writing robust code and unit tests to developing APIs and integrating machine learning models into our product ecosystem. … to hear from you. Experience in the travel or retail industry would be an advantage. Responsibilities Design, implement, and maintain software components that incorporate machine learning algorithms and data processing. Develop clean, efficient Python code for both backend logic and integration of ML models. Understand the business drivers behind each feature. Create and optimise data pipelines … and software architectures Familiarity with CI/CD and automation tools. Experience using Git for version control and platforms like Bitbucket for code collaboration. Knowledge of build tools and pipeline configuration (Jenkins) to automate testing and deployment. Strong problem-solving and analytical skills Presentation and teamwork skills Understanding of both Waterfall and Agile methodologies About Datalex Datalex's purpose More ❯

seeking a highly experienced Platform Delivery Lead to manage and ensure seamless delivery across multiple technology streams - including Front End Development, Cloud Infrastructure, Shared Business Services (SBS), and Data Platforms (including DBT and Power BI). This role will play a pivotal part in driving end-to-end solution delivery, cross-functional collaboration, quality assurance, and stakeholder satisfaction. … Key Responsibilities: Lead and manage the delivery of multiple concurrent initiatives across Front End, Cloud, SBS, and Data streams. Ensure on-time, on-budget, and high-quality delivery aligned with business goals. Coordinate delivery activities across cross-functional engineering, cloud, data, and reporting teams. Technical Oversight & Coordination Oversee Front End engineering (React, Angular, etc.) ensuring adherence … UX/UI standards. Collaborate with Cloud teams on infrastructure, DevOps, scalability, and performance. Coordinate with SBS teams to ensure integration of shared services and common components. Manage data engineering efforts including DBT models, data pipelines, and Power BI reporting solutions. Serve as the primary point of contact for senior stakeholders, providing updates on delivery progress More ❯

Craft: Data, Analytics & Strategy Job Description: Activision Blizzard Media is the gateway for brands to the cross-platform gaming company in the western world, with hundreds of millions of players across over 190 countries. Our legendary portfolio includes iconic mobile game franchises such as Candy Crush, esports opportunities like the Call of Duty and Overwatch Leagues, and top … about more than work. We love games, and are obsessed with creating the best player experience. Responsibilities Partner with senior engineers, architects, and product owners to build scalable data pipelines and services. Work with the product team to understand the business requirements and translate them into development/design tasks. Be a role model in engineering best practices … of experience working with relational databases such as MySQL, Postgres, etc. 2+ years of experience with NoSQL databases like Bigtable, Cassandra, HBase, etc. Experience with schema design and data modeling. Strong understanding of large-scale distributed data processing. Experience with developing extract-transform-load (ETL). Experience with distributed messaging systems like Kafka and RabbitMQ. Experience More ❯

Senior Data Engineer UST are currently recruiting for a Senior Data Engineer with proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. About the role The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong … coding skills in Python PySpark and SQL. You will have expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Job Description: Work as part of a self-organised Ab Initio … any inconsistencies with the standards (written or best practices) You will be able to estimate the delivery timescales and justify these estimates You will be aware of the Jenkins pipeline principles Knowledge of Agile practices Experience that would be advantageous: You will be aware of AWS interactions and file storage You will have a core understanding of Lambda programming More ❯

EE business, for an 8-month fixed-term contract in replacement of a maternity leave. As Business Intelligence Engineer, you will be driving force powering the team's data, engineering and analytical needs. You will be involved in EU-wide strategic projects to drive growth and reduce cost-to-serve working with product managers, data engineers … with experience working with technology and engineering teams Key job responsibilities: Engage stakeholders in constructive dialogues to convert problem statements into logic problems that can be solved with data and scripting. Be integral part of the design process for new initiatives and nascent workstreams. You will apply your business sense to help bring the vision to life. Design … scripting experience (Python) to process data for modelling Experience with SQL Experience in the data/BI space Top 3 Must Have Skills: SQL QuickSight Pipeline Engineering, ETL, Python More ❯

Join a mission-driven team shaping the future of geospatial data engineering. We’re looking for a Principal Data Engineer to lead the design and delivery of cutting-edge data solutions across cloud platforms and spatial technologies. If you're passionate about geospatial data, cloud architecture, and building scalable pipelines, this is … your chance to make a real impact. What You’ll Be Doing: Architecting and implementing robust data pipelines using FME and QGIS . Leading cloud-based data engineering projects across AWS and Azure . Collaborating with cross-functional teams to deliver high-impact geospatial solutions. Mentoring junior engineers and setting best practices for data engineering excellence. Driving innovation in spatial data processing, automation, and analytics. What You’ll Bring: Proven experience as a Senior or Principal Data Engineer . Deep expertise in QGIS and FME for geospatial data transformation. Strong hands-on experience with AWS (e.g., S3, Lambda, Glue) and/or Azure (e.g., Data More ❯

Data Engineer - GCP | £500-£550 per day | Inside IR35 6-Month Contract | Hybrid (2 Days Onsite - Osterley) 83zero are partnered with a leading media and broadcasting organisation on the lookout for a skilled Data Engineer to join their Data & Analytics team on an initial 6-month contract . This role is perfect for someone … with strong ETL expertise , deep experience in Google Cloud Platform (GCP) , and a passion for building scalable, cloud-native data pipelines. You'll work with cutting-edge tech in a fast-paced environment, helping to deliver critical insights and analytics to the business. What You'll Be Doing: Designing and developing scalable ETL pipelines to process and deliver … . Automating infrastructure using Terraform , Ansible , and CI/CD tooling. Writing clean, efficient code in Python , Go , and BASH . Supporting and maintaining a secure Linux-based data engineering environment. Collaborating with stakeholders to ensure data pipelines meet business needs and SLAs. What We're Looking For: Proven experience in data engineering with More ❯

About us We are a fast-growing team on a mission to reimagine analytics and make data accessible to all. The Count canvas combines the power of data notebooks with the collaborative workflow of digital whiteboards. We're often referred to as the "Figma for data" because of the way Count transforms the way … data teams work with the wider business through greater transparency and trust. Since launching in September 2022 we have seen the canvas concept explode, with Count empowering some of Europe's leading tech companies- including Cleo, BeautyPie, TooGoodToGo and Omnipresent- to revolutionise how their teams understand and work with data. What you'll do We're looking for … an exceptional software engineer to help shape Count's next stage of growth. You'll own technical projects at the intersection of software development, data engineering, analytics and DevOps infrastructure, playing a key role in automating and scaling processes that empower every team across the organisation. Your responsibilities will include: Scaling our Go-To-Market (GTM) stack : Work More ❯

Data Manager (BI) A specialty insurer is looking for a Data Manager (BI) to help shape and drive the next phase of their enterprise data platform. This is a hands-on role that also carries leadership responsibilities, sitting right at the intersection of data engineering, BI architecture, and business strategy.You'll work … closely with senior stakeholders and technical teams to deliver scalable data solutions, build and manage data pipelines, and turn complex requirements into meaningful, actionable insights - all within the Microsoft tech stack.What we're looking for:Strong experience across the Microsoft BI stack - SQL Server, Power BI, SSAS, SSIS Good knowledge of data engineering principles More ❯

Data Scientist - GCP | £500-£550 per day (Inside IR35) 2 Days Onsite - Isleworth, West London | 6-Month Contract (Extendable) 83zero are partnered with a global leader in media and broadcasting, looking for an experienced Data Scientist to support a business-critical project. You'll be joining a collaborative team of data scientists and engineers … to build and refine machine learning models that deliver genuine commercial impact. What You'll Be Doing: Work closely with fellow data scientists to explore how AI/ML can unlock insights and improve decision-making. Perform advanced analysis on large, complex datasets using statistical and modelling techniques. Build, test, and tune ML models (especially NLP or computer … ML libraries, all within Google Cloud Platform (GCP) . Optimise models for accuracy and performance, ready for product integration. Stay up-to-date with the latest developments in data science and AI to drive innovation. Present insights, results, and model performance clearly to both technical and non-technical stakeholders. Ensure your workflows are reproducible and well-documented, including More ❯

We are working with a global financial instituition to recruit for a data analyst in theMarkets Program Execution & Transformation - Data Acquisition Team, a strategic unit within Global Markets that collaborates with Legal, Compliance, Finance, and Operations & Technology to deliver regulatory and cross-business transformation initiatives. This role focuses on designing and implementing integrated data solutions that support regulatory rulemaking, supervisory requirements, and strategic change projects. You'll work across multiple workstreams, delivering high-impact data solutions that drive efficiency and compliance for Markets and its clients. Key Responsibilities Build and optimize PySpark and SQL queries to analyze, reconcile, and interrogate large datasets. Recommend improvements to reporting processes, data … documentation including BRDs, FRDs, test plans, and UAT scenarios. Manage project milestones, tasks, and stakeholder communications to ensure timely delivery. Essential Criteria 5+ years of experience in Technical Data Analysis. Proficiency in SQL, Python, and Spark. Experience within an investment banking or financial services environment. Exposure to Hive, Impala, and Spark ecosystem technologies (e.g. HDFS, Apache Spark, Spark More ❯

Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies. In 2021, we went public on the New York Stock Exchange, and we continue to reach new heights! Come work alongside Similarwebbers across the globe who are bright, curious … practical and good people. We are looking for a skilled Data/Backend Engineer to join our high-performing Data Labs team and help design high-scale systems that retrieve, process, and analyze digital data. You'll build and maintain robust backend infrastructure and data pipelines that power Similarweb's most strategic, data … environment and thrives on solving complex technical challenges. You'll work with leading global brands, helping them unlock insights from our unique datasets. Our team specializes in custom data solutions tailored to client needs, collaborating closely with product and sales to assess requirements, ensure feasibility, and deliver scalable systems. You'll own projects end-to-end, from architecture More ❯

libraries (e.g. PyTorch Geometric, DGL). Comfortable working with Python in collaborative software engineering environments. Awareness of cloud tools (e.g. AWS, GCP, Azure ), MLOps practices, and data pipeline technologies is a plus. 🌟 Bonus Skills Experience with model optimisation techniques for deployment (e.g. quantisation, pruning, distillation). Open-source contributions, research publications, or involvement in AI/ML More ❯

You'll Do Design and develop robust backend applications (initially in your core language, with support to learn and transition into Go/Golang) Build scalable APIs and data pipelines integrating with third-party platforms Write clean, maintainable code with strong testing practices Collaborate in agile sprints to deliver high-quality features and improvements Contribute to CI/ More ❯

experienced. The User Foundations team plays a pivotal role in delivering key user capabilities shared across Disney+, Hulu, ESPN+, and Star+. We build high-throughput, reliable services and data pipelines that gather user insights and power personalization across all our platforms. We're a dynamic, fast-paced, and collaborative team looking for a skilled Software Engineer who thrives More ❯

team. You'll play a key role in building scalable, reliable systems that power the growth of our platform and user base. You'll work on backend services, data pipelines, and automation tools that enable experimentation, user acquisition, retention, and performance optimization. This role involves collaborating closely with product, platform, and growth teams to develop systems that support More ❯

experienced. The User Foundations team plays a pivotal role in delivering key user capabilities shared across Disney+, Hulu, ESPN+, and Star+. We build high-throughput, reliable services and data pipelines that gather user insights and power personalization across all our platforms. We're a dynamic, fast-paced, and collaborative team looking for a skilled Software Engineer who thrives More ❯

Vacancy for Data Engineer at The UK National Archives Vacancy for Data Engineer at The UK National Archives London Full-Time The National Archives is looking for an experienced Data Engineer with in-depth experience in data design and engineering to help build the next generation of digital archiving services. We are … currently creating new digital services to help our users send public data and records to the archive and preserve this nationally important resource for the future. We have the ambition to do more to structure, enrich and analyse that data to make it easier to find, use and understand and open up new access routes for … your understanding of developing technologies that can be applied to enhance understanding of archival content and enable access and re-use of public data. ABOUT YOU: As our Data Engineer, you will have a strong background in creating models and schemas, managing and enriching data, constructing data products and services, and integrating them into More ❯

by Gartner Peer Insights as the top platform for Procurement Analytics in September 2023, we are acclaimed for our value, feature depth, quick implementation, superior service, and advanced data analytics. Role Description This is a contract hybrid role for a Power BI Consultant, located in the London Area, United Kingdom, with some work-from-home flexibility. We are … seeking a highly capable and motivated Power BI Specialist to join our data and analytics function. This role is ideal for someone with a strong background in Power BI development, data transformation, and integration, preferably with exposure to regulated sectors such as defence, government, or public services. You must be willing and eligible to obtain Security … and maintain the existing suite of Power BI dashboards. Gather and analyse future reporting requirements from stakeholders. Design, develop, and deploy new Power BI dashboards and reports. Automate data pipelines to streamline data refresh and reporting processes. Create and maintain documentation including user guides and technical specifications. Plan and prioritise future reporting needs in collaboration with More ❯

by Gartner Peer Insights as the top platform for Procurement Analytics in September 2023, we are acclaimed for our value, feature depth, quick implementation, superior service, and advanced data analytics. Role Description This is a contract hybrid role for a Power BI Consultant, located in the London Area, United Kingdom, with some work-from-home flexibility. We are … seeking a highly capable and motivated Power BI Specialist to join our data and analytics function. This role is ideal for someone with a strong background in Power BI development, data transformation, and integration, preferably with exposure to regulated sectors such as defence, government, or public services. You must be willing and eligible to obtain Security … and maintain the existing suite of Power BI dashboards. Gather and analyse future reporting requirements from stakeholders. Design, develop, and deploy new Power BI dashboards and reports. Automate data pipelines to streamline data refresh and reporting processes. Create and maintain documentation including user guides and technical specifications. Plan and prioritise future reporting needs in collaboration with More ❯

Job Title: Data Analyst - SQL/Python/MS SQL Location: London - up to 3 days per week Salary/Rate: Up to £275 a day Outside IR35 Start Date: 04/08/24 Duration: March 2026 Company Introduction We're looking for a hands-on Data Analyst who has experience digging into data, producing clean outputs, and getting answers from complex datasets. This is a data churning role, ideal for someone who is comfortable writing SQL, working with Python, and navigating MS SQL Server databases day-to-day. Job Responsibilities/Objectives Extract, clean, and process data using SQL (must be confident writing queries). Work with … large datasets in MS SQL Server environments. Use Python for data manipulation, automation, and analysis tasks. Deliver regular and ad-hoc reports for internal stakeholders. Identify inconsistencies and resolve data issues to maintain data quality. Collaborate with the team to turn business questions into data-driven insights. Required Skills/Experience Professional More ❯

As a Data Engineer with a focus on NLP, you will play a crucial role in the development of our initial platform. Your primary responsibilities will include designing, implementing, and optimizing data pipelines that support AI-driven call handling solutions. You will work collaboratively with cross-functional teams to enhance our platform's capabilities, ensuring it … and strive for continuous improvement. Ownership: Take pride in your work and reject mediocrity. Empathy: Show genuine care and consideration for others. You will: Develop and maintain scalable data architecture that supports natural language processing tasks. Implement data processing workflows to prepare text data for NLP applications, including text extraction, cleaning, and transformation. Collaborate … with data scientists and software engineers to integrate machine learning models into our platform. Utilize AWS tools and services to enhance data management and processing efficiency. Contribute to the documentation and technical specifications for the data infrastructure supporting the application. Key Requirements: Proven experience in data engineering, with a strong background in More ❯

organisation's Snowflake strategy, architecture, and delivery model. You'll bring your deep technical expertise, leadership experience, and direct engagement with Snowflake to build a best-in-class data platform offering. Key Responsibilities: Lead the design, setup, and growth of a Snowflake practice, including establishing a Centre of Excellence. Architect, implement, and maintain scalable data solutions … development and operations. Provide technical leadership in delivery planning and ongoing engagements. Ideal Candidate Profile: 4+ years of hands-on engineering/architecting experience with Snowflake , including architecture, data modelling, and performance optimisation. Proven experience … in setting up a Snowflake centre of excellence or equivalent technical leadership in a Snowflake-focused practice. Strong knowledge of Snowflake's platform, product roadmap , and data pipeline orchestration. Prior experience working directly with Snowflake (e.g., strategic partnerships, co-delivery models, early adopter programs). Demonstrated technical leadership experience, managing teams or guiding complex Snowflake implementations. Expertise More ❯