26 to 50 of 53 Data Pipeline Jobs in East Yorkshire

Senior Cloud Data Engineer – Work from Home About the Role My client is looking for a Senior Data Engineer to help lead the transformation of their cloud data infrastructure. This is an exciting opportunity to work within a highly autonomous team building secure, scalable … and modern data solutions that support a software ecosystem. You’ll design and implement robust data pipelines, models, and platform architecture – enabling better decision-making, reporting, and real-time data services. The environment is agile, forward-thinking, and full of opportunities for ownership and … innovation. Key Responsibilities Design and deploy cloud-based data platforms using Snowflake, DBT, and related tools Develop performant, scalable ETL/ELT pipelines across varied data sources Build and maintain dimensional models using Kimball, Data Vault, or Data Mesh methodologies Collaborate with More ❯

Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a More ❯

Job Title: Data/Business Analyst Location: Remote (UK-based) with occasional client site visits Salary: £55–65k This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The … role involves working both remotely and on-site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system … with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive More ❯

Software Engineer – Python/Data and Scalability We’re seeking a Software Engineer/Python Developer to join a growing team focused on transforming critical technology systems and data pipelines within the investment management sector. This role involves enhancing market data processes, improving robustness … issues. It’s a fantastic opportunity to work with modern tech stacks while delivering meaningful improvements across business-critical systems. Key Responsibilities: Optimise data processes : Enhance stability and throughput across operations, market data, and portfolio management systems. Rebuild market data flows : Complete and refine … Python-based data pipelines, transitioning from legacy systems. Root cause analysis : Investigate and resolve underlying issues causing delays or failures in processes. Develop scalable solutions : Build and maintain reliable data flows and integrations within the Cloudera environment. Collaborate across teams : Work with production support, software engineering More ❯

working directly with senior architects and distributed peers across the US and EMEA. You'll lead by doing — designing and building serverless microservices, data-rich APIs, and resilient infrastructure that scales. This is a hands-on role that also offers long-term opportunities to grow into technical leadership … Build and refine APIs (REST and GraphQL) using AppSync, API Gateway, and EventBridge • Work with DynamoDB, Aurora Serverless, and S3 for cloud-native data solutions • Collaborate with frontend (Vue.js) and data platform engineers (Snowflake, Airflow) • Contribute to CI/CD pipelines, observability, and day-2 operational … non-technical audiences Bonus Experience • Familiarity with IaC frameworks (CloudFormation, Terraform, SAM) • Exposure to Snowflake, DBT, Airflow, or cost analytics/data pipeline tools • Knowledge of FinOps practices or cost intelligence platforms • Experience contributing to open-source platforms or cloud-native communities • Working knowledge of ML or More ❯

of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for a motivated and technically capable Graduate Data & AI Engineer to join our growing Microsoft consultancy team. This is an exciting opportunity for someone early in their career to gain hands-on … experience delivering real-world Data and AI solutions on the Azure platform, while also developing consulting skills through direct customer engagement. In this role, you’ll support the design, development, and deployment of data pipelines, analytics solutions, and AI-powered applications. You’ll work alongside experienced … engineers and consultants, contributing to a wide range of projects- from traditional data engineering and reporting to modern machine learning and Generative AI initiatives. We’re looking for someone who is passionate about technology, eager to learn, and comfortable working in a dynamic environment. You should have a More ❯

tier quants, engineers, and analysts, contributing to systems that power critical investment decisions globally. 🧠 What You’ll Be Doing 📊 Design and develop scalable data pipelines for trading and quantitative analysis 🤝 Work closely with cross-functional teams to build efficient, production-grade systems 🚢 Ship robust tools used across the More ❯

Associate, Software Engineer – Data Focus I am searching for an Associate, Software Engineer – Data Focus for my client, a leading technology-driven commercial real estate firm focused on bringing digital innovation to the sector through advanced data and software solutions . You will join … a collaborative team of software engineers, machine learning scientists, and UX/UI designers, working on the buildout of transformative data-driven products. Key Responsibilities: Architect, build, and maintain efficient, scalable, and reliable data pipelines. Curate, onboard, and document external datasets for internal use. Conduct forensic … data analysis and troubleshooting to ensure data quality. Produce high-quality, maintainable code and contribute actively to peer reviews. Collaborate with stakeholders to understand analytical and product requirements. Integrate diverse data sources (APIs, S3 buckets, web interfaces) in multiple formats. Develop programmatically validated data More ❯

Senior Data Engineer Competitive Salary and Benefits Package Fully Remote I am working with a leading Fintech business who are currently strengthening their data team. In this key role, you will be working in an agile environment supporting multiple teams to develop creative data-driven solutions, building high performance, resilient, automated data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be very keen to hear from you: Advanced SQL Knowledge (Oracle, PostgreSQL, MSSQL, etc.). Scripting languages … Python, PowerShell). Web service APIs (SOAP, REST). Data modelling experience. Knowledge of Snowflake Analytics Platform would be an advantage. Experience in working within an Agile environment. Knowledge of GIT, Jenkins (CI). Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For a More ❯

Senior Data Operations Engineer Fully Remote Competitive Salary and Benefits Package I am working with a leading fintech client who are strengthening their data team. This is a key role, working as part of a team tasked with designing and developing high-performance and resilient automated … data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be really keen to hear from you: Advanced SQL Knowledge (Snowflake, PostgreSQL, MSSQL, etc.). Scripting languages (Python, PowerShell). Data quality and resolving … related processes Cloud Data Warehousing solutions and ELT/ETL solutions (e.g., Snowflake, DBT). Experience in working within an Agile environment. Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For more information and a confidential chat about this role, contact Mark Raine at More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working More ❯

experimentation and iteration Enjoys working in a high-ownership, fast-paced startup environment Nice to have (but not required): Experience with APIs, SaaS, data pipelines, or cloud platforms (e.g., AWS) Familiarity with TypeScript or modern frontend/backend stacks What You’ll Get £80k–£120k base salary + More ❯

Data Engineer Initial 3 month contract, outside IR35, rate DOE, Hybrid (London or Bristol 2 days pw) *Active eSC is required to be considered for the role* We are currently looking for an experienced Data Engineer to join our client's enterprise technology team and help … shape the future of their data landscape. Responsibilities: Design, build, and maintain robust data pipelines using Microsoft SQL Server Stack (SQL Server, SSIS, C#, T-SQL) Work with Python and Airflow to orchestrate data workflows across systems Leverage ElasticSearch/OpenSearch for high-performance … search and analytics Connect a range of systems and ensure seamless data integration across enterprise platforms Partner with cross-functional teams to deliver scalable, reliable data solutions Requirements: Strong experience in enterprise-scale environments Proven ability to solve complex data problems and implement efficient More ❯

for our innovative products and services. This position requires deep expertise in Python and hands-on experience with best practices in software architecture, data structures, algorithms, and design patterns. Your Responsibilities Design, implement, and optimize robust Python applications to support our core business functionalities, ensuring high performance and … Master’s degree in Computer Science, Software Engineering, or related field. Experience with Python-based machine learning libraries is a plus. Experience with data pipelines and Big Data frameworks. Familiarity with Agile methodologies, especially Scrum or Kanban. Why Work at A5 Labs? At A5 Labs, you More ❯

Data Engineer London (Hybrid) or Remote (UK) Up to £75k | 4-day workweek | | Unlimited leave About us Climate Policy Radar is on a mission to help people access and understand long climate documents. Nearly 350,000 users from over 100 countries already use our open databases and AI … of that, we have embraced a flexible, hybrid approach to work, including a 4 day workweek. Role Overview: We are looking for a Data Engineer to join our Platform team. Working with the existing team of three engineers and collaborating with the data science and application … teams. In this role, you will help build and improve the data and machine learning infrastructure supporting our R&D and production platforms of high-impact tools and products for global climate law and policy, already serving 330,000 users annually and opening up 500,000 pages of More ❯

machine learning, generative AI, and cloud-native tools, this is an opportunity to shape the future of the product and how they use data to solve real-world challenges. What You'll Be Doing: AI/ML Project Ownership Lead the delivery of machine learning initiatives from exploration … through to deployment and monitoring. Own the full development cycle for ML systems — including architecture, data pipelines, model training, and production deployment. Cross-functional Collaboration Work closely with Product, Engineering, and DevOps teams to embed intelligent features into our platform. Ensure smooth end-to-end integration of AI … programming, and technical reviews. Share learnings and help foster a culture of innovation and experimentation. Problem Solving at Scale Tackle challenges related to data quality, interpretability, bias, and reliability. Build processes and infrastructure that make AI/ML workflows efficient, robust, and repeatable. Documentation & Continuous Improvement Contribute to More ❯

RMN platforms, covering sponsored ads, programmatic DSP, self-service portals, and dynamic ad placements. Design scalable and modular RMN solutions, integrating Ad-Serving, Data Management Platforms (DMP), Customer Data Platforms (CDP), and Demand-Side Platforms (DSP). Ensure real-time bidding (RTB) and programmatic advertising capabilities … AI for automated ad creation, content personalization, and A/B testing. Enhance Dynamic Creative Optimization (DCO) capabilities for personalized ad experiences. 3. Data & Integration Framework Define data ingestion, processing, and activation strategies across first-party, second- party, and third-party data sources. Ensure … 4. Ad-Tech Stack & Cloud Architecture Design RMN solutions leveraging Google Cloud, AWS, or Azure, ensuring high availability and low-latency performance. Optimize data pipelines, real-time analytics, and identity resolution mechanisms. Oversee privacy-compliant data handling (GDPR, CCPA) and secure identity frameworks. 5. Stakeholder Collaboration More ❯

Our client, a leading financial services organisation, is looking for a Data Solutions Manager to lead a small team of experienced data engineers. You will be joining a fast growing team who are responsible for delivering, improving and maintaining robust data pipelines within an … ambitious data architecture. Our client has already fully transitioned to cloud, there is a mature platform in place, and you will be joining a high performing, proactive, and collaborative team. To be successful in this role, you will need the following experience: Strong hands-on data engineering experience Previous experience managing and mentoring data engineering teams Significant experience working with Snowflake, Azure, Data Factory and Azure DevOps Strong communication and stakeholder management skills This role is almost fully remote, with quarterly workshop visits to the clients office in the South More ❯

per annum 🔍 The Role As an Analytics Engineer , you’ll work across a range of exciting client projects, designing and building scalable data pipelines to support analytics on large, complex datasets. This is a client-facing role, ideal for someone who thrives in a fast-paced consultancy environment … and enjoys working closely with stakeholders. You’ll also play a key role in mentoring junior team members and contributing to the wider data engineering strategy. 💼 What You’ll Be Doing Building robust, scalable data pipelines across multiple client projects Presenting insights and technical solutions directly … Looking For Strong SQL and Python skills Experience with cloud platforms such as GCP or Azure Hands-on with BigQuery , Synapse , or similar data warehouses Familiarity with data visualisation tools — D3.js or similar Proven client-facing experience Previous consultancy experience is highly desirable This is a More ❯

Due to expansion an exceptional opportunity for a Senior Data Engineer . Leading the strategic direction of the Software Engineering Team you will have 10+ Years experience with exceptional Python, SQL and AWS component experience. Senior Data Engineer Location: Fully Remote (London Based Company) Salary: to … + Benefits Key Skills: • Experience designing and building high throughput, scalable, resilient and secure data pipelines. • Experience with the following AWS technologies : Glue jobs, Athena, S3, Step functions, Lambda, RDS (Aurora Postgres), DMS, Redshift, QuickSight, Kenesis Firehose. • Expert knowledge of SQL . • Hands on experience with Kafka. • Hands … on experience with Terraform. • Hands on experience of Python with a Data Analytics programming paradigm. • Experience building CI/CD pipelines • Exceptional troubleshooting and debugging skills. Good to have: • Experience with design and implementation of integration solutions for event/data streaming. • Experience working with Apache More ❯

Data & Document Automation Developer (Remote - £50K+) Location: Remote (with occasional travel) Salary: £50,000+ (DOE) Job Type: Full-Time, Permanent Are you a detail-oriented developer with a passion for automation and data processing? We’re looking for a Data & Document Automation Developer to … driving innovation in automated communication solutions. You'll work across dynamic projects using a blend of proprietary tech and industry tools to automate data workflows, support client delivery, and build internal systems. If you’re looking for a role where you can make a tangible impact and grow … within a stable, collaborative environment—this is it. 🔧 What You’ll Be Doing Creating and maintaining automated data pipelines using our proprietary ADPS (Automated Data Processing System). Supporting clients, account managers, and sales teams by querying transactional data and delivering accurate, timely solutions. More ❯

Software Engineer with strong Python or Java experience and a passion for cloud/platform technologies skills to join our talented and innovative data engineering team. This role sits within a part of Optum UK responsible for taking large data sets from various sources and converting … them into meaningful insights. You will get to work with Big Data utilising cutting edge Cloud services and technologies. Your work will help healthcare teams to identify opportunities to be more efficient, improve services, and design/optimise healthcare interventions. We are a collaborative team, we work hard … part of then apply today! What you’ll do You will be working with cloud infrastructure/technology to expand and advance our data platform capabilities. You will support your team through identifying and implementing improvements and efficiencies. Other key responsibilities and accountabilities will include; Successfully develop, deliver More ❯

Data Scientist (Quant) Location : London, UK (Hybrid) We are working with a scale-up and London-based team who are driving clean energy innovation to combat climate change. Are you ready to join their mission to build a sustainable future? Responsibilities Build and deploy ML models for energy … and climate data. Create data pipelines using Python (pandas, scikit-learn, TensorFlow). Apply quant skills to optimise energy systems. Collaborate on greentech strategies. Requirements: Advanced Python programming. Strong quantitative skills (stats, modelling). Passion for climate solutions. Degree in Data Science, CS, Math, or related. More ❯

build, and maintain scalable MLOps infrastructure within AWS Develop and manage CI/CD pipelines for machine learning training and deployment Implement robust data pipelines to support ML workflows from ingestion through to production Monitor and manage performance, cost, and security across ML systems Collaborate with data … adoption of infrastructure-as-code and automation practices Technologies and tools: Machine Learning - MLOps (PyTorch/TensorFlow, HFT) AWS (SageMaker - Training, Pipelines, Endpoints) Data - AWS Glue, Lambda, Step Functions Airform Terraform, ECS Python (core language), Bash, (GO is advantageous but not strictly necessary) Required experience: Strong hands-on … effectively with both technical and non-technical stakeholders Nice to have: Experience in highly=regulated environments such as healthcare or finance Familiarity with data privacy and security standards (e.g. GDPR, HIPAA) Exposure to model monitoring and drift detection Experience managing infrastructure cost and performance optimisation on AWS What More ❯

to-senior level Machine Learning Engineer, you will be involved in creating ML models to be deployed in the cloud and supporting the Data Engineering, DataOps and Devops. You will be working with the latest technology on highly visible and large-scale projects. What you’ll bring to … Azure (Azure DevOps, Azure ML, Azure SQL, ADF etc.) Able to work with databases like SQL Server, NoSQL, etc Experience with ETL process, data pipelines, Devops This role is hybrid, with requirement to be in one of their UK offices in either Scotland or England on occasion (they More ❯