76 to 100 of 101 Data Pipeline Jobs in the North of England

Role Title: Lead Data Engineer Location: Sheffield/hybrid (3 days on site) Duration: 9 months Rate: £430 per day inside ir35 We are seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms. Experience required: Extensive enterprise … Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL). Experience integrating large, disparate datasets using modern tools and frameworks. Strong background in building and optimizing ETL/ELT data ...

methodical approach and strong attention to detail are needed for this Data Analysis apprenticeship with a travel tech giant with offices all over the globe. There’s a £1,000 bonus on offer too, following successful completion of year one of the apprenticeship programme. Role A highly passionate … bunch, our data, analytics and AI team bring our unique software solutions to life. Our mission is to empower our customers and internal stakeholders to improve business performance and minimise risk by providing them with clean, reliable data and analytical models. We are with them ...

Data Engineering Apprentice role is a developmental position within the Digital Team. During the apprenticeship you will work 5 days per week, inclusive of 1 day per week for study at BPP University. On completion of this apprenticeship, you will obtain a Level 5 Data Engineering … qualification. Role We are looking for an enthusiastic Apprentice to join our team specialising in Data Engineering for our Engine Business Segment in Darlington, UK. During your apprenticeship with us, you will learn how a major global organisation operates, gaining the tools and exposure you will need ...

variety of technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining … Personal Learning & Development budget Wellbeing days What's required to be successful in this role? Demonstrable programming ability in Python, preferably within a data context A STEM-related degree Some experience with the Python scientific stack (NumPy, Pandas, SciPy, etc.) is preferred Experience with Docker, GIT and Linux ...

Title: Data Analyst (SQL) Location: Hybrid, North Yorkshire (2-3 days pw in the office) Overview We are seeking a Data Analyst (SQL) to support the development and maintenance of SQL databases, data pipelines, and reporting datasets. You will work closely with … reporting teams to ensure data is accurate, reliable, and ready for analytics. Key Responsibilities Develop and maintain SQL code (views, stored procedures, functions) in SQL Server Support ETL/data pipelines (e.g. SSIS or similar tools) Assist with data modelling for reporting and analytics ...

Lead Data Platform Engineer £75,000 - £85,000 Remote You are a well-experienced Lead Data Platform Engineer, looking to take ownership of a modern lakehouse platform and shape best-in-class data engineering practices. THE COMPANY This industry-leading organisation serves specialist, people … first knowledge to its clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically ...

Lead Data Platform Engineer £75,000 - £85,000 Remote You are a well-experienced Lead Data Platform Engineer, looking to take ownership of a modern lakehouse platform and shape best-in-class data engineering practices. THE COMPANY This industry-leading organisation serves specialist, people … first knowledge to its clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically ...

Principal Data Engineer £80,000 - £90,000 Remote (monthly meets in London) This is a rare chance to join an early-stage data consultancy where you will shape technical delivery, build from the ground up, and work directly with clients on high impact projects. … real solutions rather than maintain legacy platforms, this role offers exactly that. THE COMPANY They are a young, fast-growing consultancy focused on data engineering and machine learning. Backed by a clear vision and strong funding runway, they partner with organisations to modernise manual, fragmented data ...

Principal Data Engineer £80,000 - £90,000 Remote (monthly meets in London) This is a rare chance to join an early-stage data consultancy where you will shape technical delivery, build from the ground up, and work directly with clients on high impact projects. … real solutions rather than maintain legacy platforms, this role offers exactly that. THE COMPANY They are a young, fast-growing consultancy focused on data engineering and machine learning. Backed by a clear vision and strong funding runway, they partner with organisations to modernise manual, fragmented data ...

Lead Data Analyst - £80,000 - Newcastle (Hybrid, 3 days onsite) We're looking for a well-rounded Data & Analytics professional who can bring strong technical capability together with the adaptability needed in a consulting environment. You don't need to be an expert in everything … should have hands-on experience with at least one modern data visualisation or analytics platform, plus some exposure to a major cloud ecosystem - ideally AWS. Because our client work varies, we value people with solid fundamentals who are comfortable learning new tools, shifting between projects, and applying their ...

Test Engineer (Data) - SAP Transformation We're hiring a Test Engineer with strong data testing experience to join a newly formed team supporting a major SAP RISE transformation programme modernising infrastructure and financial data platforms. You'll work with engineering, product and finance teams … improve the quality, reliability and trustworthiness of financial data flows feeding SAP. The focus of the role is test advocacy, automation and coaching teams on testing best practices, embedding quality directly into the product lifecycle. Key Responsibilities Improve testing maturity across teams working on data pipelines ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

What We’re Looking For Proven track record designing or architecting distributed, high-volume systems Experience with event-driven architectures and high-throughput data pipelines (Kafka) Strong knowledge of at least one of: C#, .NET, Golang, or TypeScript , plus SQL/databases Ability to balance hands-on technical ...

Data Engineer Opportunity, DV-cleared only All candidates should make sure to read the following job description and information carefully before applying. London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

Graduate AI/Data Scientist/Machine Learning Engineer – Entry Level £28,000 – £35,000 | Hybrid Opportunities | North West/UK Are you a recent graduate looking to start your career in Artificial Intelligence, Machine Learning, Data Science or Software Engineering? We are currently working with … number of innovative technology organisations who are looking to recruit Graduate AI Engineers, Data Scientists and Machine Learning Engineers into their growing teams. This is an excellent opportunity for ambitious graduates who want to work with cutting-edge technologies including Artificial Intelligence, Machine Learning, Generative AI and Large ...

availability and resilience across Azure-hosted environments Architect robust backend services in Python using modern frameworks (FastAPI, Pydantic), implementing clean API design, efficient data pipelines, and integration patterns within our Azure ecosystem Establish and enforce best practices for the TypeScript/React frontend, ensuring a highly performant, accessible … intuitive user experience, including real-time interfaces and interactive data visualisations Lead the configuration and optimisation of Azure cloud environments, establishing robust CI/CD pipelines with GitHub Actions or Azure DevOps, and ensuring cost-optimised use of Azure services and container orchestration resources Set the standard ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...

/React frontend, ensuring a highly performant, accessible, and intuitive user experience for AI-driven tooling, including real-time streaming interfaces and interactive data visualisations Lead the configuration and optimisation of Azure cloud environments, establishing robust CI/CD pipelines with GitHub Actions or Azure DevOps, and ensuring … junior and mid-level engineers to grow their capabilities hampion Responsible AI practices including model evaluation, bias monitoring, content filtering, and compliance with data protection regulations; define and maintain guardrails for LLM-powered features in production Identifying patterns in recurring issues and engineering permanent solutions Contribute to technical ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected … way. We are now looking for a Machine Learning Engineer to help build and optimise production-ready machine learning systems and advance our data pipelines for inference at scale. This is a pivotal role for someone who thrives in autonomous environments and enjoys owning solutions from concept ...

extend) Location: Remote Day Rate: £550 (Outside IR35) Start Date: ASAP We’re looking for a Microsoft Fabric Architect to lead a greenfield data platform build within a growing organisation looking to modernise its data estate. You’ll take ownership of the end-to-end architecture … solution through to production. Key Experience Required Strong hands-on experience with Microsoft Fabric Experience building end-to-end Lakehouse solutions Good data modelling skills (e.g. star schema) Experience using PySpark or Spark SQL Building data pipelines from APIs, ERP or SaaS systems Working with Fabric ...

including 3rd party platforms. Our vision is to create dedicated squads that truly own our platforms end-to-end from building integrations and data pipelines through to keeping the lights in production. We want to create techno-functional teams who understand both the technology and the business domain … with our platform vendors, influencing the strategic direction for the capabilities needed for our business. Work hands-on when needed on integrations and data pipelines - this isn't a pure management role, you'll need to roll up your sleeves alongside the team. Partner with Fraud and Fincrime ...

significant demand from global customers, the company is now looking to appoint a hands-on IoT/DevOps Engineer to own device connectivity, data flows, and system integration across their next-generation platform. This is a rare opportunity to join a small, agile, engineering-driven organisation where your …/Device → Tablet (Bluetooth) → Cloud Dashboard (ThingsBoard). You’ll work across real hardware, embedded devices, gateways, industrial protocols, and cloud dashboards—ensuring data moves cleanly, securely, and consistently. This is not a pure coding role. It is a practical, problem-solving IoT role suited to someone ...

pioneer in delivering secure, cost-effective cloud solutions designed to help businesses operate confidently in the digital landscape. Their services span SaaS, data recovery, VoIP, office applications, cybersecurity, security cameras, and IoT solutions—providing organizations with the essential tools to enhance efficiency and protect critical data. About … strong technical skills across AWS core services, AI/ML platforms, and cloud-native tooling, engineers learn to diagnose complex issues, analyse model and pipeline behaviour, report incidents, and clearly communicate solutions that enable data- and AI-driven business outcomes. This role supports the organisation in maximising ...

MUST BE PAYE THROUGH UMBRELLA "Key Responsibilities Design, deploy, and operate Splunk Enterprise and ITSI for hybrid Kubernetes/OpenShift environments. Onboard data at scale (HEC, Universal Forwarder/Deployment Server), align to CIM, and enforce RBAC, retention, and cost guardrails. Build ITSI service decompositions, KPIs/multi … maintenance schedules, and runbook automation. Govern ingest and security: allow/deny lists, PII handling, TLS, token governance, index/role mapping, and data quality SLAs. Integrate upstream sources and pipelines: OpenTelemetry, Prometheus exporters, Fluentd/Fluent Bit/Vector, Kafka, CMDB/ITSM enrichments, AIOps/ ...