17 of 17 Big Data Jobs in the North of England

xperience and Education Required Approximately 10 years of industry experience implementing data integration tools such as Microsoft SSIS, Azure Data Factory, Databricks, Glue, Step Functions, Airflow, Apache Flume/Sqoop/Pig, and similar technologies. 3–5 years of team management experience. 3–5 years of consulting experience … preferred). Minimum of 5 years’ experience in data architecture, data modelling, or related disciplines. Bachelor’s degree or equivalent experience required; Master’s degree preferred. Strong knowledge of data warehousing, OLTP systems, data integration, and the software development lifecycle (SDLC). Hands-on experience with ...

xperience and Education Required Approximately 10 years of industry experience implementing data integration tools such as Microsoft SSIS, Azure Data Factory, Databricks, Glue, Step Functions, Airflow, Apache Flume/Sqoop/Pig, and similar technologies. 3–5 years of team management experience. 3–5 years of consulting experience … preferred). Minimum of 5 years’ experience in data architecture, data modelling, or related disciplines. Bachelor’s degree or equivalent experience required; Master’s degree preferred. Strong knowledge of data warehousing, OLTP systems, data integration, and the software development lifecycle (SDLC). Hands-on experience with ...

Azure Data Engineer Manchester(Hybrid) You'll design and build scalable, automated data pipelines that bring together information from across the organisation. It's a hands-on engineering role covering everything from data ingestion to transformation, modelling and delivery, all within a modern Azure environment. … report to the Lead Data Engineer and join our Data Engineering Team, working alongside architects, analysts, testers and agile delivery squads. Responsibilities: * Build and maintain scalable, automated data pipelines using Azure tools like Data Factory, Databricks and Logic Apps * Ingest, transform and model data from ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Test Engineer (Data & Automation) Location: Hybrid 3 days onsite a week (Manchester/Leeds/Birmingham/Newcastle/London) NEED ACTIVE SC CLEARANCE Overview We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation … data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions at pace. Active … clearance is essential, we are seeking DV cleared candidates only. The role You'll design and deploy production-grade data pipelines, from ingestion through to consumption, within a modern big data architecture. Work is delivery focused and delivered using agile engineering practices. Typical responsibilities Build and operate ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments Be one of the first applicants, read the complete overview of the role below, then send your application for consideration. As a Senior Data Engineer … join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role in shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both ...

hands-on Solution Architect position sitting within the Strategy & Governance team. You will be responsible for end-to-end solution design, supporting a major data platform transformation and enabling the development of next-generation cybersecurity products. You will operate at the intersection of architecture, engineering, and governance, shaping technical … requirements through to production support) Produce and maintain architecture artefacts: High-Level Designs (HLDs) Low-Level Designs (LLDs) Reference architectures Architecture Decision Records (ADRs) Data Platform Transformation Contribute to the design and evolution of a petabyte-scale cyber data platform Support a major replatforming initiative from Databricks ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected in a privacy safe … way. As we continue to expand, we are seeking a Data Platform Engineer who will play a key role in building and supporting our internal data infrastructure. The Role: Our offices are in Trafford Park, Manchester and the role consists of hybrid working, where ...

pipeline development using GitLab CI Experience with monitoring, logging and alerting tools Understanding of secure DevOps practices in regulated environments Experience working with large data stores or big data platforms Desirable skills: Experience supporting AI or data driven platforms Knowledge of cyber security or fraud prevention … within government or critical national infrastructure environments About Peregrine We build workforces that deliver tech and change programmes at leading UK organisations. By combining data science from Peregrine Intelligence, our industry-accredited Peregrine Academy, and market-leading attraction and diversity initiatives, we bridge capability gaps at all levels ...

dedicated Data Science team is at the forefront of revolutionizing pharma intelligence and how patients gain access to life-saving therapies. Armed with cutting-edge technology and a passion for innovation, we leverage the vast landscape of data to extract actionable insights that drive informed decision making. … unique collaborative approach fosters a dynamic synergy between data science and product development. Our deep expertise in machine learning, artificial intelligence, advanced statistical modelling, and big data, combined with our domain knowledge, enables us to deliver comprehensive solutions that empower our clients to stay ahead ...

least 2 years of Laravel At least 5 years of frameworked languages (Laravel or others) SQL/MySQL/MariaDB indexes & table design Data: worked with big data and enjoys it Worked with many APIs, e.g Stripe, Google, AWS, OpenAI Understands Backend concepts such as Data ...

Join a leading independent technology and services provider as an OpenSource Data Platform Solution Engineer. Job Overview: Looking for a hands-on Solution Engineer/Architect to design and support large-scale cybersecurity data platforms using open-source technologies. Location: Sheffield Rate: A daily rate, in-scope IR35 … Strategy and Governance, Cyber Sciences and Analytics, Cybersecurity Key Responsibilities: Design end-to-end technical solutions for cybersecurity applications Work on large-scale (petabyte) data platforms Create architecture documents (HLDs/LLDs) Evaluate and standardise open-source technologies Collaborate with engineering and governance teams Ensure solutions meet security, compliance ...

Kubernetes, OpenShift, MicroK8s; • Infrastructure as Code (IaC), automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring ...

work experience as a Product Owner or in product management. Experience working in a high-velocity product team. Strong analysis skills, with experience interpreting data to inform product decisions. Able to write well-defined specifications (PRDs) to clearly communicate expected product outcomes and set acceptance criteria. Proven success working … directly with engineers to build software products. Track record of being able to critically analyse data samples and produce sensible insights to fuel product initiatives. Experience working with big data is a plus! Hungry, creative, enthusiastic, and data-driven with a diverse skill set to thrive ...

work experience as a Product Owner or in product management. Experience working in a high-velocity product team. Strong analysis skills, with experience interpreting data to inform product decisions. Able to write well-defined specifications (PRDs) to clearly communicate expected product outcomes and set acceptance criteria. Proven success working … directly with engineers to build software products. Track record of being able to critically analyse data samples and produce sensible insights to fuel product initiatives. Experience working with big data is a plus! Hungry, creative, enthusiastic, and data-driven with a diverse skill set to thrive ...

work experience as a Product Owner or in product management. Experience working in a high-velocity product team. Strong analysis skills, with experience interpreting data to inform product decisions. Able to write well-defined specifications (PRDs) to clearly communicate expected product outcomes and set acceptance criteria. Proven success working … directly with engineers to build software products. Track record of being able to critically analyse data samples and produce sensible insights to fuel product initiatives. Experience working with big data is a plus! Hungry, creative, enthusiastic, and data-driven with a diverse skill set to thrive ...

work experience as a Product Owner or in product management. Experience working in a high-velocity product team. Strong analysis skills, with experience interpreting data to inform product decisions. Able to write well-defined specifications (PRDs) to clearly communicate expected product outcomes and set acceptance criteria. Proven success working … directly with engineers to build software products. Track record of being able to critically analyse data samples and produce sensible insights to fuel product initiatives. Experience working with big data is a plus! Hungry, creative, enthusiastic, and data-driven with a diverse skill set to thrive ...

work experience as a Product Owner or in product management. Experience working in a high-velocity product team. Strong analysis skills, with experience interpreting data to inform product decisions. Able to write well-defined specifications (PRDs) to clearly communicate expected product outcomes and set acceptance criteria. Proven success working … directly with engineers to build software products. Track record of being able to critically analyse data samples and produce sensible insights to fuel product initiatives. Experience working with big data is a plus! Hungry, creative, enthusiastic, and data-driven with a diverse skill set to thrive ...

work experience as a Product Owner or in product management. Experience working in a high-velocity product team. Strong analysis skills, with experience interpreting data to inform product decisions. Able to write well-defined specifications (PRDs) to clearly communicate expected product outcomes and set acceptance criteria. Proven success working … directly with engineers to build software products. Track record of being able to critically analyse data samples and produce sensible insights to fuel product initiatives. Experience working with big data is a plus! Hungry, creative, enthusiastic, and data-driven with a diverse skill set to thrive ...

work experience as a Product Owner or in product management. Experience working in a high-velocity product team. Strong analysis skills, with experience interpreting data to inform product decisions. Able to write well-defined specifications (PRDs) to clearly communicate expected product outcomes and set acceptance criteria. Proven success working … directly with engineers to build software products. Track record of being able to critically analyse data samples and produce sensible insights to fuel product initiatives. Experience working with big data is a plus! Hungry, creative, enthusiastic, and data-driven with a diverse skill set to thrive ...