12 of 12 Big Data Jobs in the North of England

frameworks. About the Role We are looking for an experienced Test Manager to lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. … hands-on technical leadership with test strategy ownership . You will be responsible for defining and driving the overall testing approach across automated pipelines, data workflows, cloud infrastructure, and release delivery while managing risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience ...

Azure Data Engineer Manchester(Hybrid) You'll design and build scalable, automated data pipelines that bring together information from across the organisation. It's a hands-on engineering role covering everything from data ingestion to transformation, modelling and delivery, all within a modern Azure environment. … report to the Lead Data Engineer and join our Data Engineering Team, working alongside architects, analysts, testers and agile delivery squads. Responsibilities: * Build and maintain scalable, automated data pipelines using Azure tools like Data Factory, Databricks and Logic Apps * Ingest, transform and model data from ...

Test Engineer (Data & Automation) Location: Hybrid 3 days onsite a week (Manchester/Leeds/Birmingham/Newcastle/London) NEED ACTIVE SC CLEARANCE Overview We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation … data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions at pace. Active … clearance is essential, we are seeking DV cleared candidates only. The role You'll design and deploy production-grade data pipelines, from ingestion through to consumption, within a modern big data architecture. Work is delivery focused and delivered using agile engineering practices. Typical responsibilities Build and operate ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

Join DWP Digital and lead the future of data engineering in one of the UK's largest and most impactful digital environments As a Senior Data Engineer, you'll join our Data Platform and Operations team within Data & Analytics, where you'll play a pivotal role … shaping how we design, build and evolve data platforms that support DWP's ambition to become a truly data-driven organisation. We're recruiting for two roles, both focused on technical leadership, engineering excellence, and building capability. You'll lead engineers - sometimes through direct line management, sometimes through ...

hands-on Solution Architect position sitting within the Strategy & Governance team. You will be responsible for end-to-end solution design, supporting a major data platform transformation and enabling the development of next-generation cybersecurity products. You will operate at the intersection of architecture, engineering, and governance, shaping technical … requirements through to production support) Produce and maintain architecture artefacts: High-Level Designs (HLDs) Low-Level Designs (LLDs) Reference architectures Architecture Decision Records (ADRs) Data Platform Transformation Contribute to the design and evolution of a petabyte-scale cyber data platform Support a major replatforming initiative from Databricks ...

plays a critical role in driving the Clients' Credit's digital transformation within the Manchester Business Centre (MBC) Operations. This role focuses on leveraging data analysis, automation, and cross-functional collaboration to improve operational efficiency and create customer-centric solutions. A key immediate focus for this role will … Engineering teams to identify, implement, and maintain efficient processes, ensuring Salesforce and other core systems are leveraged to their full potential. Essential Skills & Experience: Data Analysis & Visualisation: Proven ability to analyse operational data, identify trends, and extract actionable insights. Proficiency in SQL and data visualisation tools (specifically ...

pipeline development using GitLab CI Experience with monitoring, logging and alerting tools Understanding of secure DevOps practices in regulated environments Experience working with large data stores or big data platforms Desirable skills: Experience supporting AI or data driven platforms Knowledge of cyber security or fraud prevention … within government or critical national infrastructure environments About Peregrine We build workforces that deliver tech and change programmes at leading UK organisations. By combining data science from Peregrine Intelligence, our industry-accredited Peregrine Academy, and market-leading attraction and diversity initiatives, we bridge capability gaps at all levels ...

dedicated Data Science team is at the forefront of revolutionizing pharma intelligence and how patients gain access to life-saving therapies. Armed with cutting-edge technology and a passion for innovation, we leverage the vast landscape of data to extract actionable insights that drive informed decision making. … unique collaborative approach fosters a dynamic synergy between data science and product development. Our deep expertise in machine learning, artificial intelligence, advanced statistical modelling, and big data, combined with our domain knowledge, enables us to deliver comprehensive solutions that empower our clients to stay ahead ...

least 2 years of Laravel At least 5 years of frameworked languages (Laravel or others) SQL/MySQL/MariaDB indexes & table design Data: worked with big data and enjoys it Worked with many APIs, e.g Stripe, Google, AWS, OpenAI Understands Backend concepts such as Data ...