1 to 25 of 112 Big Data Jobs in England

frameworks. About the Role We are looking for an experienced Test Manager to lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. … hands-on technical leadership with test strategy ownership . You will be responsible for defining and driving the overall testing approach across automated pipelines, data workflows, cloud infrastructure, and release delivery while managing risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience ...

Senior Data Engineer Who we are Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud … enjoying skyrocketing growth. Our broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise ...

Data Reporting Product Lead c£100k (flexible) London based, 2-3 days in the office About the role Our client is seeking a highly motivated and experienced Data Reporting Product Lead to join their growing data department. This role will act as the vital bridge between complex … data infrastructure and actionable business insights by identifying the opportunity and recommending end-to-end data reporting solutions that directly enable the business to derive maximum value from its information assets. Reporting directly to the Head of Data and Reporting, you will lead their data reporting ...

Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of $13+ billion. For more information on how we process your personal data, please refer to HCLTech’ s Candidate Data Privacy Notice. Experience - 8+ years Hybrid - 3 days/week onsite in London Must Have …/Front Office Exposure Experience with Fixed Income/Currencies/Sales/Trading data Worked closely with front-office stakeholders Data Architecture/Engineering Awareness Understanding of data pipelines, ETL, reporting layers Exposure to data platforms (DWH, cloud, big data) Data Analysis ...

Data Architect £Up to £90,000 GBP Bonus Hybrid WORKING Location: London; Manchester; Bristol, Central London, Greater London - United Kingdom Type: Permanent Data Architect London, Bristol or Manchester | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised as one of Fortune's World … Most Admired Companies , delivering complex transformation programmes across public and private sector environments. The focus is on helping organisations modernise their data landscape through scalable architecture, cloud platforms, and robust engineering practices. [accenture.com] , [linkedin.com] Joining as a Data Architect means taking ownership of end-to-end data ...

Data Architect £Up to £90,000 GBP Bonus Hybrid WORKING Location: London; Manchester; Bristol, Central London, Greater London - United Kingdom Type: Permanent Data Architect London, Bristol or Manchester | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised as one of Fortune's World … Most Admired Companies , delivering complex transformation programmes across public and private sector environments. The focus is on helping organisations modernise their data landscape through scalable architecture, cloud platforms, and robust engineering practices. [accenture.com] , [linkedin.com] Joining as a Data Architect means taking ownership of end-to-end data ...

Data Architect £Up to £90,000 GBP Bonus Hybrid WORKING Location: London; Manchester; Bristol, Central London, Greater London - United Kingdom Type: Permanent Data Architect London, Bristol or Manchester | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised as one of Fortune's World … Most Admired Companies , delivering complex transformation programmes across public and private sector environments. The focus is on helping organisations modernise their data landscape through scalable architecture, cloud platforms, and robust engineering practices. [accenture.com] , [linkedin.com] Joining as a Data Architect means taking ownership of end-to-end data ...

Data & AI Engineer - Up to £50,000 Location: Newcastle - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver technology-enabled transformations. This team specialises in building modern, data-driven solutions that enable better … decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data & AI Engineer, you will ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven … solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven … solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven … solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven … solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data ...

Analytics & Data Engineer Location: Hybrid - London Package: Negotiable + Benefits The day to day: As a Analytics & Data Engineer within the Data Team, you will sit at the intersection of data engineering and analytics—designing robust, scalable data foundations while generating insights that support operational … strategic decision‐making. The role provides end‐to‐end ownership of data workflows, including ingestion, transformation, modelling, analysis, and testing. Core Purpose To build and maintain scalable data pipelines and platforms, and to analyse and interpret data to generate insights, reports, and recommendations that deliver business value. ...

Data & AI Engineer - Hybrid role in Technology - Up to £51k The Role As a Data & AI Engineer, you'll design, build and maintain data pipelines, analytics platforms and AI-powered capabilities all linked to high-impact business use cases. You'll collaborate closely with analysts, engineers … stakeholders to turn requirements into reliable, production-ready solutions. Key responsibilities: Designing and building scalable data pipelines, datasets, and data models Integrating data from multiple structured and unstructured sources Developing advanced analytics, machine learning and AI solutions where appropriate Building Generative AI solutions using large language models ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage … DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud-based transformation for clients across a range ...

Data & AI Engineer - Hybrid role in Technology - Up to £51k The Role As a Data & AI Engineer, you'll design, build and maintain data pipelines, analytics platforms and AI-powered capabilities all linked to high-impact business use cases. You'll collaborate closely with analysts, engineers … stakeholders to turn requirements into reliable, production-ready solutions. Key responsibilities: Designing and building scalable data pipelines, datasets, and data models Integrating data from multiple structured and unstructured sources Developing advanced analytics, machine learning and AI solutions where appropriate Building Generative AI solutions using large language models ...

Data Engineer 12 months Bath - x3 days onsite £550 Outside ir35 Active DV clearance (SC Considered) required Role Overview We are seeking an experienced DV (SC Considered) Cleared Data Engineer to support a high-profile, mission-critical programme within a secure government environment. The role will focus … designing, building and maintaining robust data pipelines and platforms that support advanced analytics, intelligence, and operational decision-making. Key Responsibilities Design, build and maintain scalable data pipelines (batch and/or streaming) within secure environments Develop and optimise ETL/ELT processes for high-volume, structured and semi ...

Senior Data Engineer – Databricks & Big Data Pipelines (SC Cleared is required for this role) Rate: £450-550 per day inside IR35 We're looking for a Senior Data Engineer – Databricks & Big Data Pipelines to join our team, working in our UK remote working division. … This position requires active UK Security Check (SC) clearance and offers the opportunity to build advanced, large-scale data engineering solutions for an innovative analytics platform. You will design, develop and optimize distributed data pipelines on Databricks and cloud ecosystems while ensuring performance, scalability, and compliance. The role ...

Engineer - Job Description Position SummaryOur client's AI & Data function focuses on helping organisations solve complex business challenges through the effective use of data, artificial intelligence, and modern technology platforms.The team delivers end-to-end, business-driven solutions that integrate data, technology, and processes across organisations … governed solutions that enable better decision-making, operational efficiency, and digital transformation. The OpportunityAs an AI Engineer, you will work at the intersection of data, engineering, and artificial intelligence to build practical, scalable solutions that deliver real business value.You'll collaborate with cross-functional teams to design, develop ...

Senior Automation QA Engineer (Data Engineering) Location: London or Cardiff - once a month in the office Salary/Rate: £500/600 per day inside IR35 Start Date: 05/05/2026 Job Type: Contract We are seeking a Senior Automation QA Engineer to drive quality across microservices … based systems and data engineering platforms. This role requires strong hands‐on experience in test automation, backend and API validation, and data pipeline testing, with the ability to work across complex, distributed architectures. The ideal candidate will collaborate closely with software engineers, data engineers, and product teams ...

Data Architect (Manager Level) Public & Private Sector Projects Location: London/Bristol/Manchester | Salary: Competitive + Package Were partnering with a leading global consultancy delivering complex, large-scale transformation programmes across government and enterprise clients. This is a high-impact Data Architect role where youll shape … data strategy and architecture across mission-critical platforms. The Role Youll take ownership of defining and delivering data architecture across major programmes, including: Designing enterprise-wide data models, integration strategies, and migration approaches Leading architecture for distributed and cloud-based data platforms Setting standards, frameworks ...

client are looking for a Contract Senior Software Developer to design, build, and maintain microservices-based applications and data engineering pipelines. This role requires strong hands-on development experience across Java services, backend systems, and data processing platforms, with a focus on building scalable, reliable, and maintainable solutions. … role involves close collaboration with data engineers, QA, product, and platform teams to deliver high-quality services and data products across a complex enterprise environment. Technical Skills & Experience Core Skills Strong hands-on experience developing Java-based applications in a microservices architecture. Solid experience building and maintaining backend ...

client are looking for a Contract Senior Software Developer to design, build, and maintain microservices-based applications and data engineering pipelines. This role requires strong hands-on development experience across Java services, backend systems, and data processing platforms, with a focus on building scalable, reliable, and maintainable solutions. … role involves close collaboration with data engineers, QA, product, and platform teams to deliver high-quality services and data products across a complex enterprise environment. Technical Skills & Experience Core Skills Strong hands-on experience developing Java-based applications in a microservices architecture. Solid experience building and maintaining backend ...

Data Engineer - Data Monetisation Global Blue Chip £46k - £69k base + 25% bonus + company benefits (10% match pension, 25 days annual leave plus your birthday off, private healthcare + more) London - 2 days a week Most data engineering jobs are about keeping the lights on. This … about building something that actually matters. Our client is sitting on some of the richest customer data in the UK. The team you'd be joining turns that raw data into high-value customer signals and commercial data products - the kind of work that has real commercial ...

evolve, offering continuous opportunities for development, influence, and leadership* Serve as the primary contact for architectural aspects of IT projects* Integrate business process, data, application, technical, and information security dimensions into cohesive IT solutions* Ensure solution architectures are documented using standard templates and tooling complying with Shell’s architectural … migrations/re-platforming of legacy on-premises systems* Engineering and architecture experience in designing and building containers, Microservices, Cloud Native applications, and federated Data platforms (Data Mesh)* Possesses solid experience in Data Architecture, including developing logical data models and designing solutions that leverage modern data ...