26 to 50 of 111 Big Data Jobs in the UK excluding London

Role: Data Engineer Location: Glasgow (Hybrid, 3 days onsite) Contract: 06-12months with possible extensions (No Sponsorship Available ) Skills/Qualifications: · 4+ years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. · 3+ years hands-on experience with cloud services, especially Databricks, for building and managing … scalable data pipelines · 3+ years of proficiency in working with Snowflake or similar cloud-based data warehousing solutions · 3+ years of experience in data development and solutions in highly complex data environments with large data volumes. · Solid understanding of ETL principles, data modelling, data warehousing concepts, and data integration best practices-Familiarity … work collaboratively in a fast-paced, dynamic environment. · Experience with code versioning tools (e.g., Git) · Knowledge of Linux operating systems · Familiarity with REST APIs and integration techniques · Familiarity with data visualization tools and libraries (e.g., Power BI) · Background in database administration or performance tuning · Familiarity with data orchestration tools, such as Apache Airflow · Previous exposure to big More ❯

We’re partnering with a leading entertainment company seeking to hire a Data Engineering Manager to play a key role in their data operations and business intelligence initiatives. Key Responsibilities: Design & maintain AWS BI infrastructure (Redshift, S3, EMR) using Terraform and IaC best practices. Develop CI/CD pipelines (Jenkins, GitHub Actions) to automate ETL and Power BI … code deployments. Manage environments (Dev, QA, UAT) and automate data refreshes for accuracy and consistency. Oversee data pipelines and big data workflows (EMR, Spark) for high-performance analytics. Optimize code for ETL and Power BI (DAX, data models, refresh scheduling) to enhance performance. Implement observability and logging (CloudWatch, Grafana, ELK) for proactive system monitoring. Collaborate … cross-functionally with BI, Platform, and Data teams on releases and issue resolution. Enforce security & compliance (RBAC, encryption, GDPR/HIPAA) across AWS services. Monitor performance & costs in AWS, driving optimisation and efficiency. Champion automation & innovation through new tools, frameworks, and cloud-native solutions. Key Skills: AWS Cloud: Expert in Redshift, S3, Lambda, EMR, and IaC (Terraform/CloudFormation More ❯

Data Engineer – Cardiff/Hybrid – £40,000 - £50,000 + benefits Yolk Recruitment are excited to be working with a global technology business that’s continuing to expand its data capability and invest in modern cloud solutions. Known for their collaborative culture and commitment to innovation, they’re offering an excellent opportunity for a Data Engineer to … make a real impact. We’re looking for a Data Engineer to help design, build, and maintain scalable data pipelines and systems that power analytics and business intelligence across the organisation. You’ll play a key role in ensuring data is accurate, accessible, and high-quality — driving data-led decision making at every level. What you … ll be doing: Design, build, and maintain scalable data pipelines and ETL processes to support analytics and operations. Develop and optimise data models and storage solutions for performance and reliability. Ensure data quality, integrity, and security throughout the data lifecycle. Collaborate with data scientists, analysts, and engineers to deliver effective data solutions. Implement and More ❯

Data Engineer - Cardiff/Hybrid - £45,000 - £50,000 + benefits Yolk Recruitment are excited to be working with a global technology business that's continuing to expand its data capability and invest in modern cloud solutions. Known for their collaborative culture and commitment to innovation, they're offering an excellent opportunity for a Data Engineer to … make a real impact. We're looking for a Data Engineer to help design, build, and maintain scalable data pipelines and systems that power analytics and business intelligence across the organisation. You'll play a key role in ensuring data is accurate, accessible, and high-quality - driving data-led decision making at every level. What you … ll be doing: Design, build, and maintain scalable data pipelines and ETL processes to support analytics and operations. Develop and optimise data models and storage solutions for performance and reliability. Ensure data quality, integrity, and security throughout the data lifecycle. Collaborate with data scientists, analysts, and engineers to deliver effective data solutions. Implement and More ❯

achieve enduring results. Working with clients in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the … following technologies to ensure scalable, high-performance applications: AWS is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics … Essential requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using More ❯

Data Engineer - Professional Services - £75,000 - Leeds (hybrid) A leading global professional services firm is seeking a Design Data Engineer to join its growing data and analytics team. This role offers the opportunity to play a pivotal part in shaping the firm’s data infrastructure and driving the intelligent use of data across global operations. … The successful candidate will design, develop, and optimise data pipelines, models, and systems that enable smarter insights, improved efficiency, and enhanced decision-making across the business. Key Responsibilities Design, develop, and maintain scalable and efficient data pipelines, integrations, and ETL processes to support analytics and reporting. Architect and optimize data models and database structures, ensuring scalability, consistency … and business alignment. Collaborate with data scientists, analysts, and business stakeholders to translate data requirements into actionable technical solutions. Ensure data quality, integrity, and governance through validation, monitoring, and documentation processes. Implement and oversee data security and compliance measures, protecting sensitive business and client information. Produce clear technical documentation for data architectures, workflows, and processes. More ❯

About Synechron: Synechron is a leading digital transformation consulting firm, delivering innovative solutions across Financial Services, Insurance, and more. We empower organizations to harness the power of data, technology, and strategy to drive growth and efficiency. Role Overview: We are seeking a skilled Data Engineer to join our UK team. In this role, you will be responsible for … designing, developing, and maintaining scalable ETL data pipelines leveraging Python and DataBricks. You will collaborate with cross-functional teams to understand data requirements and ensure the delivery of reliable, high-quality data solutions that support our business objectives. Key Responsibilities: Collaborate with stakeholders and cross-functional teams to gather data requirements and translate them into efficient … ETL processes. Develop, test, and deploy end-to-end ETL pipelines extracting data from various sources, transforming it to meet business needs, and loading it into target systems. Take ownership of the full engineering lifecycle, including data extraction, cleansing, transformation, and loading, maintaining data accuracy and consistency. Manage and monitor data pipelines, implementing proper error handling More ❯

Lead Data Scientist – Azure Data Stack – Very Attractive Base + Bonus – Manchester City Centre A rapidly growing software house in the heart of Manchester is seeking a Senior Data Scientist to spearhead innovation within their Data & Analytics function. If you're a seasoned data science professional looking for a role where you can have significant … impact, mentor a developing team, and contribute to cutting-edge analytics solutions, this could be the perfect opportunity. Role Overview As a Senior Data Scientist, you'll be a pivotal member of a cross-functional team, leading the enhancement and development of state-of-the-art features for the platform. You'll be responsible for guiding the entire modelling … lifecycle, from data preparation and analysis to the development of robust machine learning models and the creation of impactful, actionable visualisations. You'll also have the opportunity to shape the team's technical direction and mentor junior colleagues. Key Responsibilities Architecting and overseeing data preparation, cleansing, and structuring processes for advanced model development. Leading investigations into patterns, trends More ❯

Senior Data Engineer – Cardiff/Hybrid – £65,000 - £75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They’re looking for a Senior Data Engineer to help shape the next generation of their data platform — leading technical design, mentoring others, and driving … best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you’ll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best practices for data engineering, including … coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data governance, security, and compliance. Troubleshoot and resolve complex data More ❯

Senior Data Engineer - Cardiff/Hybrid - £65,000 - £75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They're looking for a Senior Data Engineer to help shape the next generation of their data platform - leading technical design, mentoring others, and driving … best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you'll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best practices for data engineering, including … coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data governance, security, and compliance. Troubleshoot and resolve complex data More ❯

Data Engineer Hybrid (West Midlands) Permanent Competitive Salary + Benefits Are you passionate about building scalable data solutions and working with cutting-edge technologies like Microsoft Fabric, Azure, and Power BI? TXP is looking for a talented Data Engineer to join our growing team and help shape the future of data-driven decision-making. We are … power of technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. What You'll Be Doing Designing, developing, and maintaining robust data pipelines. Building and optimising infrastructure for scalable data solutions. Integrating data from diverse sources across the business. Ensuring data integrity, security, and compliance with best practices. … Collaborating with cross-functional teams including analysts, developers, and business stakeholders. Leveraging Microsoft Fabric (Lakehouse, Data Pipelines) to modernise our data architecture. Supporting CI/CD and DevOps practices for data workflows. What We're Looking For Proven experience as a Data Engineer or in a similar role. Strong coding skills in SQL , Python , and PySpark More ❯

succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Analytics & AI - Data Science & AI - Senior Consultant EY exists to build a better working world. We empower our people by offering the culture, tech, teams, scale, challenges, learning … tax and transactions. EY teams ask better questions to find new answers for the complex issues facing our world today. The Team and the opportunity As part of our Data Analytics and AI team, the Data Scientist & AI role is pivotal in enabling our clients to derive significant value from their information assets. Through collaboration and domain expertise … our team embeds innovative data analytics solutions into existing business areas, transforming data into strategic assets. We are looking for a Data Scientist who is passionate about leveraging data to solve complex problems and drive business outcomes. You will play a key role in driving growth by developing new and existing client relationships and delivering first More ❯

a three-time gold investor in people award winner, an advocate of supporting women in engineering and developing their people to be the best they can be? As a data engineer specialising in generative AI; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. The opportunity: The business is looking for a Data Engineer to join an Information Management GenAI delivery Office, who will be able to evaluate design, deploy, improve and support the companies data sets. The Data Engineer will ensure data pipelines are designed to be resilient … secure and responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. The Data Engineer will provide knowledge in data management and data quality to guarantee compliance to company data governance. A key part of this role is More ❯

600pd Outside IR35Remote - UK based applicants only6 months A leading eCommerce brand is looking for a Data Platform Engineer to play a key role in evolving their data ecosystem. This is an exciting opportunity to shape how data is built, governed, and leveraged across the business, supporting a platform that impacts millions of users daily. THE COMPANY … This brand is recognised for its innovation and community-driven approach. With data at the heart of its decision-making, they're investing heavily in scalable, modern data platforms to enable better insights, experimentation, and product development. You'll join a collaborative engineering culture that values autonomy, technical excellence, and continuous improvement. THE ROLE As a Data Platform Engineer, you'll be responsible for developing and scaling the company's core data platform, ensuring teams across the business can access, trust, and use data effectively. You'll drive initiatives that improve data quality, observability, and governance, while helping shape a platform-as-a-product mindset. Key responsibilities include: Building and maintaining data More ❯

Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimise their costs and maximise the benefits from their investments in these technologies. Coeo have a strong emphasis on consulting skills, and we expect our team … has been established for over 17 years and has exclusively focused on Microsoft technologies. Our mission is to “ help our clients predict their future ” through the better use of data, technology, people and processes. To do this our business has always focused on Managed Services Data Platform Consultancy Analytics Consultancy Adoption and Change Management There has never been … client sites across the UK and occasionally abroad, with nights away from home. Job Summary: We are seeking an experienced Principal Consultant with a strong background in SQL Server, Data Warehousing, and Business Intelligence tools. The ideal candidate will have hands-on experience with Data Warehousing, SAP Business Objects Data Services, SAP Business Objects, and Crystal Reports. More ❯

Join a fast-growing technology and engineering organisation that is on a mission to become the best engineering consultancy in the UK. We are looking for a Data Engineer who is passionate about technology, eager to develop their coding skills, and ready to make a significant impact in a collaborative and innovative environment. Due to the security cleared nature … we can not accept applicants who don't possess indefinite leave to remain or are a UK resident. If you require sponsorship, then your application will not be considered. Data Engineer Annual Salary: £40,000 - £55,000 Location: UK (Flexible Hybrid Working) Job Type: Permanent Day-to-day of the role: Work on diverse client projects including building modern … data platforms and services using DevOps practices. Engage in large, distributed workloads, batch and streaming data pipelines, and high-quality monitoring. Collaborate with architects, technology consultants, and client stakeholders to help customers leverage their data effectively. Gain exposure to different industries and networks while working with the latest technologies. Spend time on internal projects, training, and development More ❯

s enduring challenges. Position We are seeking to recruit a Senior Full Stack Software Engineer to help design, build, and maintain user-facing components of our scalable, high-performance data platform supporting our bioinformaticians and science teams. This role blends hands-on engineering (70-80%) with people leadership and a focus on engineering excellence, raising the bar on standards … security, reliability, observability, and quality. Responsibilities Design, develop, and support web applications deployed to support the data platform. Own full stack development for tools supporting data management across the full lifecycle, including ingest monitoring, curation, release management, data quality monitoring, and user access control. Build and support components to manage ingest from and monitor distributed next-generation … devices, including device telemetry (Kafka, MQTT streaming from Oxford Nanopore NGS devices). Design, develop, and maintain platform tools to help bioinformaticians and science teams discover, understand, and access data (e.g., pathogen data catalogue, quality dashboards, management information reporting). Support innovation efforts by exploring new technologies such as vector databases to enable search and AI use cases. More ❯

Data Scientist, based Waltham Abbey (Hybrid role). Salary £30-50 k p.a. + many benefits. An exciting time to join an award-winning business in a phase of growth, in a newly created role to analyse data and create models to support Jollyes commercial and marketing teams. We’re developing Data Science solutions to help drive … support office in Waltham Abbey (Essex) and up to 2 x days per week from home (or other Jollyes location as preferred). 37.5 hours per week. The Role – Data Scientist This role sits within our Information Technology team, lead by our Senior Data Scientist. Success measures will include: Project delivery and impact, Data quality and management … commercial and marketing analysis using SQL and Python Automate tasks and reporting to improve efficiency and support decision-making Develop dashboards (Tableau) and email reports for business insights Use data storytelling to influence stakeholders and drive profitability Build predictive models to anticipate customer behaviour Translate data insights into actionable business outcomes Design and run A/B tests More ❯

Data Engineer Bolton- Hybrid £45,000 - £55,000 (dependent on experience) We're looking for a Data Engineer experienced in Generative AI to join our growing international and cross functional client. In this role, you'll be responsible for evaluating, building, and maintaining high quality data sets that support their internal stakeholders across the business. You'll … play a key part in ensuring data pipelines are secure, reliable, and scalable. Data Engineer Duties: Design, develop, and maintain robust data pipelines and architectures. Evaluate, build, and optimise data sets for internal customers. Ensure data systems comply with governance and security standards. Collaborate with internal teams to understand data needs and deliver effective … solutions. Stay ahead of emerging data and AI technologies, contributing to our innovation roadmap. Support the integration of generative AI capabilities into existing systems. As a Data Engineer, you will have: Strong experience with SQL (e.g., MS SQL, Oracle). Knowledge of NoSQL technologies (e.g., MongoDB, InfluxDB, Neo4J). Experience with data exchange and processing (ETL, ESB More ❯

so will the role. As such you will require a proactive approach and a high level of multi-tasking and resilience. The role would require someone confident working with Big Data and analysing trends and making recommendations. Someone who is resilient and experienced in high pressure environments and a confident individual with great communication skills. Your New Role … Subject matter expertise Data analysis, data maintenance, data representation Ability to create business reports Ability to identify gaps in the new processes and define new ones as required Create PowerPoint presentations to illustrate processes Business readiness Data cleansing and readiness of existing systems Problem solving and root cause analysis through data Process creation, testing and … Strong communication and organisational skills. Project Management skills. Ability to proactively work towards challenging deadlines through multitasking and resilience. Experience in SAP or Forecasting. Experience in Alteryx. Qualifications in data science and/or data analytics. Experience of working within a project. Experience of managing change whilst Business As Usual (BAU) activity is ongoing. What You’ll get More ❯

Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working : 2-3 days … and treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and responsive. You … will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role is keeping up to date with new More ❯

Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working : 2-3 days … and treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and responsive. You … will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role is keeping up to date with new More ❯

This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to-end outcomes across CIO. Next to delivery … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage … observability, and metadata management. Ensuring the sustainability and scalability of our data infrastructure and that it enables the company to achieve its business objectives Data Platform Optimization: Ensuring that the team is working efficiently and effectively, bringing an agile mindset to adapting to changing circumstances while working within the organisational constraints of budget, resource and quality. Work closely More ❯

This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to-end outcomes across CIO. Next to delivery … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage … observability, and metadata management. Ensuring the sustainability and scalability of our data infrastructure and that it enables the company to achieve its business objectives Data Platform Optimization: Ensuring that the team is working efficiently and effectively, bringing an agile mindset to adapting to changing circumstances while working within the organisational constraints of budget, resource and quality. Work closely More ❯

applications using C#, .NET Core, and AWS. Build and maintain well-structured RESTful APIs to integrate with various systems. Work with SQL and NoSQL databases to store and retrieve data efficiently. Implement event-driven architectures using messaging systems like RabbitMQ and AWS Kinesis/SQS. Develop modern web interfaces using TypeScript and Angular. Contribute to code reviews and ensure … proficiency in C# programming, with a focus on building scalable applications using .NET Core. Web API Development: Expertise in designing, developing, and maintaining well-structured RESTful APIs to facilitate data exchange between systems. Database Management: Solid understanding of SQL databases and experience working with NoSQL databases, particularly MongoDB. Cloud Architecture: Proven ability to architect and implement scalable cloud solutions … handle asynchronous communication. Desirable Skills Code Quality and Testing: A commitment to writing clean, maintainable code and a strong understanding of testing methodologies (unit, integration, end-to-end). Big Data: Familiarity with big data concepts, tools, and techniques for handling and processing large datasets. Rullion celebrates and supports diversity and is committed to ensuring equal More ❯