1 to 25 of 86 Permanent Big Data Jobs in the UK

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

dynamic organization allows you to work across functional business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your team Join our growing Data & Analytics practice and make a difference. In this practice you will be utilizing the most innovative technological solutions in modern data ecosystem. In this role you'll be … able to see your own ideas transform into breakthrough results in the areas of Data & Analytics strategy, Management & Governance, Data Integration & engineering, Analytics & Data science. About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This … with strong analytical and problem-solving skills and the ability to work collaboratively with clients and cross-functional teams. Requirements · Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. · Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic More ❯

Head of Data Engineering - Preston A Head of Data Engineering/Data Engineering Manager to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven … experience as a lead data engineer/Data Engineering Manager with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, Databricks, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing … concepts and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves building & managing a team of data engineers, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high More ❯

Description This position will play a critical role in the success of the Firm's Data Strategy program As a Vice President on the Data Governance team within the firmwide CDO, you will be responsible for working with stakeholders to define governance and tooling requirements and building out the Firmwide Data Lineage framework. The firmwide team also … to deliver this governance framework. In addition, you will be responsible for driving the adoption of the firmwide CDO framework by the LOBs and Corporate Functions CDOs. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm's data and analytics journey. This includes ensuring the quality, integrity, and security of the company … s data, as well as leveraging this data to generate insights and drive decision-making. The CDAO is also responsible for developing and implementing solutions that support the firm's commercial goals by harnessing artificial intelligence and machine learning technologies to develop new products, improve productivity, and enhance risk management effectively and responsibly. Job Responsibilities Partners with CDO More ❯

Lead Data Engineer - Preston A Lead Data Engineer to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven experience as a Senior or Lead data engineer Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies AWS or Azure cloud experience Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills … in Azure Databricks and Microsoft Fabric would be a bonus This new role involves leading a data team, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud More ❯

Are you passionate about data and eager to kickstart your career in data engineering? We’re looking for a motivated Junior Data Engineer to join our Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation for our client-facing … products and services. Working closely with experienced developers, data analysts, data scientists, and other stakeholders, you will be instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment. Key Responsibilities Data Pipeline Development • Contribute to the design, building, and maintenance of scalable data pipelines • Implement ETL (Extract, Transform … Load) processes to ingest data from various sources • Ensure data quality, integrity, and reliability through thorough testing and validation Database Management • Help manage and optimise data storage solutions (e.g., SQL and NoSQL databases, data lakes) • Monitor and assist in maintaining database performance and security Data Integration: • Collaborate with data analysts and scientists to integrate More ❯

Azure/Databricks Data Engineer x2 - UK Wide (Hybrid Working) £72,000-£80,000 Duties As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement … data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations. Skills/Experience Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data. Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive models and drive business insights. Monitor and optimize data pipelines and infrastructure: Analyze performance metrics, identify bottlenecks More ❯

comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. You understand and align with Solirius Reply Values. The Role: We are looking for an experienced Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. … You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. Requirements Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models … schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client and cross-functional teams to identify and address data More ❯

Senior Azure Data Engineer (Databricks, Delta Live Tables, Unity Catalog) 3 - 6 months Remote (UK Candidates Only) £550 - £600 per day Outside IR35 We are currently recruiting for an experienced Data Engineer skilled in Microsoft Azure and cloud computing concepts. As the Azure Data Engineer, you will work closely with a Microsoft & Databricks partner with responsibilities of … end-to-end design, build and deployment of industry-leading big data and AI applications. Your work will be varied and your responsibilities will include: Designing, developing, and managing end-to-end data pipelines Data processing and transformation using Spark Providing technical governance to enhance ways of working Champion DevOps and CI/CD methodologies to … ensure agile collaboration and robust data solutions Engineer and orchestrate data models and pipelines Lead development activities using Python, PySpark and other technologies Write high-quality code that contributes to a scalable and maintainable data platform To be successful in this role, you will need to have the following qualifications: Experience with Big Data Technologies More ❯

the hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms … ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … have working across our business, becoming a pivotal part of our journey, to not just meet, but continuously exceed our client expectations The Role We are seeking a skilled Data Engineer(s) to join our team, ideally initially on a contract basis, however longer term there is potential to discuss longer term opportunities in the shape of a permanent More ❯

Lead Data Scientist (SC Cleared) Location: Remote-working – Occasional visits to London office Rate: £650.00pd (Inside IR35) Security Clearance: SC Cleared (or eligibility to obtain SC clearance) Our central government customer is looking for an exceptional Lead Data Scientist to guide data-driven initiatives and deliver impactful solutions to complex challenges. You will lead a team of … Your expertise will drive the integration of cutting-edge technologies, ensuring innovation at the forefront of government strategies. Key Responsibilities Provide technical leadership and mentoring to a team of data scientists and analysts. Define and implement data science strategies aligned with organizational objectives. Lead the development of machine learning models and advanced statistical techniques to support policy-making … and operational efficiency. Collaborate with senior stakeholders to understand their goals and translate them into actionable data projects. Oversee the design, deployment, and management of data pipelines and big data platforms. Develop data governance frameworks, ensuring ethical and secure handling of sensitive information. Identify emerging technologies and methodologies to enhance the organization's data More ❯

Pentaho Developer - Pentaho, Data Engineering, Cloud, Big Data, ETL, Informatica A large global organisation is looking for an experienced Pentaho Developer to design, develop, and maintain ETL workflows and data integration solutions within a modern data engineering ecosystem. The role involves building scalable data pipelines, ensuring data quality, and supporting production environments. This … full-time, permanent position. The location is London, UK. You will be required to work 3 days on-site, and 2 days remote. KEY SKILLS & EXPERIENCE: Expertise in Pentaho Data Integration for ETL processes. Strong understanding of data warehousing concepts, data modelling, and schema design. Experience with other ETL tools (Informatica, Talend, SSIS). Advanced SQL for … querying and data manipulation. Familiarity with Java, Python, or VBA for Scripting and automation. Knowledge of RESTful APIs and various database systems. Skills in data profiling, data analysis, and ensuring data quality. Exposure to Banking/Financial Services domain is a plus. RESPONSIBILITIES: Design, develop, and manage ETL workflows using Pentaho Data Integration (PDI). More ❯

DATA SCIENTIST - eDV CLEARED NEW PERMANENT OPPORTUNITY AVAILABLE FOR A DATA SCIENTIST IN LONDON WITH ENHANCED DV CLEARANCE Permanent opportunity for a Data Scientist Enhanced DV security clearance is required Salary up to £95,000 + Clearance Bonus + Company Bonus Central London based organisation in an accessible location To apply please call/or email WHO … WE ARE? We are recruiting a permanent Data Scientist to work with a leading technology and engineering company that do excellent work in the National Security sector across a range of exciting projects. Due to the nature of our clients, you must hold enhanced DV security clearance. WHAT WILL THE DATA SCIENCE ENGINEER BE DOING? As a Data … you will be working alongside our team on a wide variety of projects with a special focus on innovation and AI. You could be working with all types of data (both structured and unstructured) using a variety of software - so we're open to seeing engineers with different technology backgrounds! THE DATA SCIENCE ENGINEER SHOULD HAVE.... Strong and More ❯

Data Governance Analyst Full time position Location: Reading Hybrid - 2x days in office Salary: 47,000 - 71,000 (depending on experience) As a Data Governance Analyst , you will support the Data Governance Manager in implementing and maintaining the organization's data governance framework. Your role will involve ensuring data quality, consistency, and compliance across various … data domains. You will work closely with data owners, data stewards, and IT teams to enforce data governance policies and procedures, and support Master Data Management (MDM) initiatives. What you'll be doing as a Data Governance Analyst Assist in developing and articulating the organisation's data governance vision, strategy and roadmap. Support … the activation and enforcement of the data governance program vision. Collaborate with various stakeholders, including IT teams, business units, and data owners. Ensure that master data is accurately represented, consistently defined and easily accessible across the organisation. Provide training and guidance to employees on data governance principles, policies and procedures. Assist in establishing mechanisms for governance More ❯

Data Governance Analyst Full time position Location: Reading | Hybrid - 2x days in office Salary: £47,000 - £71,000 (depending on experience) As a Data Governance Analyst , you will support the Data Governance Manager in implementing and maintaining the organization's data governance framework. Your role will involve ensuring data quality, consistency, and compliance across various … data domains. You will work closely with data owners, data stewards, and IT teams to enforce data governance policies and procedures, and support Master Data Management (MDM) initiatives. What you'll be doing as a Data Governance Analyst Assist in developing and articulating the organisation's data governance vision, strategy and roadmap. Support … the activation and enforcement of the data governance program vision. Collaborate with various stakeholders, including IT teams, business units, and data owners. Ensure that master data is accurately represented, consistently defined and easily accessible across the organisation. Provide training and guidance to employees on data governance principles, policies and procedures. Assist in establishing mechanisms for governance More ❯

customers make the right technology choices, ensuring both immediate and long-term success. The Skills You’ll Need: Experience in architecture & design and consulting services focused on enterprise solutions, data analytics platform, lake houses, data engineering, data processing, data warehousing, ETL, Hadoop & Big Data. Experience in defining and designing data governance, data management … and data security solutions for an enterprise across business verticals Experience on at least one of the 3 major cloud platforms- AWS, Azure, GCP Knowledge of GenAI technologies, including LLMs (Large Language Models), generative models, and related frameworks (e.g., LangChain, TensorFlow, etc.) Possess knowledge of cloud-based AI/ML services like AWS SageMaker, Azure Machine Learning, Google AI … and flexible to adapt to ambiguities and changes. Open to frequent travel to meet with customers and attend internal and external events across the Americas and Europe. Skills Required: Data Warehousing, ETL, Big Data, Presales Role: At Impetus, you will operate at the intersection of business and engineering, engaging with engineers, managers, sales teams, and C-level More ❯

Expertise in Pentaho Data Integration for ETL processes. Strong understanding of data warehousing concepts, data modelling, and schema design. Experience with other ETL tools (Informatica, Talend, SSIS) is a plus. Advanced SQL for querying and data manipulation. Familiarity with Java, Python, or VBA for scripting and automation. Knowledge of RESTful APIs and various database systems. Skills … in data profiling, data analysis, and ensuring data quality. Experience 612 years in Data Integration and ETL development. Minimum 35 years of hands-on Pentaho experience. Leading complex ETL projects and working with cross-functional teams. Exposure to Banking/Financial Services domain is a plus. Preferred Qualifications Certifications in Pentaho, Big Data, or … Cloud Platforms (AWS/GCP/Azure). Experience with Big Data technologies (Hadoop, Spark) and cloud data services. More ❯

Legal Data Analytics Manager Location: London Permanent role. Primary skills Data statistics & Analysis; Client Dashboards;To extract Data, consolidate and analyse it; Create automation solutions including AI solutions; Quantitative analytics (e.g. offer calculations for claims); Analysis for Decision making; Modelling of quantum exposure; Record Data breach analytics The Data Analytics Manager will focus on building … internal client relationships and on the delivery of day-to-day matter work in the data analytics team. Management of people ensuring the appropriate resourcing of matters, training, reporting and you will work closely with the Senior Manager, Data Analytics. The Data Analytics Manager will be responsible for providing expertise, advising on any issues within the team … of the team. The role will ensure the overall provision of high quality services and will play a key part through effective consultancy in building the reputation of the Data Analytics Team, both internally and externally to clients. Responsibilities: With the Head of Data Analytics you’ll be part of the design, development and ongoing evolution of dashboards. More ❯

We’re partnering with a leading entertainment company seeking to hire a Data Engineering Manager to play a key role in their data operations and business intelligence initiatives. Key Responsibilities: Design & maintain AWS BI infrastructure (Redshift, S3, EMR) using Terraform and IaC best practices. Develop CI/CD pipelines (Jenkins, GitHub Actions) to automate ETL and Power BI … code deployments. Manage environments (Dev, QA, UAT) and automate data refreshes for accuracy and consistency. Oversee data pipelines and big data workflows (EMR, Spark) for high-performance analytics. Optimize code for ETL and Power BI (DAX, data models, refresh scheduling) to enhance performance. Implement observability and logging (CloudWatch, Grafana, ELK) for proactive system monitoring. Collaborate … cross-functionally with BI, Platform, and Data teams on releases and issue resolution. Enforce security & compliance (RBAC, encryption, GDPR/HIPAA) across AWS services. Monitor performance & costs in AWS, driving optimisation and efficiency. Champion automation & innovation through new tools, frameworks, and cloud-native solutions. Key Skills: AWS Cloud: Expert in Redshift, S3, Lambda, EMR, and IaC (Terraform/CloudFormation More ❯

Data Engineer - Cardiff/Hybrid - £45,000 - £50,000 + benefits Yolk Recruitment are excited to be working with a global technology business that's continuing to expand its data capability and invest in modern cloud solutions. Known for their collaborative culture and commitment to innovation, they're offering an excellent opportunity for a Data Engineer to … make a real impact. We're looking for a Data Engineer to help design, build, and maintain scalable data pipelines and systems that power analytics and business intelligence across the organisation. You'll play a key role in ensuring data is accurate, accessible, and high-quality - driving data-led decision making at every level. What you … ll be doing: Design, build, and maintain scalable data pipelines and ETL processes to support analytics and operations. Develop and optimise data models and storage solutions for performance and reliability. Ensure data quality, integrity, and security throughout the data lifecycle. Collaborate with data scientists, analysts, and engineers to deliver effective data solutions. Implement and More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

Senior Data Engineer - Cardiff/Hybrid - £65,000 - £75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They're looking for a Senior Data Engineer to help shape the next generation of their data platform - leading technical design, mentoring others, and driving … best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you'll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best practices for data engineering, including … coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data governance, security, and compliance. Troubleshoot and resolve complex data More ❯

for what's next. An environment where your skills will evolve at the frontier of innovation and AI, ensuring continuous growth and development. We are looking for a Principal Data Engineer to work alongside our market-leading engineers and architects to deliver complex projects and make valuable impacts for our customers. We look for people who embody: Innovation to … every result. ‍Integrity always. About The Role The purpose of this role is to engage with enterprise-level organisations to offer a consultative view and direction on best practice data architecture using Google Cloud solutions. This role is designed for impact, and we believe our best work happens when we connect. While we operate a flexible model, we expect … on client-facing delivery projects Consult, design, coordinate architecture to modernise infrastructure for performance, scalability, latency, and reliability Identify, scope, and participate in the design and delivery of cloud data platform solutions Deliver highly scalable big data architecture solutions using Google Cloud Technology: Create and maintain appropriate standards and best practices around Google Cloud SQL, BigQuery, and More ❯