1 to 25 of 45 Permanent Big Data Jobs in the UK excluding London

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction and impact … of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's vision … and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud More ❯

delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly … maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka. Collaborate with cross-functional teams to define, design, and ship data-intensive features and services. Optimize existing data processing pipelines for efficiency, scalability, and reliability. Develop and execute unit tests, ensuring the quality and robustness of the code. Implement … development, including version control, continuous integration, and automated testing. Provide technical guidance and mentorship to junior developers. Stay abreast of the latest trends, best practices, and emerging technologies in Big Data and Java development. Contribute to the design and implementation of highly scalable, secure, and resilient data processing systems. Preferred technical and professional experience Bachelor's or More ❯

We are searching for a remote working Senior Data Engineer to join our clients high-performing Data Engineering team. This role is ideal for an experienced, hands-on professional Senior Data Engineer who thrives on technical leadership, innovation, and delivery. You can be based anywhere in the UK to be considered for the role but you MUST … be UK based as overseas working is not possible with our client. Our client is a 100% data-driven company who pride themselves on engineering excellence and delivering impactful solutions to their clients. You will play a crucial role in driving the team's vision and objectives and you will be expected to provide technical leadership, own the solution … ensure the reliability of data products, and collaborate closely with the team and customers in order to optimise data solutions. This is a unique opportunity for a highly skilled and hard-working Senior Data Engineer with deep hands-on expertise in data engineering and architecture, a strong coding background, and a strategic mindset - someone who can More ❯

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

Data Engineer Sr - Informatica ETL Expert page is loaded Data Engineer Sr - Informatica ETL Expert Apply locations Two PNC Plaza (PA374) Birmingham - Brock (AL112) Dallas Innovation Center - Luna Rd (TX270) Strongsville Technology Center (OH537) time type Full time posted on Posted 3 Days Ago job requisition id R185351 Position Overview Job Description Summary At PNC, our people are … each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company's success. As a Data Engineer within PNC's Technology organization, you will be based in Pittsburgh, PA; Cleveland, OH; Birmingham, AL or Dallas, TX. The position is primarily based in a PNC location. … the manager's discretion. PNC will not provide sponsorship for employment visas or participate in STEM OPT for this position Key responsibilities - - Design, Develop and maintain scalable and efficient data pipelines and ETL processes - Collaborate with analysts and stakeholders to gather requirements and implement data solutions that meet business needs - Proposes & designs data solutions to address complex More ❯

strategy. Role Description: Senior Quantitative engineers in Global Risk are responsible for designing and overseeing the implementation of common, reusable, and scalable software components. These components enable GRM's data and analytical capabilities. These components can be domain independent (such as generic data quality tools over billions of rows of data) or domain specific (such as classification … testing framework for Global Markets processes). Senior Quantitative engineers work with senior modelers, risk managers, and technologists to understand the current state and design the future state of data and analytics. Senior Quantitative engineers have a combination of software engineering, big data, modelling and management skills and the ability to work across the entire spectrum of … a big data stack - from data to logic to model to UI to UX. Responsibilities Seek opportunities for consistent improvement in quality, efficiency, and processes Partner effectively with senior stakeholders within GRA & EIT, Front Line Units, Technology, Audit and Compliance Provide leadership and oversight to less experienced team members Applying quantitative methods to develop capabilities that meet More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing … overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. You will collaborate with data More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

the hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms … ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … have working across our business, becoming a pivotal part of our journey, to not just meet, but continuously exceed our client expectations! The Role We are seeking a skilled Data Engineer(s) to join our team, ideally initially on a contract basis, however longer term there is potential to discuss longer term opportunities in the shape of a permanent More ❯

Data Architect Salary : Up to £85,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is looking for a skilled Data Architect to support enterprise-wide data architecture initiatives. This role focuses on transforming core data assets into trusted, reusable resources that drive service delivery improvements, business growth, and AI innovation across multiple departments. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Build scalable data architecture for high-value organizational data assets Work with product teams and stakeholders to match data solutions with user requirements … Help establish data governance and quality assurance processes Drive interoperability and open standards adoption across systems Ensure secure and ethical data management practices Enable data access for AI and analytics applications Qualifications and Requirements: More than 3 years of proven Data Architect experience with strong data modeling (conceptual, logical, physical) skills Knowledge of data More ❯

Data Engineer Who are Diligenta? Diligenta's vision is to be acknowledged as Best-in-class Platform-based Life and Pensions Administration Service provider. Customer service is at the heart of everything we do, and our aim is to transform our clients' operations. A business that has been described as ‘home’ by existing employees, we drive a culture that … is founded on positive change and development. Summary of the role: As a Data Engineer you will be responsible for designing, developing and delivering solutions to Load, optimise and transform Data within our environment and the relevant infrastructure to support them.The Data Engineer will provision, configure and implement Azure infrastructure consisting of SQL instances, and other Fabric … components as required to support the Data needs of Diligenta. You will be a key part of designing and building out our Data infrastructure that will help to drive Data insights, data use and value across the business. Benefits: 33 days including Bank Holidays Eligibility for an annual discretionary bonus scheme Personal and career development opportunities More ❯

Data Engineer Who are Diligenta? Diligenta's vision is to be acknowledged as Best-in-class Platform-based Life and Pensions Administration Service provider. Customer service is at the heart of everything we do, and our aim is to transform our clients' operations. A business that has been described as ‘home’ by existing employees, we drive a culture that … is founded on positive change and development. Summary of the role: As a Data Engineer you will be responsible for designing, developing and delivering solutions to Load, optimise and transform Data within our environment and the relevant infrastructure to support them.The Data Engineer will provision, configure and implement Azure infrastructure consisting of SQL instances, and other Fabric … components as required to support the Data needs of Diligenta. You will be a key part of designing and building out our Data infrastructure that will help to drive Data insights, data use and value across the business. Benefits: 33 days including Bank Holidays Eligibility for an annual discretionary bonus scheme Personal and career development opportunities More ❯

Lead Cloud Data Engineer – Liverpool – Hybrid - £70k A well-established professional services business that's modernising their data infrastructure and embracing cloud-first technologies are looking for a Lead Cloud Data Enigneer. Based Liverpool City Centre, they're investing significantly in their data capabilities to enhance client services, improve operational efficiency, and drive strategic decision-making … through advanced analytics and robust data management practices. The Role They're looking for an exceptional Lead Cloud Data Engineer to spearhead their data engineering initiatives and drive technical excellence across their cloud infrastructure. You'll be architecting sophisticated data solutions that power critical business operations whilst leading a talented team of engineers. This is an … outstanding opportunity for someone who's passionate about cutting-edge technology and wants to shape the future of enterprise data management. What's on offer: Up to £70k DOE Hybrid working from their Liverpool office – 3 days on site Opportunity to work with industry-leading cloud technologies Leadership role with genuine career progression prospects Collaborative environment with cross-functional More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Lead Data Scientist LondonPrivate Equity£140,000 - £150,000 + benefits Harnham is working with a tech firm in the Private Equity space and hiring a few positions across Data Science, Machine Learning Engineering and Data Engineering. The company have an impressive founding team and hold a strong reputation within the Data & AI and Private Equity … purpose of creating value. Often working in ambiguous and greenfield environments, you will collaborate with a strong team of technical people across multiple industries to solve complex commercial and data problems, delivering key data science initiatives that drive performance and revenue. In this role you will lead the technical teams that deliver value. The Role - Lead Data Scientist You will be: Working on multiple engagements within portfolio companies across various different industry sectors Delivering key Data Science/AI initiatives that drive value for customers. Shaping how projects are delivered, driving performance and working closely with C-level execs. Providing technical leadership across the business, with a focus on end-to-end machine learning solutions. More ❯

Senior Data Engineer Hybrid working - 1 day a week onsite in either London or Portsmouth Permanent - Up to £75k Overview: We are seeking a talented Senior Data Engineer specialising in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimising Starburst installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis. Responsibilities: Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations, overseeing environment setup, configuration, maintenance, upgrades, and … ensuring optimal performance. Configure various server and application settings and parameters. Integrate Starburst with various data sources to create a unified data platform. Design and tune the container solution for performance and scalability. Set up and configure data catalogs in various modes. Implement robust security controls for data access, ensure compliance with data regulations, and More ❯

Data Engineer £70,000 - £110,000 GBP Onsite WORKING Location: Manchester, North West - United Kingdom Type: Permanent Role: Lead or Senior Data Engineer Salary: £70,000 - £110,000 per annum (multiple grades - depending on experience) + Benefits Location: Open to UK-wide candidates (Remote/Hybrid options available) Overview We are looking for a Data Engineer with … a strong foundation in software engineering and experience working in consultancy environments. This role involves designing and developing large-scale data processing solutions within Agile teams, contributing to impactful digital transformation projects across sectors. You'll work across the full software lifecycle, from design and development to testing and deployment, while collaborating with colleagues and stakeholders to ensure high … quality, maintainable, and scalable data solutions. Key Responsibilities Design and develop data processing software for deployment in Big Data technologies Build and maintain ETL/ELT pipelines using modern data platforms Collaborate with team members to resolve implementation challenges and ensure code quality Work with operations teams to ensure solutions are production-ready Contribute to More ❯

Principal Data Architect Salary : Up to £100,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is seeking an experienced Principal Data Architect to spearhead the development of enterprise-wide data architecture initiatives. This pivotal role … will drive the strategic implementation of scalable data solutions that support organizational transformation, foster innovation, and enable advanced analytics capabilities across multiple business units. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities Drive data governance and stewardship transformation across the organization Build scalable data ecosystems using APIs and open standards … Work with teams and leadership to align data strategy with business goals Set up data governance, quality controls, and compliance frameworks Make data AI-ready and optimize for analytics and machine learning Embed security, privacy, and ethics into all data architecture decisions Lead the overall data architecture vision across different business areas Qualifications and Requirements More ❯

Senior Data Engineer Opportunity Salary: Up to £75k (Based on candidate experience) + Excellent benefits Work commute Model: Mostly remote with just 1 day per week on-site Location: London/Portsmouth Job Type: Permanent Ready to Shape the Future of Data? My client is a leading UK-based IT services and consulting company seeking an experienced Senior … Data Engineer who thrives on building robust, scalable systems that unlock the true potential of enterprise data. This is your opportunity to join their cutting-edge AI & Data team as a Senior Data Engineer . What You'll Be Doing Build & Optimise : Take ownership of Starburst (Trino) and Dell Data Lakehouse deployments, turning complex data ecosystems into seamless, high-performance platforms Connect Everything : Create unified data experiences by integrating diverse data sources across multiple environments Performance Mastery : Fine-tune containerised solutions for maximum scalability and lightning-fast query performance Secure by Design : Implement bulletproof security frameworks and ensure rock-solid compliance across all data touchpoints Problem Solver : Dive deep into complex More ❯