1 to 25 of 157 Big Data Jobs in the UK excluding London

delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly … maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka. Collaborate with cross-functional teams to define, design, and ship data-intensive features and services. Optimize existing data processing pipelines for efficiency, scalability, and reliability. Develop and execute unit tests, ensuring the quality and robustness of the code. Implement … development, including version control, continuous integration, and automated testing. Provide technical guidance and mentorship to junior developers. Stay abreast of the latest trends, best practices, and emerging technologies in Big Data and Java development. Contribute to the design and implementation of highly scalable, secure, and resilient data processing systems. Preferred technical and professional experience Bachelor's or More ❯

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

Data Engineering Specialist (Assembly, Bristol, United Kingdom) Why this job matters Defending BT Group against cyber-attacks is the focus of PBT Cyber Operations. BT faces threats from the full range of threat actors from sophisticated threat nation state actors developing their tactics to new heights and targeting our industry, through to criminal groups seeking to monetize efforts attacks … BT drives security decision making impacting all levels of the organization. As a large, distributed, multinational IT-based company, BT has a unique view of global cyber threat, including data sets that have never been available to the industry before. We are developing novel and sophisticated ways of analysing this data to ensure we stay ahead in this … exciting and challenging environment. As an experienced data engineer, you will be responsible for developing and maintaining data pipelines, so that this highly skilled team of data scientists, data engineers and developers, continue to generate unique, innovative and impactful intelligence. This role is hybrid (3 days in office) & can be based in either Belfast, Birmingham, Bristol More ❯

Data Engineering Specialist (Assembly, Bristol, United Kingdom) Why this job matters Defending BT Group against cyber-attacks is the focus of PBT Cyber Operations. BT faces threats from the full range of threat actors from sophisticated threat nation state actors developing their tactics to new heights and targeting our industry, through to criminal groups seeking to monetize efforts attacks … BT drives security decision making impacting all levels of the organization. As a large, distributed, multinational IT-based company, BT has a unique view of global cyber threat, including data sets that have never been available to the industry before. We are developing novel and sophisticated ways of analysing this data to ensure we stay ahead in this … exciting and challenging environment. As an experienced data engineer, you will be responsible for developing and maintaining data pipelines, so that this highly skilled team of data scientists, data engineers and developers, continue to generate unique, innovative and impactful intelligence. This role is hybrid (3 days in office) & can be based in either Belfast, Birmingham, Bristol More ❯

BT drives security decision making impacting all levels of the organization. As a large, distributed, multinational IT-based company, BT has a unique view of global cyber threat, including data sets that have never been available to the industry before. We are developing novel and sophisticated ways of analysing this data to ensure we stay ahead in this … exciting and challenging environment. As an experienced data engineer, you will be responsible for developing and maintaining data pipelines, so that this highly skilled team of data scientists, data engineers and developers, continue to generate unique, innovative and impactful intelligence. This role is hybrid (3 days in office) & can be based in either Bristol or Manchester … What you'll be doing Developing and maintaining Data Pipelines for extraction, transformation and loading processes Assembling large, complex data sets that meet user and business requirements Collaborating with data scientists and intelligence analysts, to support and deliver against their requirements Identifying and implementing process improvements to enhance data delivery and scalability Build and maintain collaboration More ❯

AWS Data Engineering Manager (1 Braham Street, London, United Kingdom) Recruiter: BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we have … we are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies. The AWS Data Engineering Manager plays a mission-critical role in enabling BT’s DD Ops transformation by leading the design, implementation, and optimisation of data infrastructure that powers intelligent, automated … operations. This role manages a team of skilled data engineers and is responsible for building and maintaining scalable, secure, and high-performance data pipelines that capture, manage, store, and utilise both structured and unstructured data from internal and external sources. These pipelines are foundational to delivering real-time insights, predictive analytics, and AI Ops capabilities across BT More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

to Content Link Select how often (in days) to receive an alert: Create Alert Competitive salary UK/Glasgow: hybrid working model (2-3 days on site) At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market … our clients stay a step ahead of the competition. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here. NTT DATA is currently looking for a Data Engineer for our growing team in the UK. Overview: NTT DATA is seeking a highly skilled Data Engineer with over 4+ years of experience to join our team to help a strategic banking client in various data transformation activities. Key Responsibilities: Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and Databricks Developing and deploying ETL jobs More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially … one day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into the platform … using batch and streaming processes, adhering to SLAs. * Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols. * Ensure data quality and reliability processes are effective, maintaining trust in the data. * Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements. * Able to More ❯

experiences and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You'll play … a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and reliable data pipelines, focusing … on ingesting and transforming CRM and customer data from various sources. Lead & Innovate: Take technical ownership of customer data integration solutions within our data platform (AWS/SQL Server). Drive improvements and implement best-in-class data engineering practices. Ensure Quality: Champion data quality and governance for customer datasets. Implement robust monitoring, validation checks More ❯

We are therefore hiring a Data Director to lead and collaborate with our data functions, encompassing data analytics, data science, data governance, and data engineering. You will deliver our vision using data to provide a market-leading platform service, driving value from data. You will drive a data-first culture, empowering self … service approaches across the business, underpinned by technology, governance, and data science capabilities. The data team will provide insights that drive improved strategic outcomes for our business; using data as the foundation for all we do. The ideal candidate will possess a strong technical grounding, a track record of problem solving, commercial acumen, and experience in a … senior role leading data teams. What we're looking for: Demonstrated leadership in data strategy and execution, with a track record of delivering data initiatives aligned to business goals. Proven track record of leading data-driven transformation, using analytics to unlock measurable business impact, enable data-led decisions, inform product development, and enhance customer insight. More ❯

We are looking to hire a additional 2 Data Engineers to join the Satalia Data Engineering Team. We are investing massively in developing next-generation AI tools for multimodal datasets and a wide range of applications. We are building large scale, enterprise grade solutions and serving these innovations to our clients and WPP agency partners. As a member … roadmap. Your contributions will directly shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. What you’ll be doing: Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data scientists have access to … the data they need in the format they need it. Implement and optimize data transformations and ETL/ELT processes, using appropriate data engineering tools. Work with a variety of databases and data warehousing solutions to store and retrieve data efficiently. Implement monitoring, troubleshooting, and maintenance procedures for data pipelines to ensure the high More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, were always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent to … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access … for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance bottlenecks, and implementing robust error … handling strategies. Youll work closely with cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. Were looking for candidates with over More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Senior Data Engineer Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling one of modern medicines biggest challenges. Theyve … intersection of science and software. What youll be doing: Following a successful product launch and securing Series A funding, theyre scaling fast and now looking for their very first Data Engineer. Youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the design … and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models More ❯

Position Summary The Database Administrator is part of the Data and AI practice. This team is made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and … at any Claranet UK office - most people choose a combination of the two. We’ve worked hard to create a remote-friendly culture and believe you can have a big impact no matter where you live. Working in the Data Practice we can offer an environment where you will be surrounded by like-minded, highly technical people. Due … Security Reporting On-Call for fourth-line support 24/7 rota. Automation of all support activities including backups, patching, and script deployments. Accompany customers towards Cloud technologies, PaaS data platforms and other cloud-native Data Services. Ensure the storage, processing, and quality of customer data You will build new customer environments, working as part of a More ❯

Senior Lead Instructor – Cloud, Data & AI Location: MediaCity, Salford (Hybrid) Salary: Competitive, based on experience Sector: Digital Skills/Technology Education/EdTech A leading, award-winning technology organisation based in Manchester's MediaCity is seeking a Senior Lead Instructor specialising in Cloud, Data, and AI technologies to join its innovative digital skills division. This organisation is on … hands-on role within the organisation's digital skills function. As Senior Lead Instructor , you'll be responsible for delivering and developing high-impact training programmes in cloud-based data, big data, and AI technologies. You'll also work closely with corporate clients to design bespoke upskilling solutions aligned to real-world business needs. You'll need … is your chance to help shape the future tech workforce while working in a vibrant, innovation-led environment. Key Responsibilities Deliver engaging in-person and virtual training on cloud, data and AI technologies to a broad range of learners. Design and update training materials, including labs, presentations, and assessments, aligned with current industry needs. Collaborate with employers to design More ❯

Data Solutions Architect £110,000 - £120,000 GBP 10% Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solutions Architect - Consulting Location: London (Remote-first) Working Pattern: Full-time, Permanent Salary: £110,000 - £120,000 per annum About the Role We're seeking a Data Solutions Architect to join a dynamic consulting team … delivering cutting-edge, cloud-based data solutions for high-profile clients across diverse industries. This is a remote-first role with occasional travel, offering the opportunity to lead end-to-end delivery of complex data architecture projects in a collaborative, agile environment. What You'll Be Doing Leading cross-functional teams of Data Engineers, Architects, BAs, and … QA Analysts. Designing and delivering scalable data solutions using modern cloud platforms and data technologies. Engaging with stakeholders to shape and own the technical delivery of data architecture projects. Applying best practices in data governance, security, and compliance. What We're Looking For Experience & Leadership Proven track record as a Lead Data Solutions Architect or More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯