226 to 250 of 678 Big Data Jobs in the UK

Lead Data Engineer – Big Data & Cloud | Shape the Future of Enterprise Data Location: Remote - UK based Type: Permanent Salary: £80,000 + Bonus + Benefits Are you a hands-on data engineer with a flair for leadership and a deep love for complex tech challenges? This is your chance to step into a pivotal role … re working with a pioneering UK-based organisation at the heart of digital transformation in real estate, environment, and planning data. They’re on the hunt for a Lead Data Engineer — a true technical expert and people leader who can own the end-to-end delivery of large-scale, cloud-native data solutions and inspire a team to … do their best work under pressure. The Role This is not just another data engineering job. You’ll be: Leading projects and mentoring a team of talented engineers, ensuring quality code, collaborative culture, and technical excellence. Designing robust, scalable data infrastructure that powers mission-critical products. Driving innovation in a big data environment using cloud tech More ❯

Principal Data Engineer, Consulting London Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build custom solutions, and transfer knowledge to client technical teams. The … ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly with clients to define requirements, refine solutions, and ensure successful … handover to internal teams. Design and implement ETL/ELT pipelines for cloud data warehouse solutions. Build and maintain data dictionaries and metadata management systems . Analyze and cleanse data using a range of tools and techniques. Manage and process structured and semi-structured data formats such as JSON, XML, CSV, and Parquet . Operate effectively More ❯

Principal Data Engineer, Consulting London Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build custom solutions, and transfer knowledge to client technical teams. The … ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly with clients to define requirements, refine solutions, and ensure successful … handover to internal teams. Design and implement ETL/ELT pipelines for cloud data warehouse solutions. Build and maintain data dictionaries and metadata management systems . Analyze and cleanse data using a range of tools and techniques. Manage and process structured and semi-structured data formats such as JSON, XML, CSV, and Parquet . Operate effectively More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus on designing and implementing … end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion and related tooling. Work closely with … junior engineers. Requirements: Strong hands-on AWS experience – S3, Redshift, Glue essential. Proven experience building ETL/ELT pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc. More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus on designing and implementing … end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion and related tooling. Work closely with … junior engineers. Requirements: Strong hands-on AWS experience – S3, Redshift, Glue essential. Proven experience building ETL/ELT pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc. More ❯

Data Engineer - Manager x5 There are data teams and then there are data teams! Our customer puts enterprise at a new scale, not only with the size of their client engagements, but also with their own size as one of the big 4 and one of the first ever Microsoft Global Alliance Partners ( all data technologies will be delivered (GCP/AWS/Big data) although Microsoft Azure is at the forefront of some roles). As a result of insane customer wins, they are now looking to expand the teams by 5 experienced Data Engineering Managers who can be at the level to lead and assist them in their varied … Cloud Data transformation projects. This internationally renowned global consulting leader has a proven track record of delivering leading edge enterprise data engineering projects/programmes for a variety of Private and Public sector organisations including banking, pharma and government; and not only will you get fantastic project diversity, you will also get the opportunity to work with the More ❯

your products. The Amazon Fulfillment Technologies (AFT) team owns all of the software and infrastructure which powers Amazon's world-class fulfillment engine. Our team is building complex, massive data systems to capture data during every step in the automated pipeline and use that data to proactively predict efficiency and cost improvements to deliver the packages fast … to our customers. As an Big Data Engineer you will be working in one of the world's largest and most complex data warehouse environments. You should be skilled in the architecture of DW solutions for the Enterprise using multiple platforms (RDBMS, Columnar, Cloud). You should have experience in the design, creation, management, and business use … of extremely large data-sets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. Above all, you should be passionate about working with huge data sets and someone who loves to bring data More ❯

We are seeking a highly skilled Data Scientist for a contract role within national security , working on critical projects that support intelligence operations and threat detection. This is a unique opportunity to apply advanced machine learning and analytics to protect national interests and enhance strategic decision-making. The Role: As a Contract Data Scientist , you will contribute to … high-impact security initiatives , analysing complex datasets to uncover threats and support intelligence-led operations. You will lead research efforts in machine learning, collaborating with security analysts, data engineers, and intelligence specialists to transform prototypes into operational solutions within classified and high-security environments . Key Responsibilities: Lead machine learning research tailored for national security applications. Collaborate with security … professionals, intelligence analysts, and engineers to transition prototypes into mission-critical production systems . Develop and deploy data models for cyber threat detection, intelligence fusion, and predictive risk assessment . Analyse structured and unstructured intelligence data to generate actionable insights. Design, test, and optimise real-time algorithms for surveillance, anomaly detection, and adversarial analysis. Ensure compliance with strict More ❯

Data Analyst 📍 Hybrid | UK or EU-based | Permanent Curious about how data can transform business strategy? Ready to shape decisions that influence thousands of customers? Want to join a high-performance team where your insights drive impact? If you thrive in a fast-paced, data-rich environment and love turning numbers into stories, this could be the … opportunity you've been waiting for. Discover the Opportunity Our client – a prominent global brand in digital entertainment - is seeking a Data Analyst to join their growing analytics function. This role is ideal for someone who’s passionate about using data to answer big questions, influence marketing strategy, and empower departments across a diverse international business. This … connect insights to actions, and help shape both customer experience and business performance. Why This Role is Great In this role, you’ll have the opportunity to: Translate complex data sets into compelling insights that inform high-level decisions Design and build engaging dashboards and reports using tools like Tableau and Power BI Collaborate closely with marketing, performance, and More ❯

Data Analyst 📍 Hybrid | UK or EU-based | Permanent Curious about how data can transform business strategy? Ready to shape decisions that influence thousands of customers? Want to join a high-performance team where your insights drive impact? If you thrive in a fast-paced, data-rich environment and love turning numbers into stories, this could be the … opportunity you've been waiting for. Discover the Opportunity Our client – a prominent global brand in digital entertainment - is seeking a Data Analyst to join their growing analytics function. This role is ideal for someone who’s passionate about using data to answer big questions, influence marketing strategy, and empower departments across a diverse international business. This … connect insights to actions, and help shape both customer experience and business performance. Why This Role is Great In this role, you’ll have the opportunity to: Translate complex data sets into compelling insights that inform high-level decisions Design and build engaging dashboards and reports using tools like Tableau and Power BI Collaborate closely with marketing, performance, and More ❯

Data Analyst Hybrid | UK or EU-based | Permanent Curious about how data can transform business strategy? Ready to shape decisions that influence thousands of customers? Want to join a high-performance team where your insights drive impact? If you thrive in a fast-paced, data-rich environment and love turning numbers into stories, this could be the … opportunity you've been waiting for. Discover the Opportunity Our client – a prominent global brand in digital entertainment - is seeking a Data Analyst to join their growing analytics function. This role is ideal for someone who’s passionate about using data to answer big questions, influence marketing strategy, and empower departments across a diverse international business. This … connect insights to actions, and help shape both customer experience and business performance. Why This Role is Great In this role, you’ll have the opportunity to: Translate complex data sets into compelling insights that inform high-level decisions Design and build engaging dashboards and reports using tools like Tableau and Power BI Collaborate closely with marketing, performance, and More ❯

Software Engineer, Analytics & Data Engineering London, England, United Kingdom Software and Services Description The ASE Analytics & Data Engineering team is responsible for building analytics platforms, datasets and processes required by Apple for analysing and powering customer experiences. This means we build computation platforms and datasets to empower our product, marketing, feature, analytic and data science teams. Given … and complexity of our datasets, this is not a trivial task. We are looking for an outstanding Software Engineer who can effectively collaborate with our partner teams to deliver data engineering solutions to improve and power the next generation of Apple features.You will be working on cross-functional projects with other engineering teams, product leads and analytics leaders to … build insights, metrics and data pipelines. The projects you will be working on will be truly impactful. You will have the freedom to innovate as you work closely with our partners to drive meaningful change and build elegant systems to deliver the results.The ideal candidate will have a strong quality focus and be motivated by taking early production systems More ❯

At Kortical we are on a mission to enable any company to be an AI company by providing world class tooling to enable data scientists to deliver superhuman ML solutions much quicker than than current offerings allow, all fully transparent and editable in code. Remote working: Flexible remote (up to 4 days p/w) At Kortical we are … on a mission to enable any company to be an AI company by providing world class tooling to enable data scientists to deliver superhuman ML solutions much quicker than than current offerings allow, all fully transparent and editable in code. The role has two elements to it: As not every company or department have in-house data scientists … Deloitte Tax, NHS and Santander using the Kortical platform. By working with our clients building these awesome ML solutions, we find areas that would make our life better as data scientists and encode those features into the platform, editing features and seeing the result before building a model, monitoring data drift, easy deployment etc Across all our projects More ❯

Senior Data Analyst - 12 month Fixed Term Contract Who are we? Modern Networks Limited is a leading provider of managed IT services, specialising in delivering reliable, scalable, and secure IT solutions tailored to the needs of commercial properties, science parks, and SMEs. Our comprehensive services include IT support, broadband connectivity, telephone systems, and proactive cybersecurity protection. Modern Networks ensures … business continuity through data backup and disaster recovery solutions, optimises performance by managing IT infrastructure, and enhances communications by monitoring and optimising network performance. They also help businesses achieve and maintain compliance with industry regulations and data protection laws. What's the role? We’re looking for a highly skilled Senior Data Analyst with strong data processing capabilities and a proven track record of translating complex data into meaningful insights. As a Senior Data Analyst, you will play a critical role in shaping and implementing the strategy and architecture of our data platform. You will: Work closely with the wider team to evolve the data platform capabilities Unify data across More ❯

the needs of commercial properties, science parks, and SMEs. Our comprehensive services include IT support, broadband connectivity, telephone systems, and proactive cybersecurity protection. Modern Networks ensures business continuity through data backup and disaster recovery solutions, optimises performance by managing IT infrastructure, and enhances communications by monitoring and optimising network performance. They also help businesses achieve and maintain compliance with … industry regulations and data protection laws. What's the role? We’re looking for a highly skilled Senior Data Analyst with strong data processing capabilities and a proven track record of translating complex data into meaningful insights. As a Senior Data Analyst, you will play a critical role in shaping and implementing the strategy and … architecture of our data platform. You will work closely with the wider team to evolve the data platform capabilities, unify data across systems to deliver trusted insights, drive decision-making, and unlock value across the business. You will be responsible for designing, developing, and deploying business intelligence solutions using Microsoft Power BI, DAX script and SQL Script. More ❯

and objections, collaborating with engineering to share insights and improve products. Maintain deep expertise in Analytics Portfolio: Microsoft Fabric (OneLake, DW, real-time intelligence, BI, Copilot), Azure Databricks, Purview Data Governance, and Azure Databases: SQL DB, Cosmos DB, PostgreSQL. Maintain and grow expertise in on-prem EDW (Teradata, Netezza, Exadata), Hadoop & BI solutions. Represent Microsoft through thought leadership in … Azure Databases (SQL DB, Cosmos DB, PostgreSQL) from migration & modernization and creating new AI applications. Expertise in Azure Analytics (Fabric, Azure Databricks, Purview) and competitors (BigQuery, Redshift, Snowflake) in data warehouse, data lake, big data, analytics, real-time intelligence, and reporting with integrated Data Security & Governance. Proven ability to lead technical engagements (e.g., hackathons, PoCs More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially … one day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into the platform … using batch and streaming processes, adhering to SLAs. * Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols. * Ensure data quality and reliability processes are effective, maintaining trust in the data. * Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements. * Able to More ❯

been turning down headhunters for years. Whatever your priorities - work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on Azure and Databricks ? Do you thrive … on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the design and implementation of cutting-edge data solutions in a cloud-native environment. You will play a key role in shaping data strategy, designing high-level and … low-level architectures , and ensuring the seamless integration of data management tools. If you enjoy working with big data technologies, governance frameworks, and modern analytics platforms , this role is for you! Key Responsibilities Design and architect scalable, secure, and cost-effective Azure Databricks solutions for business and analytical workloads. Translate business requirements into high-level and low More ❯

Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description is the UK's first comparison platform for car insurance. We've been helping customers since 2002 by empowering them to make better decisions around insurance and financial services. Our mission is simple: take away the confusion when comparing financial products and services to help you … of the organisation alongside your peers. Autonomy: Authority over technical strategy, decisions and implementation approach, so you can deliver using practices that align with your preferred ways of working. Data Driven: Utilise rich logs, metrics, and data to monitor and improve system performance & reliability. Culture: Enhancing a diverse engineering culture by taking part in various technical catch ups … team and org level contributions. Rotate around the business to build relationships and act as a multiplier. What we look for in you Understand, assess and effectively apply modern data architectures (dimensional model, data mesh, data lake). Experience in applying and using data observability methods effectively. Experience in modern software development practices (agile, CI/ More ❯

valued for their unique perspectives. We are all accountable for sustaining a diverse and inclusive environment. - What You Will Contribute To Altos We have an opportunity available for a Data Scientist to work in the field of cells, genomics and related areas. Responsibilities - Generate insights and models from multi-omics datasets (using public and internal data) to understand … patterns, trends and relationships within data to inform decision-making and solve problems. Design, develops and programs methods, processes, and systems to extract, consolidate and analyze unstructured, diverse "big data" sources to generate actionable insights. Build databases and is responsible for the curation of Data, including experimental data management. Extracting knowledge, insights and predictions from … data using statistical methods, machine learning and data visualization. Work with scientists to identify optimal ways to prepare, annotate, store and navigate their datasets, including data application design and improvement. Define and document best practices for capturing and entering experimental metadata, and educate scientists and collaborators about these standards. Build pipelines for quality control, processing and analysis More ❯

you will be responsible for developing information systems to support the Medical Director's Office, with a strong focus on Microsoft SQL Server development and/or Apache Spark big data processing environments. Your work will involve creating algorithms and pipelines to transform and process data, delivering powerful solutions that address both clinical and operational needs. If … to meet reporting/monitoring requirements using a range of technologies, and ongoing maintenance and optimisation of these information systems Serve as subject matter expert in the technical and data infrastructure of digital solutions About us At Imperial College Healthcare you can achieve extraordinary things with extraordinary people, working with leading clinicians pushing boundaries in patient care. Become part … equivalent experience Qualification in Project Management. Association of Professional Healthcare Analysts professional registration Experience Essential Demonstrable experience in healthcare informatics analytics. Knowledge and understanding of mandatory reporting requirements, NHS data standards and definitions Good understanding of NHS governance and performance systems. Experience of communicating complex issues and data concepts to a range of people. Advanced use of SQL More ❯

At Databricks, our core values center on creating a proactive and customer-centric culture. We aim to develop a unified platform that makes data science and analytics accessible to all, inspiring our customers to make informed decisions that advance their businesses. Our user-friendly and intuitive platform facilitates turning insights into actions and fosters a culture of creativity, experimentation … and continuous improvement. As part of this mission, you will use your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve complex data challenges. You will collaborate with a customer-focused team that values innovation, using your skills to create customized solutions that help our customers achieve their goals and drive their businesses … forward. Join us in transforming how data is used to make a better world. Reporting to the Manager, Field Engineering. The impact you will have: Build successful relationships with clients in your assigned territory, providing technical and business value in collaboration with Account Executives. Become an expert in big data analytics to excite customers about Databricks. Develop More ❯

core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform … action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team that values innovation and creativity, using your skills to … create customized solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! Reporting to Manager, Field Engineering. The impact you will have: Form successful relationships with clients throughout your assigned territory, providing technical and business value to Databricks customers More ❯

Integral Ad Science (IAS) is a leading global media measurement and optimization platform that delivers the industry's most actionable data to drive superior results for the world's largest advertisers, publishers, and media platforms. IAS's software provides comprehensive and enriched data that ensures ads are seen by real people in safe and suitable environments, while improving … are excited by technology that has the power to handle hundreds of thousands of transactions per second, collect tens of billions of events each day, and evaluate thousands of data points in real-time all while responding in just a few milliseconds, then IAS is the place for you! The ideal candidate has a track record of architecting and … Lead the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation, in addition to mentoring the team Collaborate cross functionally with Product, Software Engineers, and Data Engineers to design, code, and maintain components for aggregating tens of billions of daily transactions Partner with the Product team and other stakeholders across the company to understand product More ❯

technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make … for! We are looking for a Software Engineer with solid Python or Java experience and a passion for cloud/platform technologies skills to join our talented and innovative data engineering team. This role sits within a part of Optum UK responsible for taking large data sets from various sources and converting them into meaningful insights. You will … get to work with Big Data utilising cutting edge Cloud services and technologies. Your work will help healthcare teams to identify opportunities to be more efficient, improve services, and design/optimise healthcare interventions. We are a collaborative team, we work hard and are passionate about what we do, but we ensure we have fun along the way. More ❯