51 to 75 of 313 Big Data Jobs in the UK excluding London

Aventis Solutions has partnered with a fast-growing Anglo-American tech team seeking a Head of AI, Data Science & Data Engineering (Software Engineering) to architect, build and deliver an innovative AI strategy and drive transformative AI initiatives company-wide. This is your chance to be at the forefront … in this role as the firm expands. Potential to be a fully-fledged CAIO as you prove the capability. Key Skills, Attributes, Tech Desired: Data/AI Pedigree : Proven experience in senior leadership roles focused on data or artificial intelligence or software engineering/information technology. Tech-savvy … Proficiency in modern data technologies (e.g., cloud platforms, big data ecosystems, AI frameworks such as Databricks, Snowflake, BigQuery, Microsoft Fabric or similar. All-rounder : Strong knowledge of key CDO/CAIO areas such as AI/Data Governance/Quality/Management, Data Engineering, Data More ❯

Principal Data Engineer, Consulting Bristol Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build … ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly … with clients to define requirements, refine solutions, and ensure successful handover to internal teams. Design and implement ETL/ELT pipelines for cloud data warehouse solutions. Build and maintain data dictionaries and metadata management systems . Analyse and cleanse data using a range of tools and techniques. More ❯

Principal Data Engineer, Consulting Leeds Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build … ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly … with clients to define requirements, refine solutions, and ensure successful handover to internal teams. Design and implement ETL/ELT pipelines for cloud data warehouse solutions. Build and maintain data dictionaries and metadata management systems . Analyze and cleanse data using a range of tools and techniques. More ❯

an agentic AI system that seamlessly integrates into clients' systems, automating compliance and portfolio risk analysis processes. Job Summary: We are seeking a Senior Data Engineer with 3-5 years of experience in building and maintaining robust data pipelines for our SaaS platform, ensuring high-quality data is available for analysis and decision-making. You will work closely with cross-functional teams to support data-driven initiatives and contribute to the development of innovative solutions. Responsibilities: Web Crawling and Data Extraction: Develop, deploy, and maintain web crawlers using Python to extract data from … websites and social media platforms. Ensure the scalability, reliability, and efficiency of web scraping processes. Data Cleaning and Preprocessing: Perform data cleaning, standardization, and normalization to ensure data quality and consistency. Handle missing data, outliers, and inconsistencies in large datasets. Data Analysis and Modeling: Analyze More ❯

Principal Data Engineer, Consulting Leeds Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build … ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly … with clients to define requirements, refine solutions, and ensure successful handover to internal teams. Design and implement ETL/ELT pipelines for cloud data warehouse solutions. Build and maintain data dictionaries and metadata management systems . Analyze and cleanse data using a range of tools and techniques. More ❯

Job Title: Data Architect Location: Birmingham/Sheffield/Edinburgh (3 days per week in the office) Salary/Rate: Up to £431 per day INSIDE IR35 Start Date: 06/05/2025 Job Type: Contract Company Introduction We have an exciting opportunity now available with one of … our sector-leading financial services clients! They are currently looking for a skilled Data Architect to join their team for a contract until the end of November. Job Responsibilities/Objectives You will be a technical lead aligned to our Storage & Data Protection Services infrastructure team. Your primary … focus will be on building, expanding, and optimizing our data platforms. You will develop high performance data products and data pipelines to further enable our data driven approach. You will support the improvement of our data self-service capability, building the technology to allow users More ❯

Data Scientist with Databricks Experience Salary-up to £90K base + bonus + benefits Location- Work from Home but accessible to travel to London when needed Our client is an international company that requires a senior Data Scientist with experience in Azure Databricks, Knowledge Graph, Neo4J Graph Database … and RAG pipelines for LLM to join the team. Job Description: Responsibilities: Develop and implement data models and algorithms to solve complex business problems. Utilize Databricks to manage and analyse large datasets efficiently. Collaborate with cross-functional teams to understand business requirements and deliver data-driven insights. Design … and build scalable data pipelines and ETL processes. Perform data exploration, preprocessing, and feature engineering. Conduct statistical analysis and machine learning model development. Communicate findings and insights to stakeholders through data visualization and reports. Stay current with industry trends and best practices in data science and More ❯

Principal Data Engineer, Consulting Bristol Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build … ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly … with clients to define requirements, refine solutions, and ensure successful handover to internal teams. Design and implement ETL/ELT pipelines for cloud data warehouse solutions. Build and maintain data dictionaries and metadata management systems . Analyze and cleanse data using a range of tools and techniques. More ❯

EMEA, APAC, and LATAM. We are about people who create bold things, who make a difference, who have fun, and who love their work. Big Data & Analytics Center of Excellence, data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back … in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains. We hold top-level partnership statuses with all the major … Confluent, and others. IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such as Azure More ❯

Position Overview : As a Python Data Engineer at High 5 Casino, you will be responsible for designing, implementing, and maintaining data pipelines, databases and our in-house real-time player interaction software. You will collaborate with cross-functional teams to ensure seamless data integration, support data-driven decision-making, and contribute to the overall success of our gaming platforms. Key Responsibilities : Data Pipeline Development : Design, build, and maintain robust and scalable data pipelines for extracting, transforming, and loading (ETL) data from various sources. Database Management : Manage and optimize databases, ensuring data integrity, security, and performance. Implement best practices for database design, indexing, and maintenance. Data Integration : Collaborate with game providers, analysts and other stakeholders to integrate data sources, ensuring a unified and accurate view of data across the organization. Performance Monitoring : Monitor and optimize the performance of More ❯

We are seeking a diligent and innovative Data Engineer to join our Analytics team, the successful Data Engineer with be able to demonstrate a strong business acumen. The ideal candidate will ideally worked with ETL processes, Snowflake, and Tableau, and will be instrumental in bridging the gap between … data engineering and business strategy. Client Details We are a global electronics and manufacturing company that operates in 100 countries. Our UK subsidiary is based in Manchester. We are on a journey to further develop our data first approach this role will play a key part in bridging … the gap between or data engineering team and the wider business. Description The successful Data Engineer will be responsible for but not limited to: Building robust, scalable data pipelines. Implement complex, large scale big data projects with a focus on collecting, managing, analysing and visualising More ❯

Principal Data Engineer Consulting Leeds, UK £90,000 £100,000 Hybrid A leading consultancy is seeking a Principal Data Engineer to take ownership of delivering scalable, cloud-first data solutions across greenfield and transformation programmes. This is a hands-on role where you'll design, build, and … deploy enterprise-grade platforms and pipelines using AWS and modern ETL tools. As Principal Data Engineer, youll work directly with clients to understand complex requirements, shape the solution architecture, and lead end-to-end technical deliveryalways with a focus on quality, performance, and value. Your responsibilities as Principal Data Engineer include: Building cloud-native data platforms using AWS services such as Redshift, Glue, S3, Lambda, and DynamoDB Designing and implementing ETL/ELT pipelines using Matillion and similar tools Leading on solution deployment using infrastructure-as-code and CI/CD practices Transforming diverse data formats More ❯

Principal Data Engineer Consulting Bristol, UK £90,000 £100,000 Hybrid A leading consultancy is seeking a Principal Data Engineer to take ownership of delivering scalable, cloud-first data solutions across greenfield and transformation programmes. This is a hands-on role where you'll design, build, and … deploy enterprise-grade platforms and pipelines using AWS and modern ETL tools. As Principal Data Engineer, youll work directly with clients to understand complex requirements, shape the solution architecture, and lead end-to-end technical deliveryalways with a focus on quality, performance, and value. Your responsibilities as Principal Data Engineer include: Building cloud-native data platforms using AWS services such as Redshift, Glue, S3, Lambda, and DynamoDB Designing and implementing ETL/ELT pipelines using Matillion and similar tools Leading on solution deployment using infrastructure-as-code and CI/CD practices Transforming diverse data formats More ❯

Senior Cloud and Data Architect London Permanent Responsibilities : 16–18 years' experience in DWBI, Big Data, and Cloud Technologies. Hands-on expertise in at least 2 Cloud platforms (Azure, AWS, GCP, Snowflake, Databricks) and Big Data processing (e.g., Apache Spark, Beam). Proficiency in key … technologies like BigQuery, Redshift, Synapse, Pub/Sub, Kinesis, Event Hubs, Kafka, Dataflow, Airflow, and ADF. Strong ETL and data modeling skills. Proven ability to design and implement effective database solutions, ensure compliance with regulations, and oversee data migration from legacy systems. Experience in resiliency, failover, monitoring, and … POVs on emerging technologies. Good-to-have: Familiarity with DevOps tools (e.g., Jenkins, Terraform, StackDriver). Requirements : Deep understanding of database structures, SQL development, data modeling, and analytics technologies (Columnar, NoSQL, visualization). Knowledge of SDLC, project management, and system design/testing techniques. Outstanding problem-solving, organizational, and More ❯

Director of Data Engineering Location: Hybrid – London, Blackfriars Join us at Merlin Entertainments as we transform the future of digital guest experiences across our iconic global attractions. We're seeking an experienced Director of Data Engineering to lead the design, development, and implementation of Merlin's enterprise data architecture and engineering strategy. You'll oversee the data engineering and platform function, with a key focus on building a high-performing team and driving excellence across Databricks-based data platforms. About the Role A key focus will be managing the development and operational management of the … data platform using Databricks. The successful candidate will also lead a high-performing team of data engineers and platform specialists, fostering collaboration across technical and business teams to deliver innovative solutions that drive value and support data-driven decision-making. Key Responsibilities as Director of Data More ❯

Join us as a Senior Data Solution Designer at Barclays, supporting the BUK Data Foundations Programme. You will help design patterns for various use cases as we migrate from on-premise warehouses to Cloud. Collaborate with Data Product Owners, Platform Leads, and Engineering Leads to accelerate our … journey to Data Products on Cloud. To be successful, you should have: Experience designing and maintaining data warehouses in big data solutions on Cloud and on-premises, with hands-on knowledge of platforms like Snowflake, AWS (S3, Glue, EC2, Athena), Databricks, and DBT. Good understanding of … business processes, strong analytical skills, and expertise in Batch/Real-Time ETL solutions with performance enhancement knowledge. Strong knowledge of data and analytics, including dimensional modeling, ETL, reporting tools, data governance, and data warehousing. Additional useful skills: Excellent interpersonal, communication, and negotiation skills for managing stakeholders More ❯

Join us as a Senior Data Solution Designer at Barclays, supporting the BUK Data Foundations Programme. You will help design patterns for various use cases as we migrate from on-premise warehouses to Cloud. Collaborate with Data Product Owners, Platform Leads, and Engineering Leads to accelerate our … journey to Data Products on Cloud. To be successful, you should have: Experience designing and maintaining data warehouses in big data solutions on Cloud and on-premises, with hands-on knowledge of platforms like Snowflake, AWS (S3, Glue, EC2, Athena), Databricks, and DBT. Good understanding of … business processes, strong analytical skills, and expertise in Batch/Real-Time ETL solutions with performance enhancement knowledge. Strong knowledge of data and analytics, including dimensional modeling, ETL, reporting tools, data governance, and data warehousing. Additional useful skills: Excellent interpersonal, communication, and negotiation skills for managing stakeholders More ❯

shape our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec's new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with others … passionate about solving business problems. Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management techniques to create and … optimise scalable, robust, and efficient data solutions. Implement comprehensive logging, monitoring and alerting tools to manage the platform, ensuring resilience and optimal performance are maintained. Data Integration and Transformation Integrate and transform data from multiple organisational SQL databases and SaaS applications using end-to-end dependency-based More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯