1 to 25 of 1,841 Big Data Jobs in the UK

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Galytix (GX) is delivering on the promise of AI. GX has built specialised knowledge AI assistants for the banking and insurance industry. Our assistants are fed by sector-specific data and knowledge and easily adaptable through ontology layers to reflect institution-specific rules. GX AI assistants are designed for Individual Investors, Credit and Claims professionals. Our assistants are being … hallucinating, our assistants are empowering financial professionals and delivering 10x improvements by supporting them in their day-to-day tasks. Responsibilities: Helping to architect, design, implement, and optimise our data ingestion, transformation, and spreading pipelines and processes. Developing data models, processing pipelines, and back-end services supporting the data science teams, automating processes, building integrations, and analytics. … Desired skills: A university degree in Mathematics, Computer Science, Engineering, Physics or similar. 5+ years of relevant experience in Data Engineering, warehousing, ETL, automation, cloud technologies, or Software Engineering in data related areas. Ability to write clean, scalable, maintainable code in Python with a good understanding of software engineering concepts and patterns. Proficiency in other languages like Scala More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

Curve is a next-gen insights and analytics consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it’s big, it’s real, and it’s always updating. We transform data from sources such as Social, Reviews, Search, and Web to reveal fresh insights for … machine learning and AI are key to how we deliver impact, centred on: Natural Language Processing, GPT & other LLMs : unearthing trends, themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions. Marketing Data Science & Personalisation : using first party consumer … data to understand each client’s consumer base, building personalisation and other machine learning models to better engage with and excite consumers. Analytics Engineering & Data Architecture : data engineering across a variety of tools to integrate these leading technologies into optimised and efficient data models and ecosystems, feeding into best-in-class analytics dashboards and front-end More ❯

working for the Universityof Birmingham Background Over the next decade, our aspiration is to establish Birmingham in the top 50 of the world's leading universities. That is a big aspiration, and high-quality digital services and infrastructure are crucial to achieving it. In recognition of that, our Digital Strategy combined with significant investments in technology mean this is … to accessible, responsive, resilient, and secure systems and support. What we do enables our students, staff, researchers, visitors, and partners to confidently and creatively use digital services, technology, and data for the benefit of their learning, teaching, research, or work. The culture of IT Services is one of innovation, collaboration, excellence, and inclusivity, and we apply the principles of … group, bi-annual making IT happen awards recognition programme, and a superb Social Committee which arranges regular activities and events. Role Summary The University of Birmingham’s digital and data landscape is undergoing major transformation. One of the underpinning elements of our Digital Strategy is to move our on-premise warehousing and reporting to the cloud, investing in new More ❯

Job Description Department: Information Technology Job Summary We are seeking a highly skilled and motivated Data Scientist with a strong focus on machine learning (ML) and artificial intelligence (AI) to join our innovative team. The ideal candidate will excel in developing, deploying, and optimizing ML models and AI solutions, leveraging cutting-edge technologies like Azure Machine Learning, AutoML, and … tools to manage model lifecycles. Leverage cloud platforms like Azure, AWS, and GCP for scalable ML model deployment. Employ frameworks like TensorFlow, PyTorch, and scikit-learn for model development. Data Engineering and Preparation Oversee data ingestion, cleaning, transformation, and feature engineering processes to ensure high-quality datasets. Work with large datasets and implement scalable data pipelines. Model … processes and maintain a centralized repository. Establish and follow best practices in model versioning, reproducibility, and model governance. Qualifications Education Advanced degree (Master’s or Ph.D.) in Computer Science, Data Science, Statistics, or a related field. Equivalent experience will be considered. Experience Minimum of 5 years in a data science or machine learning-focused role. Technical Skills Expertise More ❯

Infor Farnborough, England, United Kingdom Join or sign in to find your next job Join to apply for the Data Management Architect role at Infor Infor Farnborough, England, United Kingdom 3 days ago Be among the first 25 applicants Join to apply for the Data Management Architect role at Infor The role supports our business plan by enabling … can handle more projects without overburdening the team, maintain high-quality delivery, and effectively manage risks, all of which are critical to our long-term success. Position Summary A Data Services Solution Architect is a technical leader responsible for designing and implementing solutions that manage, analyze, and utilize data effectively. Their role bridges business needs with technical execution … ensuring that data systems are scalable, reliable, and aligned with the project's goals. Essential Duties of a Data Services Solution Architect 1. Data Solution Design and Integration a. Architect scalable solutions for data conversions, migrations, and integrations across systems. b. Ensure smooth data flow between legacy and modern platforms during transitions. 2. Data More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world’s leading financial services firms to help them to operate more effectively. Expand’s activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We’re looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions – who also brings strategic product thinking and cross-functional leadership . In this role, you’ll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion pipelines More ❯

Social network you want to login/join with: Data Architect (Enterprise Data Foundations), Slough col-narrow-left Client: Mars Location: Slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 5770903661a6 Job Views: 4 Posted: 02.06.2025 Expiry Date: 17.07.2025 col-wide Job Description: JOB DESCRIPTION Job Description: Come become a part … of a vibrant CDO team serving Mars Snacking Enterprise. Our team helps build the Data Platforms, Model & Engineer data products, craft Analytical products and Integrations to be a truly data driven growth engine. As we continue to expand and transform digitally, we’re actively seeking an experienced and skilled Data Architect to help model, build and … own our Enterprise Data Foundations. This is a pivotal role that involves conceptualizing, designing and overseeing the implementation, and optimizing global data models to deliver value throughout the organisation. You’ll be designing and driving delivery of data products with a major focus on marketing, DCOM and overall Demand functions that will be the foundational pillars for More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Europe's leading Google Cloud specialist consultancy. We're a team that's energised by innovation and delivering exceptional results for our clients. We deliver cutting edge solutions across data and analytics, AI, cloud infrastructure or security that drive digital transformation and enable our customers to scale, modernise and thrive. In joining Qodea, you'll work alongside specialists in … motivated and energetic people who are eager to learn and grow, so if you want to supercharge your career, join Qodea! What you'll do: Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data pipelines to support data ingestion, ETL, and storage Build and maintain automated data pipelines to monitor … data quality and troubleshoot issues Implement and maintain databases and data storage solutions: Stay up-to-date with emerging trends and technologies in big data and data engineering Ensure data quality, accuracy, and completeness Implement and enforce data governance policies and procedures to ensure data quality and accuracy: Collaborate with data More ❯

Join to apply for the Data Engineer role at Lumilinks Group Ltd Join to apply for the Data Engineer role at Lumilinks Group Ltd About us: Turning the fantasy of analytics, data and A.I. into reality... In a world where vast amounts of data are being created in a multitude of different ways, Lumilinks exist to … help companies collate and use data in an automated and compliant way, creating live and actionable insights. We help businesses across the entire data journey, eliminating silos and creating data transparency. This allows our clients to be data confident in making strategic and tactical decisions that will further their business and create automation that improves processes … compliance, capability and reduces costs. The Role As a Data Engineer at Lumilinks, you will play a pivotal role in designing, building, and maintaining our data architecture and pipelines. You will work closely with data scientists and analysts to ensure that high-quality, reliable data is readily available for analysis and decision-making. Your responsibilities will More ❯

Europe's leading Google Cloud specialist consultancy. We're a team that's energised by innovation and delivering exceptional results for our clients. We deliver cutting edge solutions across data and analytics, AI, cloud infrastructure or security that drive digital transformation and enable our customers to scale, modernise and thrive. In joining Qodea, you'll work alongside specialists in … motivated and energetic people who are eager to learn and grow, so if you want to supercharge your career, join Qodea! What you'll do: Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data pipelines to support data ingestion, ETL, and storage Build and maintain automated data pipelines to monitor … data quality and troubleshoot issues Implement and maintain databases and data storage solutions: Stay up-to-date with emerging trends and technologies in big data and data engineering Ensure data quality, accuracy, and completeness Implement and enforce data governance policies and procedures to ensure data quality and accuracy: Collaborate with data More ❯

Social network you want to login/join with: Data Engineer - Provider Mobility., Feltham col-narrow-left Client: Cisco Location: Feltham, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 1c61846926c5 Job Views: 4 Posted: 18.06.2025 Expiry Date: 02.08.2025 col-wide Job Description: Who We Are You will be joining the Cisco Provider … problem-solvers and build a deeply technological product with some of the world’s best technical and creative people to solve our customers’ toughest challenges. About This Role The Data Engineer will be responsible for collecting, processing, and analysing large datasets to support data-driven decision-making within the Provider Mobility business. The ideal candidate will have a … strong background in data analysis, data engineering, and a passion for uncovering insights that drive business success. Key Responsibilities: Collect, clean, and preprocess data from various sources to ensure data quality and integrity. Design, develop, and maintain scalable data pipelines and ETL processes to support the generation of business metrics. Perform data analysis to More ❯

AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and … shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You will work closely with data scientists, analysts, and software … engineers to implement efficient data solutions that support business intelligence and analytics needs. Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and Kinesis. Work with structured and unstructured data from multiple sources, ensuring efficient data ingestion, transformation, and storage. Develop and optimize data lake More ❯

about our people, customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Overview: As a Senior Technical Consultant - Data and AI, you will be responsible for designing, implementing, and optimizing data and AI solutions for our clients. You will work closely with clients to understand their business … needs and translate them into technical solutions that leverage the latest technologies in data and AI. This role requires a deep understanding of data architecture, machine learning, and AI technologies, as well as strong problem-solving and communication skills. Key Responsibilities: Design and implement data and AI solutions that meet client requirements. Collaborate with clients to understand … their business needs and translate them into technical solutions. Develop and maintain data pipelines, data warehouses, and data lakes using tools such as Azure Data Factory, Azure Synapse Analytics, and Azure Databricks. Implement machine learning models and AI algorithms using frameworks like Azure Machine Learning, Microsoft Cognitive Services, and Databricks. Provide technical leadership and mentorship to More ❯

about our people, customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Overview: As a Senior Technical Consultant - Data and AI, you will be responsible for designing, implementing, and optimizing data and AI solutions for our clients. You will work closely with clients to understand their business … needs and translate them into technical solutions that leverage the latest technologies in data and AI. This role requires a deep understanding of data architecture, machine learning, and AI technologies, as well as strong problem-solving and communication skills. Key Responsibilities: Design and implement data and AI solutions that meet client requirements. Collaborate with clients to understand … their business needs and translate them into technical solutions. Develop and maintain data pipelines, data warehouses, and data lakes using tools such as Azure Data Factory, Azure Synapse Analytics, and Azure Databricks. Implement machine learning models and AI algorithms using frameworks like Azure Machine Learning, Microsoft Cognitive Services, and Databricks. Provide technical leadership and mentorship to More ❯

Description Data System Reliability Engineer (dSRE) Role Overview: A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly. Accountabilities: Automate data tasks on GCP Work with data domain owners, data scientists and other stakeholders to ensure that data is consumed effectively on GCP Design, build, secure and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP Measure and monitor the quality of data on GCP data platforms Implement robust monitoring and alerting … systems to proactively identify and resolve issues in data systems. Respond to incidents promptly to minimize downtime and data loss. Develop automation scripts and tools to streamline data operations and make them scalable to accommodate growing data volumes and user traffic. Optimize data systems to ensure efficient data processing, reduce latency, and improve overall More ❯

delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities IBM is seeking a skilled Senior Data Engineer to join our dynamic team, focusing on public sector accounts. This role offers an exciting opportunity to leverage your expertise in data engineering to drive impactful solutions … for government clients. The Senior Data Engineer will be responsible for designing, developing, and managing scalable data pipelines, integrating heterogeneous systems, and implementing robust data models. The ideal candidate will collaborate with cross-functional teams to ensure data integrity, security, and availability, while meeting regulatory requirements specific to the public sector. Required education None Preferred education … Bachelor's Degree Required technical and professional expertise Responsibilities: Design, build, and maintain scalable data pipelines and ETL processes. Collaborate with data scientists and engineers to integrate complex data systems. Ensure data quality, accuracy, and reliability through testing and validation procedures. Develop and implement data storage solutions, including data modeling and schema design. Provide More ❯

Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it's big, it's real, and it's always updating. We use a combination of in-house technology and bespoke solutions, powered by AI, to transform data … machine learning and AI are key to how we deliver impact, centred on: Natural Language Processing, GPT & other LLMs : unearthing trends, themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions Marketing Data Science & Personalisation : using first party consumer … data to understand each client's consumer base, building personalisation and other machine learning models to better engage with and excite consumers Data Engineering & Data Architecture : data engineering across a variety of tools to integrate these leading technologies into optimised and efficient data models and ecosystems, feeding into best-in-class analytics dashboards, marketing activation More ❯

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Modular Data We are a technology solutions provider that specialises in serving the public sector. Our mission is to help government organisations become data-driven, transform their digital offerings, streamline their processes, improve citizen services and enhance transparency. We are seeking … a highly skilled and experienced Senior Data Engineer to join our team working with our Central Government client on a contract basis. This role requires a deep understanding of data engineering best practices, strong hands-on experience with AWS, Azure, Apache Spark, data warehousing, database modelling and SQL. You’ll play a critical role in designing, building … and maintaining our data infrastructure to support scalable, high-performance data pipelines and analytics platforms. Responsibilities will include: Design, build, and maintain robust, scalable, and secure data pipelines using AWS services and Apache Spark. Develop and optimize data models for reporting and analytics in Redshift and other DWH platforms. Collaborate with Data Scientists, Analysts, and More ❯

Senior Data Engineer - (Azure/Databricks) Axis Capital London, United Kingdom Apply now Posted 15 days ago Permanent Competitive Senior Data Engineer - (Azure/Databricks) Axis Capital London, United Kingdom Apply now This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client service … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 15 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data More ❯

technology, and expertise are designed to support operational needs for our clients and deliver a seamless experience to customers in the moments that matter. We are looking for a Data Engineer to join our team and support with designing, implementing, and maintaining the data systems that support our Gen AI-driven applications and data-driven decision-making … processes. Job Summary We are looking for an experienced Senior Data Engineer to join our AI team. You will be responsible for designing and optimizing complex data storage solutions, developing and maintaining efficient data pipelines, and ensuring data quality and integrity. Working closely with data analysts, machine learning engineers, and software engineers, you will deliver … relevant datasets or data APIs for downstream applications. This role requires strong proficiency in data modelling, database management, and programming skills in Python and SQL. You should have experience with big data technologies, ETL processes, data warehousing, and cloud platforms. Additionally, expertise in implementing data security measures and maintaining data systems in regulated More ❯

Job Description Job Title: Data Architect Location: London - 3 days travel to office SC Cleared: Required Job Type: Full-Time Experience: 10+ years Job Summary : We are seeking a highly experienced and visionary Data Architect to lead the design and implementation of the data architecture for our cutting-edge Azure Databricks platform focused on economic data. This … platform is crucial for our Monetary Analysis, Forecasting, and Modelling efforts. The Data Architect will be responsible for defining the overall data strategy, data models, data governance framework, and data integration patterns. This role requires a deep understanding of data warehousing principles, big data technologies, cloud computing (specifically Azure), and a strong … grasp of data analysis concepts within the economic domain. Key Experience: Extensive Data Architecture Knowledge: They possess a deep understanding of data architecture principles, including data modeling, data warehousing, data integration, and data governance. Databricks Expertise: They have hands-on experience with the Databricks platform, including its various components such as Spark, Delta More ❯