51 to 75 of 158 Big Data Jobs in the UK excluding London

We are working with a global financial instituition to recruit for a data analyst in theMarkets Program Execution & Transformation - Data Acquisition Team, a strategic unit within Global Markets that collaborates with Legal, Compliance, Finance, and Operations & Technology to deliver regulatory and cross-business transformation initiatives. This role focuses on designing and implementing integrated data solutions that support … regulatory rulemaking, supervisory requirements, and strategic change projects. You'll work across multiple workstreams, delivering high-impact data solutions that drive efficiency and compliance for Markets and its clients. Key Responsibilities Build and optimize PySpark and SQL queries to analyze, reconcile, and interrogate large datasets. Recommend improvements to reporting processes, data quality, and query performance. Contribute to the … project documentation including BRDs, FRDs, test plans, and UAT scenarios. Manage project milestones, tasks, and stakeholder communications to ensure timely delivery. Essential Criteria 5+ years of experience in Technical Data Analysis. Proficiency in SQL, Python, and Spark. Experience within an investment banking or financial services environment. Exposure to Hive, Impala, and Spark ecosystem technologies (e.g. HDFS, Apache Spark, Spark More ❯

a Linux Engineer, you be working in Red Hat Enterprise Linux (RHEL) environments in an agile team. You will be able to utilise your expertise in Linux, Ansible and Big Data tools to set up CI/CD pipelines and platforms. WE NEED THE LINUX ENGINEER TO HAVE.... Current DV Clearance Linux/Red Hat (RHEL) Ansible or … configuration management tools Some CI/CD experience Any experience with Big Data tools such as NiFi/MiNiFi desirable OpenShift desirable TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to For further information please call me on or . I can make myself available outside of normal working hours to suit from … connect with me on LinkedIn, just search Will Roebuck. I look forward to hearing from you. LINUX ENGINEER KEY SKILLS: DEVOPS ENGINEER/PLATFORM ENGINEER/LINUX ENGINEER/BIG DATA ENGINEER/DV CLEARED/DV CLEARANCE/DEVELOPPED VETTING/DEVELOPED VETTED/DEEP VETTING/DEEP VETTED/SC CLEARED/SC CLEARANCE/SECURITY More ❯

around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities As a Big Data Engineer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your … If you are interested in a flexible working pattern, please talk to our recruitment team to find out if this is possible in the current working environment. Job Title Big Data Java Developer Job ID 37808 City/Township/Village State/Province Gloucestershire Country United Kingdom Work arrangement Hybrid Area of work Infrastructure & Technology Employment type More ❯

a DevOps Engineer, you be working in Red Hat Enterprise Linux (RHEL) environments in an agile team. You will be able to utilise your expertise in Linux, Ansible and Big Data tools to set up CI/CD pipelines and platforms. WE NEED THE DEVOPS ENGINEER TO HAVE.... Current DV Clearance Linux/Red Hat (RHEL) Ansible or … configuration management tools Some CI/CD experience Any experience with Big Data tools such as NiFi/MiNiFi desirable OpenShift desirable TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to For further information please call me on or . I can make myself available outside of normal working hours to suit from … on LinkedIn, just search Will Roebuck. I look forward to hearing from you. LINUX ENGINEER/DEVOPS ENGINEER KEY SKILLS: DEVOPS ENGINEER/PLATFORM ENGINEER/LINUX ENGINEER/BIG DATA ENGINEER/DV CLEARED/DV CLEARANCE/DEVELOPPED VETTING/DEVELOPED VETTED/DEEP VETTING/DEEP VETTED/SC CLEARED/SC CLEARANCE/SECURITY More ❯

Markets Program Execution & Transformation – Data Acquisition Team Belfast (Hybrid) - Essential | Approx. £415pd PAYE + Holiday (PAYE) The Markets Program Execution & Transformation team partners with all Global Markets businesses and various functions—including Legal, Compliance, Finance, and Operations & Technology—to identify, mobilize, and deliver regulatory and cross-business transformation initiatives. The team's core mission is to design and implement … integrated solutions that are efficient, scalable, and client-focused. This role sits within the Data Acquisition Team , playing a critical part in supporting multiple projects and workstreams. The focus is on assessing and delivering robust data solutions and managing changes that impact diverse stakeholder groups in response to regulatory rulemaking, supervisory requirements, and discretionary transformation programs. Key Responsibilities … Develop PySpark and SQL queries to analyze, reconcile, and interrogate data. Provide actionable recommendations to improve reporting processes—e.g., enhancing data quality, streamlining workflows, and optimizing query performance. Contribute to architecture and design discussions in a Hadoop-based environment. Translate high-level architecture and requirements into detailed design and code. Lead and guide complex, high-impact projects across all More ❯

maintenance of ongoing performance metrics, investigations, reports, analyses, dashboards, etc. to drive key business decisions • Participate in the build of scalable solutions/self-serve platforms that will provide data/KPIs to inform business decision making and support the Security & Loss Prevention operations in their day to day tasks and responsibilities • Recognize and adopt best practices in reporting … and analysis: data integrity, test design, analysis, validation, training, and documentation • Apply data mining and quantitative analysis to understand how our customers interact with us and identify the best way to improve the customer experience and meet our loss reduction goals • Acquire various data sources to enable holistic analysis at a global level • Establish performance benchmarks, conduct … maintenance of ongoing performance metrics, investigations, reports, analyses, dashboards, etc. to drive key business decisions • Participate in the build of scalable solutions/self-serve platforms that will provide data/KPIs to inform business decision making and support the Security & Loss Prevention operations in their day to day tasks and responsibilities • Recognize and adopt best practices in reporting More ❯

Cloud Technical Architect/Data DevOps Engineer This role has been designed as Onsite' with an expectation that you will primarily work from an HPE partner/customer office. Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their … data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today's complex world.Our culture thrives onfinding new and better ways to accelerate what's next.We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs.We … to the next level? We have a brand-new opportunity for a bright, driven, customer focussed professional to join our Hybrid Cloud 'Delivery' team, and work alongside our Enterprise Data Engineering consultants to accelerate and drive data engineering opportunities. The Advisory and Professional Services (A&PS) delivery team within HPE Pointnext Services is responsible for bringing thought-leadership More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's current … offices and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and leading food … drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll be responsible for overseeing More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's current … offices and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and leading food … drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll be responsible for overseeing More ❯

Who we are looking for State Street Associates (SSA) is looking for a highly skilled and motivated Data Scientist with hands-on experience working with Oracle database and Databricks Spark on AWS. This role will be responsible for managing and analyzing terabytes of data hosted in enterprise data warehouse and leveraging large-scale data platforms to … research and product development in the form of thought leadership, market indicators, and analytical tools. You'll work across both traditional and cloud-based platforms, using your expertise in big data processing, statistical analysis and machine learning to deliver scalable and meaningful outcomes. Key responsibilities As a Data Scientist you will Promote data governance, security, and … best practices in managing large volumes of sensitive business data, to compliance with company policies and regulatory requirements. Work with terabytes of structured and semi-structured data from our enterprise data warehouse, primarily stored in Oracle and integrated with Databricks Spark on AWS. Write efficient, production-quality SQL and PL/SQL queries for data extraction More ❯

team. As a part of the client solutions team at Verisk Maplecroft you will be a part of the team charged with using technology to create, collate and deliver data analytics and intelligence to our clients in a geospatial context. We are primarily a Python/Django house with an Angular front end. We recently moved to AWS for … develop new workflows, pipelines, features and tools that give our clients the information they need to make the right decisions to create a more sustainable and resilient world. Geospatial data forms are a significant component of the data structures used within Verisk Maplecroft, and with an increasing availability of geospatial data in the modern era, exploiting that … data to provide risk insights to our client’s is a primary objective of the client solutions team and this role. Responsibilities: Working in an agile team and assisting in requirements gathering, refinement, and delivery of continual improvements to our mapping solutions and GIS data pipelines Supporting and working with contractors to ensure effective collaborative effort and consistency More ❯

engineering teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets . Engineering, which is comprised of our Technology Division and global … real solutions. Want to push the limit of digital possibilities? Start here. Who We Look For Goldman Sachs Engineers are innovators and problem-solvers, building solutions in risk management, big data, mobile and more. We look for creative collaborators who evolve, adapt to change and thrive in a fast-paced global environment. Asset & Wealth Management Division: Across Asset … family offices, foundations and endowments, and corporations and their employees. Across AWM, our growth is driven by a relentless focus on our people, our clients and leading-edge technology, data and design. PWM Goldman Sachs Private Wealth Management (PWM) specializes in creating comprehensive wealth management plans for high net worth individuals and families, as well as select institutions, including More ❯

Are you ready to turn data into action? Thames Water is looking for a skilled and driven Collections Data Scientist to join our dynamic Credit Risk team. What you will be doing as the Collections Data Scientist : In this pivotal role, you will help shape data-led strategies that enhance customer experience and reduce bad debt … through advanced insight and proactive debt prevention. Working closely with a talented team and senior stakeholders, you'll help deliver best-in-class portfolio management, drive innovation in our data capabilities, and ensure analytics are seamlessly aligned with our digital infrastructure. Key accountabilities: Deep dive analysis: Conduct deep-dive analysis into customer portfolio trends to identify root causes of … and refine predictive models and analytical frameworks to improve credit risk assessment and optimise debt recovery strategies. Deliver bad debt improvements: Support the Bad Debt Transformation programme by providing data-led insights that drive operational improvements and policy recommendations. Transition to the Data Lake: Support the transition to a data lake environment, allowing us to link together More ❯

What you'll be doing Are you ready to contribute to the evolution of our data pipelines for our B2C division? At Future, we are transforming our data-driven decision-making processes and are looking for a passionate and experienced Data Engineer to join us. This is an exciting opportunity for someone who thrives in a creative … environment and enjoys solving complex data challenges. You'll report to the Lead Data Engineer and be part of the wider Data Engineer team. The Data & Business Intelligence team guides our organization to become more data-driven. Our go-to-market changes give us a competitive edge by ensuring visibility of objective performance data, empowering our teams to make rapid, informed decisions that enhance overall performance. Responsibilities include, but are not limited to: Maintain existing and develop new features of the data platform. Deliver development projects efficiently. Apply established software engineering practices and principles. Take ownership of BAU processes and develop domain expertise. Ensure compliance with relevant standards and policies. Utilize CI More ❯

Data Solutions Architect £90000-115000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solution Architect £90,000 - £115,000 + Bonus London - Hybrid - Permanent A global leader in IT Solutions and Consulting is seeking a Lead Data Solution Architect to join their dynamic, remote-first architectural team. You will lead the … design and delivery of innovative cloud-based data solutions for enterprise clients across various sectors. Working alongside talented Data Engineers, Business Analysts, and QA Analysts, you'll drive architectural best practices and deliver high-quality data solutions. This is an opportunity to own technical delivery, influence client architecture, and work with cutting-edge technologies such as Kafka … Databricks, Unity Catalog, and Cloud platforms like AWS, Azure, and GCP . Key Skills of the Lead Data Solution Architect: Proven experience as a Lead Data Solutions Architect , leading end-to-end delivery of complex data solutions. Extensive expertise in data architecture design , including event-driven architectures (Kafka) and Data Lake/Lakehouse platforms . More ❯

with senior clients, engineers and architects on a daily basis? Are you a critical thinker that is keen to continue exploring the untouched capabilities of technologies such as Cloud, Big Data, AI and Robotics, and how they can be architected into clients landscapes to help them achieve their strategic goals? Joining the team means becoming part of a … speed and confidence. Your responsibilities as an Enterprise Architect Manager or Senior Manager will include: Assessing the impact of the business strategy on the enterprise architecture, including organisation, applications, data, infrastructure, and operations Staying abreast of industry dynamics and the impact of trends on an organisation, to identify and formulate need for change in enterprise architecture Co-creating a … making for investment in proposed transformation roadmaps, aligned with clients strategic planning cycles Leading the creation of Enterprise Architecture blueprints, demonstrating the e2e technology landscape including applications, integrations and data Conducting end-to-end vendor assessments across technology, vendor and or data platforms Working between the business and technology client & 3rd party stakeholders to effectivity formulate communicate and More ❯

with senior clients, engineers and architects on a daily basis? Are you a critical thinker that is keen to continue exploring the untouched capabilities of technologies such as Cloud, Big Data, AI and Robotics, and how they can be architected into clients landscapes to help them achieve their strategic goals? Joining the team means becoming part of a … speed and confidence. Your responsibilities as an Enterprise Architect Manager or Senior Manager will include: Assessing the impact of the business strategy on the enterprise architecture, including organisation, applications, data, infrastructure, and operations Staying abreast of industry dynamics and the impact of trends on an organisation, to identify and formulate need for change in enterprise architecture Co-creating a … making for investment in proposed transformation roadmaps, aligned with clients strategic planning cycles Leading the creation of Enterprise Architecture blueprints, demonstrating the e2e technology landscape including applications, integrations and data Conducting end-to-end vendor assessments across technology, vendor and or data platforms Working between the business and technology client & 3rd party stakeholders to effectivity formulate communicate and More ❯

with senior clients, engineers and architects on a daily basis? Are you a critical thinker that is keen to continue exploring the untouched capabilities of technologies such as Cloud, Big Data, AI and Robotics, and how they can be architected into client's landscapes to help them achieve their strategic goals? Joining the team means becoming part of … speed and confidence. Your responsibilities as an Enterprise Architect Manager or Senior Manager will include: Assessing the impact of the business strategy on the enterprise architecture, including organisation, applications, data, infrastructure, and operations Staying abreast of industry dynamics and the impact of trends on an organisation, to identify and formulate need for change in enterprise architecture Co-creating a … for investment in proposed transformation roadmaps, aligned with client's strategic planning cycles Leading the creation of Enterprise Architecture blueprints, demonstrating the e2e technology landscape including applications, integrations and data Conducting end-to-end vendor assessments across technology, vendor and or data platforms Working between the business and technology client & 3rd party stakeholders to effectivity formulate communicate and More ❯

with senior clients, engineers and architects on a daily basis? Are you a critical thinker that is keen to continue exploring the untouched capabilities of technologies such as Cloud, Big Data, AI and Robotics, and how they can be architected into client's landscapes to help them achieve their strategic goals? Joining the team means becoming part of … speed and confidence. Your responsibilities as an Enterprise Architect Manager or Senior Manager will include: Assessing the impact of the business strategy on the enterprise architecture, including organisation, applications, data, infrastructure, and operations Staying abreast of industry dynamics and the impact of trends on an organisation, to identify and formulate need for change in enterprise architecture Co-creating a … for investment in proposed transformation roadmaps, aligned with client's strategic planning cycles Leading the creation of Enterprise Architecture blueprints, demonstrating the e2e technology landscape including applications, integrations and data Conducting end-to-end vendor assessments across technology, vendor and or data platforms Working between the business and technology client & 3rd party stakeholders to effectivity formulate communicate and More ❯

you want to become a knowledge expert in your field or apply your skills to another division. Job Description: This is a fantastic opportunity for a dynamic individual with big ambitions, who is an established technologist with both outstanding technical ability and consultative mindset. As an open-minded, personable self-starter who relishes the fluidity and collaborative nature of … consultancy, you are comfortable working independently or as part of a team, effortlessly context-switching as required. The Data DevOps Engineer role is all about the detailed development and implementation of scalable clustered Big Data solutions, with a specific focus on automated dynamic scaling, self-healing systems. You will be joining the client to provide their clients … and constantly evolving career opportunities. If you are looking for challenges in a fast-paced, thriving, international work environment, then we definitely want to hear from you! As a Data DevOps Engineer, you will be responsible for: Participating in the full lifecycle of data solution development, from requirements engineering through to continuous optimisation engineering and all the typical More ❯

This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to-end outcomes across CIO. Next to delivery … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage … observability, and metadata management. Ensuring the sustainability and scalability of our data infrastructure and that it enables the company to achieve its business objectives Data Platform Optimization: Ensuring that the team is working efficiently and effectively, bringing an agile mindset to adapting to changing circumstances while working within the organisational constraints of budget, resource and quality. Work closely More ❯

months, Full Time Join a dynamic organisation dedicated to making financial lives better through the power of every connection. We are seeking a talented Cloudera Developer to enhance our data solutions and contribute to our mission of delivering exceptional financial services. Responsibilities: utilise various architectural components to design and develop client-focused requirements. Maintain, improve, clean, and manipulate data … quo. Document and communicate essential information for deployment, maintenance, support, and business functionality. Adhere to team delivery/release processes for code deployment and releases. Drive business results with data-based insights, collaborating closely with stakeholders. Passionately discover hidden solutions in large datasets to enhance business outcomes. Design, develop, and maintain data processing pipelines using Cloudera technologies, including … Apache Hadoop, Apache Spark, Apache Hive, and Python. Collaborate with data engineers and scientists to translate data requirements into technical specifications. Develop and maintain frameworks for efficient data extraction, transformation, and loading into the Cloudera platform. optimise and tune data processing jobs for high performance and scalability. Implement data governance and security policies to ensure More ❯

a team that treats each other with respect and challenges you to be better. What you know how to do: Can write Spring 4 beans and Hibernate or JPA data objects. Knows Spring bean scopes and when to use them. Able to identify and fix defective, poor performing or non-scalable code. Knows how to develop and debug AOP … injected code. Understands software security practices including user authentication and authorization, data validation and an understanding of common DOS and SQL injection techniques. Is familiar with profiling, code coverage, logging, common IDE's and other development tools. Demonstrates good judgment, creativity, and ingenuity in proposed technical solutions. Coordinates work across teams to build seamless features. What you also have … Qualifications Does this describe you? Java REST Spring The Ideal Candidate Must have good communication skills. Must have experience working on web applications supporting 1M+ end users or large data sets with 10M+ database records. This is a very Big Data platform. Experience building REST services (orchestration layer) on CRUD data services based on Cloudera Hadoop More ❯

Are you ready to lead the future of global genomics data sharing? The European Nucleotide Archive (ENA), a cornerstone of the international genomics community, is searching for a leader to guide its evolution in an era of unprecedented genomics driven scientific discovery. This is a unique opportunity to shape the way genomic information is preserved, shared, and leveraged to … address the most pressing challenges, from understanding biodiversity, supporting global pathogen data sharing, and advancing model organism genomics driven research. The European Nucleotide Archive (ENA) provides essential foundational data services to the world and underpins many major global data resources. As the Team Leader for ENA and BioSamples, you will oversee one of the world's largest … other global databases as part of the International Nucleotide Sequence Database Collaboration (INSDC); together, INSDC databases work to capture, preserve and make available to all the globally comprehensive sequence data set. ENA also interacts and supports many key databases and resources at and beyond EMBL-EBI. ENA makes over 60 petabytes of sequencing data available for download, including More ❯

Job Type Full Time Posted Date 24-Jul-2025 Ref # 68369 We have an excellent new role for a Performance and Analytics Designer to join our Core Engineering Data Platforms team. This is a key role to develop internal data sources and tools to continuously improve and enhance performance investigation models, KPIs, reports and data visualisations … that provide insights into the efficacy and performance of Data Access and Packet Core network components. You will support performance investigations, trending and analysis of all services that the Data domain look after. You will have access to our existing tools, including PrOptima, Foresight, GCP Tools, SQL and the Tableau reporting system. These data feeds to these … systems come from a multitude of sources and network probes within our data core network. Key Responsibilities Responsible for enhancing all the performance reporting for the Data Access and Packet Core teams using the Foresight and Tableau data visualisation platform and the ingest of data and reports from a PrOptima/Foresight performance management platform. You More ❯