1 to 25 of 556 Big Data Jobs in the UK

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms that help … organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In this role, you will help design … and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big data, performing advanced data analytics, and More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Job Description Job Title: Data Architect Location: London - 3 days travel to office SC Cleared: Required Job Type: Full-Time Experience: 10+ years Job Summary : We are seeking a highly experienced and visionary Data Architect to lead the design and implementation of the data architecture for our cutting-edge Azure Databricks platform focused on economic data. This … platform is crucial for our Monetary Analysis, Forecasting, and Modelling efforts. The Data Architect will be responsible for defining the overall data strategy, data models, data governance framework, and data integration patterns. This role requires a deep understanding of data warehousing principles, big data technologies, cloud computing (specifically Azure), and a strong … grasp of data analysis concepts within the economic domain. Key Experience: Extensive Data Architecture Knowledge: They possess a deep understanding of data architecture principles, including data modeling, data warehousing, data integration, and data governance. Databricks Expertise: They have hands-on experience with the Databricks platform, including its various components such as Spark, Delta More ❯

Solutions Architect - Big Data and DevOps (f/m/d) Join to apply for the Solutions Architect - Big Data and DevOps (f/m/d) role at Stackable Solutions Architect - Big Data and DevOps (f/m/d) 2 days ago Be among the first 25 applicants Join to apply for … the Solutions Architect - Big Data and DevOps (f/m/d) role at Stackable stackable - who are we? Stackable is an innovative technology company focused on delivering cutting-edge, open source Big Data solutions for data lakehouses, data mesh, event processing and AI. We specialise in designing, deploying, and managing scalable data infrastructures that empower businesses to harness the power of data effectively. Our core product, the Stackable Data Platform, enables companies of all sizes to easily integrate and manage their sovereign data platforms in their respective IT infrastructure. Your mission at stackable: We are looking for a skilled You will architect and implement Stackable Data Platform More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Data Analyst, Data Engineer, SQL, Informatica, ETL, Data Ingestion, Data Integration, Data Analytics, Data Science There is a new role with an industry-leading Data Analytics and Data Science company based in London, looking for a Data Analyst/Data Engineer to join their business and build a career within … the business. Established six years ago, the company have grown rapidly and are now recognized as one of the industry leaders in the Data Analytics/Data Science space. They provide complex data solutions for blue chip and enterprise grade clients using cutting-edge data and cloud technology. They are looking for a Data Analyst …/Data Engineer to work across all areas of the business, defining data requirements across business units, analysing the relationships of data and technical data feed requirements aswell as working in proximity to architects on the Data Warehouse design, build and deployment This is a junior role, and as such will have a large focus More ❯

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction and impact … of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's vision … and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud More ❯

delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly … maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka. Collaborate with cross-functional teams to define, design, and ship data-intensive features and services. Optimize existing data processing pipelines for efficiency, scalability, and reliability. Develop and execute unit tests, ensuring the quality and robustness of the code. Implement … development, including version control, continuous integration, and automated testing. Provide technical guidance and mentorship to junior developers. Stay abreast of the latest trends, best practices, and emerging technologies in Big Data and Java development. Contribute to the design and implementation of highly scalable, secure, and resilient data processing systems. Preferred technical and professional experience Bachelor's or More ❯

Join to apply for the Data Architect role at Walkers 1 day ago Be among the first 25 applicants Join to apply for the Data Architect role at Walkers We are a leading international law and professional services firm providing legal, corporate and fiduciary services to global corporations, financial institutions, capital market participants and investment fund managers. With … own thinking in tune with the world in which we operate. Overview Of Role Office: London (hybrid - 2 days per week required as a min in the office) The Data Architect will be responsible for owning and executing Walkers' Enterprise Data Strategy. This will include leading and influencing the alignment of data strategy, and data architecture … across multiple service lines, and programmes of work. The Data Architect will be responsible for translating Walkers' data strategy into clear, actionable roadmaps of data-orientated solutions. The role holder will be responsible for setting and enforcing the standards, patterns and principles involving enterprise data, and ensuring that that any area within the firm working for More ❯

and keep our own thinking in tune with the world in which we operate. Office: London (hybrid - 2 days per week required as a min in the office) The Data Architect will be responsible for owning and executing Walkers' Enterprise Data Strategy. This will include leading and influencing the alignment of data strategy, and data architecture … across multiple service lines, and programmes of work. The Data Architect will be responsible for translating Walkers' data strategy into clear, actionable roadmaps of data-orientated solutions. The role holder will be responsible for setting and enforcing the standards, patterns and principles involving enterprise data, and ensuring that that any area within the firm working for … or on behalf of Walkers follows these. As part of this, the role holder will be responsible for embedding data quality, metadata and compliance requirements into reference architecture and associated standards, patterns and principles. Expected to be a key decision maker within Walkers' data governance board, the role holder will work alongside Security, and Compliance stakeholders to advise More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

Job summary If you are really passionate about data, understand the power that data can have and want to use your knowledge in a role that can make a difference, the NHS Business Services Authority (NHSBSA) have the role for you! We are looking for a Data Architect to join our Digital, Data & Technology Directorate. It … perfect opportunity to take the next step in your career whilst supporting the NHS. If you are excellent at problem solving, great at building relationships and have outstanding technical data architecture skills, you have what this role needs! You will join the Data Strategy & Governance team, as part of a newly developed data architecture function. You will … work in partnership with stakeholders, analysing how data is modelled and collected, understanding gaps, and making recommendations for improvements. You will help design, develop, and implement data principles and standards across the organisation. You will need to be enthusiastic, a logical thinker and have a drive to succeed! What do we offer ? 27 days leave (increasing with length More ❯

CONTRACT PYTHON/DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON/DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engineer National Security & Defence client Outside IR35 12 month rolling contract Central London based organisation in an easily accessible location To apply please … call/or email WHO WE ARE? We are recruiting a contract Python/Data Engineer to work with a National Security & Defence SME in central London. Due to the nature of the work, you must hold UKSV/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO HAVE.... Current DV Security Clearance (Standard … or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies TO BE CONSIDERED.... Please either More ❯

CONTRACT PYTHON/DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON/DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engineer National Security & Defence client Outside IR35 12 month rolling contract Central London based organisation in an easily accessible location To apply please … call 07704 152 640/0203 854 0120 or email WHO WE ARE? We are recruiting a contract Python/Data Engineer to work with a National Security & Defence SME in central London. Due to the nature of the work, you must hold UKSV/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO … HAVE. Current DV Security Clearance (Standard or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new More ❯

Join to apply for the Data Architect role at NTT DATA 2 days ago Be among the first 25 applicants Join to apply for the Data Architect role at NTT DATA We are seeking a highly skilled and experienced Data Architect to join our dynamic team. The ideal candidate will have a strong background in … full data modelling life cycle, e.g. design, implement, and maintain complex data models that align with organisational goals and industry standards. This role requires a deep understanding of data architecture, data modelling methodologies, and ideally in real-time data integrations. The successful candidate will collaborate with cross-functional teams to ensure optimal data structures … that support business intelligence, analytics, and operational requirements. This role is creating, assuring, and overseeing the implementation of data models within analytical and real-time streaming domains. What you'll be doing: Develop conceptual, logical, and physical data models to support data analytics, streaming and data products implementation. Define and maintain data architecture standards, principles More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

DATA ARCHITECT DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to 100,000 + Bonus London based organisation in an easily accessible location To apply please call 07704 152 640 or … email dominic.barbet@searchability.com WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE. Current DV clearance Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving More ❯

Data Scientist - skills in statistics, physics, mathematics, Computer Science, Engineering, Data Mining, Big Data (Hadoop, Hive, MapReduce) This is an exceptional opportunity to work as a Data Scientist within a global analytics team, utilizing various big data technologies to develop complex behavioral models, analyze customer uptake of products, and foster new product innovation. … and reviewing large datasets through advanced quantitative and statistical techniques. Designing, building, and utilizing consumer behavioral forecasting models across different business sectors to maximize opportunities. Leading initiatives to enhance data accuracy, availability, granularity, and coverage. Developing analytics strategies to improve customer and product strategies. Designing better data analysis processes for future use. Proactively deriving actionable insights from large … statistical techniques. Analyzing customer behavior patterns to optimize product performance and customer experience. Building complex behavior forecasting models to identify links between behavior and new opportunities. Manipulating high-level data and presenting findings clearly to senior stakeholders. Supporting the development of analytics strategies to enhance product plans and customer engagement. Ideal candidates are talented scientists with exceptional data More ❯

Join to apply for the Data Architect (Trading) role at Keyrock Join to apply for the Data Architect (Trading) role at Keyrock About Keyrock Since our beginnings in 2017, we've grown to be a leading change-maker in the digital asset space, renowned for our partnerships and innovation. Data Architect About Keyrock Since our beginnings in … industry's progress with our research and governance initiatives. At Keyrock, we're not just envisioning the future of digital assets. We're actively building it. Position Overview The Data Architect is responsible for designing, implementing, and maintaining an organization's data architecture and strategy, ensuring that data is collected, stored, and processed efficiently and securely to … support business intelligence, data analytics, and machine learning operations (MLOps) practices. Key Responsibilities Designing Data Architecture: Plan and implement a robust, scalable data architecture that integrates data from various sources and supports diverse analytical needs, while optimizing costs and meeting business requirements. Implementing Data Engineering Pipelines: Design and develop data pipelines for data More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data More ❯

The team you'll be working with: We are seeking a highly skilled and experienced Data Architect to join our dynamic team. The ideal candidate will have a strong background in full data modelling life cycle, e.g. design, implement, and maintain complex data models that align with organisational goals and industry standards. This role requires a deep … understanding of data architecture, data modelling methodologies, and ideally in real-time data integrations. The successful candidate will collaborate with cross-functional teams to ensure optimal data structures that support business intelligence, analytics, and operational requirements. This role is creating, assuring, and overseeing the implementation of data models within analytical and real-time streaming domains. … What you'll be doing: Develop conceptual, logical, and physical data models to support data analytics, streaming and data products implementation. Define and maintain data architecture standards, principles, and best practices. Ensure data models are aligned with business requirements and scalable for future needs. Work closely with business stakeholders, data engineers, data solution More ❯

Tasty, Seasoned and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You A data engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Experience in … designing and maintaining scalable data pipelines and architectures, ideally integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. Ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models … and reporting layers to support performance dashboards, user engagement analytics, ad revenue tracking, and A/B testing frameworks. Skilled in cloud-based data platforms and infrastructure (e.g., AWS, GCP), ensuring scalability and security for large volumes of streaming and batch data. Had exposure to data warehouses such as BigQuery or Snowflake. Adept in Python and/or More ❯

Tasty, Seasoned and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You A data engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Experience in … designing and maintaining scalable data pipelines and architectures, ideally integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. Ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models … and reporting layers to support performance dashboards, user engagement analytics, ad revenue tracking, and A/B testing frameworks. Skilled in cloud-based data platforms and infrastructure (e.g., AWS, GCP), ensuring scalability and security for large volumes of streaming and batch data. Had exposure to data warehouses such as BigQuery or Snowflake. Adept in Python and/or More ❯

Big Data Scientist ?" Docklands London Our Client an international organisation is looking to recruit a Big Data Expert with 2 to 5 years expertise as a Big Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and analyse large data sets to discover new insights. Working in a … multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble Methods Model using advanced statistical/mathematical models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++, Java, Python, Shell Script R, Matlab, SAS Enterprise Miner Elastic search and understanding of Hadoop ecosystem Experience working with large data sets, experience working with distributed computing tools like Map/ More ❯