1 to 25 of 256 Big Data Jobs in London

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms that help … organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In this role, you will help design … and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big data, performing advanced data analytics, and More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Data Analyst, Data Engineer, SQL, Informatica, ETL, Data Ingestion, Data Integration, Data Analytics, Data Science There is a new role with an industry-leading Data Analytics and Data Science company based in London, looking for a Data Analyst/Data Engineer to join their business and build a career within … the business. Established six years ago, the company have grown rapidly and are now recognized as one of the industry leaders in the Data Analytics/Data Science space. They provide complex data solutions for blue chip and enterprise grade clients using cutting-edge data and cloud technology. They are looking for a Data Analyst …/Data Engineer to work across all areas of the business, defining data requirements across business units, analysing the relationships of data and technical data feed requirements aswell as working in proximity to architects on the Data Warehouse design, build and deployment This is a junior role, and as such will have a large focus More ❯

been turning down headhunters for years. Whatever your priorities - work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on Azure and Databricks ? Do you thrive … on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the design and implementation of cutting-edge data solutions in a cloud-native environment. You will play a key role in shaping data strategy, designing high-level and … low-level architectures , and ensuring the seamless integration of data management tools. If you enjoy working with big data technologies, governance frameworks, and modern analytics platforms , this role is for you! Key Responsibilities Design and architect scalable, secure, and cost-effective Azure Databricks solutions for business and analytical workloads. Translate business requirements into high-level and low More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

CONTRACT PYTHON/DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON/DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engineer National Security & Defence client Outside IR35 12 month rolling contract Central London based organisation in an easily accessible location To apply please … call/or email WHO WE ARE? We are recruiting a contract Python/Data Engineer to work with a National Security & Defence SME in central London. Due to the nature of the work, you must hold UKSV/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO HAVE.... Current DV Security Clearance (Standard … or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies TO BE CONSIDERED.... Please either More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

the best platform, people, and partners together to create limitless opportunities for growth. For more information, visit About Choreograph: A Leading WPP Media Brand Choreograph is WPP's global data products and technology company. We're on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We … work with agencies and clients to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We're endlessly curious. Our team of thinkers, builders, creators and problem solvers are over … strong, across 20 markets around the world. Role Summary and Impact We are seeking a meticulous and experienced Data Architect to play a crucial role in designing, documenting, and ensuring the quality of our next-generation media data lake on the Microsoft Azure platform. This role will focus on developing and upholding the architectural integrity of the data More ❯

Data Scientist - skills in statistics, physics, mathematics, Computer Science, Engineering, Data Mining, Big Data (Hadoop, Hive, MapReduce) This is an exceptional opportunity to work as a Data Scientist within a global analytics team, utilizing various big data technologies to develop complex behavioral models, analyze customer uptake of products, and foster new product innovation. … and reviewing large datasets through advanced quantitative and statistical techniques. Designing, building, and utilizing consumer behavioral forecasting models across different business sectors to maximize opportunities. Leading initiatives to enhance data accuracy, availability, granularity, and coverage. Developing analytics strategies to improve customer and product strategies. Designing better data analysis processes for future use. Proactively deriving actionable insights from large … statistical techniques. Analyzing customer behavior patterns to optimize product performance and customer experience. Building complex behavior forecasting models to identify links between behavior and new opportunities. Manipulating high-level data and presenting findings clearly to senior stakeholders. Supporting the development of analytics strategies to enhance product plans and customer engagement. Ideal candidates are talented scientists with exceptional data More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data More ❯

Requisition ID 10803 -Posted - Years of Experience (1) - Technology - Where (1) - Job Data Reply is the Reply Group company offering a broad range of analytics and data processing services. We operate across different industries and business functions, working directly with executive level professionals, enabling them to achieve meaningful outcomes through effective use of data. We find that one … of the biggest problems experienced by our clients today is being overwhelmed with the amount of data that they face and not knowing how to leverage it to their advantage. The vast landscape of available technology stacks and models means that choosing the right ones can be a daunting task. Most companies know that their data is valuable … and that they should be making the most out of it to stay competitive, but often don't know where to begin or what to prioritise. At Data Reply, we pride ourselves on helping clients make the right decisions to build their data strategy. With our consultants' expertise, we map the right technologies to meet our clients' business More ❯

Big Data Scientist ?" Docklands London Our Client an international organisation is looking to recruit a Big Data Expert with 2 to 5 years expertise as a Big Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and analyse large data sets to discover new insights. Working in a … multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble Methods Model using advanced statistical/mathematical models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++, Java, Python, Shell Script R, Matlab, SAS Enterprise Miner Elastic search and understanding of Hadoop ecosystem Experience working with large data sets, experience working with distributed computing tools like Map/ More ❯

Report to Associate Director/Director of Data The Aztec Group is seeking a highly skilled and experienced Data Platform Architect to join our team. This role is pivotal in designing and evolving our data platform to ensure it meets the strategic needs of our business and clients. The ideal candidate will possess extensive experience with Azure … Data Platform technologies and a solid understanding of our industry. As a Data Platform Architect at Aztec Group, you will play a crucial role in shaping the future of our data infrastructure. Your responsibilities will encompass a wide range of tasks, from strategic planning and architecture design to hands-on implementation and optimisation. You will collaborate closely … with the Director of Data to align our data platform initiatives with the overall business strategy, ensuring that our data solutions are robust, scalable, and capable of meeting the evolving needs of the organisation. In addition to technical expertise, this role requires strong leadership skills. You will provide guidance and mentorship to the data engineering team More ❯

health condition, or are neurodiverse. If you'd like to apply and need adjustments made, you can let us know in your application. About the role As an Azure Data Engineer, your role involves designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. Your responsibilities will include, but not limited to: Data Integration Data Integration and ETL (Extract, Transform, Load): You'll develop and implement data integration processes to extract data from diverse sources and load it into data warehouses or data lakes. Azure Data Factory is a key tool for building efficient ETL pipelines. Your goal is to ensure that data is effectively cleaned, transformed, and … loaded. Your sources will include Rest API from various systems. Being able to onboard data from API's is essential. Use of Postman for testing outside of ADF is a preferred skill. Data Engineering As an Azure Data Engineer, you'll handle and analyse large volumes of data using big data technologies available on More ❯

IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes … Providing Unified Data and Analytics Infrastructure (UDAI) for all A.in teams which includes central Petabyte-scale Redshift data warehouse, analytics infrastructure and frameworks for visualizing and automating generation of reports & insights and self-service data applications for ingesting, storing, discovering, processing & querying of the data 2) Providing business specific data solutions for various business streams … like Payments, Finance, Consumer & Delivery Experience. The Data Engineer will play a key role in being a strong owner of our Data Platform. He/she will own and build data pipelines, automations and solutions to ensure the availability, system efficiency, IMR efficiency, scaling, expansion, operations and compliance of the data platform that serves 200 + More ❯

Artificial Intelligence Engineer/Data Scientist £50k - £90k dependant on experience bonus good bens. Flexible Working Location opportunity. This role may suit individuals who have previously held roles such as Data Engineer, Data Architect, Big Data Consultant, Data Scientist, Data Modeller, Big Data Analyst, or AI Engineer. We are assisting in … recruiting AI Engineers/Data Scientists to join an innovative and growing team within the data practice of a prestigious global technology consulting firm. The client offers excellent career growth, professional development, and a personalized benefits package. Candidates must ideally have UK security clearance and be fully flexible regarding working location. The successful candidate will be a key … team member designing modern analytical data solutions, engaging in the full project lifecycle. The role offers a diverse range of exciting work. Key Skills We are recruiting at various levels within the salary range, so candidates are not expected to be experienced in all areas listed below. AI techniques (supervised and unsupervised machine learning, deep learning, graph data More ❯

of the competitive consulting companies, headquartered in United Kingdom that provide cutting-edge technology solutions, that enable businesses to thrive in the digital era. We specialize in Cloud, DevOps, Data Science, Blockchain, IoT, and Metaverse technologies, and our team of experts is dedicated to delivering innovative solutions that drive business growth and transformation. Our team of experts has years … mandatory that the candidate should have handled more than 2 projects in the above framework using Scala. Should have 4+ years of relevant experience in handling end to end Big Data technology. Meeting with the development team to assess the company's big data infrastructure. Designing and coding Hadoop applications to analyze data collections. Creating … data processing frameworks. Extracting data and isolating data clusters. Testing scripts and analyzing results. Troubleshooting application bugs. Maintaining the security of company data. Training staff on application use Good project management and communication skills. Designing, creating, and maintaining Scala-based applications Participating in all architectural development tasks related to the application. Writing code in accordance with the More ❯

career progression, sustainability, or volunteering, you'll find like-minded people driving change at Howden. Role: Quality Assurance Engineer Objective: Ensure the quality, reliability, and governance of the Group Data Platform , covering data engineering, platform engineering, and data governance processes . Summary of the Role Howden Group Services is expanding its Group Data Platform and seeks … a Quality Assurance Engineer to test, validate, and improve data pipelines, infrastructure, and governance processes. The ideal candidate will have experience in data testing, automation frameworks, and cloud-based data platforms , ensuring high-quality standards for data pipelines, storage, and platform components . This role requires a detail-oriented professional with a strong technical background in … data assurance and test automation . You will work alongside data engineers, platform engineers, and governance teams to ensure data accuracy, reliability, and compliance . Responsibilities Support the execution of the quality assurance strategy for the Group Data Platform , ensuring the reliability of data pipelines, infrastructure, and governance processes . Develop and execute test cases More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing … overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. You will collaborate with data More ❯

Job Description Job Title: Data Architect Level: Manager (CL7) Locations: London, Bristol or Manchester Salary: Competitive salary and package (Depending on level of experience) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more spent outside … Qualification Key responsibilities of the role are summarised below: Define the architecture for high profile, public facing, government, and private sector projects, including providing architectural and technical leadership Define data strategy, data migration approach, data integration approach, data models and data design for any given client Investigate and thoroughly understand the current live applications and … and guidelines to direct the build and deployment of systems Ensure that agreed upon architectural principles and standards are applied to the finished system or product Define a strategic Data Model across the enterprise and products Propose technical solutions for storing data in distributed systems Create a model that works for small micro-services as well as big More ❯

This post is an exciting opportunity for a Data Scientist or Informatician to work with electronic healthcare databases, and to engage in big data techniques. The post will be based within King's Centre for Military Health Research, the leading UK centre of excellence for military health research and the project is funded by the Economic and … Social Research Council (ESRC) for a Secondary Data Analysis Initiative (Phase 2). The post holder will be required to manage and process multiple large databases, utilising skills in programming and data linkage. Primary responsibilities will be to: i) conduct data linkages and develop databases, ii) extract data from the healthcare records databases, iii) ensure data quality and validity and iv) ensure appropriated data management procedures. The post holder will link electronic healthcare records to a large UK military cohort study and extract health data from these complex databases. This post will also offer the opportunity to contribute to health research which should directly inform policy, and to work with the Department of More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions You will develop intricate data processing pipelines … addressing clients' most challenging problems You will collaborate with data scientists to design scalable implementations of their models You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines You will use different distributed storage and computing technologies from the plethora of options available You will develop data More ❯

agency still grounded in our founding principle that people are at the centre of all we do. Each day, we apply this belief to harness the transformative power of data and technology to inspire and move people and business forward. With more than 7,000 employees in over 100 offices around the world, we are the flagship Publicis Media … incredibly high demand. If you are passionate about shaping the future of AI and thrive on complex, high-impact challenges, we encourage you to apply. Responsibilities As a Senior Data Engineer for AI/ML, you will be the architect and builder of the data infrastructure that feeds our intelligent systems. Your responsibilities will include: Design and Build … Scalable Data Pipelines: Architect, implement, and optimize robust, high-performance real-time and batch ETL pipelines to ingest, process, and transform massive datasets for LLMs and foundational AI models. Cloud-Native Innovation: Leverage your deep expertise across AWS, Azure, and/or GCP to build cloud-native data solutions, ensuring efficiency, scalability, and cost-effectiveness. Power Generative AI More ❯