1 to 25 of 301 Big Data Jobs in London

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms that help … organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In this role, you will help design … and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big data, performing advanced data analytics, and More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Data Analyst, Data Engineer, SQL, Informatica, ETL, Data Ingestion, Data Integration, Data Analytics, Data Science There is a new role with an industry-leading Data Analytics and Data Science company based in London, looking for a Data Analyst/Data Engineer to join their business and build a career within … the business. Established six years ago, the company have grown rapidly and are now recognized as one of the industry leaders in the Data Analytics/Data Science space. They provide complex data solutions for blue chip and enterprise grade clients using cutting-edge data and cloud technology. They are looking for a Data Analyst …/Data Engineer to work across all areas of the business, defining data requirements across business units, analysing the relationships of data and technical data feed requirements aswell as working in proximity to architects on the Data Warehouse design, build and deployment This is a junior role, and as such will have a large focus More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

CONTRACT PYTHON/DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON/DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engineer National Security & Defence client Outside IR35 12 month rolling contract Central London based organisation in an easily accessible location To apply please … call/or email WHO WE ARE? We are recruiting a contract Python/Data Engineer to work with a National Security & Defence SME in central London. Due to the nature of the work, you must hold UKSV/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO HAVE.... Current DV Security Clearance (Standard … or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies TO BE CONSIDERED.... Please either More ❯

CONTRACT PYTHON/DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON/DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engineer National Security & Defence client Outside IR35 12 month rolling contract Central London based organisation in an easily accessible location To apply please … call 07704 152 640/0203 854 0120 or email WHO WE ARE? We are recruiting a contract Python/Data Engineer to work with a National Security & Defence SME in central London. Due to the nature of the work, you must hold UKSV/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO … HAVE. Current DV Security Clearance (Standard or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

Data Scientist - skills in statistics, physics, mathematics, Computer Science, Engineering, Data Mining, Big Data (Hadoop, Hive, MapReduce) This is an exceptional opportunity to work as a Data Scientist within a global analytics team, utilizing various big data technologies to develop complex behavioral models, analyze customer uptake of products, and foster new product innovation. … and reviewing large datasets through advanced quantitative and statistical techniques. Designing, building, and utilizing consumer behavioral forecasting models across different business sectors to maximize opportunities. Leading initiatives to enhance data accuracy, availability, granularity, and coverage. Developing analytics strategies to improve customer and product strategies. Designing better data analysis processes for future use. Proactively deriving actionable insights from large … statistical techniques. Analyzing customer behavior patterns to optimize product performance and customer experience. Building complex behavior forecasting models to identify links between behavior and new opportunities. Manipulating high-level data and presenting findings clearly to senior stakeholders. Supporting the development of analytics strategies to enhance product plans and customer engagement. Ideal candidates are talented scientists with exceptional data More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data More ❯

Trade Data Architect - £800 - £900 Per Day – 6 Months – London (Hybrid) - Commodities Overview: A market leading organisation operating in the physical commodities space are searching for an experienced Data Architect with strong experience on the Azure Data stack to join one of their growing teams in London on a hybrid basis. Role & Responsibilities: Design and develop Enterprise … Data Architecture for Trade, Sales Ops and Finance use cases. Deliver effective Big Data solutions aligned with Business objectives. Responsible for creating a target state architecture that best enable seamless integration of complex systems and valuable Analytics. Own and develop Conceptual, logical, and Physical data models. Technical Requirements: Experience designing and developing enterprise data architecture … and delivering effective big data solutions aligned with business objectives. Proven experience in designing Lakehouse Architecture, Data Governance, and Data Modelling Strong understanding of data integration, data quality, and data governance. Extensive experience in working with big data technology tools and platforms such as Microsoft Azure Data Factory, Databricks, Unity More ❯

We have 9 NEW open positions based in our London office. As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and … and productionalizing customer use cases Work with engagement managers to scope a variety of professional services work with input from the customer Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications Consult on architecture and design … Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution for engagement specific product and support issues. What we look for: Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices Comfortable writing code in either Python or More ❯

We have 9 open positions based in our London office. As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud … s and productionalising customer use cases Work with engagement managers to scope a variety of professional services with input from the customer Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications Consult on architecture and design … Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution of engagement-specific product and support issues. What we look for: Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices Comfortable writing code in either Python or More ❯

Artificial Intelligence Engineer/Data Scientist £50k - £90k dependant on experience bonus good bens. Flexible Working Location opportunity. This role may suit individuals who have previously held roles such as Data Engineer, Data Architect, Big Data Consultant, Data Scientist, Data Modeller, Big Data Analyst, or AI Engineer. We are assisting in … recruiting AI Engineers/Data Scientists to join an innovative and growing team within the data practice of a prestigious global technology consulting firm. The client offers excellent career growth, professional development, and a personalized benefits package. Candidates must ideally have UK security clearance and be fully flexible regarding working location. The successful candidate will be a key … team member designing modern analytical data solutions, engaging in the full project lifecycle. The role offers a diverse range of exciting work. Key Skills We are recruiting at various levels within the salary range, so candidates are not expected to be experienced in all areas listed below. AI techniques (supervised and unsupervised machine learning, deep learning, graph data More ❯

Are you passionate about data? Does the prospect of dealing with massive volumes of data excite you? Do you want to build data engineering solutions that process billions of records a day in a scalable fashion using AWS technologies? Do you want to create the next-generation tools for intuitive data access? If so, Amazon Finance … Technology (FinTech) is for you! FinTech is seeking a Data Engineer to join the team that is shaping the future of the finance data platform. The team is committed to building the next generation big data platform that will be one of the world's largest finance data warehouse to support Amazon's rapidly growing … and dynamic businesses, and use it to deliver the BI applications which will have an immediate influence on day-to-day decision making. Amazon has culture of data-driven decision-making, and demands data that is timely, accurate, and actionable. Our platform serves Amazon's finance, tax and accounting functions across the globe. As a Data Engineer More ❯

Data Engineer I, Business Data Technologies Business Data Technologies (BDT) makes it easier for teams across Amazon to produce, store, catalog, secure, move, and analyze data at massive scale. Our managed solutions combine standard AWS tooling, open-source products, and custom services to free teams from worrying about the complexities of operating at Amazon scale. This … lets BDT customers move beyond the engineering and operational burden associated with managing and scaling platforms, and instead focus on scaling the value they can glean from their data, both for their customers and their teams. We own the one of the biggest (largest) data lakes for Amazon where 1000's of Amazon teams can search, share, and … store EB (Exabytes) of data in a secure and seamless way; using our solutions, teams around the world can schedule/process millions of workloads on a daily basis. We provide enterprise solutions that focus on compliance, security, integrity, and cost efficiency of operating and managing EBs of Amazon data. Key job responsibilities CORE RESPONSIBILITIES: Be hands-on with More ❯

career progression, sustainability, or volunteering, you'll find like-minded people driving change at Howden. Role: Quality Assurance Engineer Objective: Ensure the quality, reliability, and governance of the Group Data Platform , covering data engineering, platform engineering, and data governance processes . Summary of the Role Howden Group Services is expanding its Group Data Platform and seeks … a Quality Assurance Engineer to test, validate, and improve data pipelines, infrastructure, and governance processes. The ideal candidate will have experience in data testing, automation frameworks, and cloud-based data platforms , ensuring high-quality standards for data pipelines, storage, and platform components . This role requires a detail-oriented professional with a strong technical background in … data assurance and test automation . You will work alongside data engineers, platform engineers, and governance teams to ensure data accuracy, reliability, and compliance . Responsibilities Support the execution of the quality assurance strategy for the Group Data Platform , ensuring the reliability of data pipelines, infrastructure, and governance processes . Develop and execute test cases More ❯

Want to help solve the world's toughest problems with big data and AI? This is what we do every day at Databricks. As a Named Enterprise Account Executive, you will come with an informed and compelling point of view on the Big Data, Advanced Analytics, and AI space which will guide your successful strategy and … that accelerates existing customer success, identifies and acquires new customers and enables you to exceed quarterly/annual usage and booking goals You will motivate a diverse team of big data and AI professionals to implement your business plan You will lead your team, customers, and partners to identify impactful big data and AI use cases … whilst proving their value on the Databricks Data Intelligence Platform You will support the broader big data and AI transformation goals of your customers through a combination of strategic partnerships, well-scoped professional services, training, and targeted Executive engagement You will build exceptional value with all engagements to guide successful negotiations to close What we look for More ❯

Senior ML & AI Backend Engineer - Big Data, LLMs & MLOps About the Role We're an ambitious, fast-moving tech company developing next-generation solutions at the intersection of advanced Machine Learning, Big Data, and Large Language Models (LLMs). We're looking for a hands-on Senior ML & AI Backend Engineer to design and build the … systems powering ML models and LLMs in production. Design, build, and maintain end-to-end ML pipelines, championing MLOps best practices for deployment, monitoring, and iteration. Develop solutions for big data storage and processing, ensuring data quality, security, and efficiency. Integrate and optimize both classical ML models and LLMs for real-world use cases. Research and experiment … with state-of-the-art algorithms, tools, and frameworks - bringing fresh ideas from prototype to production. Collaborate closely with a cross-functional team of data scientists, engineers, and product stakeholders. Write clean, maintainable, well-tested code and help set engineering best practices. Diagnose and resolve complex technical challenges in big data and ML systems. About You You More ❯

This post is an exciting opportunity for a Data Scientist or Informatician to work with electronic healthcare databases, and to engage in big data techniques. The post will be based within King's Centre for Military Health Research, the leading UK centre of excellence for military health research and the project is funded by the Economic and … Social Research Council (ESRC) for a Secondary Data Analysis Initiative (Phase 2). The post holder will be required to manage and process multiple large databases, utilising skills in programming and data linkage. Primary responsibilities will be to: i) conduct data linkages and develop databases, ii) extract data from the healthcare records databases, iii) ensure data quality and validity and iv) ensure appropriated data management procedures. The post holder will link electronic healthcare records to a large UK military cohort study and extract health data from these complex databases. This post will also offer the opportunity to contribute to health research which should directly inform policy, and to work with the Department of More ❯

Metyis is growing! We are looking for a Data Engineering Associate with 3-4 years of experience to join our Data and Analytics team in London. Who we are Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions and Advisory … the best version of yourself. We are Metyis. Partners for Impact. What we offer Interact with senior stakeholders at our clients regularly to drive impactful business change. Work with Data Scientists to manage data throughout its lifecycle - acquisition, exploration, cleaning, integration, analysis, interpretation, and visualization. Become part of a fast-growing, international, and diverse team. What you will … technical solutions to solve concrete business challenges across various domains. Gather functional and non-functional requirements, considering technical environments, business constraints, and organizational needs. Support clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services More ❯

Senior ML & AI Backend Developer You'll lead the design and deployment of scalable backend systems powering ML, big data, and LLM-driven applications. From MLOps pipelines and big data engineering to productionizing classical ML and LLMs, you'll be at the core of AI infrastructure. Key Requirements: Expert in Python, ML/AI frameworks (PyTorch … TensorFlow, Hugging Face) Proven MLOps, big data, and backend/API development experience Deep understanding of NLP and LLMs Proficient with cloud platforms (AWS/GCP/Azure), Airflow, DBT, Docker/Kubernetes Strong collaboration, problem-solving, and coding best practices Nice to have: LLM fine-tuning, streaming data, big data warehousing, open-source contributions. More ❯

sets thefoundation for delivering our full suite of capabilities. Job Description Employment Type: Full-Time Location: UK Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will have a … strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with data analysts and other stakeholders to meet … data requirements. Optimize data storage and processing for performance and cost. Maintain data security and compliance standards. Minimum Qualifications Bachelor's degree in Computer Science , Information Technology, Engineering, or a related field. Minimum 3 years of experience as a Database Designer & Senior Data Engineer, with hands-on experience in cloud based data services. Proficiency in More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally … you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: ·Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components More ❯