12 of 12 Big Data Engineer Jobs

Description Job Description KDA Consulting Inc. is seeking a highly skilled Full Stack Developer with Big Data expertise to support mission-critical programs within the Intelligence Community (IC). This role will focus on designing, developing, and maintaining scalable applications that process and analyze large volumes of data in support of national security objectives. The ideal candidate will bring a strong mix of full stack engineering capabilities and data-intensive application experience , with the ability to operate in a fast-paced, highly collaborative environment. This position offers the opportunity to work on modernized systems, cloud-based ...

London Stock Exchange is seeking a highly skilled Senior Data Engineer to design, build, and manage our data infrastructure and analytics solutions. You will enable data-driven decision-making across the organization by working with complex datasets and cross-functional teams to unlock insights and deliver … actionable intelligence. You will design, develop, and optimize big data pipelines, architectures, and data integration workflows, building scalable data storage such as data lakes and #J-18808-Ljbffr ...

Title: Big Data DevOps Engineer1. Job Summary highlight project details/what is exciting about the role :New transformational program for a UK customer focusing on Big Data and advanced visualization capabilitiesAgile mode of working with teams co-located in London A sound DevOps expertise …/CD pipeline within Big Data technology landscape and ability to articulate and influence leadership stakeholders on infrastructure autiomation are pre-requisites. In addition to core DevOps expertise, hand-on experience in AWS, Hortonworks, S3, Java 8, Hbase, Kafka, JanusGraph, HDF (NiFi) and related big data ...

Consulting Limited is seeking a Sr Data Engineer with a minimum of 6-8 years of experience to join their team in Northampton, UK. This hybrid role involves working 2 days a week in the office. The ideal candidate will have expertise in Bigdata technologies, including PySpark ...

Bank in Bromley is seeking a Quantitative Engineer to design and implement scalable data and analytics components for Global Risk. You will work with modelers, risk managers and technologists across the full data stack to understand current state and shape future analytics. Applicants should have strong Python … software development experience, familiarity with big data technologies, and a degree in Computer Science or a related field. #J-18808-Ljbffr ...

Solirius Reply, part of the Reply Group, is seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team. You will design, build and maintain robust data pipelines and services within secure, data-intensive environments. Applicants should have a strong background … Python, ETL/ELT pipelines, and data processing, with experience handling large datasets and collaborating with cross-functional teams. #J-18808-Ljbffr ...

Roke in Gloucester is seeking a Senior Software Engineer to deliver mission-critical solutions for National Security customers, building data-heavy products to protect people, platforms, missions and information. You will lead hands-on data engineering, mentor colleagues, and work at the forefront of innovation. You will … design cloud-native data processing architectures, develop ingestion pipelines, and collaborate with stakeholders while ensuring secure, scalable systems that meet customer #J-18808-Ljbffr ...

Bank of America in Bromley, United Kingdom is seeking a Quantitative Engineer to design and oversee scalable data analytics components for Global Risk. You will collaborate with senior modelers and technologists, apply quantitative methods, build large-scale data pipelines, and deliver high-quality code across the lifecycle. ...

Forward Role is seeking a Software Engineer for national security projects in the UK. You will design, develop and maintain scalable Java applications and data pipelines using Spring Boot and Hadoop. You will work on automation, reliability and performance, participate in code reviews, CI/CD with GitLab ...

other basis protected by law. Build streaming and storage systems at PulsePointPulsePoint processes billions of events daily through Kafka, Hadoop HDFS and Ceph. Our Data Platform team maintains these systems across hybrid infrastructure: bare-metal on-prem, cloud, and the integration between them. You own the lifecycle from architecture … design, placement optimization, capacity planning. Operational automation, reduce manual work, faster incident response, preventive systems. SQL Server backup and recovery pipelines, basic cluster support. Data team tooling with self-service capabilities and observability. TechnologyApache Kafka for messaging layerHadoop and Ceph as distributed storage layerSQL Server backup and recoveryTerraform, Ansible ...

other basis protected by law.Build streaming and storage systems at PulsePointPulsePoint processes billions of events daily through Kafka, Hadoop HDFS and Ceph. Our Data Platform team maintains these systems across hybrid infrastructure: bare-metal on-prem, cloud, and the integration between them. You own the lifecycle from architecture through … understand distributed systems, failure recovery, and operational patterns at scale. Apache Kafka and Ceph expertise is most valuable.Who we're looking forYou've operated data infrastructure at petabyte scale or billions of events/day. You understand replication failures, consistency tradeoffs, and cost-optimization of large systems. You automate ...

London Metal Exchange Limited is seeking a Senior Engineer in London to design and develop core trading and market data applications. You will liaise with business analysts and product owners to translate complex requirements into robust software solutions, guided by DevSecOps practices. You will contribute to architecture reviews ...