151 to 161 of 161 Data Pipeline Jobs in the City of London

both new and existing secure transformation projects. You’ll play a key role in architecting and maintaining scalable, security-first cloud infrastructure using AWS, Kubernetes, and real-time data streaming pipelines. This is a hands-on role for engineers who thrive in high-assurance environments and enjoy driving automation and DevSecOps best practices. What’s on Offer Highly … impact on secure solutions shaping UK defence programmes What You’ll Be Doing Designing and supporting secure AWS multi-account environments Driving automation, container orchestration, and real-time data pipelines Leading initiatives in infrastructure-as-code, CI/CD, and platform monitoring Enabling robust security practices across DevOps delivery teams Core Skills & Experience Strong experience with AWS MSK More ❯

the team, and help shape the future of AI in education. Responsibilities: Build and lead a new ML team from the ground up. Define the tech stack for data pipelines and ML models. Develop generative models using diverse datasets (text, audio, video, test results). Design and deploy data integration and analysis pipelines. Collaborate with engineers … Create innovative language assessments and predictive models. Optimize models for performance, scalability, and accuracy. Qualifications: Deep knowledge of neural networks (CNNs, RNNs, LSTMs, Transformers). Strong experience with data tools (Pandas, NumPy, Apache Spark). Solid understanding of NLP algorithms. Experience integrating ML models via RESTful APIs. Familiarity with CI/CD pipelines and deployment automation. Strategic thinking More ❯

the team, and help shape the future of AI in education. Responsibilities: Build and lead a new ML team from the ground up. Define the tech stack for data pipelines and ML models. Develop generative models using diverse datasets (text, audio, video, test results). Design and deploy data integration and analysis pipelines. Collaborate with engineers … Create innovative language assessments and predictive models. Optimize models for performance, scalability, and accuracy. Qualifications: Deep knowledge of neural networks (CNNs, RNNs, LSTMs, Transformers). Strong experience with data tools (Pandas, NumPy, Apache Spark). Solid understanding of NLP algorithms. Experience integrating ML models via RESTful APIs. Familiarity with CI/CD pipelines and deployment automation. Strategic thinking More ❯

working with a disruptive London-based Computer Networking company who are working on the cutting edge of AI and Machine learning technology with applications for increased productivity in Data centres and HPCs. Responsibilities: Design automated test frameworks for optical networks using Python, C++ Develop integrated hardware solutions across network systems using hardware instruments, BERTS, Burst-mode test, and … oscilloscopes. Engineer optimisation algorithms as part of the test framework platform and metaheuristic algorithms Support across the validation of testing, and analysis of data for improvement Collaborate with cross-functional teams of hardware, software, embedded and electronic engineers. Skills: Software scripting and Automation experience using Python, C++, C# Experience in generating and scripting algorithms for AI/ML … applications, as well as Metaheuristic optimisation. Understanding of cloud-based environments and data pipelines. Degree in either Computer Science, Electrical/Electronic, or related. What’s in it for you? Up to £80k DOE Lucrative stock options. 25 days holiday + bank holidays. Hybrid working. Relocation assistance. Visa sponsorship provided. More ❯

working with a disruptive London-based Computer Networking company who are working on the cutting edge of AI and Machine learning technology with applications for increased productivity in Data centres and HPCs. Responsibilities: Design automated test frameworks for optical networks using Python, C++ Develop integrated hardware solutions across network systems using hardware instruments, BERTS, Burst-mode test, and … oscilloscopes. Engineer optimisation algorithms as part of the test framework platform and metaheuristic algorithms Support across the validation of testing, and analysis of data for improvement Collaborate with cross-functional teams of hardware, software, embedded and electronic engineers. Skills: Software scripting and Automation experience using Python, C++, C# Experience in generating and scripting algorithms for AI/ML … applications, as well as Metaheuristic optimisation. Understanding of cloud-based environments and data pipelines. Degree in either Computer Science, Electrical/Electronic, or related. What’s in it for you? Up to £80k DOE Lucrative stock options. 25 days holiday + bank holidays. Hybrid working. Relocation assistance. Visa sponsorship provided. More ❯

a skilled Backend Java Engineer to join an innovative team on a 6-month contract. If you love solving complex problems, mentoring others, and working on cutting-edge data platforms at scale- this one’s for you! 🙌 🌟 What you’ll do: 💻 Develop and maintain scalable, data-driven applications in Java 🛠️ Lead on requirements, design workshops, and … solutioning 🤝 Mentor junior engineers and share best practices ☁️ Implement & optimise microservices and distributed systems on GCP (GKE, PubSub, BigQuery, Dataflow) using Docker & Kubernetes 🔄 Build and manage efficient data pipelines with streaming tech + relational/NoSQL databases ✅ Ensure high quality through robust unit, integration, and non-functional testing ⚡ Contribute to CI/CD practices with Jenkins and Git … Troubleshoot, propose improvements, and stay ahead of emerging technologies 💡 What you’ll bring: 🔑 Strong Java & OOP experience 📊 Background in data platforms, frameworks & streaming technologies 🧩 Familiarity with microservices & distributed systems ☁️ Exposure to GCP (GKE, PubSub, BigQuery) 🗄️ Experience with relational/NoSQL databases 🐳 Proficiency with Docker & Kubernetes 🔄 Solid understanding of engineering best practices (CI/CD, Git, testing) 🧠 Problem-solving More ❯

a skilled Backend Java Engineer to join an innovative team on a 6-month contract. If you love solving complex problems, mentoring others, and working on cutting-edge data platforms at scale- this one’s for you! 🙌 🌟 What you’ll do: 💻 Develop and maintain scalable, data-driven applications in Java 🛠️ Lead on requirements, design workshops, and … solutioning 🤝 Mentor junior engineers and share best practices ☁️ Implement & optimise microservices and distributed systems on GCP (GKE, PubSub, BigQuery, Dataflow) using Docker & Kubernetes 🔄 Build and manage efficient data pipelines with streaming tech + relational/NoSQL databases ✅ Ensure high quality through robust unit, integration, and non-functional testing ⚡ Contribute to CI/CD practices with Jenkins and Git … Troubleshoot, propose improvements, and stay ahead of emerging technologies 💡 What you’ll bring: 🔑 Strong Java & OOP experience 📊 Background in data platforms, frameworks & streaming technologies 🧩 Familiarity with microservices & distributed systems ☁️ Exposure to GCP (GKE, PubSub, BigQuery) 🗄️ Experience with relational/NoSQL databases 🐳 Proficiency with Docker & Kubernetes 🔄 Solid understanding of engineering best practices (CI/CD, Git, testing) 🧠 Problem-solving More ❯

chain operations, including trading, liquidity management, and asset custody. * Write, test, and deploy smart contracts; proficiency beyond Solidity is highly valued. * Develop and maintain off-chain automation bots, data pipelines, and monitoring tools using languages like Python or Java. * Collaborate with the quant and trading teams to translate strategies into reliable, automated code. * Conduct code reviews and contribute … such as Python or Java. * Demonstrable experience in systematically integrating with on-chain DeFi protocols. * A deep understanding of the DeFi landscape, including MEV, gas optimization, and blockchain data structures. * Familiarity with Web3 libraries (e.g., web3.py, ethers.js) and interacting with blockchain nodes. Bonus Qualifications (Highly Desirable): * Experience in on-chain auditing or security review of smart contracts. * Knowledge More ❯

chain operations, including trading, liquidity management, and asset custody. * Write, test, and deploy smart contracts; proficiency beyond Solidity is highly valued. * Develop and maintain off-chain automation bots, data pipelines, and monitoring tools using languages like Python or Java. * Collaborate with the quant and trading teams to translate strategies into reliable, automated code. * Conduct code reviews and contribute … such as Python or Java. * Demonstrable experience in systematically integrating with on-chain DeFi protocols. * A deep understanding of the DeFi landscape, including MEV, gas optimization, and blockchain data structures. * Familiarity with Web3 libraries (e.g., web3.py, ethers.js) and interacting with blockchain nodes. Bonus Qualifications (Highly Desirable): * Experience in on-chain auditing or security review of smart contracts. * Knowledge More ❯

Quantitative Developer – Core Data | Prime Brokerage – Digital Assets Location: London OR New York Company Overview: A global prime brokerage platform, purpose-built to support both traditional and digital asset markets. Serving institutional clients, the firm provides integrated credit intermediation, trade execution, and clearing services - enabling counterparties to access global liquidity with minimal friction and no counterparty risk. Role … Overview: As a QD within Core Data, you'd be responsible for building and maintaining the data infrastructure that underpins key services such as Entity Master, Pricing Service, and Position Service. Your work will ensure these systems are reliable, performant, and scalable - freeing up the wider Quant/DS team to focus on strategic platform development. … You'll lead efforts to improve data accuracy, integrate new reference sources, and develop robust pipelines for ingestion and processing. This is a hands-on role at the core of a high-performance trading infrastructure. Key Qualifications: 5+ years of experience in quantitative software development at a top-tier firm Strong Python skills, with experience writing production-grade More ❯

Quantitative Developer – Core Data | Prime Brokerage – Digital Assets Location: London OR New York Company Overview: A global prime brokerage platform, purpose-built to support both traditional and digital asset markets. Serving institutional clients, the firm provides integrated credit intermediation, trade execution, and clearing services - enabling counterparties to access global liquidity with minimal friction and no counterparty risk. Role … Overview: As a QD within Core Data, you'd be responsible for building and maintaining the data infrastructure that underpins key services such as Entity Master, Pricing Service, and Position Service. Your work will ensure these systems are reliable, performant, and scalable - freeing up the wider Quant/DS team to focus on strategic platform development. … You'll lead efforts to improve data accuracy, integrate new reference sources, and develop robust pipelines for ingestion and processing. This is a hands-on role at the core of a high-performance trading infrastructure. Key Qualifications: 5+ years of experience in quantitative software development at a top-tier firm Strong Python skills, with experience writing production-grade More ❯