26 to 41 of 41 Data Ingestion Jobs in the City of London

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

Data Scientist - Finance/Investments London – 5 days in office Up to £120,000 + Strong Bonus Potential About the Role We are working with a leading hedge fund and alternative investment firm, specialising in global macro strategies with a particular emphasis on inflation modelling and the wider economic landscape. They are looking for a Data Scientist to … cutting edge of time-series forecasting within a fast-paced and intellectually rigorous environment. Key Responsibilities Building machine learning models, with a focus on time-series forecasting. Collaborating with data scientists and researchers to productionise models. Managing both cloud-based and on-premise infrastructure. Ensuring reliability and scalability of ML systems in production. What We’re Looking For 3+ … years of experience in Data Science. Strong proficiency in Python and experience with ML libraries/frameworks (Pandas, NumPy, Scikit-learn, TensorFlow, PyTorch). Hands-on experience implementing end-to-end ML pipelines (data ingestion, training, validation, serving). Familiarity with ML workflow orchestration tools (Airflow, Prefect, Kubeflow) and feature/data platforms (Databricks, Tecton, etc. More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will work … closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with cross-functional teams to gather requirements … and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best practices. Stay updated with emerging technologies and More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will work … closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with cross-functional teams to gather requirements … and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best practices. Stay updated with emerging technologies and More ❯

context, and clarity are essential. The Role We’re looking for a Founding Software Engineer to lead backend and infrastructure development for our category-defining video understanding product. From data ingestion pipelines to scalable APIs, you’ll blend backend engineering and DevOps to turn cutting-edge AI into a production-ready platform. As part of the founding team … challenges, exposure to the latest AI developments 💬 End-to-end ownership + product influence 🌍 Flexible location (London/Athens hubs) Key Responsibilities Architect and implement the backend platform for data processing, search, and advanced reasoning Design scalable systems and APIs for data-intensive, low-latency workflows Optimize database interactions for high-speed visual search and reasoning Manage cloud … just “how” What You’ll Need Essential Skills Startup Mindset: Bias for action, ownership, comfort with ambiguity Backend Development: Python (FastAPI, Flask) + microservices Distributed Systems: Scaling high-volume data systems Cloud: AWS/GCP/Azure (ECS/EKS, S3, Lambda, IAM or similar) Databases: PostgreSQL + strong data modeling Containers: Docker; orchestration tools Infra as Code More ❯

context, and clarity are essential. The Role We’re looking for a Founding Software Engineer to lead backend and infrastructure development for our category-defining video understanding product. From data ingestion pipelines to scalable APIs, you’ll blend backend engineering and DevOps to turn cutting-edge AI into a production-ready platform. As part of the founding team … challenges, exposure to the latest AI developments 💬 End-to-end ownership + product influence 🌍 Flexible location (London/Athens hubs) Key Responsibilities Architect and implement the backend platform for data processing, search, and advanced reasoning Design scalable systems and APIs for data-intensive, low-latency workflows Optimize database interactions for high-speed visual search and reasoning Manage cloud … just “how” What You’ll Need Essential Skills Startup Mindset: Bias for action, ownership, comfort with ambiguity Backend Development: Python (FastAPI, Flask) + microservices Distributed Systems: Scaling high-volume data systems Cloud: AWS/GCP/Azure (ECS/EKS, S3, Lambda, IAM or similar) Databases: PostgreSQL + strong data modeling Containers: Docker; orchestration tools Infra as Code More ❯

of solutions Drive architectural and design decisions, ensuring scalable, resilient systems built on sound engineering principles and best practices Partner with clients to define and evolve their technology and data strategy, modernizing infrastructure, architecture, and technology stacks Utilize DevOps tools and practices to automate and streamline the build and deployment processes Work closely with Data Scientists and Engineers … to deliver robust, production-level AI and Machine Learning systems Develop frameworks and tools for efficient data ingestion from diverse and complex sources Operate in short, iterative sprints, delivering working software aligned with clear deliverables and client-defined deadlines Demonstrate flexibility by learning and working across multiple programming languages and technologies as required Additional Responsibilities: Actively contribute to … an added advantage Understanding of web APIs, contracts and communication protocols Understanding of Cloud platforms, infra-automation/DevOps, IaC/GitOps/Containers, design and development of large data platforms A maker’s mindset - To be resourceful and have the ability to do things that have no instructions What will you experience in terms of culture at Sahaj More ❯

of solutions Drive architectural and design decisions, ensuring scalable, resilient systems built on sound engineering principles and best practices Partner with clients to define and evolve their technology and data strategy, modernizing infrastructure, architecture, and technology stacks Utilize DevOps tools and practices to automate and streamline the build and deployment processes Work closely with Data Scientists and Engineers … to deliver robust, production-level AI and Machine Learning systems Develop frameworks and tools for efficient data ingestion from diverse and complex sources Operate in short, iterative sprints, delivering working software aligned with clear deliverables and client-defined deadlines Demonstrate flexibility by learning and working across multiple programming languages and technologies as required Additional Responsibilities: Actively contribute to … an added advantage Understanding of web APIs, contracts and communication protocols Understanding of Cloud platforms, infra-automation/DevOps, IaC/GitOps/Containers, design and development of large data platforms A maker’s mindset - To be resourceful and have the ability to do things that have no instructions What will you experience in terms of culture at Sahaj More ❯

and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure as code (Terraform, or similar) for … or similar model management systems. Practical knowledge of infrastructure as code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent). Understanding of ML concepts. … and reproducibility, but you also enable teams to ship fast. Nice to Have Experience delivering API services (FastAPI, SpringBoot or similar). Experience with message brokers and real-time data and event processing (Kafka, Pulsar, or similar). Why Join Us You'll be part of a small, high-output team where intensity and focus are the norm. You More ❯

and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure as code (Terraform, or similar) for … or similar model management systems. Practical knowledge of infrastructure as code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent). Understanding of ML concepts. … and reproducibility, but you also enable teams to ship fast. Nice to Have Experience delivering API services (FastAPI, SpringBoot or similar). Experience with message brokers and real-time data and event processing (Kafka, Pulsar, or similar). Why Join Us You'll be part of a small, high-output team where intensity and focus are the norm. You More ❯

frameworks like LangChain, LangGraph, and the Google Agent Development Kit (ADK). Develop and Evaluate RAG Pipelines: Engineer and optimize end-to-end Retrieval-Augmented Generation (RAG) systems, including data ingestion, chunking strategies, and implementing rigorous pipeline evaluation frameworks for accuracy and performance. Fine-Tune & Optimize LLMs: Implement advanced model customization techniques, including PEFT (Parameter-Efficient Fine-Tuning More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯

really do and delivering rapid-fire prototypes that become mission-critical apps. What you’ll tackle Spot the pain-points across Equities, Credit, Rates and central Risk teams; translate data-flow headaches into buildable tech projects. Prototype at pace in Python—leveraging LLM co-pilots—to stand-up analytics services, REST APIs and lightweight Dash/React front-ends. … Own the full stack: data ingestion (SQL, files, feeds), business logic, web/UI, CI pipelines and Linux deployment. Codify best practice for safe, auditable LLM-assisted development; lead code reviews and knowledge-share sessions. Stay user-facing —white-board with quants, ask clarifying questions, iterate live and keep comms flowing. You in a nutshell 5 + years … building production-grade Python systems for data-heavy businesses; comfortable with tests, version control and optimisation. Confident SQL , exposure to REST and messaging (Rabbit, Kafka, etc.), and enough Linux to troubleshoot on the command line. UI chops in Dash, Flask or React to whip up proof-of-concept dashboards. Solid grounding in financial products & risk metrics —equities, bonds and More ❯

Crime Enhancement Project focused on Sanctions and PEP screening. What you'll do: Administer and configure LexisNexis Bridger Insight for sanctions and PEP screening workflows. Run screening jobs, manage data ingestion, and generate reports within Bridger. Set up users, permissions, and workflows tailored to project requirements. Collaborate with internal teams and external consultants to backfill and transition responsibilities. … Strong understanding of Sanctions and PEP screening processes. Background in Financial Crime, AML, or Compliance projects. Ability to manage screening engines, workflows, and user configurations. Comfortable running jobs, handling data files, and producing reports specific to Bridger functionality. Next steps We have a diverse workforce and an inclusive culture at M&G plc, underpinned by our policies and our More ❯

as of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion and Data Flow Strong … Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport the design and development of BigData echosystem Experience in building complex SQL Queries Strong Communication Skills More ❯