151 to 175 of 207 Data Ingestion Jobs in the UK

Senior Software Engineer/Developer (Python FastAPI Data) London to £90k Are you a data centric Software Engineer with strong Python and SQL skills? You could be progressing your career in a senior, hands-on role at a fast growing, global Insurance Underwriting technology provider that focusses on developing a complex SaaS calculation platform for rapidly growing Cybersecurity … insurance markets. As a Senior Software Engineer you will design and develop data centric backend services for the core platform with a focus on Python coding and building FastAPIs within an Azure environment with Databricks. You'll participate in the design and implementation of advanced mechanisms for data ingestion, transformation, mass parallel orchestration of network IO and … will model data for a variety of purposes. You'll also collaborate with the Infrastructure Team to maintain Infrastructure as Code and develop new features on the engineering platform. Location/WFH: There's a hybrid work from home model with three days a week in the high spec London, City office with rooftop bar. About you: You have More ❯

Managed Services Analyst 3 About Behavox Behavox is shaping the future for how businesses harness their most important raw material - data. Our mission is bold: Organize enterprise data into actionable information that protects and promotes the business growth of multinational companies around the world. From managing enterprise risk and compliance to maximizing revenue and value, our data operating … platform presents a widespread opportunity to build multilingual, AI/ML-based solutions that activate data for every function within a global enterprise. Our approach is unique, and it's validated by our customers who tell us to keep forging ahead because no one else is aggregating, analyzing, and acting on data to uncover opportunities or solve problems … have an insatiable appetite for building what no one has built before. About the Role As a Managed Services Analyst, you will sit at the intersection of technology delivery, data analytics, and client services - ensuring that Behavox solutions, such as Mosaic Smart Data, deliver measurable value from day one. You will lead end-to-end delivery of Behavox More ❯

a set of old and new platforms that serve the Client's FX business in multiple countries by providing the ability for real-time derivatives pricing, risk management and data analytics. Our platform is starting to replace a set of the existing risk applications with new generation ones with web-based UI, server-side computing and grid technology, distributed … and motivated FX Risk Lead Java Developer. Key Responsibilities Design, develop, and maintain Java-based microservices for high-throughput application Integrate and optimize Apache Ignite based solution: in memory data grid for FX trades processing Implement real time data ingestion and processing pipelines using Apache Kafka/Solace messaging Design and maintain robust Mongo DB/Oracle … data models and queries for data persistence Ensure application scalability and reliability in cloud-hosted Linux based environment Collaborate with DevOps to containerize services and deploy using CI/CD pipelines Conduct performance tuning, code reviews, and troubleshooting production issues Document system architecture, design decisions, and development processes What we want from you Strong hands-on experience with More ❯

We are currently looking for a Power BI Self-Service Lead to join the innovative and dynamic Data Tech team. You'll be part of a renowned organisation, working on solutions that serve a wide audience of loyal customers and colleagues. With strong ethical values and technology leaders who truly understand data platforms and management, this is an … exciting time to join as we evolve into a digital-first, data-led organisation. As Power BI Self-Service Lead, you'll play a key role in this transformation, reporting directly to our Data Platform Manager. The Opportunity In this role, you'll drive responsible usage of our newly built data platform, ensuring it evolves with cutting … and enhancing our Lab proposition, you'll foster a culture of innovation, develop governance frameworks, and implement tools that provide consistent, supportable solutions for activities such as self-service data ingestion and transitioning processes from Lab to Factory. Key responsibilities include: Drive Innovation : Lead the development and delivery of our Lab proposition to elevate practitioner self-service and More ❯

context, and clarity are essential. The Role We’re looking for a Founding Software Engineer to lead backend and infrastructure development for our category-defining video understanding product. From data ingestion pipelines to scalable APIs, you’ll blend backend engineering and DevOps to turn cutting-edge AI into a production-ready platform. As part of the founding team … challenges, exposure to the latest AI developments 💬 End-to-end ownership + product influence 🌍 Flexible location (London/Athens hubs) Key Responsibilities Architect and implement the backend platform for data processing, search, and advanced reasoning Design scalable systems and APIs for data-intensive, low-latency workflows Optimize database interactions for high-speed visual search and reasoning Manage cloud … just “how” What You’ll Need Essential Skills Startup Mindset: Bias for action, ownership, comfort with ambiguity Backend Development: Python (FastAPI, Flask) + microservices Distributed Systems: Scaling high-volume data systems Cloud: AWS/GCP/Azure (ECS/EKS, S3, Lambda, IAM or similar) Databases: PostgreSQL + strong data modeling Containers: Docker; orchestration tools Infra as Code More ❯

context, and clarity are essential. The Role We’re looking for a Founding Software Engineer to lead backend and infrastructure development for our category-defining video understanding product. From data ingestion pipelines to scalable APIs, you’ll blend backend engineering and DevOps to turn cutting-edge AI into a production-ready platform. As part of the founding team … challenges, exposure to the latest AI developments 💬 End-to-end ownership + product influence 🌍 Flexible location (London/Athens hubs) Key Responsibilities Architect and implement the backend platform for data processing, search, and advanced reasoning Design scalable systems and APIs for data-intensive, low-latency workflows Optimize database interactions for high-speed visual search and reasoning Manage cloud … just “how” What You’ll Need Essential Skills Startup Mindset: Bias for action, ownership, comfort with ambiguity Backend Development: Python (FastAPI, Flask) + microservices Distributed Systems: Scaling high-volume data systems Cloud: AWS/GCP/Azure (ECS/EKS, S3, Lambda, IAM or similar) Databases: PostgreSQL + strong data modeling Containers: Docker; orchestration tools Infra as Code More ❯

context, and clarity are essential. The Role We’re looking for a Founding Software Engineer to lead backend and infrastructure development for our category-defining video understanding product. From data ingestion pipelines to scalable APIs, you’ll blend backend engineering and DevOps to turn cutting-edge AI into a production-ready platform. As part of the founding team … challenges, exposure to the latest AI developments 💬 End-to-end ownership + product influence 🌍 Flexible location (London/Athens hubs) Key Responsibilities Architect and implement the backend platform for data processing, search, and advanced reasoning Design scalable systems and APIs for data-intensive, low-latency workflows Optimize database interactions for high-speed visual search and reasoning Manage cloud … just “how” What You’ll Need Essential Skills Startup Mindset: Bias for action, ownership, comfort with ambiguity Backend Development: Python (FastAPI, Flask) + microservices Distributed Systems: Scaling high-volume data systems Cloud: AWS/GCP/Azure (ECS/EKS, S3, Lambda, IAM or similar) Databases: PostgreSQL + strong data modeling Containers: Docker; orchestration tools Infra as Code More ❯

context, and clarity are essential. The Role We’re looking for a Founding Software Engineer to lead backend and infrastructure development for our category-defining video understanding product. From data ingestion pipelines to scalable APIs, you’ll blend backend engineering and DevOps to turn cutting-edge AI into a production-ready platform. As part of the founding team … challenges, exposure to the latest AI developments 💬 End-to-end ownership + product influence 🌍 Flexible location (London/Athens hubs) Key Responsibilities Architect and implement the backend platform for data processing, search, and advanced reasoning Design scalable systems and APIs for data-intensive, low-latency workflows Optimize database interactions for high-speed visual search and reasoning Manage cloud … just “how” What You’ll Need Essential Skills Startup Mindset: Bias for action, ownership, comfort with ambiguity Backend Development: Python (FastAPI, Flask) + microservices Distributed Systems: Scaling high-volume data systems Cloud: AWS/GCP/Azure (ECS/EKS, S3, Lambda, IAM or similar) Databases: PostgreSQL + strong data modeling Containers: Docker; orchestration tools Infra as Code More ❯

context, and clarity are essential. The Role We’re looking for a Founding Software Engineer to lead backend and infrastructure development for our category-defining video understanding product. From data ingestion pipelines to scalable APIs, you’ll blend backend engineering and DevOps to turn cutting-edge AI into a production-ready platform. As part of the founding team … challenges, exposure to the latest AI developments 💬 End-to-end ownership + product influence 🌍 Flexible location (London/Athens hubs) Key Responsibilities Architect and implement the backend platform for data processing, search, and advanced reasoning Design scalable systems and APIs for data-intensive, low-latency workflows Optimize database interactions for high-speed visual search and reasoning Manage cloud … just “how” What You’ll Need Essential Skills Startup Mindset: Bias for action, ownership, comfort with ambiguity Backend Development: Python (FastAPI, Flask) + microservices Distributed Systems: Scaling high-volume data systems Cloud: AWS/GCP/Azure (ECS/EKS, S3, Lambda, IAM or similar) Databases: PostgreSQL + strong data modeling Containers: Docker; orchestration tools Infra as Code More ❯

Role Title: Salesforce Data Cloud Technical Architect Location: London/Manchester/Leeds/Birmingham Salary: Competitive salary and package dependent on experience Career Level: Associate Manager to Manager Accenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across all of these services. … global team, you'll be working with cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. As a Salesforce Data Cloud Technical Architect, you will: Work as part of an integrated Accenture and client team, defining, architecting, designing, delivering and deploying Data Cloud based solutions to our clients … Design and implement end-to-end data architectures across Salesforce Data Cloud and other Salesforce Core Clouds (Sales, Service, Marketing, Commerce), with a strong focus on data ingestion, unification, and scalable target activation. Drive creativity and innovation in solutions to deliver value for clients and Accenture Support pre-sales activities including shaping and presenting solutions, and More ❯

fraudulent registrations out of 1 million annually — and saving the UK taxpayer hundreds of millions in lost revenue. To enhance these capabilities, the team is migrating and automating data ingestion and risk analytics processes within the SAS Viya 4 platform, leveraging 20+ data sources from the Minerva Oracle estate. This new test role sits at the heart … of that transformation — ensuring that automated testing, data quality, and performance assurance are embedded into every stage of delivery. The Role: We’re looking for a Network Test Specialist/Test Automation Engineer with strong experience in data and analytics platforms, ideally including SAS Viya. You’ll join a newly formed agile team within the Minerva platform programme … working closely with developers, DevOps engineers, and analysts to build robust automated test frameworks supporting the ingestion, analytics, and Intelligent Decisioning capabilities of the platform. You’ll own the automation test strategy, build frameworks from the ground up, integrate them into CI/CD pipelines, and ensure that every component — from data pipelines to user interfaces — is validated More ❯

fraudulent registrations out of 1 million annually - and saving the UK taxpayer hundreds of millions in lost revenue. To enhance these capabilities, the team is migrating and automating data ingestion and risk analytics processes within the SAS Viya 4 platform, leveraging 20+ data sources from the Minerva Oracle estate. This new test role sits at the heart … of that transformation - ensuring that automated testing, data quality, and performance assurance are embedded into every stage of delivery. The Role: We're looking for a Network Test Specialist/Test Automation Engineer with strong experience in data and analytics platforms, ideally including SAS Viya. You'll join a newly formed agile team within the Minerva platform programme … working closely with developers, DevOps engineers, and analysts to build robust automated test frameworks supporting the ingestion, analytics, and Intelligent Decisioning capabilities of the platform. You'll own the automation test strategy, build frameworks from the ground up, integrate them into CI/CD pipelines, and ensure that every component - from data pipelines to user interfaces - is validated More ❯

between rapid AI development and the stringent security and compliance requirements of the financial industry. You will design and implement robust, scalable, and secure MLOps platforms that enable our data scientists to innovate safely and at speed, ensuring the integrity, confidentiality, and availability of our models and data. Key Responsibilities Secure MLOps Platform Engineering: Design, implement, and manage secure … automated CI/CD pipelines specifically for machine learning models (MLOps), integrating security checks (SAST, DAST, SCA) and data validation gates. AI/ML Infrastructure Security: Harden and secure the underlying cloud infrastructure for AI/ML workloads, including GPU clusters, container orchestration (Kubernetes), and managed services (e.g., AWS SageMaker, Azure ML). Security by Design: Embed security controls … into every stage of the ML lifecycle (data ingestion, feature store, model training, deployment, monitoring). Implement secrets management, network security (firewalls, VPCs), and identity and access management (IAM) for data and model assets. Compliance & Governance: Ensure the MLOps platform adheres to stringent financial industry regulations (e.g., GDPR, SOX, PCI-DSS, SWIFT CSCF) and internal policies (Model More ❯

highly motivated Lead Software Engineer with deep expertise in Artificial Intelligence (AI) , Machine Learning (ML) , and Python development to lead the design, development, and deployment of intelligent systems and data-driven applications for a leading client in London. The ideal candidate will have a strong background in AI/ML frameworks, scalable system design, and Python-based development, along … architecture and development of AI/ML solutions, ensuring scalable and efficient design. Design and implement ML models and algorithms (classification, regression, NLP, etc.) using modern frameworks. Collaborate with data scientists, engineers, and product teams to transform prototypes into production-grade applications. Optimize model performance and manage end-to-end ML lifecycle (data ingestion, training, evaluation, deployment … . Mentor junior engineers and contribute to code reviews, best practices, and technical decision-making. Implement MLOps pipelines for continuous training, deployment, and monitoring of models. Ensure compliance with data privacy and security regulations (GDPR, etc.). Required Skills & Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, AI, or related field. 7+ years of professional software More ❯

Among your responsibilities, you will: Own and influence architecture decisions across the Portfolio, ensuring it is in alignment with BCG standards, and design principles. Own the annual DDP refresh (Data & Digital Platforms) architecture for the portfolio that covers tech maturity, road mapping, integrations, security, and data strategies. Create reference architecture focused on design principles, detailed APIs, and major … Valuing simplicity and being unafraid to challenge technical constraints and procedures to enable an agile, high-performing team. Comfortable partnering with Product Owners and technical leadership and providing a data-driven approach to decision making, both in the day-to-day management and in making strategic trade-offs Committing to cross-functional collaboration to achieve the best results for … decisions Being flexible to be available outside of normal business hours for international calls as needed What You'll Bring Education and Certifications Bachelor's degree in information science, data management, computer science or related field. 15+ years of relevant experience in IT architecture with strong technical background, preferably in large international organizations Experience with scalable architectures, API management More ❯

Python Engineer Permanent | Fully remote (UK based only) Sports Trading | Start up What you’ll tackle Translate data-flow headaches into buildable tech projects, managing data pipelines Python engineering to stand-up analytics services, REST APIs and lightweight front-ends. Data ingestion (SQL, files, feeds), business logic, web/UI, CI pipelines and Linux deployment. White … board with quants, ask clarifying questions, iterate live and keep comms flowing. What you need 3 + years building production-grade Python systems for data-heavy businesses; comfortable with tests, version control and optimisation. Confident SQL , exposure to REST and messaging (Rabbit, Kafka, etc.), and enough Linux to troubleshoot on the command line. Solid grounding in financial products & risk More ❯

AI/ML products who thrives in dynamic, fast-paced environments and enjoys working closely with small, high-impact teams. You will lead initiatives involving AI-driven system upgrades, data platform modernization, and greenfield builds, collaborating directly with director-level stakeholders to align technical innovation with business outcomes. Your work will help shape intelligent solutions that drive measurable value … through automation, personalization, and data insights. Key Responsibilities Own and manage the product backlog with a focus on AI/ML feature development, turning business needs into actionable user stories and clear acceptance criteria. Lead end-to-end initiatives involving AI-powered applications, from data ingestion and model deployment to user-facing functionality. Collaborate with data … customer, advocating for responsible AI adoption and transparency across the product lifecycle. Skills & Experience Proven experience as a Product Owner (or similar role) working on AI/ML or data-driven products in agile/scrum teams. Demonstrated success leading AI product development, including model integrations, intelligent workflows, or predictive analytics. Strong ability to translate complex AI concepts into More ❯

of solutions Drive architectural and design decisions, ensuring scalable, resilient systems built on sound engineering principles and best practices Partner with clients to define and evolve their technology and data strategy, modernizing infrastructure, architecture, and technology stacks Utilize DevOps tools and practices to automate and streamline the build and deployment processes Work closely with Data Scientists and Engineers … to deliver robust, production-level AI and Machine Learning systems Develop frameworks and tools for efficient data ingestion from diverse and complex sources Operate in short, iterative sprints, delivering working software aligned with clear deliverables and client-defined deadlines Demonstrate flexibility by learning and working across multiple programming languages and technologies as required Additional Responsibilities: Actively contribute to … an added advantage Understanding of web APIs, contracts and communication protocols Understanding of Cloud platforms, infra-automation/DevOps, IaC/GitOps/Containers, design and development of large data platforms A maker’s mindset - To be resourceful and have the ability to do things that have no instructions What will you experience in terms of culture at Sahaj More ❯

of solutions Drive architectural and design decisions, ensuring scalable, resilient systems built on sound engineering principles and best practices Partner with clients to define and evolve their technology and data strategy, modernizing infrastructure, architecture, and technology stacks Utilize DevOps tools and practices to automate and streamline the build and deployment processes Work closely with Data Scientists and Engineers … to deliver robust, production-level AI and Machine Learning systems Develop frameworks and tools for efficient data ingestion from diverse and complex sources Operate in short, iterative sprints, delivering working software aligned with clear deliverables and client-defined deadlines Demonstrate flexibility by learning and working across multiple programming languages and technologies as required Additional Responsibilities: Actively contribute to … an added advantage Understanding of web APIs, contracts and communication protocols Understanding of Cloud platforms, infra-automation/DevOps, IaC/GitOps/Containers, design and development of large data platforms A maker’s mindset - To be resourceful and have the ability to do things that have no instructions What will you experience in terms of culture at Sahaj More ❯

of solutions Drive architectural and design decisions, ensuring scalable, resilient systems built on sound engineering principles and best practices Partner with clients to define and evolve their technology and data strategy, modernizing infrastructure, architecture, and technology stacks Utilize DevOps tools and practices to automate and streamline the build and deployment processes Work closely with Data Scientists and Engineers … to deliver robust, production-level AI and Machine Learning systems Develop frameworks and tools for efficient data ingestion from diverse and complex sources Operate in short, iterative sprints, delivering working software aligned with clear deliverables and client-defined deadlines Demonstrate flexibility by learning and working across multiple programming languages and technologies as required Additional Responsibilities: Actively contribute to … an added advantage Understanding of web APIs, contracts and communication protocols Understanding of Cloud platforms, infra-automation/DevOps, IaC/GitOps/Containers, design and development of large data platforms A maker’s mindset - To be resourceful and have the ability to do things that have no instructions What will you experience in terms of culture at Sahaj More ❯

of solutions Drive architectural and design decisions, ensuring scalable, resilient systems built on sound engineering principles and best practices Partner with clients to define and evolve their technology and data strategy, modernizing infrastructure, architecture, and technology stacks Utilize DevOps tools and practices to automate and streamline the build and deployment processes Work closely with Data Scientists and Engineers … to deliver robust, production-level AI and Machine Learning systems Develop frameworks and tools for efficient data ingestion from diverse and complex sources Operate in short, iterative sprints, delivering working software aligned with clear deliverables and client-defined deadlines Demonstrate flexibility by learning and working across multiple programming languages and technologies as required Additional Responsibilities: Actively contribute to … an added advantage Understanding of web APIs, contracts and communication protocols Understanding of Cloud platforms, infra-automation/DevOps, IaC/GitOps/Containers, design and development of large data platforms A maker’s mindset - To be resourceful and have the ability to do things that have no instructions What will you experience in terms of culture at Sahaj More ❯

of solutions Drive architectural and design decisions, ensuring scalable, resilient systems built on sound engineering principles and best practices Partner with clients to define and evolve their technology and data strategy, modernizing infrastructure, architecture, and technology stacks Utilize DevOps tools and practices to automate and streamline the build and deployment processes Work closely with Data Scientists and Engineers … to deliver robust, production-level AI and Machine Learning systems Develop frameworks and tools for efficient data ingestion from diverse and complex sources Operate in short, iterative sprints, delivering working software aligned with clear deliverables and client-defined deadlines Demonstrate flexibility by learning and working across multiple programming languages and technologies as required Additional Responsibilities: Actively contribute to … an added advantage Understanding of web APIs, contracts and communication protocols Understanding of Cloud platforms, infra-automation/DevOps, IaC/GitOps/Containers, design and development of large data platforms A maker’s mindset - To be resourceful and have the ability to do things that have no instructions What will you experience in terms of culture at Sahaj More ❯

who is responsible for designing enterprise AI solutions that align with business objectives while ensuring scalability, security, and efficiency. This role translates business needs into AI-driven architectures (across data ingestion, models and operational workflows), ensuring feasibility, cost-effectiveness, and adherence to industry best practices and firmwide standards. The AI Solution Architect works closely with the sales teams … existing IT infrastructure. This role is for you if you have: Proven experience architecting AI-driven solutions for enterprise customers, collaborating with sales and engineering teams. Ability to assess data dependencies, business constraints, and success criteria to deliver AI solutions that meet user and business needs. Expertise in AI Solution Architecture, including LLM/SLM (Large Language Models/… Security & FinOps, including AI landing zones, model refinement and testing, and compliance strategies. Experience in Enterprise AI Design, focusing on scalable, secure, and cost-effective AI integration. Understanding of data science principles, enabling informed evaluation of machine learning and statistical models. What you'll receive from us: No matter where you may be in your career or personal life More ❯

and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure as code (Terraform, or similar) for … or similar model management systems. Practical knowledge of infrastructure as code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent). Understanding of ML concepts. … and reproducibility, but you also enable teams to ship fast. Nice to Have Experience delivering API services (FastAPI, SpringBoot or similar). Experience with message brokers and real-time data and event processing (Kafka, Pulsar, or similar). Why Join Us You'll be part of a small, high-output team where intensity and focus are the norm. You More ❯

and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure as code (Terraform, or similar) for … or similar model management systems. Practical knowledge of infrastructure as code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent). Understanding of ML concepts. … and reproducibility, but you also enable teams to ship fast. Nice to Have Experience delivering API services (FastAPI, SpringBoot or similar). Experience with message brokers and real-time data and event processing (Kafka, Pulsar, or similar). Why Join Us You'll be part of a small, high-output team where intensity and focus are the norm. You More ❯