151 to 175 of 182 Data Ingestion Jobs in England

and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure as code (Terraform, or similar) for … or similar model management systems. Practical knowledge of infrastructure as code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent). Understanding of ML concepts. … and reproducibility, but you also enable teams to ship fast. Nice to Have Experience delivering API services (FastAPI, SpringBoot or similar). Experience with message brokers and real-time data and event processing (Kafka, Pulsar, or similar). Why Join Us You'll be part of a small, high-output team where intensity and focus are the norm. You More ❯

and scale reliable, high-performing software in both private and public cloud environments, then the GCI and TRR teams are the perfect fit for you. Here, we focus on Data ingestion, backup, and unified search & Export for our archiving, e-discovery and compliance customers for different data types, as well as delivering Best-in-class user reporting … code. Experience with performance/scalability testing of backend systems and APIs. Experience testing applications that interact with PostgreSQL or similar databases, including writing queries for validation and verifying data integrity. Experience testing applications running in Kubernetes environments. Familiarity with using monitoring and observability tools like Grafana to support test analysis and validation. Experience troubleshooting and supporting customers with … offer of employment will be subject to your successful completion of applicable background checks, conducted in accordance with local law. About Us We save companies the embarrassment of awkward data slip ups by disrupting cybercriminal activity. We think fast, go big and always demand more. We work hard, deliver - and repeat. We grow with meaningful determination. And put success More ❯

frameworks like LangChain, LangGraph, and the Google Agent Development Kit (ADK). Develop and Evaluate RAG Pipelines: Engineer and optimize end-to-end Retrieval-Augmented Generation (RAG) systems, including data ingestion, chunking strategies, and implementing rigorous pipeline evaluation frameworks for accuracy and performance. Fine-Tune & Optimize LLMs: Implement advanced model customization techniques, including PEFT (Parameter-Efficient Fine-Tuning More ❯

frameworks like LangChain, LangGraph, and the Google Agent Development Kit (ADK). Develop and Evaluate RAG Pipelines: Engineer and optimize end-to-end Retrieval-Augmented Generation (RAG) systems, including data ingestion, chunking strategies, and implementing rigorous pipeline evaluation frameworks for accuracy and performance. Fine-Tune & Optimize LLMs: Implement advanced model customization techniques, including PEFT (Parameter-Efficient Fine-Tuning More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯

really do and delivering rapid-fire prototypes that become mission-critical apps. What you’ll tackle Spot the pain-points across Equities, Credit, Rates and central Risk teams; translate data-flow headaches into buildable tech projects. Prototype at pace in Python—leveraging LLM co-pilots—to stand-up analytics services, REST APIs and lightweight Dash/React front-ends. … Own the full stack: data ingestion (SQL, files, feeds), business logic, web/UI, CI pipelines and Linux deployment. Codify best practice for safe, auditable LLM-assisted development; lead code reviews and knowledge-share sessions. Stay user-facing —white-board with quants, ask clarifying questions, iterate live and keep comms flowing. You in a nutshell 5 + years … building production-grade Python systems for data-heavy businesses; comfortable with tests, version control and optimisation. Confident SQL , exposure to REST and messaging (Rabbit, Kafka, etc.), and enough Linux to troubleshoot on the command line. UI chops in Dash, Flask or React to whip up proof-of-concept dashboards. Solid grounding in financial products & risk metrics —equities, bonds and More ❯

really do and delivering rapid-fire prototypes that become mission-critical apps. What you’ll tackle Spot the pain-points across Equities, Credit, Rates and central Risk teams; translate data-flow headaches into buildable tech projects. Prototype at pace in Python—leveraging LLM co-pilots—to stand-up analytics services, REST APIs and lightweight Dash/React front-ends. … Own the full stack: data ingestion (SQL, files, feeds), business logic, web/UI, CI pipelines and Linux deployment. Codify best practice for safe, auditable LLM-assisted development; lead code reviews and knowledge-share sessions. Stay user-facing —white-board with quants, ask clarifying questions, iterate live and keep comms flowing. You in a nutshell 5 + years … building production-grade Python systems for data-heavy businesses; comfortable with tests, version control and optimisation. Confident SQL , exposure to REST and messaging (Rabbit, Kafka, etc.), and enough Linux to troubleshoot on the command line. UI chops in Dash, Flask or React to whip up proof-of-concept dashboards. Solid grounding in financial products & risk metrics —equities, bonds and More ❯

really do and delivering rapid-fire prototypes that become mission-critical apps. What you’ll tackle Spot the pain-points across Equities, Credit, Rates and central Risk teams; translate data-flow headaches into buildable tech projects. Prototype at pace in Python—leveraging LLM co-pilots—to stand-up analytics services, REST APIs and lightweight Dash/React front-ends. … Own the full stack: data ingestion (SQL, files, feeds), business logic, web/UI, CI pipelines and Linux deployment. Codify best practice for safe, auditable LLM-assisted development; lead code reviews and knowledge-share sessions. Stay user-facing —white-board with quants, ask clarifying questions, iterate live and keep comms flowing. You in a nutshell 5 + years … building production-grade Python systems for data-heavy businesses; comfortable with tests, version control and optimisation. Confident SQL , exposure to REST and messaging (Rabbit, Kafka, etc.), and enough Linux to troubleshoot on the command line. UI chops in Dash, Flask or React to whip up proof-of-concept dashboards. Solid grounding in financial products & risk metrics —equities, bonds and More ❯

really do and delivering rapid-fire prototypes that become mission-critical apps. What you’ll tackle Spot the pain-points across Equities, Credit, Rates and central Risk teams; translate data-flow headaches into buildable tech projects. Prototype at pace in Python—leveraging LLM co-pilots—to stand-up analytics services, REST APIs and lightweight Dash/React front-ends. … Own the full stack: data ingestion (SQL, files, feeds), business logic, web/UI, CI pipelines and Linux deployment. Codify best practice for safe, auditable LLM-assisted development; lead code reviews and knowledge-share sessions. Stay user-facing —white-board with quants, ask clarifying questions, iterate live and keep comms flowing. You in a nutshell 5 + years … building production-grade Python systems for data-heavy businesses; comfortable with tests, version control and optimisation. Confident SQL , exposure to REST and messaging (Rabbit, Kafka, etc.), and enough Linux to troubleshoot on the command line. UI chops in Dash, Flask or React to whip up proof-of-concept dashboards. Solid grounding in financial products & risk metrics —equities, bonds and More ❯

chain transaction flows. Role Overview The Senior Backend Engineer will contribute to the design, development, and optimization of core blockchain infrastructure systems, with a particular focus on Ethereum transaction data and Geth integration. The successful candidate will work closely with a globally distributed engineering team to deliver highly performant and reliable backend services supporting real-time transaction analytics. Responsibilities … Design and implement backend services for mempool and transaction data ingestion, processing, and visualization. Work on Geth integration and extend core Ethereum node functionality. Develop and maintain APIs and services enabling real-time transaction insight. Optimize system performance, reliability, and scalability for large-scale data environments. Collaborate with cross-functional teams to support research, product, and infrastructure … P2P networks , transaction propagation , and blockchain consensus mechanisms. Experience designing and maintaining distributed backend systems. Proficiency in Go , Rust , or similar system-level languages. Strong grasp of software architecture, data pipelines, and observability practices. Excellent communication skills and ability to work effectively in a remote, collaborative environment. What’s Offered Competitive base compensation and meaningful equity. Fully remote role More ❯

XML, DITA, CMS). • Ensure seamless integration with engineering systems (PLM, ERP) and digital twin environments. Governance & Compliance • Establish architecture governance frameworks to ensure consistency, scalability, and compliance. • Define data models, metadata standards, and content lifecycle policies. • Ensure adherence to cybersecurity, regulatory, and quality standards in aerospace. Stakeholder Engagement & Leadership • Collaborate with engineering, product, IT, and documentation teams to … Familiarity with publishing engines viz. XML Professional Publisher, Framemaker Publishing, Oxygen Publishing, etc • Familiarity with business workflow mgmt. tools – BREX, Schematron, Activiti, etc • Working knowledge with logging & monitoring and Data Ingestion Transformation Analytics • Familiarity with IETP/IETM tools – Nivomax viewer, RWS LiveContent, CORENA IETP, Pinpoint, etc • Extensive Systems Architecture experience • Effective communication, presentation, and interpersonal skills • Ability More ❯

design, test and deploy AI projects. Azure AI/ML Engineer, key responsibilities: Build, develop and deploy AI applications using Python Design and Develop AI services Setup and develop data ingestion pipelines and components Develop search related components using Azure AI Search Developing and deploying AI/ML models Built and maintain scalable, high-performance AI apps on More ❯

design, test and deploy AI projects. Azure AI/ML Engineer, key responsibilities: Build, develop and deploy AI applications using Python Design and Develop AI services Setup and develop data ingestion pipelines and components Develop search related components using Azure AI Search Developing and deploying AI/ML models Built and maintain scalable, high-performance AI apps on More ❯

Work mode: Hybrid, 3 days working from client office Contract duration: Location: Birmingham, UK --------------------------------------- JOB DETAILS Role Title: Splunk SRE Engineer Responsible for leading and executing the migration of data, dashboards, alerts, and configurations from Splunk systems to Elasticsearch. This role involves deep technical expertise in Splunk architecture, data ingestion, and observability tools, along with strong project … communication skills -strong project management Responsibilities: Minimum number of relevant years of experience: 5 Detailed Job Description: -Ability to deploy and configure Elasticsearch, Logstash, Kibana for centralized logging/data analytics; setting up ELK clusters with high availability/optimization -Proficiency in containerization using Docker and orchestration with Kubernetes, ensuring effective management and scaling of containerized applications in all More ❯

I am working with a client in the education sector who are looking for a data engineer with experience across architect & strategy to join on a part-time 12 month contract.1-2 days per weekFully remoteOutside IR35Immediate start12 month contract Essential Been to school in the UK Data Ingestion of APIs GCP based (Google Cloud Platform) Snowflake More ❯

I am working with a client in the education sector who are looking for a data engineer with experience across architect & strategy to join on a part-time 12 month contract. 1-2 days per week Fully remote Outside IR35 Immediate start 12 month contract Essential Been to school in the UK Data Ingestion of APIs GCP More ❯

commercial, military, business, and general aviation aircraft. An MFT (Managed File Transfer) admin is responsible for managing and maintaining the MFT platform, ensuring the secure and reliable transfer of data between different systems and partners. This includes creating and managing connections, configuring security settings, managing user permissions, monitoring transfer activity, and troubleshooting issues. Key responsibilities: Design, deploy, and support … InfoArchive solutions based on business requirements. Perform installation, configuration, and upgrades of the InfoArchive platform on UNIX systems. Develop and manage data ingestion pipelines into InfoArchive from various enterprise applications. Monitor and tune PostgreSQL databases used by InfoArchive for performance and stability. Write and optimize scripts for automation, maintenance, and monitoring of archive processes. Collaborate with application, infrastructure … and compliance teams for integration and data governance. Troubleshoot production issues related to InfoArchive and its underlying components (UNIX, DB). Document architecture, configurations, procedures, and troubleshooting guides. Key Skills/Knowledge Hands-on experience with OpenText InfoArchive – design, deployment, and maintenance. Strong proficiency in UNIX/Linux environments (shell scripting, system commands, etc.). Expertise in PostgreSQL administration More ❯

commercial, military, business, and general aviation aircraft. An MFT (Managed File Transfer) admin is responsible for managing and maintaining the MFT platform, ensuring the secure and reliable transfer of data between different systems and partners. This includes creating and managing connections, configuring security settings, managing user permissions, monitoring transfer activity, and troubleshooting issues. Key responsibilities: Design, deploy, and support … InfoArchive solutions based on business requirements. Perform installation, configuration, and upgrades of the InfoArchive platform on UNIX systems. Develop and manage data ingestion pipelines into InfoArchive from various enterprise applications. Monitor and tune PostgreSQL databases used by InfoArchive for performance and stability. Write and optimize scripts for automation, maintenance, and monitoring of archive processes. Collaborate with application, infrastructure … and compliance teams for integration and data governance. Troubleshoot production issues related to InfoArchive and its underlying components (UNIX, DB). Document architecture, configurations, procedures, and troubleshooting guides. Key Skills/Knowledge Hands-on experience with OpenText InfoArchive – design, deployment, and maintenance. Strong proficiency in UNIX/Linux environments (shell scripting, system commands, etc.). Expertise in PostgreSQL administration More ❯

built models for digital human, voice localization and best of breed image & video generation models in the industry. The current products include: An agentic AI platform with high-quality data ingestion and conversational interfaces. Tools for content creation, automation, and reuse via AI-powered content studio agents. Media asset management, video collaboration, and supply chain components designed for … high-performance Product team including PMs, POs, and UI/UX • Instil a performance culture with measurable success criteria (OKRs, adoption, monetisation, retention). • Foster close partnership with Engineering, Data, Commercial, and GTM leads. Cross-Functional and Executive Alignment • Act as a bridge between technical innovation and executive vision. Collaborate with the Chief Innovation Officer, CTO, Product Owners and … cross-functional collaboration skills. Preferred Qualifications Background in AI-driven, synthetic media, or generative content technologies. Familiarity with product licensing models (SaaS, enterprise sales, usage-basedpricing). Understanding of data provenance, consent management, and ethical AIpractices. Experience working in a startup or growth-stage company that has scaled tomaturity. Familiarity with localisation and global product considerations is a plus. More ❯

Crime Enhancement Project focused on Sanctions and PEP screening. What you'll do: Administer and configure LexisNexis Bridger Insight for sanctions and PEP screening workflows. Run screening jobs, manage data ingestion, and generate reports within Bridger. Set up users, permissions, and workflows tailored to project requirements. Collaborate with internal teams and external consultants to backfill and transition responsibilities. … Strong understanding of Sanctions and PEP screening processes. Background in Financial Crime, AML, or Compliance projects. Ability to manage screening engines, workflows, and user configurations. Comfortable running jobs, handling data files, and producing reports specific to Bridger functionality. Next steps We have a diverse workforce and an inclusive culture at M&G plc, underpinned by our policies and our More ❯

Crime Enhancement Project focused on Sanctions and PEP screening. What you'll do: Administer and configure LexisNexis Bridger Insight for sanctions and PEP screening workflows. Run screening jobs, manage data ingestion, and generate reports within Bridger. Set up users, permissions, and workflows tailored to project requirements. Collaborate with internal teams and external consultants to backfill and transition responsibilities. … Strong understanding of Sanctions and PEP screening processes. Background in Financial Crime, AML, or Compliance projects. Ability to manage screening engines, workflows, and user configurations. Comfortable running jobs, handling data files, and producing reports specific to Bridger functionality. Next steps We have a diverse workforce and an inclusive culture at M&G plc, underpinned by our policies and our More ❯