76 to 100 of 121 Remote Data Ingestion Jobs

prominent IT solutions provider is seeking a remote Sr. Data Engineer. This role involves designing and developing data ingestion solutions, contributing to data product expansion, and collaborating with diverse stakeholders. The successful applicant will focus on building reliable data pipelines and enhancing data delivery … processes. Strong experience in data processing and collaboration skills are essential. The position is open to both permanent and contract arrangements with a competitive salary based on market rates. #J-18808-Ljbffr ...

developed tools such as dashboards and portfolio management utilities). The engineer will play a key role in modernizing the platform architectures while improving data pipelines, system reliability, and development standards. You will work in a fast-paced environment requiring strong expertise in data engineering, application development … e.g., GitHub Copilot, Claude, ChatGPT, AWS Bedrock) for coding, tests, documentation, and prototyping; set review standards for AI‐generated code. Design, build, and maintain data engineering workflows and platform services supporting the Vision platform and model delivery ecosystemDevelop and extend platform components responsible for data ingestion, transformation ...

process, driving much of the testing at all stages. Experience in trading systems architecture: Familiarity with Order Management Systems (OMS), exchange gateway connectivity, market data ingestion and processing, as well as high-throughput, low-latency systems. You take a pragmatic approach to developing clean solutions to complex problems. … Basic understanding of algorithms, data structures, databases and distributed systems is must. Compensation & perks Full-time salary based on experience and meaningful equity in an industry-leading company Role based in our London office, with a mandatory in-office presence four days per week Work from Anywhere Policy ...

Citi Tech. In this role, you will be directly responsible for leading the technical design, development, and optimization of our regulatory reporting framework and data pipelines, with a strong focus on onboarding new regulations. This is an active engineering leadership position where you will guide a team of developers … write clean, production-grade code, design system components, and troubleshoot complex data processing issues. You will work closely within an Agile team, collaborating with business analysts and other engineers to translate regulatory requirements into reliable, scalable software solutions. Lead and Mentor: Guide and support a team of software engineers ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description As a Senior Regulatory Data Developer, you'll modernise complex reporting pipelines and build scalable cloud architectures that process high-volume data with pinpoint accuracy. Our Data Engineering department powers high-volume data platforms that support 24/7 global operations. Within this function, the Regulatory Data team builds and maintains batch and near real-time pipelines that transform complex operational data into precise reporting outputs. In this hands-on technical role ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description As a Senior Regulatory Data Developer, you'll modernise complex reporting pipelines and build scalable cloud architectures that process high-volume data with pinpoint accuracy. Our Data Engineering department powers high-volume data platforms that support 24/7 global operations. Within this function, the Regulatory Data team builds and maintains batch and near real-time pipelines that transform complex operational data into precise reporting outputs. In this hands-on technical role ...

support means today. The role: This is an exciting opportunity to join a fast-growing, Private Equity backed business at a time when our Data and Analytics function is central to the next phase of growth. The team sits across every division, acquisition and product at Focus Group … analytics products from start to finish, lead projects that cut across operations, finance and every part of the group, and turn data into decisions the business can act on. You'll be a key voice in giving our executive leadership team the tools they need to make fast, accurate ...

Global Banking Markets - Software Engineer - Equities Data Platform Engineering - London - Vice President location_on London, Greater London, England, United Kingdom The Equities Data Platform team is core to delivering real-time analytics and handling critical fiduciary functions for Goldman Sachs' Electronic Trading business across Equities and Listed Options. … excited by the challenge of engineering systems that process massive volumes of business-critical data in real time, this is your opportunity to make a real impact. As a senior contributor, you will be one of the senior engineers leading the platform, owning the architecture and delivery ...

data solutions company located in Cheltenham is seeking a Data Engineer to develop and operate a Data Collection Hub, ensuring reliable data ingestion and processing. The ideal candidate will have over 2 years of experience in building production software systems, with proficiency in Python ...

evolving threatsusing ground-breaking technology. Key Responsibilities Decompose high-level features/requirementsinto user stories, acceptance criteria, and clear backlog prioritization. Collaborate with engineering, data science, andsolutions teamsto deliver high-quality TM features (real-time and batch pipelines,detection analytics,alert scoring,alert/case creation, feedback loops). … release validation. Monitor metrics (alert volumes, false positives, investigator throughput, conversion rates) and iterate tooptimize. Manage dependencies with external systems (watchlists, screening, sanctions feeds, data enrichment, client data ingestion). Create or update product documentation, user guides, runbooks, and support internal teams (sales, services, support). Stay ...

# D365 Finance & Operations transformation12 Jun 2025We’re working on a large-scale D365 Finance & Operations transformation and are looking for a hands-on Data Engineer to join the programme on a 6–12 month contract. Remote-first (UK) 6–12 months | Outside IR35 £550- £600pdYou’ll play … role in building scalable Azure/Databricks data pipelines to support a global F&O deployment — ideal for someone who thrives in delivery-focused, fast-paced environments.Essential Skills: Proven experience with D365 Finance & Operations (F&O) data migrations or engineering Strong expertise in Azure (Data Factory, Synapse ...

Presales Architect – Data/Microsoft Fabric - £80,000 - £100,000 + 20% bonus – Home based We are looking for an experienced Presales Architect specialising in Data and specifically Microsoft Fabric to join a growing Microsoft-focused Managed Service Provider. This is a highly consultative role where you will … intersection of technology, customers and sales, helping organisations understand how modern Microsoft data technologies can solve complex business challenges. You will take ownership of the technical solution throughout the presales lifecycle, from initial discovery and requirements gathering through to solution design, proposals, demonstrations and handover into delivery. Microsoft Fabric ...

helping them define the right problems, shape solutions, and deliver technology-driven outcomes that create measurable business value. Our expertise spans software engineering, AI & data, product development, and customer experience, delivered by teams that combine strong technical depth with a consulting mindset. Why Join Us? If you are looking … solving complex, high-stakes financial challenges through technology. This is a deliberately broad and hands-on role. You will move fluently across frontend, backend, data, cloud infrastructure, and applied AI, owning solutions end-to-end, from a whiteboard session with a deal or risk team, through rapid prototyping ...

architecture, scalability and platform evolution, connecting technical decisions to product and business outcomes Collaborating on systems that involve the full ML lifecycle from data ingestion and preprocessing, to model deployment, integration, and performance monitoring Driving innovation by proactively surfacing new technical approaches and product solutions Leading or initiating … encourage applicants with experience in the following areas: Platform engineering: building reusable software foundations, internal developer platforms, and infrastructure that other teams build on Data Engineering: including platforms like Databricks for data processing and analytics Delivering production agentic systems, including RAG pipelines, vector search, and agentic frameworks such ...

AppyWay is the industry-leading SaaS solution decarbonising cities by empowering local authorities to digitally manage their kerbside and share kerbside data with fleets and drivers. Our journey began with AppyParking, an app born from the frustration of finding and understanding parking on the streets of London. During … clear that cities lacked shareable, machine-readable, standardised parking restriction data. So we built the UK's largest set of standardised kerbside data, in turn discovering the untapped potential beneath everyone's feet. Today, we're Europe's leading intelligent kerbside platform, helping cities and drivers optimise operations ...

position into something more powerful: a source of truth. You will build the infrastructure that captures, stores, and surfaces build provenance and pipeline usage data — so that when a customer asks which of their services consumed a given artifact, and what build produced it, the answer is in Cloudsmith … support a global set of customers who are engineers like us. Key Responsibilities Build: Design, implement, and ship the provenance ingestion service — capable of accepting provenance and attestation payloads from CI/CD systems, public registries, signed bundles, and customer-uploaded artifacts across a wide range of formats (SLSA ...

researchers every year. You will lead a team of backend and database developers and work closely with the product team, machine learning engineers and data scientists to shape the next generation of literature discovery and AI-powered research services. Working alongside the Literature Services Team Lead, Product Lead … Data Science Lead, you will help define the technical strategy for Europe PMC, ensuring the platform continues to scale while delivering innovative capabilities that support modern scientific research. Europe PMC contains more than 11 million full-text articles and preprints, together with 45 million abstracts, enriched with citations, links ...

Salary Range £107,304 - £126,240 We support flexible working – Flexible Working Options Hybrid Working Job Description Summary . Job Description JOB TITLE: Data & ML Platform Lead SALARY: £107,304 - £126,240 LOCATION: London HOURS: Full-Time WORKING PATTERN Our work style is hybrid, which involves spending at least … supported with workplace adjustments including hybrid working expectations in line with our Flexibility Works policy. What you’ll be doing... As a Data & ML Platform Lead, you will lead the team responsible for building and operating the infrastructure at the core of Curve’s business. ...

that deliver measurable value in real-world commercial environments . You will work across agent orchestration, LLM and vision-language model integration, retrieval, multimodal data, evaluation and production infrastructure. You'll be expected to understand not only how to make an AI system work, but how to make … into reasoning, retrieval, summarisation and task-execution workflows. Build retrieval, memory, evaluation and guardrail capabilities around AI systems. Design and implement production pipelines covering data ingestion, processing and inference. Build search and retrieval systems across very large multimodal datasets, including text, imagery, telemetry and sensor data. Design indexing ...

Software Engineer - Senior Department: Factor Employment Type: Permanent - Full Time Location: London, UK Description Factor is an API driven, AI powered retail data platform for global energy utilities. We use deep machine learning to help energy retailers accurately value the energy they sell: improving margins, unlocking more competitive customer … priced, forecast, and delivered globally. As a senior engineer, you will play a pivotal role in developing the core of our system: scalable data pipelines, pricing engines, and APIs that support real time decision making for energy retailers and their customers. You’ll work in a highly capable senior ...

About the job you’re consideringThe continued digitisation of our clients' businesses and the growing complexity of modern technology estates generate vast volumes of data and telemetry. The real value lies in making sense of those signals, building a coherent view of service health and business impact, and turning … complex challenges into clear architectural decisions.Lead the end-to-end architecture of the Splunk platform, including scalability, resilience, security, performance, and lifecycle management.Define telemetry, data-ingestion and integration patterns across applications, infrastructure, cloud, networks and service management.Own architecture governance for the observability domain, including HLDs, reference architectures, standards ...

maintainable, and built to scale, adhering to secure development principles. Governance: Implement solutions in line with our AI governance framework, encompassing factors such as data handling, audit logging, human-in-the-loop controls, and regulatory compliance. Cost Management: Monitor and optimise LLM API usage and infrastructure costs, implementing strategies … vector databases: context windows, temperature and sampling parameters, system prompts, tool/function calling. Experience of implementing RAG pipelines end-to-end, including data ingestion, chunking strategies, embedding model selection, and retrieval tuning. Experience of implementing parsing pipelines for tasks such as document processing/ingestion, including ...

backend services that power the platform, from ingesting MQTT traffic from thousands of deployed devices through to APIs and internal services that ensure data remains reliable and consistent. This is an opportunity for someone who enjoys genuine ownership. You'll deploy the services you build, take responsibility for them … production operations. Your responsibilities will include: Designing, building and maintaining production-grade Python services supporting thousands of deployed smart meters. Developing and supporting data ingestion services handling MQTT traffic from connected devices. Building APIs and internal backend services that provide reliable access to platform data. Designing resilient services ...

Description Factor is an API driven, AI powered retail data platform for global energy utilities. We use deep machine learning to help energy retailers accurately value the energy they sell: improving margins, unlocking more competitive customer products, and driving lower carbon emissions. We believe that great environmental outcomes come … Responsibilities Build and ship backend features and services with a focus on elegance, scalability, performance, and resilience. Design and evolve Factor’s core data and application architecture (Typescript rust, AWS, etc). Solve complex, end to end problems across the stack, from data ingestion and transformation, complex ...

government/publications/united-kingdom-security-vetting-clearance-levels Key areas of responsibility Support the design of end-to-end AI pipelines, from data ingestion and feature engineering through to model training, evaluation, deployment, and monitoring, contributing technical input and developing architectural judgement under senior guidance. Assist … assess tooling, platform, and hosting options, summarising trade-offs clearly to inform architectural decisions. Support the identification of technical risks in AI solutions, including data quality issues, model drift, integration failure modes, and AI security and safety considerations. Work with ML engineers, data engineers, and domain SMEs ...