101 to 125 of 135 Data Ingestion Jobs in the UK excluding London

Social network you want to login/join with: We’re seeking a proactive Trading Developer to architect and enhance the data and process backbone of our trading environment. You’ll design and implement backend APIs, real-time data pipelines, and monitoring frameworks—ensuring reliable, low-latency access to market and operational data. While your core focus is … tasks and responsibilities API & Service Development Design, develop, and maintain robust internal RESTful and event-driven APIs. Establish best practices for versioning, documentation, security, and monitoring. Build and manage data streaming pipelines using frameworks such as Spark, Kafka, or equivalents. Ensure high-availability and low-latency delivery of market and industry data. Deploy and operate services on Azure using … Functions, App Services, AKS (Kubernetes), and related services. Data Ingestion & Management Ingest diverse data sources (exchange feeds, third-party APIs, FIX/WebSocket interfaces). Implement ETL processes and data models to drive downstream analytics and trading strategies. Uptime & Monitoring Implement health checks, alerting, and observability (metrics, logs, tracing) to maintain 24/7 uptime. Rapidly More ❯

length of service Sick Pay – Increasing with length of service The Role: We are looking for an experienced SQL Database Administrator. Key Responsibilities: Support and maintain a large-scale data warehouse environment, handling high volumes of structured data. Manage and process incoming data streams from external sources (e.g. cameras and monitoring systems). Develop and support server-side … data processing workflows to ensure timely and accurate data ingestion. Collaborate with 2nd and 3rd line support teams, providing expertise on complex data-related issues. Maintain and optimise the central database infrastructure, ensuring performance, reliability, and scalability. Work closely with stakeholders to deliver custom reports and analytics. Ensure data integrity, transformation, and storage aligns with business … and regulatory requirements. Participate in long-standing, enterprise-level projects requiring consistent support and system knowledge. Troubleshoot data warehouse and integration issues and implement enhancements for improved performance and reliability. Contribute to the design, development, and maintenance of ETL pipelines and reporting systems. Requirements: Microsoft SQL Server Database deployed on-premise and in the cloud. Always On replication to More ❯

tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role You will be joining our rapidly growing Data & AI Strategy team within Capgemini Invent, where we are at the forefront of designing and building winning strategies and operating models to transform the way in which organisations across … all industries and sectors leverage data & AI. We're building a successful team of experts across the data & AI lifecycle, and we're looking for talented people to strengthen our position as consulting leaders in data & AI strategy & operating model. Our Managers and Senior Managers marry best-in-class delivery with thought leadership to become trusted advisors … with senior clients. You will be leading teams of data & AI consultants and technical specialists from across Capgemini on the design and implementation of large and complex data & AI operating model work to transform of their data & AI capabilities. We are looking for candidates with consulting experience in one or more of the following sectors: Transport, Energy More ❯

Data Engineer (Snowflake) Hybrid working pattern 2 days per week in the London office My client, a large global Insurance company, are seeking a talented AWS Data Engineer with Snowflake experience to join their growing data practice within the UK. As a key member of this team, you will play a pivotal role in designing and implementing … data warehousing solutions using Snowflake and AWS. The ideal candidate must have: Strong experience as an AWS Data Engineer Lead the design and implementation of Snowflake [and Redshift] based data warehousing solutions within an AWS environment Extensive experience in AWS services, e.g. EC2, S3, RDS, DynamoDB, Redshift, Lambda, API Gateway Develop and optimize ETL processes using AWS … services (e.g. AWS Glue, Lambda) to ensure efficient data ingestion, transformation, storage, and cost optimization. Strong SQL skills for complex data queries and transformations ETL Pipe-lining experience Experience with Python AWS and Snowflake Certifications are a plus Insurance experience or Financial services experience advantageous Must have experience of working closely with business teams and communicating with More ❯

s challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role As a Data & AI Operating Model Consultant, you will play a key role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage data and AI to … drive business outcomes: You will play a central role in the designing of effective data, analytics & AI operating models, covering all components required to deliver an effective data & AI capability. You will be work with our clients to define their strategic objectives, and then build a picture of the requisite data & analytical capabilities required to realise those … strategic objectives. You will provide guidance and advisory services to clients on a wide range of data & analytics capabilities at all points of the data & analytics value chain. You will work with stakeholders at all levels of the organisation to assess the maturity of existing data capabilities, identifying opportunities for re-use and corresponding gaps in capability. More ❯

you will play a key role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Role Overview: Develop ETL processes to extract and normalise capacity data from infrastructure sources. … Automate data ingestion and processing into SQL Server databases. Normalising raw infrastructure and monitoring data into structured formats suitable for graphing and trending Collaborate with DBAs and technical teams to ensure transparency and supportability. Build data flows that support capacity reporting and trending, using modern technologies. Skills & Experience Required: 3+ years' experience in ETL/data processing roles. Proficiency with ETL tools, SQL Server, RESTful APIs. Experience working with infrastructure data (e.g., Nutanix, VMware, Dell EMC desirable). Scripting experience in Python, SQL (T-SQL), Excel VBA. Knowledge of data optimisation, large datasets, JSON/XML formats. Experience of setting up SQL DTSS and Control/M batch jobs useful Excellent communication, analytical More ❯

This is an exciting opportunity for a Power BI Specialist. Based in London, you will use your expertise to create insightful dashboards and reports that support data-driven decision-making. Client Details A £100million turnover company. Description Design, build, and refine dashboards focusing on profit and loss, margin analysis, cost control, and operational KPIs across the Group. Enhance existing … dashboards to integrate with the new Microsoft Data Links repository, replacing scheduled refreshes with live data feeds. Use Power Query (M language) for data ingestion and transformation. Develop advanced DAX measures, including time intelligence calculations, dynamic reporting layers, and calculated tables. Manage the full dashboard development lifecycle, from stakeholder engagement and data modelling to prototyping … business units to gather requirements and shape outputs. Ensure dashboards are user-friendly, commercially relevant, and actionable for both finance and non-finance users. Work alongside internal ERP and data teams (who manage SQL and connectors) to maintain data consistency with Unit4 and Tagetik systems. Provide ad-hoc support for wider reporting and transformation projects, including benchmarking and More ❯

management Skills and Experience AI/ML Expertise: Strong understanding of LLMs, NLP, and AI-driven recommendations. Technical Leadership: Experience in AI product scalability, DevOps, and cloud architecture. Backend & Data Skills: Proficiency in Python, Node.js, PostgreSQL, MongoDB, API security. AI Model Deployment: MLOps, scaling, data engineering, and AI ethics awareness. Strategic Mindset: Ability to align technology with business … objectives and cost efficiency. Security & Compliance Knowledge: GDPR, API authentication, and observability best practices. Big data processing: Understanding data lakes, warehouses, and tools like Spark, Kafka, and Airflow. ETL Pipelines: Ability to evaluate data ingestion, transformation, and cleaning processes. DevOps & CI/CD: Hands-on knowledge of Jenkins, GitHub Actions, Terraform, and CloudFormation. What's in More ❯

patches, and enhancements with minimal disruption to business operations. Collaborate with stakeholders to define requirements for system integrations, user needs, and architectural designs. Identify and implement solutions to improve data quality, ingestion/extraction processes, and overall data accessibility across SQL and other databases. Execute system failovers and disaster recovery procedures to minimize risk and downtime. Manage … with strong experience customizing Symitar for reporting and system enhancements. Expertise in Jack Henry system releases, including planning, testing, and deployment. In-depth experience with SQL Server management including data ingestion, query optimization, and backups. Strong project leadership skills and experience managing complex, cross-functional technical initiatives. Advanced troubleshooting, analytical, and strategic problem-solving abilities in high-pressure More ❯

Miami, London, and Singapore to develop risk analytics solutions for our businesses (fixed income, commodities, equities, etc.) Build, enhance, and maintain existing Java REST services and related systems Develop data ingestion pipelines and core data systems to provide risk management with programmatic access to analytics as well as via web interfaces Create and manage cloud applications on … and Risk Managers Required skills/experience: Strong analytical and mathematical skills, with interest and/or exposure to quantitative finance Good understanding of various design patterns, algorithms, and data structures Substantial experience with modern Java Experience with REST APIs and cloud services Relational SQL database development experience Unix/Linux command-line experience Ability to work independently in … a fast-paced environment Detail-oriented, organized, demonstrating thoroughness and strong ownership of work Desirable skills/experience: Experience working with Python and data analysis libraries (pandas, polars, numpy) Experience with financial mathematics, statistics, and a broad understanding of financial instruments and services Experience in JavaScript development, especially with AngularJS or ReactJS AWS cloud services: EC2, S3, Aurora, Redshift More ❯

The Role Design, build and run the software and data that power our platform—from user interfaces to APIs and data ingestion—while keeping security front of mind. Key Responsibilities Build and maintain our Vue 3 platform plus supporting APIs, microservices, database and semantic layers. Write clean, well‐tested code and review peers’ work. Day to day … operation of systems, including availability, security and data integrity Collaborate daily with product, data and DevOps teams in short agile sprints. Skills & Experience Production experience with Vue.js, JavaScript/TypeScript, HTML and CSS. Proficiency in at least one back‐end language (Python, Java, C#, Node). Strong SQL and familiarity with relational & NoSQL databases. Experience designing and consuming … relationships with peers. Communicative: speak up in discussions, share ideas and listen actively. Leadership mindset: take initiative, mentor others and drive best practices. The Opportunity Shape an industry‐leading data platform used across the UK and US. Small, supportive team where every engineer has real impact. Rapid growth means space to develop your skills and career. Why Broker Insights More ❯

Ability to troubleshoot technical issues and resolve problems. Bachelor’s degree in Computer Science, Information Technology, or related field. Proficiency in configuring Sprinklr Modern Care's/CCaas including data ingestion, workflow automation, and reporting. Experience with integrating Sprinklr Modern Care with external systems, including CRM systems, ticketing systems, and custom applications. Desirable skills/knowledge/experience … and direct experience working with social media management software. Knowledge of industry-standard frameworks (e.g., Contact center, ITIL). Certification in Sprinklr Modern Care or related technologies. Experience with data analytics and reporting tools. Familiarity with cloud-based technologies and software-as-a-service (SaaS) solutions. Rewards & Benefits TCS is consistently voted a Top Employer in the UK and More ❯

Job title: Solution Architect Location: Leeds, UK (Hybrid- 3 days/week) Type: Contract Client: Wipro Job description As part of the CTO Data Ingestion Service, the incumbent will be required to: Designing and architecting scalable, real-time systems in Kafka, with a focus on on-premise Cloudera open source Kafka and disaster recovery aspects. Configuring, deploying, and … maintaining Kafka clusters to ensure high availability, resiliency, and scalability, including understanding and explaining features like KRAFT. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam. Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs. Implementing security measures … to protect Kafka clusters and data streams. Monitoring Kafka performance, troubleshooting issues, and enhancing disaster recovery strategies. Providing technical guidance and support to development operations teams. Staying updated with the latest Kafka features, industry practices, and real-time technologies like Spark. Mandatory keywords: Experience with on-premise/cloudera open source Kafka Focus on disaster recovery aspects Knowledge of More ❯

Dundee, 1 - 2 days a week in the office Salary £45 - £55k Head Resourcing are recruiting for a software engineer for a fintech company based in Dundee. We use data to transform the commercial insurance market. The role focuses on designing, building and running the software and data that power our platform-from user interfaces to APIs and … data ingestion-while keeping security front of mind. Key Responsibilities Build and maintain our Vue?3 platform plus supporting APIs, microservices, database and semantic layers. Write clean, well?tested code and review peers' work. Day to day operation of systems, including availability, security and data integrity Collaborate daily with product, data and DevOps teams in short … with peers. Communicative: speak up in discussions, share ideas and listen actively. Leadership mindset: take initiative, mentor others and drive best practices. Why Join Us? Shape an industry?leading data platform used across the UK and US. Small, supportive team where every engineer has real impact. Rapid growth means space to develop your skills and career. More ❯

Dundee, 1 - 2 days a week in the office Salary £45 - £55k Head Resourcing are recruiting for a software engineer for a fintech company based in Dundee. We use data to transform the commercial insurance market. The role focuses on designing, building and running the software and data that power our platform-from user interfaces to APIs and … data ingestion-while keeping security front of mind. Key Responsibilities Build and maintain our Vue 3 platform plus supporting APIs, microservices, database and semantic layers. Write clean, well tested code and review peers' work. Day to day operation of systems, including availability, security and data integrity Collaborate daily with product, data and DevOps teams in short … with peers. Communicative: speak up in discussions, share ideas and listen actively. Leadership mindset: take initiative, mentor others and drive best practices. Why Join Us? Shape an industry leading data platform used across the UK and US. Small, supportive team where every engineer has real impact. Rapid growth means space to develop your skills and career. More ❯

We are data insight experts, empowering clients to own, manage and rule their data. One of our specialisations is in cybersecurity consultancy offering end-to-end SIEM services, helping clients design, deploy, and optimise security monitoring and threat detection solutions. Our team provides comprehensive support across all stages of SIEM implementation, from initial strategy and solution design to deployment … integration with client systems and optimizing for effective threat detection and real-time monitoring. Perform hands-on configuration and tuning of SIEM components, setting up alerting, custom dashboards, and data ingestion as needed to support client-specific use cases. Support clients in deploying SIEM in hybrid environments, including on-premises, cloud, and multi-cloud platforms, integrating cloud-native … and adapt to evolving threat landscapes. Advisory & Compliance: Advise clients on aligning SIEM deployments with security frameworks and compliance requirements, including GDPR, HIPAA, and PCI DSS. Provide guidance on data strategies for security monitoring, such as data persistence and streaming for long-term analysis and real-time detection. Assist clients in implementing data retention policies and optimising More ❯

are used by the world's most advanced government agencies and businesses, enabling them to go further, faster, and deeper into the dark web. Our proprietary technology provides actionable data that was previously unobtainable; delivering insights, situational awareness and sense-making helping our customers keep ahead. Our mission is simple - protect society from the threats contained within the dark … end components, and integrating user-facing elements in collaboration with front-end developers. The role of a Python developer is a broad one for us, covering the discovery and ingestion of new data, through to how it is managed and analyzed inside our products. We're looking for both experienced and junior developers, and are mostly looking for … you should possess in-depth knowledge of object-relational mapping, experience with server-side logic, and above-average knowledge of Python programming. WHAT WILL I DO? Produce and maintain data harvesting tools in Python Implementing web-scraping tools Maintaining existing infrastructure and services, covering Python, Elastic Search, Docker, Kubernetes and more Developing prototype products in line with new technical More ❯

more junior team members. Responsibilities Working under the direction of the Managers and/or senior managers to identify and understand client needs, will include being responsible for: Processing data (in Relativity and/or Nuix) Moving data into Relativity Running searches across Relativity Creating review batches and coding layouts in Relativity Preparing productions and exports from Relativity … Supporting legal review teams with their review workflows (including running threading, near de-duplication, and CAL) Additional responsibilities include: Maintaining the integrity of data, including evidence handling, processing, and data tracking. Liaising with other team members to ensure that correct solutions and processes are implemented at a cost-effective level and work is delivered on time. Acting as … have 4-5+ years' eDiscovery experience (law firm or service provider). Deep understanding and practical day-to-day use of eDiscovery technology, specifically Relativity and Nuix, including data processing, data ingestion, database setup, searching, production, threading, near de-duplication, clustering, and active learning. Strong documentation and communication skills, including effective collaboration with case teams, eDiscovery More ❯

more junior team members. Responsibilities Working under the direction of the Managers and/or senior managers to identify and understand client needs, will include being responsible for: Processing data (in Relativity and/or Nuix) Moving data into Relativity Running searches across Relativity Creating review batches and coding layouts in Relativity Preparing productions and exports from Relativity … Supporting legal review teams with their review workflows (including running threading, near de-duplication, and CAL) Additional responsibilities include: Maintaining the integrity of data, including evidence handling, processing, and data tracking. Liaising with other team members to ensure that correct solutions and processes are implemented at a cost-effective level and work is delivered on time. Acting as … have 4-5+ years' eDiscovery experience (law firm or service provider). Deep understanding and practical day-to-day use of eDiscovery technology, specifically Relativity and Nuix, including data processing, data ingestion, database setup, searching, production, threading, near de-duplication, clustering, and active learning. Strong documentation and communication skills, including effective collaboration with case teams, eDiscovery More ❯

more junior team members. Responsibilities Working under the direction of the Managers and/or senior managers to identify and understand client needs, will include being responsible for: Processing data (in Relativity and/or Nuix) Moving data into Relativity Running searches across Relativity Creating review batches and coding layouts in Relativity Preparing productions and exports from Relativity … Supporting legal review teams with their review workflows (including running threading, near de-duplication, and CAL) Additional responsibilities include: Maintaining the integrity of data, including evidence handling, processing, and data tracking. Liaising with other team members to ensure that correct solutions and processes are implemented at a cost-effective level and work is delivered on time. Acting as … have 4-5+ years' eDiscovery experience (law firm or service provider). Deep understanding and practical day-to-day use of eDiscovery technology, specifically Relativity and Nuix, including data processing, data ingestion, database setup, searching, production, threading, near de-duplication, clustering, and active learning. Strong documentation and communication skills, including effective collaboration with case teams, eDiscovery More ❯

Manage the implementation of software releases and updates for Jack Henry systems, including testing, deployment, and coordination with stakeholders. Provide expert-level support for SQL Server environments related to data ingestion, extraction, optimization, and backup. Create accurate and timely system reports, ensuring data integrity and reliability. As needed, perform hands-on technical work as a Core Systems … support issue resolution. Consistently meet assigned project deadlines and goals. Maintain strong attention to detail in high-pressure situations. Create accurate and timely reports from Credit Union systems, ensuring data validity. Collaborate with business units, vendors and technical staff to achieve business results. Excellent interpersonal and communications skills with both technical and non-technical staff Strong analytical skills Performs … transitions through meticulous planning, rigorous testing, and effective coordination with cross-functional teams. Proven expertise in executing system failovers and disaster recovery drills, minimizing risk of outages and protecting data integrity essential for continuous banking operations. Skilled in managing SQL Database Servers, with a focus on data ingestion, extraction, query optimization, and performing backups, which supports robust More ❯

geographic data. The Technology Stack Our platform is built using: Frontend : Vue.js for responsive, interactive user interfaces Backend : Node.js with Express framework Database : PostgreSQL with PostGIS extensions for spatial data management GIS : Modern geospatial libraries and mapping technologies Key Responsibilities Backend Development Design and implement robust APIs for geospatial data processing and visualisation Optimise database queries and spatial … operations using PostgreSQL and PostGIS Build scalable microservices architecture to handle large datasets Implement data ingestion pipelines for various GIS formats (GeoJSON, Shapefiles, etc.) Ensure optimal performance for complex spatial queries and real-time data updates Quality Assurance & Testing Develop comprehensive testing strategies including unit, integration, and end-to-end tests Implement automated testing pipelines using modern … and implement performance testing for geospatial operations Technical Leadership Take ownership of backend architecture and drive technical decisions Collaborate with frontend-focused team members to optimise API design and data flow Lead architectural discussions and technical planning for backend systems Code review and establish backend coding standards and best practices Contribute to technical documentation and development guidelines Technical Skills More ❯

of the organisation alongside your peers. Autonomy: Authority over technical strategy, decisions and implementation approach, so you can deliver using practices that align with your preferred ways of working. Data Driven: Utilise rich logs, metrics, and data to monitor and improve system performance & reliability. Culture: Enhancing a diverse engineering culture by taking part in various technical catch ups … as a multiplier. What we look for in you: Experience working in large and small agile teams of engineers, and eager to collaborate with other disciplines, such as Marketing, Data Analytics & Product Owners. Good understanding of Cloud technologies, and their application to solve problems such as Event/Data Ingestion and 3rd Party API Integrations. As well More ❯

an OFSTED Inspector. Involvement in school improvement initiatives. Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. Skilled in technical writing. Competence More ❯

Other EU work permit required: Yes Job Reference: b81240d71528 Job Views: 5 Posted: 25.06.2025 Expiry Date: 09.08.2025 Job Description: Job Purpose To contribute to the growing research in Geospatial Data Science at the College of Science and Engineering, working with Professor Ana Basiri and the Geospatial Data Science Group at the University of Glasgow. The successful candidate will … geospatial AI tools, deliver high-impact research, and contribute to team development through research outputs, proposals, supervision, and presentations. Main Duties and Responsibilities Develop innovative GeoAI solutions combining geospatial data with APIs like GPT, Codex, etc., for data tasks and AI-driven applications. Study and develop applications using Large Language Models through fine-tuning and integration. Apply techniques … such as prompt engineering, data ingestion, and transformation. Collaborate with the Geospatial Data Science team and external partners across industry, government, and third sectors. Enhance research profile through publications, societal impact, and research indicators. Present work at conferences, seminars, and workshops. Support FAIR principles by making data and code repositories accessible and reproducible. Pursue personal and More ❯