18 of 18 Permanent Data Ingestion Jobs in Stockport

Job Title: Data Engineering Manager Job Type: Full Time, Permanent Location: London, Hybrid Role Purpose At Travelex we are developing modern data technology and data products. Data is central to the way we define and sell our foreign currency exchange products. Our relationship with our customers … is deeply data-driven. The data engineering manager ( DEM ) owns the design and delivery of all data flows to and from our data platform, underpinning crucial data products. The DEM is responsible for a significant transformation Travelex is going through, with event-driven and transactional … enhancements to our enterprise data architecture, alongside expansion of our data warehousing function to support a wide range of data integrations. Main Responsibilities: Leadership & Strategy Work with the Director of Data Engineering and IT Leadership to enhance the company's data maturity. Maintain strong business More ❯

PositionTitle: LeadDataEngineer/Architect Department: EnterpriseSystems ReportsTo: Director,DataAnalytics Supervises: N/A Classification: Full Time, Permanent JOB SUMMARY: The Lead Data Engineer/Architect is responsible for managing, expanding, and optimizing our business data platforms, supporting and working with project teams, business stakeholders, and product owners to … ensure optimal data delivery, consistent data architecture, and effective performance of data solutions. ESSENTIAL FUNCTIONS: Leading and coordinating the engineering architecture Coordinating & debugging DevOps release deployments to test/production environments. Assisting the cloud engineering team with the coordinating & debugging of Azure infrastructure buildouts, monitoring & maintenance Developing … maintaining & debugging ingestion/ETL pipelines in Azure Data Factory. Developing, maintaining & debugging ingestion/ETL database objects in Azure SQL. Azure SQL performance tuning/optimization. Data Platform Design and Architecture: Leading the design and implementation of data platforms, including data lakes, data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Data Engineer (Python) Location: Belfast (Hybrid - 3 days/week on-site) Type: Full-time | Permanent The Opportunity We're hiring a Data Engineer with strong Python skills to support the evolution of a data platform within a global cybersecurity context. Sitting at the heart of a … cross-functional data and customer success team, you'll build robust data pipelines, drive system integration's, and help unlock critical insights across the business. This is a hands-on engineering role where your ability to turn complex data into usable, actionable outcomes will directly impact customer … satisfaction, retention, and product evolution. What You'll Be Doing Design, build, and maintain scalable data pipelines and integration's between platforms (e.g. CRM, customer success, analytics tools). Develop automated data workflows that support dashboards, health scoring, churn models, and other predictive analytics. Own system integration and More ❯

Job Title: Senior Data Engineer Salary: up to £65,000 Location: Hybrid – 1 day per fortnight in the Wilmslow offices Working hours 0900 to 1730 The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such … a fantastic opportunity has arisen for a strong data engineer to work in the data engineering team, to expand and maintain the data infrastructure that provides the foundations from which our BI, Data Science and Operational Data teams deliver insights and revenue to the functions … across the wider group. We’re looking for an individual who has experience working with enterprise grade data pipelines and infrastructure, who can implement processes on our modern tech stack with robust, pragmatic solutions. Responsibilities develop, and maintain ETL/ELT data pipelines using AWS services Data More ❯

Data Engineer Remote | UK or EU timezone preferred This is an opportunity to build high-impact pipelines, implement real-time streaming solutions, and collaborate cross-functionally across engineering, product, and analytics teams. About the Role As a Data Engineer, you'll play a key role in designing and … maintaining robust data pipelines, streamlining data ingestion from multiple sources, and building scalable warehousing and lakehouse solutions. You'll also be involved in shaping the platform's event-driven architecture and implementing observability best practices to ensure reliability and traceability. What You'll Do Design and build … scalable data pipelines (ETL/ELT) for ingestion, transformation, and loading from a wide variety of structured and unstructured sources Develop solutions for real-time and event-driven data processing using modern streaming frameworks Build and maintain data warehouses and data lakes to support business More ❯

AWS DATA ENGINEER 3-MONTH CONTRACT £400-£450 PER DAY OUTSIDE IR35 FULLY REMOTE This role offers a great opportunity for an AWS Data Engineer to join a fast-paced media company working on a cutting-edge data ingestion and transformation project. You'll take ownership … of end-to-end pipeline development, integrating real-time data streams and third-party APIs into a modern analytics stack. The environment promotes autonomy, modern tooling, and close collaboration across technical and business teams. THE COMPANY This is a leading media organisation leveraging data to drive audience insights … engagement strategies, and targeted content delivery. They are investing heavily in their data platform and tooling, with an emphasis on real-time decision-making and scalable infrastructure. You'll be joining a team focused on delivering data into key business systems including CRM and analytics layers. THE ROLE More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

role will report into Operations Lead UK and Europe. You will work alongside the Sales & Distribution, Technology, Finance and Outsourced Operations teams to manage data onboarding, premium and cash management of speciality underwriters within Europe and UK, at Accelerant we call them members. In this role you will build … relationships and intimate knowledge of our Members data, technology and processes and will be the point contact on all data queries, problems and solutions. You will work alongside our members to assist them in the analysis and resolution of data quality issues that impact data ingestion, regulatory compliance, and reporting, utilising your knowledge and experience of the applicable data standards. Your role will contribute to the overall success of the Operations function who are charged with transforming our data processes to deliver governed, timely and high-fidelity data sources. Key Responsibilities Member More ❯

and internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality … cloud providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software … monitoring/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure, latency optimization, execution systems, and market data feeds. Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a team More ❯

+ Bonus + Benefits We're working with a global financial institution to hire a mid-level KDB+ Engineer for their growing real-time data team based in Canary Wharf. This team plays a key role in supporting time-series data systems for trading, with a strong focus … on performance, scalability, and data accuracy. You'll work onsite three days per week, collaborating closely with quants, traders, and fellow engineers to develop and optimise KDB+/q-based solutions that power front-office decision-making and analytics. What You'll Be Doing Build and maintain real-time … and historical KDB+ systems Optimise tick data ingestion and query performance Partner with trading desks to deliver reliable data feeds and tools Implement best practices in q coding, testing, and deployment Monitor, troubleshoot, and fine-tune system performance Work on system upgrades, migrations, and ongoing improvements What More ❯

contributors to our digital transformation teams. You will need: 5+ years experience using kdb+ technology including KX Insights Enterprise Feedhandler development using Java and data ingestion into KX Insights Enterprise Large scale data capture and platform analysis experience Excellent communication and interpersonal skills/Confident in communicating More ❯

TalentCo are thrilled to be working with a VC-backed AI infrastructure startup building the future of multimodal data systems. Having recently raised a substantial Seed round, they are now looking to hire an exceptional backend focused Senior Rust Engineer to join their high-calibre, distributed team in Europe. … analytical databases purpose-built for high-throughput, multimodal time-series data. Working in Rust, you’ll architect performant, scalable systems that handle everything from ingestion and indexing to complex query execution. If you're keen to be at the sharp-end of the AI boom, love building technical infrastructure … logs. Work with technologies like Rust, Apache Arrow, and Datafusion to build scalable, low-latency systems. Collaborate on every part of the stack—from data ingestion and indexing to query planning and optimisation. Build observability, reliability, and scalability into a product being designed for some of the most More ❯

our products.This individual will work closely with Signals co-founders and Lead Engineer, contributing to both backend and frontend systems, and supporting devops and data-oriented tasks as needed. Responsibilities Contribute to backend development using Python (Flask framework) Maintain and expand our Typescript/React frontend Build and maintain … Dockerized services deployed in AWS Troubleshoot and optimize application performance Support data ingestion and transformation pipelines as needed Work cross-functionally with product and data functions to deliver new features and maintain existing functionality Essential Qualifications Proven experience as a full-stack engineer, with a strong Python More ❯

enhance a platform that supports the collection and analysis of intelligence related to cryptocurrency crime. The role involves developing tools and systems to streamline data ingestion from various sources and integrate it into a proprietary graph database. Key Responsibilities: Design and develop software tools for intelligence collection and … Passionate about cryptocurrencies and blockchain technology. Strong coding skills in JavaScript, TypeScript, or Python. Experience integrating systems to improve operational efficiency. Collaborative, communicative, and data-driven in decision-making. Required Experience: 5+ years of commercial software engineering experience. Proficiency with AWS, Kubernetes, Postgres, and Terraform. Bonus Skills: Background in More ❯

About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member … Design and implement advanced methodologies like LoRA, prefix-tuning, and adapter-based approaches for fine-tuning AI models. Develop robust, fault-tolerant systems for data ingestion, processing, and model customisation. Optimise GPU utilisation and system performance using frameworks like DeepSpeed, Triton Inference Server, TensorRT, and custom CUDA/… and PyTorch, with a strong understanding of transformer architectures, LLMs, and multimodal generative models. Expertise in distributed training frameworks like DeepSpeed or Fully Sharded Data Parallel (FSDP). Experience with GPU programming and optimisation e.g CUDA, TensorRT, or ROCm. Knowledge of fine-tuning methods, such as LoRA, prefix-tuning More ❯

processes. Configure correlation searches and alerting mechanisms, optimising rules to minimise false positives. Serve as the Subject Matter Expert (SME) for SIEM deployment, supporting data ingestion from sources such as AWS and Qualys. Assist in the integration of SIEM alerts with Jira, enabling streamlined alert tracking and incident More ❯