5 of 5 Data Ingestion Jobs in Stockport

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

TalentCo are thrilled to be working with a VC-backed AI infrastructure startup building the future of multimodal data systems. Having recently raised a substantial Seed round, they are now looking to hire an exceptional backend focused Senior Rust Engineer to join their high-calibre, distributed team in Europe. … analytical databases purpose-built for high-throughput, multimodal time-series data. Working in Rust, you’ll architect performant, scalable systems that handle everything from ingestion and indexing to complex query execution. If you're keen to be at the sharp-end of the AI boom, love building technical infrastructure … logs. Work with technologies like Rust, Apache Arrow, and Datafusion to build scalable, low-latency systems. Collaborate on every part of the stack—from data ingestion and indexing to query planning and optimisation. Build observability, reliability, and scalability into a product being designed for some of the most More ❯

About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member … Design and implement advanced methodologies like LoRA, prefix-tuning, and adapter-based approaches for fine-tuning AI models. Develop robust, fault-tolerant systems for data ingestion, processing, and model customisation. Optimise GPU utilisation and system performance using frameworks like DeepSpeed, Triton Inference Server, TensorRT, and custom CUDA/… and PyTorch, with a strong understanding of transformer architectures, LLMs, and multimodal generative models. Expertise in distributed training frameworks like DeepSpeed or Fully Sharded Data Parallel (FSDP). Experience with GPU programming and optimisation e.g CUDA, TensorRT, or ROCm. Knowledge of fine-tuning methods, such as LoRA, prefix-tuning More ❯

processes. Configure correlation searches and alerting mechanisms, optimising rules to minimise false positives. Serve as the Subject Matter Expert (SME) for SIEM deployment, supporting data ingestion from sources such as AWS and Qualys. Assist in the integration of SIEM alerts with Jira, enabling streamlined alert tracking and incident More ❯