21 of 21 Data Ingestion Jobs in Derbyshire

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Data Engineer – Data Warehouse £55,000 + Annual Bonus Are you looking to join an expanding Data function within a Global Team? There has been significant investment into growing the Data Teams and this is a really good opportunity to be a part of something special … The Data Engineer will be working on a centralised enterprise Data Warehouse and will be working on deploying architectures to drive greater analytical and business value from various data sources. What will you be doing? Working with various teams from delivery, product, architecture to develop data driven solutions Developing and supporting a comprehensive data warehouse. Leverage your data modelling skills – designing and developing a dimensional model. Identify & deploy appropriate file formats for data ingestion Tech Stack SQL Python Web APIs – SOAP, REST DBT Have worked on denormalised data Has worked More ❯

Data Engineer – Data Warehouse £55,000 + Annual Bonus Are you looking to join an expanding Data function within a Global Team? There has been significant investment into growing the Data Teams and this is a really good opportunity to be a part of something special … The Data Engineer will be working on a centralised enterprise Data Warehouse and will be working on deploying architectures to drive greater analytical and business value from various data sources. What will you be doing? Working with various teams from delivery, product, architecture to develop data driven solutions Developing and supporting a comprehensive data warehouse. Leverage your data modelling skills – designing and developing a dimensional model. Identify & deploy appropriate file formats for data ingestion Tech Stack SQL Python Web APIs – SOAP, REST DBT Have worked on denormalised data Has worked More ❯

Kingdom (Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … My client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a hands-on More ❯

Kingdom (Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … My client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a hands-on More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

of RMN platforms, covering sponsored ads, programmatic DSP, self-service portals, and dynamic ad placements. Design scalable and modular RMN solutions, integrating Ad-Serving, Data Management Platforms (DMP), Customer Data Platforms (CDP), and Demand-Side Platforms (DSP). Ensure real-time bidding (RTB) and programmatic advertising capabilities within … Generative AI for automated ad creation, content personalization, and A/B testing. Enhance Dynamic Creative Optimization (DCO) capabilities for personalized ad experiences. 3. Data & Integration Framework Define data ingestion, processing, and activation strategies across first-party, second- party, and third-party data sources. Ensure seamless … effectively. 4. Ad-Tech Stack & Cloud Architecture Design RMN solutions leveraging Google Cloud, AWS, or Azure, ensuring high availability and low-latency performance. Optimize data pipelines, real-time analytics, and identity resolution mechanisms. Oversee privacy-compliant data handling (GDPR, CCPA) and secure identity frameworks. 5. Stakeholder Collaboration & Roadmap More ❯

of RMN platforms, covering sponsored ads, programmatic DSP, self-service portals, and dynamic ad placements. Design scalable and modular RMN solutions, integrating Ad-Serving, Data Management Platforms (DMP), Customer Data Platforms (CDP), and Demand-Side Platforms (DSP). Ensure real-time bidding (RTB) and programmatic advertising capabilities within … Generative AI for automated ad creation, content personalization, and A/B testing. Enhance Dynamic Creative Optimization (DCO) capabilities for personalized ad experiences. 3. Data & Integration Framework Define data ingestion, processing, and activation strategies across first-party, second- party, and third-party data sources. Ensure seamless … effectively. 4. Ad-Tech Stack & Cloud Architecture Design RMN solutions leveraging Google Cloud, AWS, or Azure, ensuring high availability and low-latency performance. Optimize data pipelines, real-time analytics, and identity resolution mechanisms. Oversee privacy-compliant data handling (GDPR, CCPA) and secure identity frameworks. 5. Stakeholder Collaboration & Roadmap More ❯

role will report into Operations Lead UK and Europe. You will work alongside the Sales & Distribution, Technology, Finance and Outsourced Operations teams to manage data onboarding, premium and cash management of speciality underwriters within Europe and UK, at Accelerant we call them members. In this role you will build … relationships and intimate knowledge of our Members data, technology and processes and will be the point contact on all data queries, problems and solutions. You will work alongside our members to assist them in the analysis and resolution of data quality issues that impact data ingestion, regulatory compliance, and reporting, utilising your knowledge and experience of the applicable data standards. Your role will contribute to the overall success of the Operations function who are charged with transforming our data processes to deliver governed, timely and high-fidelity data sources. Key Responsibilities Member More ❯

role will report into Operations Lead UK and Europe. You will work alongside the Sales & Distribution, Technology, Finance and Outsourced Operations teams to manage data onboarding, premium and cash management of speciality underwriters within Europe and UK, at Accelerant we call them members. In this role you will build … relationships and intimate knowledge of our Members data, technology and processes and will be the point contact on all data queries, problems and solutions. You will work alongside our members to assist them in the analysis and resolution of data quality issues that impact data ingestion, regulatory compliance, and reporting, utilising your knowledge and experience of the applicable data standards. Your role will contribute to the overall success of the Operations function who are charged with transforming our data processes to deliver governed, timely and high-fidelity data sources. Key Responsibilities Member More ❯

and resolve problems. Bachelor’s degree in Computer Science, Information Technology, or related field. Proficiency in configuring Sprinklr Modern Care's/CCaas including data ingestion, workflow automation, and reporting. Experience with integrating Sprinklr Modern Care with external systems, including CRM systems, ticketing systems, and custom applications. Desirable … social media management software. Knowledge of industry-standard frameworks (e.g., Contact center, ITIL). Certification in Sprinklr Modern Care or related technologies. Experience with data analytics and reporting tools. Familiarity with cloud-based technologies and software-as-a-service (SaaS) solutions. Rewards & Benefits TCS is consistently voted a Top More ❯

forecast price movements, and support scenario modeling. Integrate analytics directly into the investment process, influencing real-time trading decisions. Collaborate with traders, researchers, and data scientists to deliver impactful, production-ready tools. Engineer scalable systems for data ingestion, modelling, and visualization. Design infrastructure for predictive analytics and More ❯

forecast price movements, and support scenario modeling. Integrate analytics directly into the investment process, influencing real-time trading decisions. Collaborate with traders, researchers, and data scientists to deliver impactful, production-ready tools. Engineer scalable systems for data ingestion, modelling, and visualization. Design infrastructure for predictive analytics and More ❯

About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member … Design and implement advanced methodologies like LoRA, prefix-tuning, and adapter-based approaches for fine-tuning AI models. Develop robust, fault-tolerant systems for data ingestion, processing, and model customisation. Optimise GPU utilisation and system performance using frameworks like DeepSpeed, Triton Inference Server, TensorRT, and custom CUDA/… and PyTorch, with a strong understanding of transformer architectures, LLMs, and multimodal generative models. Expertise in distributed training frameworks like DeepSpeed or Fully Sharded Data Parallel (FSDP). Experience with GPU programming and optimisation e.g CUDA, TensorRT, or ROCm. Knowledge of fine-tuning methods, such as LoRA, prefix-tuning More ❯

About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member … Design and implement advanced methodologies like LoRA, prefix-tuning, and adapter-based approaches for fine-tuning AI models. Develop robust, fault-tolerant systems for data ingestion, processing, and model customisation. Optimise GPU utilisation and system performance using frameworks like DeepSpeed, Triton Inference Server, TensorRT, and custom CUDA/… and PyTorch, with a strong understanding of transformer architectures, LLMs, and multimodal generative models. Expertise in distributed training frameworks like DeepSpeed or Fully Sharded Data Parallel (FSDP). Experience with GPU programming and optimisation e.g CUDA, TensorRT, or ROCm. Knowledge of fine-tuning methods, such as LoRA, prefix-tuning More ❯

processes. Configure correlation searches and alerting mechanisms, optimising rules to minimise false positives. Serve as the Subject Matter Expert (SME) for SIEM deployment, supporting data ingestion from sources such as AWS and Qualys. Assist in the integration of SIEM alerts with Jira, enabling streamlined alert tracking and incident More ❯

processes. Configure correlation searches and alerting mechanisms, optimising rules to minimise false positives. Serve as the Subject Matter Expert (SME) for SIEM deployment, supporting data ingestion from sources such as AWS and Qualys. Assist in the integration of SIEM alerts with Jira, enabling streamlined alert tracking and incident More ❯