7 of 7 Data Ingestion Jobs in the South West

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Data Engineer | Bristol (Hybrid) | £40,000 - £50,000 P.A | Permanent Peaple Talent have partnered with an existing client in Bristol looking to recruit a Data Engineer. The successful candidate will collaborate to build, enhance, and support both data-driven solutions and our clients analytics infrastructure, from initial design through to testing and ongoing development. Key Responsibilities: Design … develop, and sustain high-performance data pipelines and infrastructure that are both scalable and aligned with company goals and technical frameworks. Participate in Agile team practices and contribute to essential technical workflows, including peer code reviews. Partner with other data engineers to exchange expertise and collaboratively deliver impactful data solutions. Stay current with emerging technologies and contribute … a culture of ongoing enhancement, identifying areas for process automation and operational efficiency. Translate complex engineering concepts into accessible insight for audiences without technical backgrounds. Diagnose and resolve intricate data challenges while fine-tuning existing systems to improve speed, reliability, and performance. Work closely with multidisciplinary teams to gather requirements and ensure solutions are tailored to evolving business priorities. More ❯

DV (MOD) Cleared Data Engineer - Elastic Stack & Apache NiFi Location: Bristol | Contract Type: £430.00 pd (Outside IR35) | Working Pattern: Hybrid (3 - 4 days on-site) Are you a contract Data Engineer with a knack for designing secure, high-performance data solutions? We're on the lookout for a technical expert in the Elastic Stack and Apache NiFi … to take the lead in building robust, real-time data pipelines in a security-focused environment. This is a hands-on contract opportunity to make a real impact-ideal for professionals with a strong track record in regulated sectors. What You'll Be Doing Designing and deploying scalable, secure data pipelines using Elasticsearch, Logstash, Kibana, and Apache NiFi … Handling real-time data ingestion and transformation with an emphasis on integrity and availability Collaborating with architects and cybersecurity stakeholders to align with governance and compliance needs Monitoring and optimising high-throughput data flows across on-prem and cloud environments Building insightful Kibana dashboards to support business intelligence and operational decision-making Maintaining documentation of data More ❯

our purpose is to radically accelerate the clean-energy revolution - starting withsmarter, safer, and more efficient homes.We're focused on improving experiences for people through the application of technology, data, and a deep understanding of human behaviour. Why? As a society, we need to decarbonise and accelerate the transition to alternative energy sources. Existing solutions are expensive and disparate … led and puts people at its core, then we'd love to hear from you! The Role We're looking to grow our quality and test coverage in our data space. In this Intermediate-Senior role,you'll be helping us to implement processes, architectures and test coverage for validating our data backend with your excellent software skills … and guidance. We have an existing small team working and building the data backend and we need a QA engineer to work with the team to verify and validate this part of our product. Some of the things that you might be involved in include: Lead Data Quality Assurance: Develop and implement comprehensive testing for our data More ❯

length of service Sick Pay – Increasing with length of service The Role: We are looking for an experienced SQL Database Administrator. Key Responsibilities: Support and maintain a large-scale data warehouse environment, handling high volumes of structured data. Manage and process incoming data streams from external sources (e.g. cameras and monitoring systems). Develop and support server-side … data processing workflows to ensure timely and accurate data ingestion. Collaborate with 2nd and 3rd line support teams, providing expertise on complex data-related issues. Maintain and optimise the central database infrastructure, ensuring performance, reliability, and scalability. Work closely with stakeholders to deliver custom reports and analytics. Ensure data integrity, transformation, and storage aligns with business … and regulatory requirements. Participate in long-standing, enterprise-level projects requiring consistent support and system knowledge. Troubleshoot data warehouse and integration issues and implement enhancements for improved performance and reliability. Contribute to the design, development, and maintenance of ETL pipelines and reporting systems. Requirements: Microsoft SQL Server Database deployed on-premise and in the cloud. Always On replication to More ❯

you will play a key role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Role Overview: Develop ETL processes to extract and normalise capacity data from infrastructure sources. … Automate data ingestion and processing into SQL Server databases. Normalising raw infrastructure and monitoring data into structured formats suitable for graphing and trending Collaborate with DBAs and technical teams to ensure transparency and supportability. Build data flows that support capacity reporting and trending, using modern technologies. Skills & Experience Required: 3+ years' experience in ETL/data processing roles. Proficiency with ETL tools, SQL Server, RESTful APIs. Experience working with infrastructure data (e.g., Nutanix, VMware, Dell EMC desirable). Scripting experience in Python, SQL (T-SQL), Excel VBA. Knowledge of data optimisation, large datasets, JSON/XML formats. Experience of setting up SQL DTSS and Control/M batch jobs useful Excellent communication, analytical More ❯

geographic data. The Technology Stack Our platform is built using: Frontend : Vue.js for responsive, interactive user interfaces Backend : Node.js with Express framework Database : PostgreSQL with PostGIS extensions for spatial data management GIS : Modern geospatial libraries and mapping technologies Key Responsibilities Backend Development Design and implement robust APIs for geospatial data processing and visualisation Optimise database queries and spatial … operations using PostgreSQL and PostGIS Build scalable microservices architecture to handle large datasets Implement data ingestion pipelines for various GIS formats (GeoJSON, Shapefiles, etc.) Ensure optimal performance for complex spatial queries and real-time data updates Quality Assurance & Testing Develop comprehensive testing strategies including unit, integration, and end-to-end tests Implement automated testing pipelines using modern … and implement performance testing for geospatial operations Technical Leadership Take ownership of backend architecture and drive technical decisions Collaborate with frontend-focused team members to optimise API design and data flow Lead architectural discussions and technical planning for backend systems Code review and establish backend coding standards and best practices Contribute to technical documentation and development guidelines Technical Skills More ❯