2 Data Pipeline Jobs in Kent

My Prop-Fintech client is looking for a Data Engineer to join the Head of Data and 2 data analysts in the building, extraction, and refining of new and innovative datasets. This Geospatial Dataset contains billions of datapoints and has infinite possibilities of growth. … bonus, private healthcare for you and the family, Gym Benefits, and home office equipment. KEY RESPONSIBILITY Design and uphold an efficient data pipeline architecture. Enhance data storage platforms for optimal speed, scalability, reliability, and performance. Oversee critical functions such as data acquisition, extraction … preparation, and processing of extensive datasets for predictive modelling purposes. Conduct web scraping and proficiently manipulate data as required. Take the lead in pioneering modelling techniques utilising emerging technologies. Collaborate closely with data subject specialists to enhance data functionality and accessibility. Provide technical support more »

be able to demonstrate strong capabilities in Azure DevOps methodologies with the ability to implement CI/CD pipelines in collaboration with the data engineering team. Core responsibilities: Lead the implementation and maintenance of CI/CD pipelines for data projects, ensuring efficiency and scalability. Collaborate … for process improvement and implement solutions to streamline development workflows. Monitor system performance and implement optimizations to ensure the reliability and availability of data pipelines and services. Collaborate with cross-functional teams to troubleshoot issues, implement fixes, and ensure timely resolution of technical challenges. Stay up-to-date … with industry trends, emerging technologies, and best practices in DevOps and data engineering. Document processes, configurations, and best practices to ensure knowledge sharing and maintainability of data infrastructure and pipelines. Key technical skill-set: Proven leadership capabilities in regards to project implementation coupled with the ability more »