3 of 3 Data Ingestion Jobs in Gloucestershire

Our client a high profile deep-tech organisation, urgently require an experienced AI/Data Developer to undertake a contract assignment. In order to be successful, you will have the following experience: Extensive AI & Data Development background Experiences with Python (including data libraries such as Pandas, NumPy, and PySpark) and Apache Spark (PySpark preferred) Strong experience with … data management and processing pipelines Algorithm development and knowledge of graphs will be beneficial SC Clearance is essential Within this role, you will be responsible for: Supporting the development and delivery of AI solution to a Government customer Design, develop, and maintain data processing pipelines using Apache Spark Implement ETL/ELT workflows to extract, transform and load … large-scale datasets efficiently Develop and optimize Python-based applications for data ingestion Collaborate on development of machine learning models Ensure data quality, integrity, and performance across distributed environments Contribute to the design of data architectures, storage strategies, and processing frameworks Work with cloud data platforms (e.g., AWS, Azure, or GCP) to deploy scalable solutions More ❯

commercial, military, business, and general aviation aircraft. An MFT (Managed File Transfer) admin is responsible for managing and maintaining the MFT platform, ensuring the secure and reliable transfer of data between different systems and partners. This includes creating and managing connections, configuring security settings, managing user permissions, monitoring transfer activity, and troubleshooting issues. Key responsibilities: Design, deploy, and support … InfoArchive solutions based on business requirements. Perform installation, configuration, and upgrades of the InfoArchive platform on UNIX systems. Develop and manage data ingestion pipelines into InfoArchive from various enterprise applications. Monitor and tune PostgreSQL databases used by InfoArchive for performance and stability. Write and optimize scripts for automation, maintenance, and monitoring of archive processes. Collaborate with application, infrastructure … and compliance teams for integration and data governance. Troubleshoot production issues related to InfoArchive and its underlying components (UNIX, DB). Document architecture, configurations, procedures, and troubleshooting guides. Key Skills/Knowledge Hands-on experience with OpenText InfoArchive – design, deployment, and maintenance. Strong proficiency in UNIX/Linux environments (shell scripting, system commands, etc.). Expertise in PostgreSQL administration More ❯

commercial, military, business, and general aviation aircraft. An MFT (Managed File Transfer) admin is responsible for managing and maintaining the MFT platform, ensuring the secure and reliable transfer of data between different systems and partners. This includes creating and managing connections, configuring security settings, managing user permissions, monitoring transfer activity, and troubleshooting issues. Key responsibilities: Design, deploy, and support … InfoArchive solutions based on business requirements. Perform installation, configuration, and upgrades of the InfoArchive platform on UNIX systems. Develop and manage data ingestion pipelines into InfoArchive from various enterprise applications. Monitor and tune PostgreSQL databases used by InfoArchive for performance and stability. Write and optimize scripts for automation, maintenance, and monitoring of archive processes. Collaborate with application, infrastructure … and compliance teams for integration and data governance. Troubleshoot production issues related to InfoArchive and its underlying components (UNIX, DB). Document architecture, configurations, procedures, and troubleshooting guides. Key Skills/Knowledge Hands-on experience with OpenText InfoArchive – design, deployment, and maintenance. Strong proficiency in UNIX/Linux environments (shell scripting, system commands, etc.). Expertise in PostgreSQL administration More ❯