5 of 5 Data Ingestion Jobs in the South West

Role: Technical Data Architect Location: UK (remote is fine, candidate must be in UK and available for any IMP meeting) Contract: 3 months (will likelyextend) Data Feed Factory - for Telco Network Function Expectations on the role : Hands on Experience on design & architecture of the Data Platform, Technical components and Data Engg. related activities for supporting the … key capabilities Technical Data Architecture Data Ingestion framework ( Batch/Micro Batch processing ) Data Contract & Data management( including DQ, metadata & lineage) Delivery, Scaling & Op Model Discovery/assessment along with the Data platform requirements Identify and document the relevant data sources to be used for collection & ingestion, cataloging, defining Data management. … This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/technical requirements for More ❯

Data Engineer £700/day outside IR35 3-month initial contract Remote working - occasional site visits Working with a leading financial services client who are looking for a Data Engineering Consultant. Looking for someone who can act independently and deliver complex data products - work with stakeholders to understand requirements, engineer and deliver products. Data Engineering Consultant … key responsibilities: Work cross-functionally with non-technical stakeholders to understand data requirements Expert knowledge of SQL to query, analysis and model data Experience with Snowflake Using DBT for data transforms and modelling Data ingestion using Python Build foundations for business functions to be able to access the correct data and insights Experience working More ❯

Our client a high profile deep-tech organisation, urgently require an experienced AI/Data Developer to undertake a contract assignment. In order to be successful, you will have the following experience: Extensive AI & Data Development background Experiences with Python (including data libraries such as Pandas, NumPy, and PySpark) and Apache Spark (PySpark preferred) Strong experience with … data management and processing pipelines Algorithm development and knowledge of graphs will be beneficial SC Clearance is essential Within this role, you will be responsible for: Supporting the development and delivery of AI solution to a Government customer Design, develop, and maintain data processing pipelines using Apache Spark Implement ETL/ELT workflows to extract, transform and load … large-scale datasets efficiently Develop and optimize Python-based applications for data ingestion Collaborate on development of machine learning models Ensure data quality, integrity, and performance across distributed environments Contribute to the design of data architectures, storage strategies, and processing frameworks Work with cloud data platforms (e.g., AWS, Azure, or GCP) to deploy scalable solutions More ❯

commercial, military, business, and general aviation aircraft. An MFT (Managed File Transfer) admin is responsible for managing and maintaining the MFT platform, ensuring the secure and reliable transfer of data between different systems and partners. This includes creating and managing connections, configuring security settings, managing user permissions, monitoring transfer activity, and troubleshooting issues. Key responsibilities: Design, deploy, and support … InfoArchive solutions based on business requirements. Perform installation, configuration, and upgrades of the InfoArchive platform on UNIX systems. Develop and manage data ingestion pipelines into InfoArchive from various enterprise applications. Monitor and tune PostgreSQL databases used by InfoArchive for performance and stability. Write and optimize scripts for automation, maintenance, and monitoring of archive processes. Collaborate with application, infrastructure … and compliance teams for integration and data governance. Troubleshoot production issues related to InfoArchive and its underlying components (UNIX, DB). Document architecture, configurations, procedures, and troubleshooting guides. Key Skills/Knowledge Hands-on experience with OpenText InfoArchive – design, deployment, and maintenance. Strong proficiency in UNIX/Linux environments (shell scripting, system commands, etc.). Expertise in PostgreSQL administration More ❯

commercial, military, business, and general aviation aircraft. An MFT (Managed File Transfer) admin is responsible for managing and maintaining the MFT platform, ensuring the secure and reliable transfer of data between different systems and partners. This includes creating and managing connections, configuring security settings, managing user permissions, monitoring transfer activity, and troubleshooting issues. Key responsibilities: Design, deploy, and support … InfoArchive solutions based on business requirements. Perform installation, configuration, and upgrades of the InfoArchive platform on UNIX systems. Develop and manage data ingestion pipelines into InfoArchive from various enterprise applications. Monitor and tune PostgreSQL databases used by InfoArchive for performance and stability. Write and optimize scripts for automation, maintenance, and monitoring of archive processes. Collaborate with application, infrastructure … and compliance teams for integration and data governance. Troubleshoot production issues related to InfoArchive and its underlying components (UNIX, DB). Document architecture, configurations, procedures, and troubleshooting guides. Key Skills/Knowledge Hands-on experience with OpenText InfoArchive – design, deployment, and maintenance. Strong proficiency in UNIX/Linux environments (shell scripting, system commands, etc.). Expertise in PostgreSQL administration More ❯