16 of 16 Data Ingestion Jobs in the South West

site travel as well. Opportunity to condense the hours of work. This role is inside IR35. What you will do as a Senior Data Engineer Design, build and maintain secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage. ...

International Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … approach, youre comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are looking for an experienced Senior Data Engineer to join our team here at our client.You will be working as part of a team, developing and delivering exciting projects with afantastic ...

work every day to make that a reality. Join us and help shape the future of home improvement. Role purpose The Senior Data Designer defines what data is ingested into the Enterprise Data Warehouse and how it is transformed for reporting and downstream use. The role involves … analysing and documenting source system data, designing data ingestion methods and frequencies, and specifying mappings, transformations, and calculations. You will ensure the target data models are coherent, well-documented, and aligned with the wider data warehouse architecture to support clear, business-ready insights. This role ...

Data Engineering Lead required by our client an international educational establishment to provide the technical engine for the Value Management Office automating the visibility of portfolio performance and benefit realization across the organization. It is responsible for building and maintaining the "Value Dashboard," ensuring that data from disparate … integrated to provide a real-time view of strategic ROI. The role holder defines technical standards for value-tracking tools and creates automated data objects that link project outputs to the organisation's strategic objectives. Take the next step in your career now, scroll down to read the full ...

Contract Data Engineer/Analytics Engineer £650-£700 pd outside IR35 Bristol - 1 day per month onsite A leading organisation is seeking an experienced Contract Data Engineer/Analytics Engineer to join its data team. You'll work with business stakeholders and technical teams to deliver scalable … data solutions, enabling trusted insights and data-driven decision-making across the organisation. Key Responsibilities Gather and translate business data requirements into technical solutions. Design and deliver scalable data products and models. Build and maintain DBT transformation pipelines. Write and optimise complex SQL queries for analysis ...

next Data Engineer, you'll be managing and developing data pipelines that transform raw data into valuable insights for Roke's National Security customers, enabling downstream analytics and reporting. You'll be working with diverse data sources (batch, streaming, real-time and unstructured), applying distributed compute … techniques to handle large datasets. What You'll Do * Data pipeline development - Data ingestion and pipeline orchestration design and tooling. * Database schema design/database modelling * Data integration - Integrating and enriching data from various sources, ensuring data consistency and quality. * ETL processing design ...

Data Engineer Location: London (Hybrid) Salary: £50,000£70,000 + bonus and benefits The Opportunity Im working with a leading organisation in the cyber and defence sector that delivers critical technology solutions across national security. Theyre looking to expand their data engineering capability with engineers … build and maintain reliable, scalable data solutions in complex and secure environments. This is an opportunity to work on data platforms that support mission-critical operations, helping transform large volumes of data into trusted, accessible and actionable information. The Role Youll be responsible for developing and enhancing ...

Senior Data Engineer Location: Wiltshire Contract: 2 months Pay: Up to 62.50p/h Inside IR35 (DOE) Due to the nature of the work, we require candidates who already hold active MOD DV clearance . Responsibilities: Design, build and maintain secure, scalable data solutions across the full lifecycle … including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs ...

money. For everyone, everywhere. More about our mission and what we offer . Job Description About the role Were looking for a seasoned, senior Data Engineer with a strong software engineering background to join our Scalable Growth team within the Global Product Tribe . In this role, youll report … Scalable Growth Engineering Lead while embedding day-to-day with the Marketing Platform team. You will serve as the technical authority on data architecture, bridging the gap between platform engineering and analytics engineering. Youll bring maturity, resilience, and scalability to our data infrastructurebuilding and shaping systems that handle ...

Role: We are looking for an experienced AI Engineer to join our team here at our client. You will join a multidisciplinary practice comprising Data Scientists, Data Engineers, and Software Engineers, developing and delivering exciting projects with a fantastic team of technology experts. Your primary focus will … agentic workflows (using frameworks like LangChain, AutoGen, or CrewAI) that can reason, plan, and execute tasks across multiple tools. Production Engineering: Work collaboratively with Data Engineers to ensure model deployments are supported by robust data storage, vector databases, and cloud infrastructure. AI-Assisted Development (AICA ...

teams play a vital role in making pet healthcare more accessible through innovation, operational excellence, and outstanding customer experience. Help Shape the Future of Data at Pet Drugs Online We're looking for a BI Developer to join our growing team and play a key role in transforming data into meaningful insights that help our business thrive. If you're passionate about Power BI, enjoy solving complex data challenges, and love working closely with stakeholders to deliver impactful reporting solutions, we'd love to hear from you. What You'll Be Doing As our BI Developer ...

data solutions company located in Cheltenham is seeking a Data Engineer to develop and operate a Data Collection Hub, ensuring reliable data ingestion and processing. The ideal candidate will have over 2 years of experience in building production software systems, with proficiency in Python ...

deployment of AI/ML solutions aligned to Army training objectives and enterprise architecture principles. Support the development and maintenance of ML pipelines including data pre-processing, feature engineering, model training, validation, and performance evaluation. Support integration of AI capabilities into secure operational environments, ensuring compatibility with DevSecOps pipelines … platform constraints. Monitor deployed models, analyse performance metrics, and implement tuning or retraining strategies to maintain operational effectiveness. Collaborate with data engineers and software teams to support scalable, maintainable, and secure AI components. Review and apply ethical AI principles including bias mitigation, data governance, and regulatory compliance ...

choices while delivering high-quality work within deadlines Leading architecture and software design discussions Collaborating on systems that involve the full ML lifecycle from data ingestion and preprocessing, to model deployment, integration, and performance monitoring Generating new potential solutions to challenges (technical and non-technical) in partnership with … encourage applicants with experience in the following areas: Platform engineering: building reusable software foundations, internal developer platforms, and infrastructure that other teams build on Data Engineering: including platforms like Databricks for data processing and analytics Delivering production agentic systems, including RAG pipelines, vector search, and agentic frameworks such ...

expansion into European markets, there's plenty to get involved in. You'll work closely with engineers and traders, building reliable backend services and data pipelines that support forecasting, trading and day to day business operations. You don't need previous energy or trading experience: curiosity, sound engineering judgement … willingness to take ownership matter most. The role Sitting between backend software engineering and data engineering, this position gives you the chance to understand how your work connects to the wider business, including cash management and financial workflows. You'll: Build and maintain data ingestion services connecting ...

maintainable, and built to scale, adhering to secure development principles. Governance: Implement solutions in line with our AI governance framework, encompassing factors such as data handling, audit logging, human-in-the-loop controls, and regulatory compliance. Cost Management: Monitor and optimise LLM API usage and infrastructure costs, implementing strategies … vector databases: context windows, temperature and sampling parameters, system prompts, tool/function calling. Experience of implementing RAG pipelines end-to-end, including data ingestion, chunking strategies, embedding model selection, and retrieval tuning. Experience of implementing parsing pipelines for tasks such as document processing/ingestion, including ...