14 of 14 Data Pipeline Jobs in Reading

flow across the organisation. Build efficient, fault-tolerant, and highly available data ingestion processes. Monitor and improve data pipeline performance and scalability for low-latency and high-throughput. Work closely with cross-functional teams, including software engineers, data scientists, and business … similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written ...

summary The Data Test Engineer plays a key role in ensuring the quality, reliability, and performance of the Trust's digital applications, data platforms, and integrated clinical systems, focusing on areas such as Electronic Patient Records (EPR), Clinical Applications, Interoperability, Data Systems, Infrastructure … Digital Assurance. Reporting to the Data Assurance and Quality Lead, the role requires strong expertise in data testing and validation and involves designing, executing, and maintaining manual and automated testing processes, ensuring that all systems meet the highest standards of performance, security, and usability. The Test ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

seeking a highly experienced DevOps Engineer with a strong background in Google Cloud Platform (GCP) and a proven track record in delivering complex data analytics projects for clients. In this full-time, permanent role, you will be responsible for designing, implementing, and managing the infrastructure and deployment processes … infrastructures tailored to each client's unique project requirements, ensuring high performance, availability, and security. Work closely with client stakeholders, full-stack developers, data engineers, and data scientists to define and execute efficient data ingestion, processing, and storage solutions that meet project deliverables. Implement ...

DETAILS JOB BAND: D CONTRACT TYPE: 10 Month Attachment/Fixed-term, Full-time DEPARTMENT: Product Group - Data Platform LOCATION: London, hybrid PROPOSED SALARY RANGE: Up to £75,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external … like more information on BBC Extend, please visit the BBC Extend webpage. (EXTEND code: EX2324). PURPOSE OF THE ROLE The BBC Data Platform underpins how data flows across the organisation. It powers our analytics, personalisation, and insights for products such as iPlayer, Sounds, and News. ...

Role: Senior Data Platform Architect (Contract) Duration: 6 months+ IR35: Inside Start: January Location: Remote (occasional on-site as required) Overview A large organisation is maturing its modern cloud-based data platform built on Snowflake and Azure. They have strong leadership, product ownership, and capable data … Azure DevOps/GitHub Actions) Azure Data Services (ADF, Functions, Key Vault, Event Hub, etc.) ELT patterns and data pipeline orchestration Strong understanding of platform security, RBAC/ABAC, governance-enabling patterns, and data quality foundations. Broad experience across integration, platform automation, pipelines ...

experts to design and deliver secure, scalable, and resilient systems for enterprise and government clients. We work across multiple domains - from data privacy and cloud security to AI assurance - ensuring that every solution meets the highest standards of compliance, reliability, and trust. We are now inviting a Security … Architect to join our UK-based team, contributing to large-scale digital transformation programmes that handle sensitive personal and medical data, integrating AI responsibly and securely across hybrid environments. IF YOU ARE An experienced Security Architect or Security Lead with 8+ years of experience designing secure systems ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

will you make an impact in this role? American Express Technologies is seeking a Senior Engineer with advanced skills in Generative AI and Data Engineering to join our Production Management tooling team. Our mission is to transform how critical platforms are supported by embedding AI-first solutions into … meet evolving requirements Design and develop Generative AI applications, including RAG pipelines, agentic workflows, and Model Context Protocol (MCP) integrations. Collaborate with data owners to build data pipelines, feature engineering processes, and context enrichment strategies that optimize AI-enabled solutions. Prototype and deliver production-ready tools ...

Spain Role Purpose: We are looking for an experienced DevOps Engineer to support the implementation, optimisation, and management of our cloud infrastructure and data pipelines. This role requires strong expertise in AWS services and DevOps best practices, with a focus on automation, security, scalability, and reliability. You will … responsible for building and maintaining Infrastructure as Code (IaC) with Terraform, deploying containerized applications using Kubernetes and Docker, and ensuring seamless integration of data ingestion processes. As a key member of our existing DevOps team, you will collaborate with development, data, and operations teams ...

office Key Skills/Knowledge/Experience Required: Proven experience as a DevOps Engineer, Cloud Engineer, or DataOps Engineer working in Azure-based data platforms, supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos … Databricks resources, Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking, Azure Log Analytics, and Azure AD. Proficient in scripting with Python, Bash ...

Software Engineer to join a growing tech company developing a cloud platform used to manage autonomous robotic inspections and transform sensor data into actionable insights for industrial clients. The Role: Youll work across backend, frontend, and data services, contributing to new features, improving existing systems … develop full-stack skills and work with cutting-edge technologies. Key Responsibilities: Develop features across backend and frontend systems Build and maintain APIs, data pipelines, and UI components Write clean, maintainable code following best practices Support cloud deployment (AWS experience beneficial) Build dashboards and tools for processing inspection ...

top. We're working with a fintech scale-up building the next generation of intelligent financial products, automated decisioning, predictive insights, real-time data layers, and genuinely smart user experiences powered by applied AI. They're looking for a Product Manager who isn't scared of the unknown. … Turning ML capabilities (Python, TensorFlow, PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless ...