226 to 250 of 254 Data Pipeline Jobs in England

home. What you’ll be doing Building and evolving customer-facing platforms, internal tools, and operational systems Working across APIs, services, frontends, and data pipelines Pairing, reviewing code, and solving problems as a team Shipping fast, learning quickly, and improving continuously What we’re looking … Cloud-native – AWS or Azure in real production environments Polyglot engineer – comfortable picking up and switching languages Full-stack capability – frontend, backend, APIs, data Hands-on builder – scripts, CLIs, background workers, not just web apps Modern architecture – serverless, event-driven systems, or breaking apart monoliths Data ...

onboarding of additional delivery capability. You will work primarily across Talend and Oracle RDS platforms , contributing to the development and support of secure data integration and exchange services using established frameworks and patterns. Key Responsibilities Develop and maintain ETL solutions within an existing Talend framework Support data integration and outbound data exchange services Work with Oracle RDS databases to deliver and support data pipelines Collaborate with delivery teams to meet increasing programme demand Ensure solutions align with security, data handling, and quality standards Essential Skills & Experience Active SC Clearance ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

systems using modern cloud-native and streaming technologies. Key Responsibilities Develop event-driven integrations and backend services Build connectors, event-processing services, and data pipelines Design scalable integration patterns, schemas, and event flows Develop CDC pipelines and resilient messaging solutions Improve observability through logging, metrics, and tracing Deploy … streaming technologies Enterprise system integrations and API design Agile development experience Strong communication and collaboration skills Desirable Skills Go and/or Python CDC pipeline development Azure cloud experience Observability tooling (Prometheus, Grafana, OpenTelemetry) Experience within regulated environments What's on Offer Hybrid working - 2 days per week ...

will facilitate research and development within the healthcare sector! This company's diagnostics visualisation platform allows medical researchers to visualise and analyse clinical data in order to develop new treatments that will massively improve the lives of patients. Key to this is the creation of secure multi-tenant … multi-region storage solution that allows swift and secure access to various types of data. Data security and integrity is of paramount importance, and the solution needs to be compliant with healthcare industry software standards. This role calls for strong AWS skills, rapid application development, and software development ...

incidents and investigations Implement platform-level changes to support incident response and remediation Support detection engineering including rule deployment, tuning, and validation Resolve data quality, alerting, and detection gaps impacting operational effectiveness Support automation and SOAR initiatives (e.g. Sentinel, Logic Apps) Collaborate with SOC providers to maintain SIEM … understanding of SIEM, XDR, and security platform integrations Experience in hybrid (on-prem and cloud) environments Strong troubleshooting skills across platforms, integrations, and data pipelines Experience with scripting/automation (PowerShell, Python or similar) Strong understanding of networking, cloud, and infrastructure fundamentals Experience in regulated environments (e.g. financial ...

While the role is full stack in nature, the majority of your time will be spent on backend development, including system architecture, APIs, data pipelines, and cloud-based services. You'll also work across the frontend where needed, ensuring end-to-end solutions are robust, scalable, and maintainable. … What were looking for Essential Strong commercial experience in backend development, NodeJs and TypeScript preferred Solid experience building and maintaining RESTful APIs and data integrations Experience working with relational and/or non-relational databases Hands-on experience with cloud platforms (AWS and/or Azure) Confident using ...

complex multi-platform environment. Reporting directly to the CEO, you will act as the organisation's trusted technical voice, connecting systems, improving data integrity, strengthening vendor accountability, and helping create a scalable technology foundation for future growth. This is a hands-on role suited to someone who enjoys … build, test, and support integrations across Microsoft Dynamics CRM, Business Central, SaaS platforms, and other business systems. Develop and maintain API-based integrations, data pipelines, webhooks, and automated workflows. Troubleshoot integration issues, data discrepancies, and system connectivity challenges. Support platform upgrades, system enhancements, and data ...

complex multi-platform environment. Reporting directly to the CEO, you will act as the organisation's trusted technical voice, connecting systems, improving data integrity, strengthening vendor accountability, and helping create a scalable technology foundation for future growth. This is a hands-on role suited to someone who enjoys … build, test, and support integrations across Microsoft Dynamics CRM, Business Central, SaaS platforms, and other business systems. Develop and maintain API-based integrations, data pipelines, webhooks, and automated workflows. Troubleshoot integration issues, data discrepancies, and system connectivity challenges. Support platform upgrades, system enhancements, and data ...

doing You’ll play a key role in maintaining and evolving our core engineering platforms, including: Backstage and internal developer portal capabilities Engineering data platforms, including ELT workflows, DBT and SQL-based data pipelines Observability and monitoring Grafana platforms Internal automation and workflow platforms that support … Supporting integration across internal platforms and tooling Improving the developer experience through self-service tooling, templates and golden paths Using engineering insights and data to drive continuous improvement Providing technical guidance and support to engineering teams Driving adoption of modern platform tools and practices Mentoring Platform Engineers ...

Develop and enhance algorithmic trading and automated bidding solutions Build scalable back testing frameworks and validation pipelines Integrate new datasets, products, and external data sources Take operational ownership of deployed systems (monitoring, reliability, improvements) Collaborate with engineering, data, and trading teams to deliver robust solutions Drive … Infrastructure: AWS, Docker, Docker Compose, AWS Fargate DevOps & CI/CD: Azure DevOps, CI/CD pipelines, Entra ID Monitoring: Datadog Optimisation: CPLEX Data & APIs: EATT API, AIDA What You'll Be Delivering AWS Fargate-based backtesting infrastructure Rust-based orchestration UI Integration of optimisation models (CPLEX) External ...

building production-ready AI systems using LLMs, this role offers high ownership and the chance to shape how AI is applied in critical, data-intensive domains. The Role: Design, build, and deploy agentic AI systems within a scalable, production environment. This is a hands-on engineering role with … Strong experience building production AI/ML systems Experience with LLMs and agentic AI frameworks Proficiency in Python and working with APIs/data pipelines Experience working with structured or enterprise data Ability to operate in a fast-paced, high-ownership environment If this role ...

including JavaScript/TypeScript and Python Experience with React (frontend) and backend frameworks such as FastAPI or similar Experience designing and implementing scalable data pipelines and database structures Hands-on experience with cloud infrastructure, ideally AWS Strong understanding of security and compliance considerations including ISO 27001 and GDPR … evolve it into a production-ready SaaS platform for enterprise customers Build and maintain a secure, scalable backend capable of handling sensitive enterprise data Design and develop high-quality frontend interfaces that make complex AI outputs intuitive and actionable for users Build and maintain deployment pipelines, testing frameworks ...

with cloud infrastructure, containerisation (Docker, Kubernetes), CI/CD pipelines, and deployment of Azure-hosted or similar cloud services. Experience designing and building data pipelines for ingestion, transformation, and storage at reasonable scale. Strong analytical and problem-solving skills, including the ability to work with evolving requirements, translate … startup experience. This focuses more on the engineering aspects than before: Shifted emphasis from evaluation/research to platform engineering, APIs, data pipelines, deployment, and operational reliability Added CI/CD, monitoring, containerisation, and deployment as explicit responsibilities Moved ML/evaluation experience from required to preferred Made ...

edge platforms Design, curate, and manage image/video datasets for training and evaluation Develop and maintain annotation workflows and tooling Create synthetic data pipelines (including generative approaches) to augment real-world datasets Stay current with emerging tools, methods, and best practices in CV/ML What … mindset with strong problem-solving ability Clear communicator who works well in a collaborative team Nice to Have Experience with real-world sensor data (e.g., RGB-D, thermal, radar) Model optimisation/deployment tooling (ONNX, TensorRT) Edge deployment experience (e.g., NVIDIA Jetson or other resource-constrained devices) Familiarity ...

specialist technology consultancy based in Bristol. We help large organisations banks, energy companies, airports, investment platforms get real value from the data that flows through their IT infrastructure. That means helping them monitor their systems, protect their networks, and make sense of the information their technology generates every … consultants, and building skills that have a clear path to progression. The Opportunity Were looking for a Graduate Consultant to join our Data practice. Youll work alongside senior colleagues on the design, deployment, and optimisation of monitoring and observability platforms primarily Splunk and Cribl helping enterprise clients ...

Life Cycle. The successful candidate will support the integration of AI/ML models into enterprise systems, working closely with architects, engineers, and data teams. This programme is focused on: Scaling AI capability across a complex enterprise landscape. Transitioning from proof-of-concept to production AI systems. Embedding … models (including LLMs and agentic components) into enterprise systems. Prepare and manage model inputs/outputs, validation processes, and interaction patterns. Collaborate with data engineers to ensure data pipelines meet model requirements (quality, lineage, reliability). Execute structured model testing, performance evaluation, and safety/bias ...

role is 100% on site. The successful candidate will join our development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real … time data flows, and complex multi-threaded processing pipelines. Proficient in C++ and with knowledge of C#, you will play a critical part in the design, development, integration, and verification of test software solutions that are central to our system validation and delivery capabilities. Responsibilities: Design and develop ...

Hiring: Manager - Platform Engineer (AI & Data Solutions) I'm currently working on an opportunity for a Manager level Platform Engineer to join a Technology & Transformation team, focused on delivering large-scale cloud and data platform solutions across complex enterprise environments. This role sits within AI & Data … services (GKE, Compute Engine, IAM, VPC, Cloud Storage, etc.)* Strong background in Infrastructure as Code (Terraform or similar tools)* CI/CD pipeline design and automation (Jenkins, GitLab CI, Cloud Build, etc.)* Strong scripting ability (Python, Bash, or Go)* Containerisation and orchestration (Docker, Kubernetes, GKE)* Strong understanding of cloud ...

arisen for an experienced KDB Developer to work alongside their Quants and Traders. This is an exciting opportunity to take ownership of critical data and analytics capabilities in a business where your work will directly support front-office decision-making, research, and platform performance. In addition … months. THE ROLE: KDB Developer This position sits within a small, highly capable team focused on building, improving and supporting the firms data environment. The successful candidate will play a key role in designing and developing scalable data collection and analytics solutions, while helping ensure ...

critical solutions for National Security customers - building products that protect people, platforms, missions and information against evolving threats. You'll help customers use data to improve mission outcomes, lead teams hands-on, and mentor others while working at the forefront of innovation. What you'll be doing … patterns across established and emerging technologies. Convert designs into working implementations and document to required standards. Develop and maintain APIs, UI components and data pipelines within existing data infrastructure. Lead and contribute to agile ceremonies (stand-ups, refinement, planning, demos). Keep the team aligned ...

areas linked to statutory and non-statutory duties which protect and improve the health, wellbeing and safety of our residents. We utilise data and evidence to help guide decisions on investment and targeting of particular programmes of work. Role Lead or support data analysis, surveys … statistical methods within team and with wider stakeholders, maintaining links to external partners to keep abreast of best practice Management of data pipelines from across the local authority and partners Deep-dive analysis on priority areas for the local authority and partners, such as child development, domestic abuse ...

through to booking, enrichment, reconciliation and analytics. This is a hands on engineering role where you will own production systems, improve reliability, optimise data flows and help shape the architecture behind one of the most advanced trading environments in the industry. The environment is deeply technical, collaborative … quality driven, with strong expectations around software engineering standards, data integrity, and scalable distributed design. Core Requirements • Strong Computer Science background with 5 years Python engineering in trading or post trade domains • Proven experience building data intensive services and working with PostgreSQL and data ...

questions into production ready LLM and RAG workflows Debug, optimise and scale LLM applications in real world, client facing environments Build and integrate data pipelines and services across cloud platforms and modern data stacks Collaborate with non technical stakeholders, clearly explaining platform capabilities and guiding them … back into product and engineering teams to shape the roadmap Your Skills and Experience Strong commercial engineering experience in AI, machine learning or data focused roles Hands on experience with retrieval augmented generation and production LLM workflows Confidence debugging and improving end to end LLM systems in live ...

office 5 days a weekStart: ASAP This is an opportunity to take ownership of a critical ML platform used day to day by data, machine learning, and robotics engineers. You will work on real production systems that sit at the heart of data capture, dataset creation … tooling that unblocks entire teams. The Company They are a technology-driven organisation building a sophisticated platform at the intersection of machine learning, data infrastructure, and robotics. The environment is highly collaborative, bringing together software engineers, ML specialists, and robotics engineers to solve complex, real world problems. Engineering ...