76 to 100 of 106 Data Pipeline Jobs in the South West

seeking a skilled AWS Cloud & Python Engineer to bridge application development and cloud infrastructure from Exeter. You will own end-to-end data transformation apps, writing clean Python and designing AWS infra with Terraform for scalable, high-performance processing. You will work in a hybrid setup from ...

Scott Logic in the UK delivers bespoke software and data platforms. Data engineers work hands-on with Python, Spark, SQL and BI tools to transform data into insights for clients. Roles are senior/lead with client-facing expectations; some on-site work … London area, with flexibility for remote in a hybrid model. We value collaboration, modern toolsets, and a pragmatic approach to data and analytics, helping clients make the best use of their data. #J-18808-Ljbffr ...

Senior Data Engineer (Contract) x3 South West - Highly Remote 6 Months £600-£700/day Umbrella ASAP Start Core Skills: Data Engineering, Snowflake, dbt, AWS, SQL, Data Modelling, Cloud Platforms, Agile Delivery, Data Pipelines, Analytics Engineering An exciting opportunity has arisen … Senior Data Engineers to join a high performing Data & Analytics team during a critical period of growth an click apply for full job details ...

deploy intelligent, scalable applications. You will work at the intersection of backend engineering and artificial intelligence, building systems that integrate machine learning models, data pipelines, and cloud-native services. This role is ideal for someone passionate about clean architecture, performance optimization, and applying AI technologies to real-world … based applications Integrate AI/ML models into production-grade backend systems Build RESTful APIs and microservices using modern Java frameworks Collaborate with data scientists to deploy and scale machine learning solutions Optimise system performance, scalability, and security Implement CI/CD pipelines and ensure high code quality ...

deep technical engine behind our internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath — data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … models, schemas, and storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

About Ripjar Ripjar specialises in the development of software and data products that help governments and organisations combat serious financial crime. Our technology is used to identify criminal activity such as money laundering and terrorist financing, enabling organisations to enforce sanctions at scale to help combat rogue entities … state actors. Data infuses everything Ripjar does. We work with a wide variety of datasets of all scales, including an ever‐growing archive of billions of news articles covering most languages going back over 30 years, sanctions and watchlist data provided by governments, and vast organisation ...

solutions using SDD - Spec Driven Development Utilise your strong C# background to ensure AI agents integrate seamlessly with core enterprise systems, APIs, and data pipelines. Refine prompt engineering, agent autonomy, and guardrails to ensure high performance, security, and accuracy. Proven experience building Agentic AI systems (autonomous agents, multi ...

solutions using SDD - Spec Driven Development Utilise your strong C# background to ensure AI agents integrate seamlessly with core enterprise systems, APIs, and data pipelines. Refine prompt engineering, agent autonomy, and guardrails to ensure high performance, security, and accuracy. Proven experience building Agentic AI systems (autonomous agents, multi ...

workflows across the group Experimenting with large language models (LLMs), APIs, and emerging AI platforms to solve real business challenges Developing internal dashboards, data pipelines, and reporting tools to support commercial decision-making Researching and evaluating new AI technologies, tools, and vendors relevant to talent acquisition and professional … services Collaborating with consultants, managers, and clients to understand pain points and translate them into technical solutions Supporting data quality, CRM optimisation, and systems integration projects across the business Contributing to the company’s broader technology strategy and AI roadmap What We’re Looking For: A qualification ...

seeking a BI Developer to join the Estates Intelligence team in the United Kingdom. The role focuses on building and maintaining the Reporting Data Warehouse, creating BI datasets, and driving data-driven insights for estates and facilities projects. Hybrid work with 3 days in Swindon. … will develop ML algorithms in Fabric Notebooks, implement SQL data transformations, and configure data pipelines and governance across Dev/Test/Prod environments. #J-18808-Ljbffr ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates …/ML platforms and workloads on AWS (or multi-cloud with strong AWS depth). Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data ...

area. Device & Embedded Software Systems Embedded Linux, C++/Python, embedded systems, multi-sensor and camera-based devices (including thermal and line-scan), data acquisition and edge processing, device-to-cloud pipelines, networking, system integration, hardware/software collaboration, field diagnostics, performance optimisation, secure and robust systems, Linux … build systems (e.g. Yocto), media pipelines (e.g. GStreamer), FFMPEG, IoT devices, sensor data processing, signal conditioning, computer vision, FPGA exposure, electronics fundamentals. Platform Engineering Cloud infrastructure, AWS, distributed systems, backend services, RESTful APIs, microservices architecture, service integration, data pipelines, storage systems, relational databases (MySQL), scalability, system ...

AtkinsRéalis is seeking an experienced Azure Data Engineer to design, build, and maintain scalable data pipelines on the Microsoft Azure platform. You will optimise data storage, processing, and enable data-driven decision-making for diverse client projects. The role requires expertise … Azure data services, ETL/ELT patterns, and collaborating with stakeholders to deliver robust solutions in a fast-paced agile environment. Some on-site work at client sites is required. #J-18808-Ljbffr ...

Kubernetes, Elastic Container Service, or equivalent technologies in production environments Strong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, data pipelines, PostgreSQL, MongoDB, Redis, vector databases, observability, and automated deployment pipelines Demonstrated ability to influence technical direction while remaining close to the codebase, mentoring … coding, reviewing, debugging, and improving production systems that support AI-powered products and services Design and build scalable backend services, application programming interfaces, data pipelines, inference pipelines, and platform capabilities that support real-time and batch AI workloads at enterprise scale Implement advanced large language model applications using ...

Kubernetes, Elastic Container Service, or equivalent technologies in production environments Strong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, data pipelines, PostgreSQL, MongoDB, Redis, vector databases, observability, and automated deployment pipelines Demonstrated ability to influence technical direction while remaining close to the codebase, mentoring … coding, reviewing, debugging, and improving production systems that support AI-powered products and services Design and build scalable backend services, application programming interfaces, data pipelines, inference pipelines, and platform capabilities that support real-time and batch AI workloads at enterprise scale Implement advanced large language model applications using ...

applications on AWS . Integrate Large Language Models (LLMs), vector databases, and modern AI frameworks into production systems. Build secure, reliable, and performant data pipelines to power AI applications. Collaborate with product managers, engineers, and stakeholders throughout the deployment lifecycle. Optimize AI solutions for performance, reliability, and cost. … developing Generative AI applications using modern LLMs. Strong understanding of AI application architecture, APIs, and distributed systems. Experience working with structured and unstructured data . Ability to rapidly prototype solutions and iterate in fast-moving customer environments. Excellent problem-solving and debugging skills. Strong communication skills with ...

with cloud and third-party AI services to deliver production-ready outcomes. Your role spans the full solution lifecycle assessing client needs and data, selecting and customizing models (including Deep Learning, Generative AI, and Large Language Models), designing scalable data and DevOps &MLOpspipelines for training … practical, efficient, and scalable AI and Machine Learning solutions Develop and implement machine learning algorithms, models, and computational systems; design and build scalable data pipelines to support model training and production with DevOps &MLOps Customize and apply Deep Learningand Gen AI models for various use cases based ...

Enablement Team is the catalyst for internal transformation and product acceleration across Actian. In the modern data landscape, AI is not a siloed experimental lab; it is a core capability that must be embedded into our product DNA and our engineering workflows. We are looking … safely, rapidly, and at scale. You will democratize AI across the organization, establish modern LLMOps/MLOps practices, and directly impact the Actian Data Intelligence Platform by introducing agentic workflows, intelligent data pipelines, and cutting-edge capabilities. Core Responsibilities: Internal AI tooling: Design and maintain ...

Enablement Team is the catalyst for internal transformation and product acceleration across Actian. In the modern data landscape, AI is not a siloed experimental lab; it is a core capability that must be embedded into our product DNA and our engineering workflows. We are looking … safely, rapidly, and at scale. You will democratize AI across the organization, establish modern LLMOps/MLOps practices, and directly impact the Actian Data Intelligence Platform by introducing agentic workflows, intelligent data pipelines, and cutting-edge capabilities. Core Responsibilities: Internal AI tooling: Design and maintain ...

colleagues to understand requirements and priorities Share knowledge, contribute ideas and support a collaborative team culture Good understanding of computer science fundamentals, including data structures, algorithms and software design Practical experience with classical machine learning techniques and an awareness of modern approaches such as natural language processing … deep learning Strong Python skills and experience with common libraries such as Pandas, scikit-learn and Jupyter Experience working with SQL and data pipelines to prepare and transform data for model training Understanding of model evaluation, monitoring and improving performance in a production environment Familiarity with ...

technical design through production deployment and ongoing operation with limited supervision Hands-on experience with cloud-native technologies, serverless applications, event-driven architectures, data pipelines, relational and NoSQL databases, vector databases, observability tooling, and automated deployment pipelines Solid understanding of algorithms, data structures, scalability, reliability, performance … related discipline, or equivalent professional experience Responsibilities Designs, builds, and operates the services and AI-powered features behind Moody's intelligent data products as a senior contributor within the Digital Content and Innovation organization. Design, code, test, and operate backend services, application programming interfaces, data pipelines ...

Rates Swap Derivative products and Options products . You will be responsible for developing scalable, performant code that handles large volumes of market data and complex financial calculations. This includes implementing risk metrics, PnL attribution frameworks, and data pipelines that connect trading systems with downstream consumers. … rates products including Swaps, Securities, Options, and Repo Familiarity with risk methodologies and PnL calculation frameworks Experience with distributed systems and real-time data processing Proficiency with relational and NoSQL databases Knowledge of modern development practices including CI/CD pipelines and containerization Exposure to quantitative finance concepts ...

Must hold active Enhanced DV Clearance (West)/n - Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus/n - Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL/n/n Who Are We?/n Our client ...

Senior Product Manager | £65,000 - £75,000 | UK/Remote | Data | Suitability | Recycling | Tech4good | Data Pipelines | Azure | Regulations Looking to have ownership to launch a greenfield product? Or maybe you want to build something which is helping the planet, if so I have a role … you. I am supporting a brilliant company that harness data and insights which allow household names such as M&S become more sustainable and environmentally friendly. As a Senior Product Manager you will be launching a brand new product which will be used to allow companies and international ...