22 of 22 Data Pipeline Jobs in Dorset

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

About The Role Team – Data Engineering Working Pattern - Hybrid – 2 days per week in the Vitality Bournemouth or London Office. Full time, 37.5 hours per week. We are happy to discuss flexible working! Top 3 skills needed for this role: Designing and maintaining resilient data pipelines … Collaborating with cross-functional stakeholders Building well-structured datasets and automated processes What this role is all about: Join us as a Data Engineer and help build the data foundations that power machine learning and analytics across Vitality. You’ll work with rich datasets and modern ...

Title: Data Engineer Location: Hybrid/Manchester Rate: £400/day Inside Ir35 Duration: until 31/03/26 to begin with About Us: Brio Digital are currently supporting a public sector consultancy who are currently looking for a skilled Data Engineer with … experience with R, Shiny & Databricks. Role Overview: As a Databricks Engineer, you will design, develop, and manage data solutions on the Databricks platform, enabling high-performance data pipelines and analytics. This role will work closely with data scientists, analysts, and engineering teams to support ...

Senior Data Engineer – Remote (UK) - £70K-£80K Are you passionate about building robust data solutions that power analytics and business intelligence? We're working with a global organisation seeking a talented Senior Data Engineer to join their IT team and play a key role … shaping their centralised data platform. About the Role As a Data Engineer, you'll design, develop, and maintain scalable data pipelines and integration solutions that enable secure, efficient data flows across the business. You'll collaborate with internal stakeholders and external partners ...

Position Overview We are seeking a highly skilled Machine Learning Engineer to design, build, deploy, and optimise machine learning models that power data-driven products and business solutions. This role bridges data science and software engineering, focusing on production-ready ML systems, scalability, and performance. … ideal candidate has strong experience in Python, ML frameworks, data pipelines, and cloud platforms, and is comfortable working in a fully remote, collaborative environment within the UK. Key Responsibilities 1. Machine Learning Model Development Design, develop, train, and evaluate machine learning models for prediction, classification, recommendation, or automation ...

Senior Data Scientist SME & AI Architect (10+ Years Experience) We are seeking a highly accomplished and results-oriented Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep … technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains, including Generative AI, Computer Vision, and Natural Language Processing (NLP). You will be the principal technical leader, driving strategy, setting standards, and delivering high-impact solutions that transform business outcomes. ...

client is looking for a Salesforce-centric Data & Integration Technical Engineer to own and evolve the entire Sales & Marketing tech stack for a fast-growing group of Salesforce-based SaaS companies. You will operate at the intersection of data engineering, Salesforce development, and go-to-market … single, intelligent ecosystem. We are looking for a technical engineer, deeply fluent in Salesforce architecture & development, and capable of administering and extending Salesforce Data Cloud to unify data across multiple orgs. You will design and maintain the backbone that connects Data Cloud, 5+ Salesforce ...

translate your vision of a modern marketing function - embracing the latest ideas, methodologies and technologies - into a high performing reality. About the Data Analyst Role As a Data Analyst in Modern's Digital team, you'll support the development and delivery of our reporting, measurement … data systems, helping translate raw data into insights that drive client success through our proprietary platform. This is a great fit for someone a year or two into their data career that's curious, collaborative and ready to learn in a fast-moving digital ...

challenge. We believe we're on the brink of creating something truly awesome. What will you do? We're looking for a Lead Data Engineer to drive the next phase of our data strategy at Midnite. This is a hands-on leadership role where … technical direction, own the design and scalability of our data infrastructure, and ensure the team delivers high-quality, impactful solutions. You'll work across the full data lifecycle from ingestion and modelling to orchestration, monitoring, and analytics enablement, while also mentoring engineers and shaping engineering best ...

senior Business Intelligence contractor to play a pivotal role in a greenfield Microsoft Fabric implementation, replacing a legacy on-premise SQL data warehouse across a multi-country European organisation. This is a high-impact, advisory-led role for someone who understands Azure and Fabric deeply, can confidently challenge … Doing Provide technical direction and oversight for the migration to Microsoft Fabric Act as the technical conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets ...

building management systems (BMS). This role is responsible for creating robust server-side solutions within the Niagara Framework (N4) that enable efficient data exchange, automation workflows, and system interoperability. The specialist will work across a range of building systems and assets including HVAC, lighting, energy metering, environmental … Framework Development Design, develop, and maintain server-side components and logic within the Niagara N4 platform. Build and deploy custom services, APIs, and data flows to support complex multi-system integration requirements. Configure and optimize Niagara stations, drivers, network settings, and performance for large-scale environments. MQTT ...

Title: Observability Engineer (Custom Data Integration) Location: Remote(UK) Key responsibilities Design and implement observability frameworks: Integrate and manage monitoring, logging, and tracing for cloud-native and on-premises systems. Data integration and ingestion: Build systems to collect and ingest data from various sources … often through APIs, and manage time-series data at scale. Develop custom solutions: Create custom dashboards, alerts, and reporting views to provide clear, actionable insights into system performance. Build status pages: Develop and maintain status pages that provide a user friendly web experience to communicate system health ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

Title: SC Cleared - Data Engineer (Databricks/Azure) Location: Fully Remote (UK-based) Day rate: Up to £400 a day Inside IR35 Clearance: SC Clearance required Contract Type: 12-month contract Interview Process: One stage Role Overview We are looking for an experienced Data Engineer … required to support a large-scale public sector digital transformation programme currently underway. The programme focuses on migrating data from legacy platforms into modern, cloud-based data environments. Key Responsibilities Design, develop and support data pipelines as part of a cloud migration initiative Build ...

Business Systems & Reporting Specialist (Transitioning to Data & BI Specialist) | Poole | Up to £50,000 | Office Based Are you a technically skilled professional looking for a role that evolves with your career? This is a unique opportunity to join a business during a critical transformation phase, starting with business … systems support and moving into advanced data and BI analytics. As a Business Systems & Reporting Specialist, you will benefit from: Exposure to ERP implementation and modern data platforms Opportunities to transition into a Data & BI Specialist role Autonomy to design and maintain reporting solutions ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

have : Java, Spring, Microservices, AWS, Kafka, JD: Design, develop, and maintain scalable microservices using Java and Spring Boot. Build and optimize real-time data pipelines leveraging Apache Kafka, Flink, and Spark/Databricks. Develop robust data distribution and streaming solutions for high-throughput systems. Deploy, manage … Spring Boot. Hands-on experience with Microservices architecture and RESTful APIs. Proficiency with Kafka and distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with ...

awareness: you understand value propositions, return on investment, trade-offs (cost vs speed vs write-down risk), and you factor in risk, compliance, data governance when designing solutions. Key Responsibilities Lead technical discovery and scoping phases with prospective clients: understand their business, compliance, risk, operational, regulatory and data environment. Design solution architectures leveraging Aveni's products (Detect, Assist, Agents, FinLLM) plus integrations with client systems (e.g. CRM, communication tools, data pipelines). Develop, deliver, and customise demos, POCs, workshops to illustrate value, ROI, regulatory compliance, risk mitigation, etc. Collaborate with sales teams to respond ...

Role Summary We are seeking a highly skilled Data Engineer with strong AIML (LLMs, Generative AI, Agentic AI) and Python expertise to design, develop, and implement AI/ML-driven solutions for Test Automation within the Securities Processing domain. The ideal candidate will work on building innovative AIML … copilots, autonomous AI agents, and MCP-based systems. Build, train, fine-tune, and evaluate AIML models for automation use cases. Develop Python-based data pipelines and algorithms using NLTK, NumPy, Scikit-learn, Pandas. Collaborate with cross-functional teams in an Agile setup (sprint planning, refinement, retrospectives). Integrate ...

proof, and expand their revenue opportunities. Their product empowers lawyers and finance teams to maximise value from engagements through: Pricing agents that create data-driven, lawyer-friendly quotes. Management tools that predict overruns and help avoid costly late bills. Enrichment engines that clean and structure messy legal datasets … join. The Role: AI/ML Engineer – Agentic Systems You will design and deliver intelligent agentic workflows, leveraging frontier LLMs. Working with their data scientists and backend engineers, you'll be responsible for making unstructured legal data usable, scalable, and impactful. This is not a prototyping ...

will Work end-to-end on new ML models from development through to training and optimising Work closely with a small team of data scientists, engineers and product managers Implement scalable data pipelines and deployment strategies for new models Continuously improve solutions and conduct performance evaluations ...

growth, scaling the platform, and building a high-performing engineering team. About the Role You will take full ownership of the platform architecture, data pipelines, integrations, and multi-tenant SaaS infrastructure. This is a highly visible, strategic role where you will work closely with the founder and early … customers, ensuring the platform is scalable, secure, reliable, and enterprise-ready. Key Responsibilities Own the full platform architecture, including ingestion, scoring, data stores, APIs, and dashboards. Lead AI/ML-powered enrichment and scoring systems. Build and scale microservices, event-driven pipelines, and automated intelligence workflows. Harden cloud ...