24 of 24 Permanent Data Pipeline Jobs in Aberdeen

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Maintain accurate data dictionaries, metadata, and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards. Contribute to the evolution of internal audit data strategy ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer. The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

Contract Type: 5 months (Outside IR35) Location: Remote, United Kingdom Daily Rate: £350 per day We are currently recruiting for an experienced Data Engineer to join a leading consulting firm on a 5-month contract basis. This is a fully remote role, based in the United Kingdom. … with cloud platforms – AWS or GCP is essential, both would be highly beneficial Deep understanding of ETL/ELT processes and data pipeline development Strong problem-solving skills and the ability to work independently in remote settings Excellent communication skills and a consultative mindset This ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Title: Data Engineer Location: Hybrid/Manchester Rate: £400/day Inside Ir35 Duration: until 31/03/26 to begin with About Us: Brio Digital are currently supporting a public sector consultancy who are currently looking for a skilled Data Engineer with … experience with R, Shiny & Databricks. Role Overview: As a Databricks Engineer, you will design, develop, and manage data solutions on the Databricks platform, enabling high-performance data pipelines and analytics. This role will work closely with data scientists, analysts, and engineering teams to support ...

Hiring: Data Consultant – HealthTech We're supporting a leading healthtech provider in their search for a Data Consultant to help implement, configure, support, and maintain complex data pipelines that make a real impact in healthcare. What You'll Be Doing Translating business requirements into … clear technical specifications Ensuring the data warehouse aligns with stakeholder needs Creating, enhancing, and documenting data specifications, including mapping data from NHS source systems into a dimensional data warehouse Developing and delivering solutions for data extraction, integration, and transformation What ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data … What We're Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services ...

Position Overview We are seeking a highly skilled Machine Learning Engineer to design, build, deploy, and optimise machine learning models that power data-driven products and business solutions. This role bridges data science and software engineering, focusing on production-ready ML systems, scalability, and performance. … ideal candidate has strong experience in Python, ML frameworks, data pipelines, and cloud platforms, and is comfortable working in a fully remote, collaborative environment within the UK. Key Responsibilities 1. Machine Learning Model Development Design, develop, train, and evaluate machine learning models for prediction, classification, recommendation, or automation ...

Senior Data Scientist SME & AI Architect (10+ Years Experience) We are seeking a highly accomplished and results-oriented Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep … technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains, including Generative AI, Computer Vision, and Natural Language Processing (NLP). You will be the principal technical leader, driving strategy, setting standards, and delivering high-impact solutions that transform business outcomes. ...

translate your vision of a modern marketing function - embracing the latest ideas, methodologies and technologies - into a high performing reality. About the Data Analyst Role As a Data Analyst in Modern's Digital team, you'll support the development and delivery of our reporting, measurement … data systems, helping translate raw data into insights that drive client success through our proprietary platform. This is a great fit for someone a year or two into their data career that's curious, collaborative and ready to learn in a fast-moving digital ...

senior Business Intelligence contractor to play a pivotal role in a greenfield Microsoft Fabric implementation, replacing a legacy on-premise SQL data warehouse across a multi-country European organisation. This is a high-impact, advisory-led role for someone who understands Azure and Fabric deeply, can confidently challenge … Doing Provide technical direction and oversight for the migration to Microsoft Fabric Act as the technical conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets ...

building management systems (BMS). This role is responsible for creating robust server-side solutions within the Niagara Framework (N4) that enable efficient data exchange, automation workflows, and system interoperability. The specialist will work across a range of building systems and assets including HVAC, lighting, energy metering, environmental … Framework Development Design, develop, and maintain server-side components and logic within the Niagara N4 platform. Build and deploy custom services, APIs, and data flows to support complex multi-system integration requirements. Configure and optimize Niagara stations, drivers, network settings, and performance for large-scale environments. MQTT ...

Title: Observability Engineer (Custom Data Integration) Location: Remote(UK) Key responsibilities Design and implement observability frameworks: Integrate and manage monitoring, logging, and tracing for cloud-native and on-premises systems. Data integration and ingestion: Build systems to collect and ingest data from various sources … often through APIs, and manage time-series data at scale. Develop custom solutions: Create custom dashboards, alerts, and reporting views to provide clear, actionable insights into system performance. Build status pages: Develop and maintain status pages that provide a user friendly web experience to communicate system health ...

Data & AI Senior Consultants Location - We are flexible: onsite, hybrid or fully remote, depending on what works for you and the client, UK or Netherlands based. What you will actually be doing This is not a role where you build clever models that never get used. Your focus … creating measurable value for clients using data science, machine learning and GenAI, in a consulting and advisory context. You will own work from the very beginning, asking questions like \"What value are we trying to create here?\" and \"Is this the right problem to solve?\" through ...

powered applications from frontend to model serving Build intuitive user interfaces Develop scalable backend systems using Python and Go for model inference, data pipelines, and API services Develop sophisticated prompt engineering strategies for LLM-based features, including few-shot learning, chain-of-thought reasoning, and retrieval-augmented generation ...

Azure stack, including Logic Apps and Function Apps Experience with Microsoft Power Platform tools Proven experience building and maintaining API integrations and data pipelines (REST, JSON, XML, JDBC) Desirable Experience: Experience with MuleSoft Experience with Workday If this role sounds of interest, please contact Megan ...

with prompt engineering, tool calling, retrieval-augmented generation (RAG), and multi-agent workflows Experience integrating AI into real systems, APIs, event-driven architectures, data pipelines, and automation platforms (e.g. UiPath, Blue Prism) Comfortable experimenting with new models, SDKs, and platforms, and evaluating what's production-ready vs hype ...

model capabilities and protocols. Leadership & Collaboration - Collaborate on UI/UX integration, code reviews, architecture and roadmap decisions, and cross-functional work with data science, product, and commercial teams. Data Engineering - Design and maintain efficient data pipelines, ensuring smooth data flow between ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

Lead Data Engineer – Contract - OUTSIDE IR35 £400 per day - 6 months (potential to be extended) - Immediate Start Remote (UK-based) Uneek is looking for a Lead Data Engineer to join on a 6-month contract with the possibility to extend. This role is remote (UK-based … data pipelines using dbt, SQL, and Snowflake Delivering backlog items and improving data models Driving tech debt remediation and pipeline reliability Collaborating with engineers, analysts, and stakeholders to enhance data delivery Start Date: Immediate – quick interview process. ...

rehabilitation progress. -Behavioural analytics (e.g., detecting self-harm risk via AIM). -Intelligent workflow automation for case management systems. Develop and optimize robust data pipelines, ensuring privacy and compliance with strict security standards. Continuously improve model accuracy, fairness, interpretability, and scalability. Stay up to date with research … recommend innovations that align with Unlinks vision and the sensitive nature of justice services. Person Specification Must-Have: Degree in Computer Science, AI, Data Science, or equivalent experience. Strong Python skills, with experience in ML libraries like TensorFlow, PyTorch, scikit-learn. Solid understanding of ML principles, algorithms ...

top. We're working with a fintech scale-up building the next generation of intelligent financial products, automated decisioning, predictive insights, real-time data layers, and genuinely smart user experiences powered by applied AI. They're looking for a Product Manager who isn't scared of the unknown. … Turning ML capabilities (Python, TensorFlow, PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless ...

whose platform shows large enterprises how they could be compromised in real time, before attackers succeed. They blend attacker behavior, large-scale data pipelines and automated offensive security to give security teams true, live exposure visibility. The Role for Engineering Manager, Cybersecurity Applications You'll be the global … account lifecycle, auth/SSO, granular access control, notifications, logging and multi-tenancy • Partner tightly with Product and Design to turn complex security data into simple, powerful workflows that customers love • Shape engineering practices across teams, embedding quality, security and agility into how software is built and shipped ...