1 to 25 of 29 Permanent Data Pipeline Jobs in North Yorkshire

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Maintain accurate data dictionaries, metadata, and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards. Contribute to the evolution of internal audit data strategy ...

Title: Data Engineer Location: York, 4x per week Salary: Up to £65,000 Why Apply? This is an opportunity to step into a high-impact Data Engineer role within a growing organisation that is investing heavily in its data capabilities. You'll play … central role in shaping a modern, cloud-based data platform that underpins analytics, reporting, and data products across the business. You will drive business value by designing, building, and maintaining a scalable, secure data platform. Delivering robust data pipelines and trusted datasets ...

Contract Type: 5 months (Outside IR35) Location: Remote, United Kingdom Daily Rate: £350 per day We are currently recruiting for an experienced Data Engineer to join a leading consulting firm on a 5-month contract basis. This is a fully remote role, based in the United Kingdom. … with cloud platforms – AWS or GCP is essential, both would be highly beneficial Deep understanding of ETL/ELT processes and data pipeline development Strong problem-solving skills and the ability to work independently in remote settings Excellent communication skills and a consultative mindset This ...

Senior Data Engineer – Remote (UK) - £70K-£80K Are you passionate about building robust data solutions that power analytics and business intelligence? We're working with a global organisation seeking a talented Senior Data Engineer to join their IT team and play a key role … shaping their centralised data platform. About the Role As a Data Engineer, you'll design, develop, and maintain scalable data pipelines and integration solutions that enable secure, efficient data flows across the business. You'll collaborate with internal stakeholders and external partners ...

Data Engineer Contract Length: 6 months IR35 Status: Inside IR35 Day Rate: £610/day Location: York/Remote (twice a month in the office) Overview WRK digital is excited to partner with a well-known and trusted UK brand to recruit a skilled Data Engineer … technology team focused on scalability, automation, and cloud infrastructure innovation. The successful candidate will play a key role in designing, building, and optimising data pipelines and analytical workflows, with a strong focus on AWS cloud services and Alteryx data automation. Key Responsibilities Design, build, and maintain ...

Hiring: Data Consultant – HealthTech We're supporting a leading healthtech provider in their search for a Data Consultant to help implement, configure, support, and maintain complex data pipelines that make a real impact in healthcare. What You'll Be Doing Translating business requirements into … clear technical specifications Ensuring the data warehouse aligns with stakeholder needs Creating, enhancing, and documenting data specifications, including mapping data from NHS source systems into a dimensional data warehouse Developing and delivering solutions for data extraction, integration, and transformation What ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data … What We're Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services ...

Senior Data Scientist SME & AI Architect (10+ Years Experience) We are seeking a highly accomplished and results-oriented Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep … technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains, including Generative AI, Computer Vision, and Natural Language Processing (NLP). You will be the principal technical leader, driving strategy, setting standards, and delivering high-impact solutions that transform business outcomes. ...

client is looking for a Salesforce-centric Data & Integration Technical Engineer to own and evolve the entire Sales & Marketing tech stack for a fast-growing group of Salesforce-based SaaS companies. You will operate at the intersection of data engineering, Salesforce development, and go-to-market … single, intelligent ecosystem. We are looking for a technical engineer, deeply fluent in Salesforce architecture & development, and capable of administering and extending Salesforce Data Cloud to unify data across multiple orgs. You will design and maintain the backbone that connects Data Cloud, 5+ Salesforce ...

challenge. We believe we're on the brink of creating something truly awesome. What will you do? We're looking for a Lead Data Engineer to drive the next phase of our data strategy at Midnite. This is a hands-on leadership role where … technical direction, own the design and scalability of our data infrastructure, and ensure the team delivers high-quality, impactful solutions. You'll work across the full data lifecycle from ingestion and modelling to orchestration, monitoring, and analytics enablement, while also mentoring engineers and shaping engineering best ...

building management systems (BMS). This role is responsible for creating robust server-side solutions within the Niagara Framework (N4) that enable efficient data exchange, automation workflows, and system interoperability. The specialist will work across a range of building systems and assets including HVAC, lighting, energy metering, environmental … Framework Development Design, develop, and maintain server-side components and logic within the Niagara N4 platform. Build and deploy custom services, APIs, and data flows to support complex multi-system integration requirements. Configure and optimize Niagara stations, drivers, network settings, and performance for large-scale environments. MQTT ...

Title: Observability Engineer (Custom Data Integration) Location: Remote(UK) Key responsibilities Design and implement observability frameworks: Integrate and manage monitoring, logging, and tracing for cloud-native and on-premises systems. Data integration and ingestion: Build systems to collect and ingest data from various sources … often through APIs, and manage time-series data at scale. Develop custom solutions: Create custom dashboards, alerts, and reporting views to provide clear, actionable insights into system performance. Build status pages: Develop and maintain status pages that provide a user friendly web experience to communicate system health ...

Data & AI Senior Consultants Location - We are flexible: onsite, hybrid or fully remote, depending on what works for you and the client, UK or Netherlands based. What you will actually be doing This is not a role where you build clever models that never get used. Your focus … creating measurable value for clients using data science, machine learning and GenAI, in a consulting and advisory context. You will own work from the very beginning, asking questions like \"What value are we trying to create here?\" and \"Is this the right problem to solve?\" through ...

Apply? Take ownership of the BI engineering backbone for a forward thinking organisation, supporting the delivery of high quality data solutions. This role offers the chance to optimise data pipelines, manage backend BI systems, and develop scalable reporting solutions in a collaborative and supportive environment. … drive business value by building, maintaining, and optimising the organisation's BI systems. You will manage backend datasets, pipelines, and reporting platforms, supporting data-driven decision-making across the business. Key Responsibilities: Design, develop, and maintain scalable BI solutions, dashboards, and reports in Power BI. Prioritise and manage ...

client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines in Python (Pandas, NumPy), SQL, GCP (BigQuery), DBT, and Databricks. … This role focuses on large-scale financial data, automating processes, integrating multiple data sources, and delivering actionable insights to senior stakeholders. Only candidates with direct experience in investment, asset management, or reinsurance/insurance operations handling financial securities or actuarial outputs will be considered. Key Skills ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

powered applications from frontend to model serving Build intuitive user interfaces Develop scalable backend systems using Python and Go for model inference, data pipelines, and API services Develop sophisticated prompt engineering strategies for LLM-based features, including few-shot learning, chain-of-thought reasoning, and retrieval-augmented generation ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration … layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part ...

Azure stack, including Logic Apps and Function Apps Experience with Microsoft Power Platform tools Proven experience building and maintaining API integrations and data pipelines (REST, JSON, XML, JDBC) Desirable Experience: Experience with MuleSoft Experience with Workday If this role sounds of interest, please contact Megan ...

with prompt engineering, tool calling, retrieval-augmented generation (RAG), and multi-agent workflows Experience integrating AI into real systems, APIs, event-driven architectures, data pipelines, and automation platforms (e.g. UiPath, Blue Prism) Comfortable experimenting with new models, SDKs, and platforms, and evaluating what's production-ready vs hype ...

model capabilities and protocols. Leadership & Collaboration - Collaborate on UI/UX integration, code reviews, architecture and roadmap decisions, and cross-functional work with data science, product, and commercial teams. Data Engineering - Design and maintain efficient data pipelines, ensuring smooth data flow between ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

Lead Data Engineer – Contract - OUTSIDE IR35 £400 per day - 6 months (potential to be extended) - Immediate Start Remote (UK-based) Uneek is looking for a Lead Data Engineer to join on a 6-month contract with the possibility to extend. This role is remote (UK-based … data pipelines using dbt, SQL, and Snowflake Delivering backlog items and improving data models Driving tech debt remediation and pipeline reliability Collaborating with engineers, analysts, and stakeholders to enhance data delivery Start Date: Immediate – quick interview process. ...

proof, and expand their revenue opportunities. Their product empowers lawyers and finance teams to maximise value from engagements through: Pricing agents that create data-driven, lawyer-friendly quotes. Management tools that predict overruns and help avoid costly late bills. Enrichment engines that clean and structure messy legal datasets … join. The Role: AI/ML Engineer – Agentic Systems You will design and deliver intelligent agentic workflows, leveraging frontier LLMs. Working with their data scientists and backend engineers, you'll be responsible for making unstructured legal data usable, scalable, and impactful. This is not a prototyping ...