1 to 25 of 27 Data Pipeline Jobs in the North East

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Azure Data Engineer - £500PD - Hybrid We are seeking an Azure Data Engineer with strong experience in Databricks to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have hands-on expertise across Azure data services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities* Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL).* Build and optimize ETL/ELT workflows that ingest data from various on-prem ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer.The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects … significant on-premise design experience. 5+ years in data engineering or business intelligence roles. Extensive ETL and data pipeline design experience, technology agnostic. Proficiency in SQL and experience with data engineering coding languages such as Python, R, or Spark. Understanding of data ...

This role is fully remote in UK, with full work authorization already in effect. No Visa sponsorship is available. Job Description In a data-driven and AI-oriented environment, you will be responsible for the design, industrialization, and optimization of inter-application data pipelines. You will … Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial … markets. They are expanding their engineering capability in Newcastle and are looking for a talented Data Engineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a Data Engineer ...

Data Engineer - £50,000 - £130,000 plus bonus - Newcastle upon Tyne, United Kingdom (Hybrid) Are you a talented Data Engineer with a passion for building robust data platforms and pipelines? Join a fast-growing, high-calibre team in the heart of Newcastle, where … work on impactful projects that shape how data drives investment decisions. Role This is a unique opportunity to join a newly established venture at an early stage. You’ll help define the culture, shape the technical roadmap, and work alongside some of the brightest minds in data ...

Data Engineer - £50,000 - £130,000 plus bonus - Newcastle upon Tyne, United Kingdom (Hybrid) Are you a talented Data Engineer with a passion for building robust data platforms and pipelines? Join a fast-growing, high-calibre team in the heart of Newcastle, where … work on impactful projects that shape how data drives investment decisions. Role This is a unique opportunity to join a newly established venture at an early stage. You'll help define the culture, shape the technical roadmap, and work alongside some of the brightest minds in data ...

Contract Data Engineer - Databricks & Azure (SC Cleared) Location: Newcastle (2-3 days onsite per week) Rate: £450 per day (Outside IR35) Duration: 6 months Clearance: Active SC clearance is mandatory Expenses: Not reimbursed - candidates must be based in or near Newcastle About the Role We are seeking … experienced Data Engineer with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities Design, develop, and maintain scalable data pipelines using ...

Data Engineer - Databricks & Azure (SC Cleared) Location: Newcastle (2-3 days onsite per week) Rate: £450 per day (Outside IR35) Duration: 6 months Clearance: Active SC clearance is mandatory Expenses: Not reimbursed - candidates must be based in or near Newcastle About the Role We are seeking an experienced … Data Engineer with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks ...

Data Engineer - Databricks & Azure (SC Cleared) Location: Newcastle (2-3 days onsite per week) Rate: £450 per day (Outside IR35) Duration: 6 months Clearance: Active SC clearance is mandatory Expenses: Not reimbursed - candidates must be based in or near Newcastle About the Role We are seeking an experienced … Data Engineer with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks ...

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a Security Clearance (Including BPSS) process as part of this role, which requires 5+ … cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. Role Overview: As a Data & ML Engineer, you will design, build, and optimize scalable data pipelines and machine learning solutions. You’ll work with client teams ...

Role: Senior Data engineerLocation - Newcastle upon Tyne/Hybrid (2-3 days per week in office)Contract - 6 monthsDaily rate - £450 (outside IR35)Active SC clearance is a must have Key Responsibilities Design, build, and optimise data pipelines and solutions on the Azure platform.Implement best practices … data architecture, security, and performance.Collaborate with stakeholders to deliver robust and scalable data solutions.Troubleshoot and resolve complex data engineering challenges. Required Skills & Experience Proven experience as a Senior Data Engineer with strong Azure expertise.Strong hands-on experience with Databricks.Proficiency in Python ...

client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines in Python (Pandas, NumPy), SQL, GCP (BigQuery), DBT, and Databricks. … This role focuses on large-scale financial data, automating processes, integrating multiple data sources, and delivering actionable insights to senior stakeholders. Only candidates with direct experience in investment, asset management, or reinsurance/insurance operations handling financial securities or actuarial outputs will be considered. Key Skills ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

Azure Data Engineer (Databricks) - Must be SC Cleared (Outside IR35) Contract: 6 months Location: Newcastle Upon Tyne (2-3 days onsite per week) Expenses: Not reimbursable Domain: Public Sector Clearance: SC Clearance is mandatory Role Overview: We are seeking an experienced Azure Data Engineer with strong … expertise in Databricks to join a public sector project. The successful candidate will work on designing, building, and optimizing data pipelines and solutions within the Azure ecosystem. Key Responsibilities: Develop and maintain scalable data pipelines using Azure Databricks. Implement data solutions aligned with business ...

model capabilities and protocols. Leadership & Collaboration - Collaborate on UI/UX integration, code reviews, architecture and roadmap decisions, and cross-functional work with data science, product, and commercial teams. Data Engineering - Design and maintain efficient data pipelines, ensuring smooth data flow between ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … sharing opportunities to reuse data flows where possible. Coordinate teams and set best practices and standards when it comes to data eng... ...

rehabilitation progress. -Behavioural analytics (e.g., detecting self-harm risk via AIM). -Intelligent workflow automation for case management systems. Develop and optimize robust data pipelines, ensuring privacy and compliance with strict security standards. Continuously improve model accuracy, fairness, interpretability, and scalability. Stay up to date with research … recommend innovations that align with Unlinks vision and the sensitive nature of justice services. Person Specification Must-Have: Degree in Computer Science, AI, Data Science, or equivalent experience. Strong Python skills, with experience in ML libraries like TensorFlow, PyTorch, scikit-learn. Solid understanding of ML principles, algorithms ...

works. You will help us automate manual tasks, connect AI agents to our CRM and ERP systems, strengthen customer interactions with data-driven “proof packages,” and explore new AI-enabled capabilities that strengthen our position as a UK leader in custom battery technology. This role is ideal … documentation, production forecasting). Create AI workflows that integrate with our CRM and ERP systems (including IFS Cloud), enabling smarter insights, rapid data retrieval, and improved traceability. Maintain AI agents that support internal teams, including text-analysis bots, report generators, and knowledge-retrieval tools. Data engineering ...

proof, and expand their revenue opportunities. Their product empowers lawyers and finance teams to maximise value from engagements through: Pricing agents that create data-driven, lawyer-friendly quotes. Management tools that predict overruns and help avoid costly late bills. Enrichment engines that clean and structure messy legal datasets … join. The Role: AI/ML Engineer – Agentic Systems You will design and deliver intelligent agentic workflows, leveraging frontier LLMs. Working with their data scientists and backend engineers, you'll be responsible for making unstructured legal data usable, scalable, and impactful. This is not a prototyping ...

TypeScript Strong SQL skills & RDBMS experience (SQL Server preferred) ORM experience (Prisma, Sequelize, TypeORM, or similar) Full-stack ability across frontend, backend, and data workflows What You'll Work With: TypeScript backend services and internal tools React frontends powering prototype and product experiences SQL Server for structured datasets … insights-rich workflows Azure-native services across compute, storage, and data pipelines Rapid prototyping frameworks and experimental tooling AI-driven product concepts (LLMs, automation, data intelligence) Working closely with engineering squads to transition validated prototypes into production Bonus Experience: Python and FastAPI exposure Experience with cloud ...