23 of 23 Data Pipeline Jobs in Basildon

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer. The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

Role: Snowflake Architect Location: Basildon, UK/Dublin, Ireland Work mode : Hybrid Responsibilities: -Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. -Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. -Collaborate with data analysts … maintain data integration solutions, ensuring seamless data flow between various sources and Snowflake. -Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. -Stay up-to-date with the latest trends and best practices in data engineering ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Title: Data Engineer Location: Hybrid/Manchester Rate: £400/day Inside Ir35 Duration: until 31/03/26 to begin with About Us: Brio Digital are currently supporting a public sector consultancy who are currently looking for a skilled Data Engineer with … experience with R, Shiny & Databricks. Role Overview: As a Databricks Engineer, you will design, develop, and manage data solutions on the Databricks platform, enabling high-performance data pipelines and analytics. This role will work closely with data scientists, analysts, and engineering teams to support ...

Hiring: Data Consultant – HealthTech We're supporting a leading healthtech provider in their search for a Data Consultant to help implement, configure, support, and maintain complex data pipelines that make a real impact in healthcare. What You'll Be Doing Translating business requirements into … clear technical specifications Ensuring the data warehouse aligns with stakeholder needs Creating, enhancing, and documenting data specifications, including mapping data from NHS source systems into a dimensional data warehouse Developing and delivering solutions for data extraction, integration, and transformation What ...

Data Production & Analysis Manager (Remote – UK Based) Full-time | Competitive salary: up to £80,000 DOE 100% Remote (UK-based only) Growing data & technology organisation Contract type : Permanent We are recruiting a Data Production & Analysis Manager for a rapidly expanding data solutions … undergone significant growth through multiple acquisitions and offers a stable, long-term environment where individuals can take real ownership of complex, high-impact data operations. About 60% of the job is hands-on data processing, 25% analysis, and a smaller share of client-facing work This ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data … What We're Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services ...

Position Overview We are seeking a highly skilled Machine Learning Engineer to design, build, deploy, and optimise machine learning models that power data-driven products and business solutions. This role bridges data science and software engineering, focusing on production-ready ML systems, scalability, and performance. … ideal candidate has strong experience in Python, ML frameworks, data pipelines, and cloud platforms, and is comfortable working in a fully remote, collaborative environment within the UK. Key Responsibilities 1. Machine Learning Model Development Design, develop, train, and evaluate machine learning models for prediction, classification, recommendation, or automation ...

translate your vision of a modern marketing function - embracing the latest ideas, methodologies and technologies - into a high performing reality. About the Data Analyst Role As a Data Analyst in Modern's Digital team, you'll support the development and delivery of our reporting, measurement … data systems, helping translate raw data into insights that drive client success through our proprietary platform. This is a great fit for someone a year or two into their data career that's curious, collaborative and ready to learn in a fast-moving digital ...

client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines in Python (Pandas, NumPy), SQL, GCP (BigQuery), DBT, and Databricks. … This role focuses on large-scale financial data, automating processes, integrating multiple data sources, and delivering actionable insights to senior stakeholders. Only candidates with direct experience in investment, asset management, or reinsurance/insurance operations handling financial securities or actuarial outputs will be considered. Key Skills ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration … layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part ...

Azure stack, including Logic Apps and Function Apps Experience with Microsoft Power Platform tools Proven experience building and maintaining API integrations and data pipelines (REST, JSON, XML, JDBC) Desirable Experience: Experience with MuleSoft Experience with Workday If this role sounds of interest, please contact Megan ...

with prompt engineering, tool calling, retrieval-augmented generation (RAG), and multi-agent workflows Experience integrating AI into real systems, APIs, event-driven architectures, data pipelines, and automation platforms (e.g. UiPath, Blue Prism) Comfortable experimenting with new models, SDKs, and platforms, and evaluating what's production-ready vs hype ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

awareness: you understand value propositions, return on investment, trade-offs (cost vs speed vs write-down risk), and you factor in risk, compliance, data governance when designing solutions. Key Responsibilities Lead technical discovery and scoping phases with prospective clients: understand their business, compliance, risk, operational, regulatory and data environment. Design solution architectures leveraging Aveni's products (Detect, Assist, Agents, FinLLM) plus integrations with client systems (e.g. CRM, communication tools, data pipelines). Develop, deliver, and customise demos, POCs, workshops to illustrate value, ROI, regulatory compliance, risk mitigation, etc. Collaborate with sales teams to respond ...

Lead Data Engineer – Contract - OUTSIDE IR35 £400 per day - 6 months (potential to be extended) - Immediate Start Remote (UK-based) Uneek is looking for a Lead Data Engineer to join on a 6-month contract with the possibility to extend. This role is remote (UK-based … data pipelines using dbt, SQL, and Snowflake Delivering backlog items and improving data models Driving tech debt remediation and pipeline reliability Collaborating with engineers, analysts, and stakeholders to enhance data delivery Start Date: Immediate – quick interview process. ...

rehabilitation progress. -Behavioural analytics (e.g., detecting self-harm risk via AIM). -Intelligent workflow automation for case management systems. Develop and optimize robust data pipelines, ensuring privacy and compliance with strict security standards. Continuously improve model accuracy, fairness, interpretability, and scalability. Stay up to date with research … recommend innovations that align with Unlinks vision and the sensitive nature of justice services. Person Specification Must-Have: Degree in Computer Science, AI, Data Science, or equivalent experience. Strong Python skills, with experience in ML libraries like TensorFlow, PyTorch, scikit-learn. Solid understanding of ML principles, algorithms ...

proof, and expand their revenue opportunities. Their product empowers lawyers and finance teams to maximise value from engagements through: Pricing agents that create data-driven, lawyer-friendly quotes. Management tools that predict overruns and help avoid costly late bills. Enrichment engines that clean and structure messy legal datasets … join. The Role: AI/ML Engineer – Agentic Systems You will design and deliver intelligent agentic workflows, leveraging frontier LLMs. Working with their data scientists and backend engineers, you'll be responsible for making unstructured legal data usable, scalable, and impactful. This is not a prototyping ...

will Work end-to-end on new ML models from development through to training and optimising Work closely with a small team of data scientists, engineers and product managers Implement scalable data pipelines and deployment strategies for new models Continuously improve solutions and conduct performance evaluations ...

TypeScript Strong SQL skills & RDBMS experience (SQL Server preferred) ORM experience (Prisma, Sequelize, TypeORM, or similar) Full-stack ability across frontend, backend, and data workflows What You'll Work With: TypeScript backend services and internal tools React frontends powering prototype and product experiences SQL Server for structured datasets … insights-rich workflows Azure-native services across compute, storage, and data pipelines Rapid prototyping frameworks and experimental tooling AI-driven product concepts (LLMs, automation, data intelligence) Working closely with engineering squads to transition validated prototypes into production Bonus Experience: Python and FastAPI exposure Experience with cloud ...

whose platform shows large enterprises how they could be compromised in real time, before attackers succeed. They blend attacker behavior, large-scale data pipelines and automated offensive security to give security teams true, live exposure visibility. The Role for Engineering Manager, Cybersecurity Applications You'll be the global … account lifecycle, auth/SSO, granular access control, notifications, logging and multi-tenancy • Partner tightly with Product and Design to turn complex security data into simple, powerful workflows that customers love • Shape engineering practices across teams, embedding quality, security and agility into how software is built and shipped ...