201 to 225 of 435 Data Pipeline Jobs in England

Positive Employment is currently recruiting for a Data Engineer for our client a government organisation in West Berkshire. The successful post holder will display strong system integration capabilities to ensure that data flows between systems are aligned, reliable, and continuously improved. Responsibilities will include implementing platform … delivering system and database customisations—covering SQL Server, QTC/Unit4 environments, and system-to-system migration assessments. The post ensures that data remains trusted, secure, well-structured, and readily available to support analytics, reporting, and digital services. This role is a temporary contract initially for 3 months ...

Client Gamma RRF ID 1 £400 per day Outside IR35 Duration 3 months initial Start ASAP Overview We are looking for an experienced Data Engineer to design and deliver scalable, secure … high performance data solutions. The role focuses heavily on Snowflake architecture, cloud data platforms, and modern data pipeline development click apply for full job details ...

Senior Data Engineer Salary: £95,000 Location: Remote First (London Office) Join a team where data engineering isn't just support, it's the engine. Build the models and pipelines that fuel innovation, accelerate growth, and elevate how the whole company thinks about data. The Opportunity … This opportunity puts you at the centre of shaping the company's data landscape, giving you the ability to influence how teams access, understand, and trust their data. You'll take ownership of high-impact initiatives that drive better decision-making and unlock meaningful insights across the business. ...

looking for a Data Engineer to design and deliver scalable, cloud-based data solutions within a client-facing consulting environment.This role is ideal for someone who enjoys working directly with stakeholders, solving complex data challenges, and building modern data platforms using Azure … technologies. Hybrid - London Victoria Salary up to £60,000 The Role Design, build and maintain data pipelines using Azure tools Develop data models and analytics solutions Work closely with clients to understand requirements and deliver solutions Optimise ETL/ELT processes for performance and reliability Troubleshoot ...

architecture to improve maintainability and reduce operational overhead. Assess and advise on converting Iceberg datasets into optimised Parquet formats. Implement solutions to improve pipeline stability and reduce AWS operational costs. Document existing architecture, identify technical debt, and create remediation strategies. Work closely with data engineering teams … schema evolution, table formats, time travel) Deep understanding of Parquet, Iceberg, ORC and performance trade offs. Proven track record of diagnosing and resolving complex pipeline performance issues. Strong SQL skills and experience with query optimisation. Experience with AWS cost optimisation for large scale data workloads. Understanding ...

Data Scientist - Hybrid - Outside IR35 About the Role We are seeking a highly analytical and business-minded Data Scientist to join our team. In this role, you will transform complex data into actionable insights, build predictive models, and partner with cross-functional stakeholders … drive strategic decision-making. You will work with large datasets, apply advanced statistical and machine learning techniques, and help shape data-driven initiatives across the organization. Key Responsibilities Collect, clean, and analyze structured and unstructured datasets from multiple sources Develop and deploy predictive models and machine learning algorithms ...

user personalisation, including recommendation systems, ranking models, user segmentation, and content understanding, with a strong focus on TensorFlow-based development. Data Pipeline Engineering: Build and maintain scalable data pipelines to support feature engineering and model training across large structured and unstructured datasets, leveraging cloud‐native …/B testing and offline experimentation to evaluate model performance and guide ongoing improvement. Cross‐Functional Collaboration: Work closely with engineering, product, data, and research teams to ensure ML solutions align with product and business goals. Research & Innovation: Stay informed on advances in machine learning, deep learning ...

Analytics Solution Engineer - Inside IR35 - Remote Role Overview This role sits at the intersection of Data Engineering, DevOps, and Site Reliability Engineering within the App Reporting team. You will be responsible for maintaining, improving, and operating critical data platforms - primarily Azure Databricks and Palantir Foundry - ensuring … Data Engineers building pipelines Enable and support data pipelines within Palantir Foundry and Azure Databricks Assist with performance optimisation, pipeline reliability, and operational readiness Analytics Infrastructure & Operations Build and maintain analytics infrastructure to support reporting and redline initiatives Improve operational processes across the data ...

IR35 - Hybrid The Senior BI Developer will design, develop, and maintain scalable Business Intelligence (BI) solutions leveraging Microsoft Fabric and the broader Microsoft data ecosystem. This role is responsible for delivering a modern, secure, and high-performing Azure-based data platform that enables high-quality reporting … analytics, and business insight across the Group. The successful candidate will: Design and develop scalable BI solutions using Microsoft Fabric Build and manage data pipelines using OneLake, Dataflow Gen2, and Azure Data Factory Develop semantic models in Microsoft Power BI and integrate with DirectLake or Warehouse ...

rate: £500 - £550 Inside IR35 Location: London Key Responsibilities Design, build, and maintain scalable data pipelines , ETL processes, and data integrations. Develop and optimize data models , storage solutions, and analytics environments. Partner with UX/UI designers to create user-friendly dashboards, data … make complex datasets understandable for technical and non-technical users. Work with cross-functional teams to translate product requirements into technical designs. Ensure data quality, governance, and best practices across systems. Contribute to the evolution of our design systems and front-end components for data tools. ...

Performance Info Engineer Rate: £400-470/day inside IR35 Location: Bristol, hybrid Reports To: Head of Data Governance 6 month contract Purpose: The Performance Info Engineer is responsible for designing, developing, testing, and maintaining high-quality data products and pipelines that support business intelligence, analytics … decision-making. This includes transforming and integrating data from multiple sources, ensuring alignment with architectural standards, and enabling actionable insights for project safety, quality, time, and cost management. Key Responsibilities: Translate business requirements and designs into technical solutions. Develop, test, and deploy data products using Databricks ...

project. Due to the nature of the work, candidates hold UKSV DV clearance. Key Skills & Experience Strong expertise in Python, Docker, Kubernetes, and Data Governance Experience working in air-gapped … environments, including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range ...

Senior Data Engineer AI SaaS | Data as a Product | London (Hybrid) This is a brilliant opportunity for someone who loves solving problems at the intersection of data and product and wants real ownership in a fast-scaling company. I’m partnering with a high … They're already profitable, backed by strong investors, and scaling quickly to meet demand. This is your chance to get in early. Here, data isn't a support function, it's the product. You'll help complex organisations implement and expand a platform that's reshaping ...

Data Engineer £60000-90000 GBP Bonus, Car Allowance Hybrid WORKING Location: Bristol, South West - United Kingdom Type: Permanent Data Engineer - Bristol Hybrid/Bristol £60,000 - £90,000 + Package Our client, a leading UK digital transformation consultancy, is seeking a talented Data Engineer … Bristol. This is a fantastic opportunity to work across high-impact projects in defence, national security, public sector and critical infrastructure helping shape data solutions that make a real difference. Due to the nature of this work, active MOD DV Clearance is essential. As a Data ...

Fabric BI Developer - Modern Data Platform Outside IR35Ideally 2 days in Brentford office, but can be remote Start date: Immediate About the Role As a BI Developer, you will design, build, and optimise end-to-end BI solutions across a modern data stack. You will work … closely with data architects, analysts, IT teams, and business stakeholders to develop robust data pipelines, semantic models, and reporting assets that support strategic decision-making across the organisation. This is a hands-on technical role suited to someone passionate about engineering reliable, secure, and scalable ...

Finance Systems & IT Support Analyst acts as the dedicated technical specialist for all Finance-related systems, providing expert-level support, system administration, and data management across platforms such as Microsoft Dynamics, SQL Server, Visual Studio, Power Bi, Metabase and associated tools. In addition to Finance systems expertise, this … query writing, data manipulation, and reporting. Working knowledge of Metabase and Power BI. Experience with DBT for data transformation and pipeline management. Excellent troubleshooting, communication, and documentation skills. Desirable: Exposure to ERP or finance system integrations and data warehousing concepts. Experience supporting ...

Contract Snowflake Developer Our client is looking for an experienced Snowflake Developer to join a data-focused team working on large-scale analytics and cloud data platforms. You’ll play a key role in designing, building, and optimising Snowflake-based data solutions that support … months (extension likely) Rate – DOE Key Skills & Experience Strong hands-on experience as a Snowflake Developer Solid SQL skills and experience with complex data transformations Experience with cloud platform - Azure Familiarity with ETL/ELT tools Strong understanding of data warehousing concepts and dimensional modelling Responsibilities ...

Data Platform Engineer Location: Warton, full time on site (occasional travel to Reading HQ) Duration : 12 months Hourly Rate: £50 PAYE or £67.47 Umbrella Working Arrangements: Full time on site (occasional travel to Reading HQ) What You’ll Be Doing As a Data Platform Engineer , your … responsibilities will include: Designing, developing, and maintaining robust, secure, and scalable data pipelines using Apache NiFi and related technologies. Troubleshooting, optimising, and maintaining NiFi flows — addressing performance, error handling, and throughput challenges. Integrating NiFi with cloud platforms, SQL/NoSQL databases, APIs , and third-party systems. Ensuring data ...

Data Platform Engineer Location: Warton, full time on site (occasional travel to Reading HQ) Duration : 12 months Hourly Rate: £50 PAYE or £67.47 Umbrella Working Arrangements: Full time on site (occasional travel to Reading HQ) What You’ll Be Doing As a Data Platform Engineer , your … responsibilities will include: Designing, developing, and maintaining robust, secure, and scalable data pipelines using Apache NiFi and related technologies. Troubleshooting, optimising, and maintaining NiFi flows — addressing performance, error handling, and throughput challenges. Integrating NiFi with cloud platforms, SQL/NoSQL databases, APIs , and third-party systems. Ensuring data ...

days onsite work until probation - then dropping down to 4) Our client is seeking a talented Power BI Developer to join their data team and play a key role in transforming data into meaningful business insight. The role Design, implement, and govern robust data models within Databricks Data Catalogues , leveraging Medallion Architecture for high-quality, analytics-ready data Develop and maintain engaging, high-performance Power BI dashboards that translate complex data into clear business narratives Own data quality and governance , implementing validation and integrity ...

Strong communication skills to collaborate with technical and military/non-technical stakeholders Experience integrating data from multiple sources into Foundry via Pipeline Builder and custom code Comfortable working on-site within a secure environment and at pace with end-users TO BE CONSIDERED... . Please either … submit your application to our client in conjunction with this vacancy only. KEY SKILLS: PALANTIR/FOUNDARY/DATA ENGINEER/PIPELINE BUILDER/ONTOLOGY/PYTHON/TYPESCRIPT/FULL STACK/DV CLEARED/LONDON/CONTRACT ...

kind of role that gives you real ownership. A well-established organisation in the education and partnerships space is investing heavily in data transformation and modern BI capability. They're looking for a Lead Analyst who can balance technical depth with strategic thinking, and who's comfortable being … shape it. Why this role stands out You'll act as the analytics lead across multiple teams including partnerships, marketing, and data platforms. You'll drive the delivery of major data and BI transformation projects . You'll build reporting frameworks, modern dashboards, and automated analytics ...

kind of role that gives you real ownership. A well-established organisation in the education and partnerships space is investing heavily in data transformation and modern BI capability. They're looking for a Lead Analyst who can balance technical depth with strategic thinking, and who's comfortable being … shape it. Why this role stands out You'll act as the analytics lead across multiple teams including partnerships, marketing, and data platforms. You'll drive the delivery of major data and BI transformation projects . You'll build reporting frameworks, modern dashboards, and automated analytics ...

kind of role that gives you real ownership. A well-established organisation in the education and partnerships space is investing heavily in data transformation and modern BI capability. They're looking for a Lead Analyst who can balance technical depth with strategic thinking, and who's comfortable being … shape it. Why this role stands out You'll act as the analytics lead across multiple teams including partnerships, marketing, and data platforms. You'll drive the delivery of major data and BI transformation projects . You'll build reporting frameworks, modern dashboards, and automated analytics ...

able to, and have experience of, taking a messy ingest problem and producing a practical design that engineers can implement. This includes designing telemetry pipeline architectures : receivers processors exporters (OTel Collector model) pipeline tooling and patterns (e.g. Cribl Stream/Edge/Lake style: reduce/enrich/… route to any destination, or other data pipeline tools) cost/noise optimisation: what drives ingest cost, reducing low-value telemetry, retention/lifecycle strategy security lake/long retention approaches (e.g., Amazon Security Lake (OCSF) + S3/Parquet; lakehouse stacks like Databricks/Snowflake/ ...