16 of 16 Contract Data Pipeline Jobs in England

Technical Data Specialist Contract onsite in London Day rate: £650 - £858 per day inside IR35 We're currently seeking an accomplished and highly ambitious Technical Data Specialist to work with our exceptional client, a world class brand in a secure environment to drive major business transformation … process and technical change across this complex organisation. This contract roles will require you to conduct security clearance prior to assignment. The Technical Data Specialist role is conducted in an environment that is far from ordinary, therefore, we're not looking for ordinary. The Technical Data Specialists set the vision for the organisation's use of data (through data design) to ensure that data is managed properly and meets the organisation's needs. You will work with key internal and external partners to deliver data architecture More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to … in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new … warehousing. * Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. * Can make data pipeline design recommendations based on business requirements. * Experience with data migration is a plus. * Open to new ways of working and new technologies. More ❯

That to be considered you must be in possession of active NPPV3 clearance. THE ROLE To design, implement, and develop robust and scalable data infrastructure that supports advanced analytics and intelligence operations within the police department, enabling data-driven decision-making for crime prevention, investigations, and … safety. This post will work within a 130-strong team of intelligence professionals. Enabling seamless integration and analysis of complex criminological and intelligence data, empowering analysts and investigators to identify crime patterns, predict future incidents, and enhance investigative outcomes. Ensuring the integrity, security, and ethical use of sensitive … criminal justice information, adhering to stringent compliance standards and fostering public trust. Drive innovation in data management and analytics, leveraging cutting-edge technologies to enhance the department's ability to respond to evolving crime trends and emerging threats. Empower the department with the tools to transform data More ❯

About the role Reporting into the Data Systems Manager, the Data Systems Executive is a key position within the Operations arm of the Moorepay marketing team. The role will work with key stakeholders within the wider Data Operations team to enable and maintain the … Moorepay Data Platform' (MDP). This includes managing data quality as well as administration and maintenance of the ETL Engine and the Data Lakehouse, enabling the business to build value-adding data products at scale to support core business objectives. In particular … literate with strong data language expertise - SQL and Python primarily - for data manipulation and end-to-end data pipeline management Familiar with data-as-code methodology, specifically around version control and documentation/change controls Knowledge of working within GDPR and More ❯

Engineer 6 month Northampton - hybrid £450 per day inside ir35 - Umbrella only Job Description: 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS … services like S3, Redshift, EMR, Glue, and Kinesis. This involves designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Key Skills: AWS Services: Strong understanding and experience with AWS services like S3 , Redshift, EMR, Glue , Kinesis, and Lambda. … Programming Languages: Proficiency in programming languages like Python or Java, used for designing and building data pipelines. SQL: Knowledge of SQL for querying and manipulating data in relational databases. ETL Processes: Experience with ETL tools and techniques. Cloud Computing: Familiarity with cloud computing concepts and principles. More ❯

Senior Data Engineer Bristol 6-month contract Paying up to 80p/h (Outside IR35) Please note that due to the nature of the work you must be hold or be eligible to obtain DV level security clearance Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. … Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. More ❯

Job Title: Snowflake Data Engineer Location: Somerset, 3 days per week onsite Contract- outside IR35 Overview: We are looking for a talented Snowflake Data Engineer to join our growing data team. Reporting to the BI & Data Manager, you will play a key … role in the technical build of our new enterprise data warehouse. While the overall BI and data strategy is being led by the manager, your focus will be on hands-on development: building scalable pipelines, designing efficient data models, and ensuring a high-quality … Snowflake environment to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities: Develop and optimize data pipelines and ETL processes into Snowflake. Build, structure, and maintain the Snowflake data warehouse. Work closely with the BI & Data Manager to align technical More ❯

Job Title: Snowflake Data Engineer Location: Somerset, 3 days per week onsite Contract- outside IR35 Overview: We are looking for a talented Snowflake Data Engineer to join our growing data team. Reporting to the BI & Data Manager, you will play a key … role in the technical build of our new enterprise data warehouse. While the overall BI and data strategy is being led by the manager, your focus will be on hands-on development: building scalable pipelines, designing efficient data models, and ensuring a high-quality … Snowflake environment to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities: Develop and optimize data pipelines and ETL processes into Snowflake. Build, structure, and maintain the Snowflake data warehouse. Work closely with the BI & Data Manager to align technical More ❯

proficiency in PySpark, Hadoop, Python, Git - Strong understanding of data engineering concepts and ETL processes, Data warehousing, Data Pipeline, SQL - Additional Good To Have Skills: AWS Glue, Knowledge of implementing ETL and data pipelines in AWS -5+ years of experience More ❯

As the Lead Enterprise Architect for our Advanced Analytics business unit, you will lead the development of innovative tools and systems that power data-driven insights and analytics across the organisation. Your leadership will play a pivotal role in driving the next generation of advanced analytics capabilities, ensuring … role offers a broad scope of responsibility, where you'll influence the direction of our analytics solutions and shape the way we leverage data to optimise business outcomes. You will work closely with passionate and dedicated colleagues and clients, all committed to driving transformation in the digital media … years of experience in a leadership role with 5+ years of hands-on software engineering experience. Strong expertise in software architecture, data pipeline design, and scalable analytics systems. Proven experience with integrating and automating business workflows, including data-driven processes and system integrations. Familiarity with More ❯

Job Title: Senior Data Engineer Location: London or Telford Contract: 6 months Clearance Requirement: Must hold or be eligible to obtain SC clearance About the Role We are seeking a Senior Data Engineer to join our team on a permanent basis, working on a high-profile … UK Government programme. You'll apply your expertise in data engineering and software development to solve complex data challenges, supporting critical infrastructure and decision-making through scalable, secure, and innovative data solutions. This is a fantastic opportunity to work with modern technologies in a … collaborative and mission-driven environment, with the freedom to innovate and grow your skills. Key Responsibilities Design and lead implementation of data pipelines from operational systems to BI and analytics platforms Build, maintain, and operate scalable data environments and real-time data streaming systems More ❯

Full stack Microsoft Azure Data Engineer/Developer 7 months Remote Inside IR35 - Umbrella only Role Overview: We are seeking a hands-on Microsoft Databricks Developer with expertise in data engineering best practices. The ideal candidate will have strong experience in Git/DevOps integration, Unity … Catalog, and performance optimization for Databricks data transformation workloads. Key Responsibilities: Develop and optimize Databricks data pipelines for efficient data transformation. Implement code version management using Git and DevOps integration. Configure and manage Unity Catalog for secure and scalable data governance. Enhance … performance optimization in Databricks workloads, ensuring efficient resource utilization. Collaborate with data engineers and architects to design scalable solutions. Ensure adherence to best practices in Databricks data engineering. Required Skills & Experience: Hands-on experience with Microsoft Databricks and Apache Spark. Strong knowledge of Git, DevOps integration More ❯

I'm seeking a Data Engineer with extensive hands-on experience in Databricks, Azure Data Factory, Python, and DBT. The suitable candidate will develop data models, troubleshoot pipelines, and deliver production-ready code. Effective communication skills and the ability to articulate technical decisions clearly … Responsibilities: Develop and maintain SQL models and macros using DBT Collaborate with stakeholders to gather and refine modelling requirements Debug and enhance existing data models Design and implement ETL/ELT workflows and data pipelines using Azure Data Factory Automate ETL workflows to support … machine learning features Apply best practices for data governance, quality, and performance Utilise Azure Databricks and adhere to code-based deployment practices Essential Skills: Over 3 years of experience with Databricks (including Lakehouse, Delta Lake, PySpark, Spark SQL) Strong proficiency in SQL with 5+ years of experience Extensive More ❯

and Xray Have deep knowledge on event driven systems using frameworks like Active MQ, Kafka, AWS Kinesis Have a working experience of AWS data pipelines, Glue, S3 and Glacier storage, file transfer solutions like Data Sync. If you are interested in this position and would like More ❯

Integration Engineer City of London - Contract Circa £700 per day OUTSIDE IR35 APIs ; Data Flows ; Azure Logic Apps Working with prestigious London market insurer I am looking for an experienced integration engineer to ensure my clients platforms can communicate effectively and securely. They've invested in a data … business and project teams, you will be in the perfect place to build relationships to support our operational responsibilities such as maintaining our data quality, timeliness, and spotting opportunities to continually improve the way they transform data. You will need: Design and implement system integrations using APIs and … data pipelines, ensuring security, scalability, and performance. Document all integrations clearly, including logic, dependencies, and failover processes. Use tools such as Azure Logic Apps, API Management, and other approved integration platforms. Integration Delivery Collaborate with data engineering and application teams to deliver integrations into live environments. More ❯

We are seeking a highly skilled and experienced Back-End Developer with advanced expertise in Go (Golang), data analytics, and cloud-based backend services. This individual will play a key role in building scalable APIs, processing data pipelines, and supporting front-end web applications with real … insights What you'll do: Design and implement RESTful APIs and GraphQL endpoints to support front-end applications. Process and optimize large-scale data pipelines for real-time analytics and reporting. Write clean, maintainable, and efficient code that adheres to best practices and coding standards. Utilize AWS cloud … services for scalable and secure backend application deployment. Ensure robust data storage and management using PostgreSQL and other database solutions. Implement authentication, authorization, and security best practices in backend services. What you'll bring: Advanced proficiency in Go (Golang) for backend development. Strong experience with RESTful APIs, GraphQL More ❯