13 of 13 Contract Data Pipeline Jobs in England

Technical Data Specialist Contract onsite in London Day rate: £650 - £858 per day inside IR35 We're currently seeking an accomplished and highly ambitious Technical Data Specialist to work with our exceptional client, a world class brand in a secure environment to drive major business transformation … process and technical change across this complex organisation. This contract roles will require you to conduct security clearance prior to assignment. The Technical Data Specialist role is conducted in an environment that is far from ordinary, therefore, we're not looking for ordinary. The Technical Data Specialists set the vision for the organisation's use of data (through data design) to ensure that data is managed properly and meets the organisation's needs. You will work with key internal and external partners to deliver data architecture More ❯

Purpose of Role: The data engineer will play a critical role in building and maintaining a robust data infrastructure to support the research, trading, and operational activities of this London-based fintech. The role involves designing scalable data pipelines, managing frequent and alternative … datasets, and ensuring efficient and reliable access to data for quantitative analysts, the investment team, and other stakeholders. Responsibilities: Data Pipeline Development and Management Design, build, and maintain real-time and batch ELT pipelines to ingest, transform, and integrate diverse datasets, including financial market data, alternative data, and proprietary datasets. Ensure low-latency processing and high availability of critical data pipelines to support trading and research functions. Data Infrastructure and Storage Develop and manage scalable data infrastructure, including cloud-based data lakes and More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to … in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new … warehousing. * Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. * Can make data pipeline design recommendations based on business requirements. * Experience with data migration is a plus. * Open to new ways of working and new technologies. More ❯

About the role Reporting into the Data Systems Manager, the Data Systems Executive is a key position within the Operations arm of the Moorepay marketing team. The role will work with key stakeholders within the wider Data Operations team to enable and maintain the … Moorepay Data Platform' (MDP). This includes managing data quality as well as administration and maintenance of the ETL Engine and the Data Lakehouse, enabling the business to build value-adding data products at scale to support core business objectives. In particular … literate with strong data language expertise - SQL and Python primarily - for data manipulation and end-to-end data pipeline management Familiar with data-as-code methodology, specifically around version control and documentation/change controls Knowledge of working within GDPR and More ❯

Engineer 6 month Northampton - hybrid £450 per day inside ir35 - Umbrella only Job Description: 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS … services like S3, Redshift, EMR, Glue, and Kinesis. This involves designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Key Skills: AWS Services: Strong understanding and experience with AWS services like S3 , Redshift, EMR, Glue , Kinesis, and Lambda. … Programming Languages: Proficiency in programming languages like Python or Java, used for designing and building data pipelines. SQL: Knowledge of SQL for querying and manipulating data in relational databases. ETL Processes: Experience with ETL tools and techniques. Cloud Computing: Familiarity with cloud computing concepts and principles. More ❯

proficiency in PySpark, Hadoop, Python, Git - Strong understanding of data engineering concepts and ETL processes, Data warehousing, Data Pipeline, SQL - Additional Good To Have Skills: AWS Glue, Knowledge of implementing ETL and data pipelines in AWS -5+ years of experience More ❯

As the Lead Enterprise Architect for our Advanced Analytics business unit, you will lead the development of innovative tools and systems that power data-driven insights and analytics across the organisation. Your leadership will play a pivotal role in driving the next generation of advanced analytics capabilities, ensuring … role offers a broad scope of responsibility, where you'll influence the direction of our analytics solutions and shape the way we leverage data to optimise business outcomes. You will work closely with passionate and dedicated colleagues and clients, all committed to driving transformation in the digital media … years of experience in a leadership role with 5+ years of hands-on software engineering experience. Strong expertise in software architecture, data pipeline design, and scalable analytics systems. Proven experience with integrating and automating business workflows, including data-driven processes and system integrations. Familiarity with More ❯

Job Title: Senior Data Engineer Location: London or Telford Contract: 6 months Clearance Requirement: Must hold or be eligible to obtain SC clearance About the Role We are seeking a Senior Data Engineer to join our team on a permanent basis, working on a high-profile … UK Government programme. You'll apply your expertise in data engineering and software development to solve complex data challenges, supporting critical infrastructure and decision-making through scalable, secure, and innovative data solutions. This is a fantastic opportunity to work with modern technologies in a … collaborative and mission-driven environment, with the freedom to innovate and grow your skills. Key Responsibilities Design and lead implementation of data pipelines from operational systems to BI and analytics platforms Build, maintain, and operate scalable data environments and real-time data streaming systems More ❯

Full stack Microsoft Azure Data Engineer/Developer 7 months Remote Inside IR35 - Umbrella only Role Overview: We are seeking a hands-on Microsoft Databricks Developer with expertise in data engineering best practices. The ideal candidate will have strong experience in Git/DevOps integration, Unity … Catalog, and performance optimization for Databricks data transformation workloads. Key Responsibilities: Develop and optimize Databricks data pipelines for efficient data transformation. Implement code version management using Git and DevOps integration. Configure and manage Unity Catalog for secure and scalable data governance. Enhance … performance optimization in Databricks workloads, ensuring efficient resource utilization. Collaborate with data engineers and architects to design scalable solutions. Ensure adherence to best practices in Databricks data engineering. Required Skills & Experience: Hands-on experience with Microsoft Databricks and Apache Spark. Strong knowledge of Git, DevOps integration More ❯

Systems Developer (Azure Data Factory) Hybrid - 1 day onsite in the North West (UK) £400/day (Inside IR35) 6 months About the Role We are looking for a talented and detail-oriented Systems Developer to join our team on a 3-6 month contract. You will be … gather and refine technical requirements Design and implement scalable, secure, and maintainable solutions Integrate internal systems with third-party platforms and APIs Develop data pipelines and workflows using Azure Data Factory Ensure robust error handling and logging across integrated systems Write clean, efficient, and well-documented … Agile, Scrum, DevOps, etc. Experience of analysing business requirements, documenting system design, developing objects/code, unit testing and deployment Essential C# Azure Data Factory Strong systems integration experience Desirable Experience with Oracle Cloud Fusion (advantageous but not essential) Familiarity with Azure Service Bus Working Arrangement Hybrid More ❯

and Xray Have deep knowledge on event driven systems using frameworks like Active MQ, Kafka, AWS Kinesis Have a working experience of AWS data pipelines, Glue, S3 and Glacier storage, file transfer solutions like Data Sync. If you are interested in this position and would like More ❯

Integration Engineer City of London - Contract Circa £700 per day OUTSIDE IR35 APIs ; Data Flows ; Azure Logic Apps Working with prestigious London market insurer I am looking for an experienced integration engineer to ensure my clients platforms can communicate effectively and securely. They've invested in a data … business and project teams, you will be in the perfect place to build relationships to support our operational responsibilities such as maintaining our data quality, timeliness, and spotting opportunities to continually improve the way they transform data. You will need: Design and implement system integrations using APIs and … data pipelines, ensuring security, scalability, and performance. Document all integrations clearly, including logic, dependencies, and failover processes. Use tools such as Azure Logic Apps, API Management, and other approved integration platforms. Integration Delivery Collaborate with data engineering and application teams to deliver integrations into live environments. More ❯

We are seeking a highly skilled and experienced Back-End Developer with advanced expertise in Go (Golang), data analytics, and cloud-based backend services. This individual will play a key role in building scalable APIs, processing data pipelines, and supporting front-end web applications with real … insights What you'll do: Design and implement RESTful APIs and GraphQL endpoints to support front-end applications. Process and optimize large-scale data pipelines for real-time analytics and reporting. Write clean, maintainable, and efficient code that adheres to best practices and coding standards. Utilize AWS cloud … services for scalable and secure backend application deployment. Ensure robust data storage and management using PostgreSQL and other database solutions. Implement authentication, authorization, and security best practices in backend services. What you'll bring: Advanced proficiency in Go (Golang) for backend development. Strong experience with RESTful APIs, GraphQL More ❯