1 to 18 of 18 Contract Data Pipeline Jobs in London

the forefront of innovation to address the entire breadth of opportunities in the evolving world of cloud, digital and platforms. Context program: The Data & Analytics team's vision is to: Help answer complex questions quickly but bringing the right data and insights to the people that … need them Build a culture of using data with speed and agility to drive decisions. The goal of our 2024 program is to improve Global Procurement's data analytics capability and maximise value creation from HSBC's supply chain data. The program is a success when … Modernising Procurement's data & analytics platforms: extending our Data Management Platform (Google Cloud) and the associated data products Deliver Next Generation Insights: enabling data-driven decision making through both brand new and improved insights across Global Procurement domains Enable Supplier Mastering & Normalisation more »

Job summary We're on the lookout for an experienced Data Engineer to join our vibrant Performance, Information & BI team. In this role, your responsibilities will include designing, implementing & optimizing data pipelines for loading & maintaining the data warehouse to support the Trust's data & analytics needs. Join us at this exciting time as we delve into new data driven projects & work towards modernizing our data warehouse. The perfect fit for this role would have technical expertise in data engineering tools, strong data analysis skills … excellent problem-solving abilities & strong communication skills. A successful candidate will have: Extensive experience in data engineering, with expertise in designing, building & maintaining data pipelines, data warehouses, and/or data lakes. Significant experience in using ETL tools such as SQL Server more »

and annual plan for delivering this is available on our website. Our new team are embarking on a piece of work to monitor data to identify and respond to patterns indicative of potential fraud. This will support our current work that reduces the likelihood of fraud occurring. We … will bring in data science capabilities to be deployed in counter fraud activity and work closely with partners across health and government to further maximise the preventative impact of proactive counter fraud analysis. We will combine this with our range of counter fraud and domain expertise to maximise … our impact using your knowledge, experience, and passion for your chosen field. The Data Scientist role requires expertise in machine learning, statistical analysis, anomaly detection, and strong communication and collaboration skills. Key responsibilities include developing innovative models, designing, applying, and optimising models in a dynamic environment. The role more »

appoint a talented Automation Test Engineer on a Contract basis. The role will work on creating test automation frameworks, developing test pipelines for data pipelines, and contributing to both manual testing and test management activities. About the role: Based in Greater London (Hybrid): Create test automation frameworks. Develop … test pipelines for data pipelines. Contribute to manual testing efforts. Assist in requirements and scenario definition and elicitation. Participate in test management and test planning activities. Create and manage CI/CD pipelines. About you: You will have the following experiences: Proficiency in test automation and knowledge of … test architecture. Experience with data and database testing. Strong test management and planning skills. Ability to create use cases, requirements, and scenarios. Local Authority/Public Sector experience is highly desired. What's on offer: Salary: £450+ per day (Inside IR35) *negotiable based on experience *please submit your more »

and reliability of their products through innovative testing practices. Key Responsibilities: Create and maintain test automation frameworks. Develop and manage test pipelines for data pipelines. Contribute to manual testing efforts and overall test management activities. Assist in requirements and scenario definition and elicitation. Participate in test planning and … and manage Continuous Integration/Continuous Deployment (CI/CD) pipelines. Skills and Qualifications: Proficiency in test automation and related tools. Experience with data and database testing. Strong skills in test management and planning. Ability to create use cases, requirements, and scenarios. Knowledge of test architecture … and best practices. About You: You are a detail-oriented and innovative professional with a strong background in test automation and data pipeline testing. Your ability to create robust test frameworks and manage test activities will contribute significantly to our product's success. Your experience with CI more »

office on a hybrid basis. As a Contract Senior Golang Developer, you will play a crucial role in assessing, analysing, and enhancing our data ingestion, transformation, and storage layers. Your primary focus will be on Go Programming and DBT, with secondary skills in Google Cloud Services. The successful … candidate will bring 5 to 10 years of experience in developing robust data pipelines, conducting unit testing, and providing support for production deployments. Key Responsibilities: Assess and analyse data ingestion, transformation, and storage layers, including RAW, Exploratory, Curated, and application layers. Understand existing codebase and make … alterations or fixes as per design requirements. Develop and optimize data ingestion pipelines using Go Programming and DBT. Conduct unit testing and validation of the developed code to ensure reliability and performance. Collaborate with cross-functional teams to support production deployments and resolve any issues that may arise. more »

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … ideal candidate will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL …/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and more »

a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Extensive ETL and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application) - Understand and provide inputs for STT documents. - Design and develop the data pipelines more »

a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Extensive ETL and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyse, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application ) - Understand and provide inputs for STT documents. - Design and develop the data pipelines more »

will need as much of the following as possible. Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Assess, analyse, data ingestion, transformation & storage layers (RAW, Exploratory, Curated application) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD pipelines more »

days pweek) iR35 determination - Inisde iR35 Duration - 6 months Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud … Key Responsibilities Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application ) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using … CICD pipelines built. Essential Skills Extensive ETL and Data warehousing experience Strong experience in GoLang programming Google Cloud Services and BigQuery more »

Developer - £500 per day - London/remote - 12 months Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Duties Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD … pipelines built. Essential Skills: Extensive ETL and Data warehousing experience Strong experience in GoLang programming Google Cloud Services and BigQuery more »

Position: Software Engineer - Data & AWS We are seeking a Software Engineer to build and optimize data platforms leveraging AWS and key technologies like CDAP, Snowflake, and Databricks. You will design and implement robust and scalable data pipelines, ETL, and analytics systems in the cloud. … Responsibilities: Develop and enhance data pipelines, ETL processes using CDAP on AWS infrastructure. Build data integration flows to migrate large datasets into Snowflake data warehouse. Implement AWS infrastructure-as-code solutions for deployment automation. Instrument data pipelines and leverage monitoring for performance … tuning and reliability. Work with data scientists to optimize data workflows and models on Databricks. Follow security best practices for access control, encryption, and auditing across data platforms. Participate in architecture reviews and technology selections. Continuously monitor and improve data platforms for more »

Dive into a pivotal role leading data management and analytics transformation. We're on the hunt for an SC Cleared Azure Data Lead with a knack for innovation and a comprehensive skill set: MUST HAVE ACTIVE SC CLEARANCE Key Responsibilities Oversee the evolution of the data platform, encompassing data pipelines, storage, and processing. Establish and nurture robust relationships with stakeholders to guarantee a positive user experience and to identify any potential opportunities for additional services or products. Play a key role in the formulation and execution of the data management … record in the development and management of an Azure cloud-based data & analytics platform. Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, and ETL processes. Profound understanding of best practices in data governance more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data …/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and more »

Data Scientist - Lead Generation & Prospecting Contract Role - Inside IR35 via umbrella Our client, a London based Financial Services/Payements Solutions provider is seeking a Data Scientist to join the team on contract with experience within new business/prospecting - Please only aply if you have … demonstrable experience in these areas. Responsibilities: Utilise advanced data analytics and machine learning techniques to identify high-value prospects and generate leads in the payments industry. Design and implement propensity models to predict potential client engagement and conversion rates, optimising our prospecting strategies. Analyse transactional and financial data … or Master's degree in Statistics, Mathematics, Computer Science, Finance, or a related field. Experience working with Salesforce from a data/pipeline management perspective along with Snowflake Data Connectors a plus. If you are a results-oriented Data Scientist with a passion more »

Job Title: Senior Data Engineer (SAS) Responsibilities: Rewrite existing data pipelines (SAS, Info, pearl, shell scripts) to Python and DBT transformation-based solutions. Convert SAS-based modules to Python-based pipelines. Load transformed data to Snowflake on Azure. Requirements: Strong experience with SAS programming … primary skill). Proficiency in pearl and shell scripting (secondary skills). Expertise in Python and DBT for data transformation. Experience in converting SAS-based modules to Python-based solutions. Familiarity with Snowflake for data management. Experience with Airflow or similar technologies is a plus. Desired more »