scalable and reliable data pipelines and platforms using various technology solutions. Extract, transform, andload (ETL) data from various sources and formats. Build and maintain ETL pipelines Ensure data quality, integrity, and security by applying data governance and validation rules. Optimise data performance and efficiency by tuning, partitioning, indexing, and … Hands-on experience in designing, planning, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments. Skilled in data integration, ETL processes, and ensuring data quality. Capable of turning data into insights using visualisation and reporting tools. Able to effectively document business use-cases, data sources more »
in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data engineering and analytics landscape, the more »
in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data engineering and analytics landscape, the more »
practices. • Extensive experience with SQL databases, including complex queries and stored procedures. • Experience with SSIS, SSRS, and SSAS. • Strong understanding of data warehousing concepts, ETL, and data modelling. • Familiarity with statistical analysis, data visualization, data mining, and data transformation. • Power BI certification is a plus. • Proven problem-solving skills andmore »
london, south east england, United Kingdom Hybrid / WFH Options
Anson McCade
practices. • Extensive experience with SQL databases, including complex queries and stored procedures. • Experience with SSIS, SSRS, and SSAS. • Strong understanding of data warehousing concepts, ETL, and data modelling. • Familiarity with statistical analysis, data visualization, data mining, and data transformation. • Power BI certification is a plus. • Proven problem-solving skills andmore »
Coordinating the work of business, IT, and external teams to deliver the required results. Perform Feasibility, Impact Assessment, Estimation, Planning, Design and Delivery of ETL Migration projects. Documentation Review, ensuring that work produced by the teams conform to methods, designs, and standards so that economies of scale can be achieved … meaning of the data. Design, estimate, plan and implement the data migration projects from one platform/tool to another. Utilize Azure environment to extract, transform, andload (ETL) data from various sources. Design and implement data models, ensuring data accuracy, consistency, and integrity. Perform data analysis to identify trends … not limited to, SAP ERP, SAP BW, SAP HANA, Marketo, Salesforce etc. Collaboration with different teams, Requirement Gathering, Design and Delivery of Technical solutions. ETL migration project planning, estimation, and delivery Adeptia, Snaplogic ETL migration experience Hands on experience on Azure, ADF, ADLS, Synapse more »
Coordinating the work of business, IT, and external teams to deliver the required results. Perform Feasibility, Impact Assessment, Estimation, Planning, Design and Delivery of ETL Migration projects. Documentation Review, ensuring that work produced by the teams conform to methods, designs, and standards so that economies of scale can be achieved … meaning of the data. Design, estimate, plan and implement the data migration projects from one platform/tool to another. Utilize Azure environment to extract, transform, andload (ETL) data from various sources. Design and implement data models, ensuring data accuracy, consistency, and integrity. Perform data analysis to identify trends … not limited to, SAP ERP, SAP BW, SAP HANA, Marketo, Salesforce etc. Collaboration with different teams, Requirement Gathering, Design and Delivery of Technical solutions. ETL migration project planning, estimation, and delivery Adeptia, Snaplogic ETL migration experience Hands on experience on Azure, ADF, ADLS, Synapse more »
encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, andETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online, Power Apps, GitHub, MS Teams, etc. In-depth knowledge & experience more »
knowledge of business intelligence concepts, data visualisation and analytic methods. * Data Engineering: A strong background in data engineering, with thorough understanding of concepts like ETL (Extract, Transform, Load), data cleaning, data structures, and data warehousing. * Azure Data Services: Hands-on experience with Azure data services like Azure SQL Database, Azure more »
such as Docker and orchestration tools like Kubernetes for containerized deployments. with workflow management tools such as Airflow for orchestrating complex data pipelines andETL processes. certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem. Rewards & Benefits TCS is consistently voted a more »
london, south east england, United Kingdom Hybrid / WFH Options
Tata Consultancy Services
such as Docker and orchestration tools like Kubernetes for containerized deployments. with workflow management tools such as Airflow for orchestrating complex data pipelines andETL processes. certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem. Rewards & Benefits TCS is consistently voted a more »
Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in designing, implementing, and managing ETL processes using Azure Data Factory and other relevant tools. Proficiency in building and managing data warehouses using Azure Synapse Analytics and other data warehousing solutions. more »
Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in designing, implementing, and managing ETL processes using Azure Data Factory and other relevant tools. Proficiency in building and managing data warehouses using Azure Synapse Analytics and other data warehousing solutions. more »
SE1, Chaucer, Greater London, United Kingdom Hybrid / WFH Options
Royal College Of Obstetricians And Gynaecologists
through to developing user reports. They will work on the technical aspects of system integration and be involved in the development and maintenance of ETL (extract, transform, load) processes across all systems. The post holder will work closely with colleagues across the organisation to gather requirements and ensure data integrity … ensure that our technical solutions are fully integrated into business processes. Responsibilities: Advanced T-SQL and SSIS development for the creation and maintenance of ETLand reporting solutions. To lead the development and maintenance of custom applications to provide bespoke functionality, for example using .NET Framework, C# or Python. Development … expertise to internal stakeholders for College supported databases. Requirements: Experience of Advanced T-SQL querying and development: Stored Procedures, Views, functions etc. Experience of ETL development using SSIS or similar Knowledge of database and data warehouse design principles Experience of developing and maintaining custom applications to provide bespoke functionality, for more »
South East London, London, United Kingdom Hybrid / WFH Options
Aj Bell Limited
and Snowflake. Support Senior BI developer by overseeing the collection and integration of data from internal and external sources. Implement robust data pipelines andETL processes to streamline data ingestion and transformation. Competence, Knowledge & Skills: Proven experience in a data management or analytics role within the financial services industry Proven more »
and its tooling (Snowpark, Snowpipe, etc.). Familiarity with Fivetran, DBT, TensorFlow, PyTorch, and other modern data stack components. Knowledge of data integration andETL frameworks and tools. Understanding of DataOps, data mining, and data visualization/BI tools. Strong problem-solving and analytical skills. Excellent communication and collaboration abilities. more »
and its tooling (Snowpark, Snowpipe, etc.). Familiarity with Fivetran, DBT, TensorFlow, PyTorch, and other modern data stack components. Knowledge of data integration andETL frameworks and tools. Understanding of DataOps, data mining, and data visualization/BI tools. Strong problem-solving and analytical skills. Excellent communication and collaboration abilities. more »
various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. > Developing and managing ETL processes for data ingestion, processing, and transformation. > Implementing data governance practices to ensure data integrity, security, and compliance. > Monitoring and troubleshooting data infrastructure to address more »
various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. > Developing and managing ETL processes for data ingestion, processing, and transformation. > Implementing data governance practices to ensure data integrity, security, and compliance. > Monitoring and troubleshooting data infrastructure to address more »
to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, andload data from various sources into AWS data storage solutions. Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue … Java, or Scala. Experience with AWS services including S3, Redshift, Glue, Lambda, and RDS. Strong SQL skills for data manipulation and querying. Familiarity with ETL tools and processes. Understanding of data modeling and database design. Soft Skills : Strong problem-solving and analytical skills. Excellent communication and teamwork abilities. Detail-oriented more »
to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, andload data from various sources into AWS data storage solutions. Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue … Java, or Scala. Experience with AWS services including S3, Redshift, Glue, Lambda, and RDS. Strong SQL skills for data manipulation and querying. Familiarity with ETL tools and processes. Understanding of data modeling and database design. Soft Skills : Strong problem-solving and analytical skills. Excellent communication and teamwork abilities. Detail-oriented more »
Greater London, England, United Kingdom Hybrid / WFH Options
Validis
believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute significantly to our … data infrastructure. Key responsibilities of the Senior Data Engineer; Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.). Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes. Designing and implementing CI …/CD workflows for data engineering projects. Optimize ETL processes for efficiency, scalability, and performance. Develop and maintain documentation for data pipelines and data models. Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity. Collaborate with data analysts, data scientists, and other engineers to understand data needs andmore »
london, south east england, United Kingdom Hybrid / WFH Options
Validis
believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute significantly to our … data infrastructure. Key responsibilities of the Senior Data Engineer; Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.). Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes. Designing and implementing CI …/CD workflows for data engineering projects. Optimize ETL processes for efficiency, scalability, and performance. Develop and maintain documentation for data pipelines and data models. Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity. Collaborate with data analysts, data scientists, and other engineers to understand data needs andmore »
open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity andmore »
Power BI, Azure Cloud Services (including PowerShell, Functions, Devops, and CI/CD Pipelines) Significant experience in Azure SQL Development and Data engineering, managing ETLand ELT pipelines Ability to work in a small dynamic team working across the data and analytics space University degree in a STEM subject HOW more »