24 of 24 ETL Jobs in South Yorkshire

standardisation: Experience in resolving data quality issues and ensuring data accuracy through cleansing and standardisation techniques. Use of data integration tools: Skilled in using ETL tools for data integration and storage. Ensures data interoperability with other datasets. Collaboration with data professionals: Experience collaborating with other data professionals to improve modelling ...

when required. About you: You have strong experience as a Senior Data Engineer or Data Architect on Azure based platforms You have experience with ETL and orchestration tools including Azure Data Factory, Synapse Pipelines and Logic Apps You have experience with Microsoft Fabric, including Power BI, Lakehouse and Warehouse components ...

Proven hands-on experience as a Data Engineer or in a similar data-centric role. Strong proficiency in SQL and Python. Solid understanding of ETL/ELT pipelines, data modelling, and data warehousing principles. Experience working with cloud platforms such as AWS, Azure, or GCP. Exposure to modern data tools ...

Ontology & Application Design: Create and manage Ontology Objects, Links, and Actions to support downstream applications and workflows. Pipeline Development & Automation: Build scalable, fault-tolerant ETL/ELT pipelines using PySpark, SQL, and Foundry's proprietary tools like Pipeline Builder and Code Workbook. Productization & Scaling: Create Prototypes and Convert them into ...

data models that effectively represent business entities and relationships and support efficient querying and analysis from relational data warehouses. Experience building and maintaining reliable ETL pipelines to integrate data from diverse sources. Strong Python expertise, including development of clean, reusable functions and object-oriented code for production-quality solutions. Solid ...

data models that effectively represent business entities and relationships and support efficient querying and analysis from relational data warehouses. Experience building and maintaining reliable ETL pipelines to integrate data from diverse sources. Strong Python expertise, including development of clean, reusable functions and object-oriented code for production-quality solutions. Solid ...

and CSV formats. Perform testing on graph database management systems (GDBMS). Implement testing strategies for Policy as Code and GitOps repositories. Conduct Batch ETL testing, Pub/Sub and message queue testing, and SaaS testing. Mentor junior engineers and supported knowledge-sharing across the team. Integrate automation testing into ...

testing and database comparison testing expertise. Experience with JIRA , Xephyr , and broader test management tools. API Testing, API Gateway testing, Batch/ETL testing. Experience with GitOps repositories and modern DevOps workflows. Excellent stakeholder engagement and communication skills, with the ability to lead and influence. Experience working in Agile and ...

Azure integrations Testing functions and decision points "As Code", such as Policy as code Experience of GitOps Repos API Testing, API Gateway testing, Batch ETL testing Team Leadership & Management - Proven ability to lead, mentor, and manage other engineers within the team DevOps & CI/CD Integration - Ability to integrate automation ...

Azure integrations Testing functions and decision points ??As Code??, such as Policy as code Experience of GitOps Repos API Testing, API Gateway testing, Batch ETL testing Team Leadership & Management - Proven ability to lead, mentor, and manage other engineers within the team DevOps & CI/CD Integration - Ability to integrate automation ...

data engineering and AI/ML tooling, workflows, and trends in enterprise setting Proficiency in Python, Spark, and/or SQL with experience developing ETL applications Excellent communication and presentation skills, with comfort in objection handling Hands-on experience with AWS, and other cloud providers Databricks and/or Snowflake ...

Azure integrations Testing functions and decision points ""As Code"", such as Policy as code Experience of GitOps Repos API Testing, API Gateway testing, Batch ETL testing Proven ability to mentor other engineers within the team DevOps & CI/CD Integration - Ability to integrate automation tests into GitLab CI/ ...

Azure Data Factory, Azure Synapse, Databricks, and PowerBI to build robust, scalable, and future-proof end-to-end data solutions. Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data. Develop and maintain sophisticated data models, employing … Synapse, Databricks, Microsoft Fabric, or even on-premise Spark clusters, using PySpark or Spark SQL to manage and process large datasets. Expertise in Building ETL and ELT Pipelines: You are skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark-based solutions ...

Skills Experience within Identity & Access Management , Privileged Access, Secrets Management or related security domains. Exposure to AD/ADLDS , API Gateway testing, Batch/ETL testing. Experience with automation tools such as Jenkins, Maven, JUnit Jupiter, Selenium WebDriver . Working knowledge of Java . Experience with SailPoint IdentityIQ , Identity Warehousing ...

pragmatic, innovative, and self-motivated problem solver who delivers results through collaboration and technical excellence. Data Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments … e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience ...

Server (2019, Analysis, Security, Objects, Jobs) Advanced experience with Visual Studio (SSIS, SSAS, DAX) Advanced skills in SSIS (Package creation, Data ingestion, Data Cleansing & ETL) Strong understanding of interaction with SSAS and Power BI Desktop Strong experience using DAX within Tabular Model Advanced experience in Active Directory Experienced in setting ...

Server (2019, Analysis, Security, Objects, Jobs) Advanced experience with Visual Studio (SSIS, SSAS, DAX) Advanced skills in SSIS (Package creation, Data ingestion, Data Cleansing & ETL) Strong understanding of interaction with SSAS and Power BI Desktop Strong experience using DAX within Tabular Model Advanced experience in Active Directory Experienced in setting ...

Cloud or any Industry Clouds Broad range of experience in large-scale database and data warehousing technology, like Snowflake or Databricks, as well as ETL processes, analytics and cloud technologies, Data Engineering, Data Science Hands on Experience in AI/ML solutions like Einstein, Sagemaker, and Vertex. Solid Understanding … Services, Microsoft Azure or Google Cloud Platform. Hands-on expertise with analytics tools like Tableau, PowerBI, Looker, etc Familiarity with data activation or "reverse ETL" platforms in the context of Composable Data Platforms (CDP) and integrating various marketing technologies and data tools into a cohesive system. Experience will be evaluated ...

Flexible, hybrid working from central London And much more What do we need from you? PyTorch, Python, understanding of the machine learning ecosystem AWS ETL processes Good understanding of vector databases (they use open search) Proven experience using LLMs through APIs Sound like you? No CV is needed at this ...

services. Nice-to-Have: Familiarity with TOGAF, UML, Agile methodologies (Scrum/Kanban). Knowledge of MS SQL Server, Oracle DB, C#, Java, ETL (Informatica), Tableau, HTML5, JavaScript. Banking industry experience. ...

services. Nice-to-Have: Familiarity with TOGAF, UML, Agile methodologies (Scrum/Kanban). Knowledge of MS SQL Server, Oracle DB, C#, Java, ETL (Informatica), Tableau, HTML5, JavaScript. Banking industry experience. ...

Snowflake Architect Location: Basildon, UK/Dublin, Ireland Work from Client office 5 days weekly Responsibilities: -Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. -Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. -Collaborate with data analysts, scientists, and other … related field. >5+ years of experience in data engineering, with a strong focus on Snowflake and AWS. > Proficiency in SQL, Python, and ETL tools (Streamsets, DBT etc.) > Hands on experience with Oracle RDBMS > Data Migration experience to Snowflake > Experience with AWS services such as S3, Lambda, Redshift, and Glue. > Strong ...

Implement metadata ingestion, lineage integrations and custom API/SDK automation Configure and support Collibra Edge, metadata harvesting and ingestion pipelines Integrate Collibra with ETL/ELT, databases and BI tools Optimise platform performance, troubleshoot issues and support upgrades Enable dashboards, KPIs and reporting within Collibra Provide best practices, technical … with Collibra development Proficiency in BPMN, Groovy, Java, REST APIs Solid SQL skills and experience with major databases (Oracle, PostgreSQL, DB2, BigQuery) Experience with ETL/ELT tools (e.g., Informatica, DataStage) and BI tools (Qlik, Power BI) Good understanding of metadata standards, lineage, reference data and business glossaries Exposure ...

and suggested improvements to team members. WHAT YOU'LL BRING: Significant experience in a data science related role Demonstrable experience on data migration using ETL tools. Ability to translate business requirements into data solutions. Expert level skill on Informatica IICS or Matillion or equivalent ETL tool which covers from extracting ...