1 to 25 of 41 ETL Jobs in Doncaster

services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity More ❯

in the business Programming experience in Python Experience writing, troubleshooting, and debugging advanced SQL queries Outstanding analytical and problem-solving skills Experience working with ETL/ELT, and reporting and analytics tools Skills and experience we’d love you to have... But if not? We’ll help you get there More ❯

IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse More ❯

collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others. IF YOU ARE A technology professional focused on Data Warehouses, ETL, and BI solutions development Experienced in eliciting business requirements to address the customer’s data visualization needs Ready to dive into a customer's subject More ❯

and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist in gathering, documenting, and managing data engineering requirements and workflows. Contribute to the development … reviews of designs, prototypes, and other work products to ensure requirements are met. Skills & Experience: Essential: Basic understanding of data engineering concepts, such as ETL processes, data pipelines, and data quality management. Hands-on experience with SQL (e.g., writing queries, basic database management). Familiarity with data tools and platforms More ❯

On a daily basis your varied role will include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and More ❯

reporting development (advanced/expert levels only). Key Tools & Technologies Visualization Tools: Tibco Spotfire, Tableau, Power BI, or QlikView Data Management & Querying: SQL, ETL pipelines, Data Warehousing (e.g., ODW) Scripting/Programming: Iron Python, R, R Shiny, SAS Collaboration & Platforms: SharePoint, clinical trial data platforms Qualifications Entry Level: Bachelor More ❯

meet current best practices and internal standards. Work closely with project managers and technical leads to integrate new enterprise data sources into ongoing projects. ETL Development Develop robust, automated ETL (Extract, Transform, Load) pipelines using industry-standard tools and frameworks, prioritizing scalability, reliability, and fault tolerance. Essential Skills & Experience Strong … ESRI, 3GIS, Bentley, Hexagon, Crescent Link, CadTel, etc.). Experience with business requirement analysis and the development of reporting and analytics structures. Familiarity with ETL solutions, including experience with SAFE FME, is highly desirable. Strong knowledge of data privacy regulations and practices. Exposure to analytics and reporting tools is considered More ❯

in: Azure Data & AI services (e.g., Azure Machine Learning, Azure OpenAI, Cognitive Services, Synapse) Programming with Python for data and AI workloads Data pipelines, ETL/ELT processes, and analytics foundations App development techniques to integrate AI capabilities Working in secure, enterprise-ready cloud environments Consulting fundamentals and effective customer More ❯

business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem-solving, and communication skills. - Experience with operational data processes, ETL, data warehouse migration, schema mapping, and MI/BI reporting. - Proficient in tools such as JIRA, Confluence, Asana, Miro, and Excel. - Familiarity with Agile (SCRUM More ❯

OAC). Should be aware about process of creating Semantic data model in FDI. Proven experience in data modeling, data extraction, transformation, and loading (ETL) using Oracle Cloud tools Hands-on experience in creating dashboards, KPIs, custom reports, and visual analytics for Finance, Supply Chain, and HCM modules Strong understanding More ❯

shape something from the ground up — this is for you. What you’ll do: Design and build a cloud-native data warehouse Develop scalable ETL/ELT pipelines and dimensional models (Kimball, Data Vault, etc.) Integrate multiple data sources (cloud & on-prem) Ensure high data quality, performance and reliability Collaborate More ❯

data sets, produce dashboards and drive actionable insights. SQL Development: Write and optimise complex Microsoft SQL Server queries for data extraction, transformation and loading (ETL). Data Governance: Implement master data management and governance policies to maintain data quality, compliance and lineage. Stakeholder Management: Communicate effectively with project managers and More ❯

needs and business strategies. Cloud Architecture: Design and implement scalable, cost-effective architectures across AWS, Azure, or GCP environments. Data Engineering: Develop and manage ETL/ELT pipelines, data integration workflows, and implement CDC and delta load design for effective data management. SAP Tools: Lead SAP BW to SAP Datasphere More ❯

Knowledge (Snowflake, PostgreSQL, MSSQL, etc.). Scripting languages (Python, PowerShell). Data quality and resolving related processes Cloud Data Warehousing solutions and ELT/ETL solutions (e.g., Snowflake, DBT). Experience in working within an Agile environment. Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For More ❯

and dynamic team. Responsibilities: Collaborate with various squads within the data team on project-based work. Develop and optimize data models, warehouse solutions, and ETL processes. Work with Scala, Spark, and Java to handle large-scale data processing. Contribute to manual Databricks-like data processing solutions. Requirements: Minimum of More ❯

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 More ❯

delivery approach within a DevOps environment Extensive experience in creating technical specifications and code for data migration Proven expertise in extracting, transforming, and loading (ETL) financial data during migration from on-premise systems to the cloud Demonstrated ability to track, report, and improve data migration quality metrics It would be More ❯

an agile framework preferable, including defining functional and non-functional requirements and sprint tasks. Understanding of data engineering, some experience with building production-grade ETL pipelines, as well as backend web development, backend-for-frontend, GraphQL, and FastAPI. Strong communication skills, able to communicate with both technical and commercial people. More ❯

Key aspects of the role include: Data Pipeline Development: Architect, develop, and optimise data extraction, transformation, and loading (ETL) processes for high-volume healthcare data. Integration of NHS Systems Data: Work directly with NHS data sources and ensure seamless integration of systems like UDAL, NCDR, SUS+, HES, and ODS into … and ODS—and to address the unique challenges these datasets present. Data Engineering Proficiency: Advanced proficiency in building and maintaining robust data pipelines using ETL tools and frameworks. Familiarity with data warehousing concepts and experience in developing scalable, high-performance data architectures. Technical Expertise: Strong command of SQL and scripting More ❯

that meet business goals. Architecture & Engineering Excellence: Design and implement scalable, cost-effective data architectures across AWS, Azure, and GCP; build and maintain robust ETL/ELT pipelines and implement CDC and delta load frameworks to enhance data integration and performance. Platform Modernization & SAP Expertise: Lead complex migrations from legacy More ❯

would have 10+ years experience in Data Engineering/Architecture and have good knowledge within: Cloud (AWS, GCP, Azure) Data Warehousing (Snowflake, Redshift, BigQuery) ETL (Data Fabric, Data Mesh) DevOps (IaC, CI/CD, Containers) Leadership/Line Management Consulting/Client Facing Experience In return they would be offering More ❯

major teams in sports such as American football, soccer, NBA, Formula 1, and Olympic events. Key Responsibilities: Design and build large-scale data warehouses, ETL pipelines, and reporting platforms that are robust and efficient. (Looking at going down Snowflake or BigQuery) Utilize your expertise in backend languages; the tech stack More ❯

What You Will Bring: Extensive experience in database design, management, and optimization. Proficiency in advanced SQL and query optimization techniques. Hands-on experience with ETL processes and monitoring tools. Knowledge of both relational and non-relational database systems. Expertise in cloud-based database solutions and services, particularly Azure. Experience working More ❯

to security policies. • Develop and enforce GCP security hardening measures (network segmentation, access controls, encryption, GDPR/ISO 27001 compliance). • Design and implement ETL pipelines for marketing data into BigQuery for Looker. • Optimise BigQuery data models and schemas for Looker exploration and reporting. • Implement robust monitoring, logging, and alerting More ❯