10 of 10 Permanent PySpark Jobs in Wales

e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability ...

years of hands-on experience in enterprise data modelling using tools such as ERwin, ER/Studio, or Power Designer Proven experience with Databricks, PySpark, Python, SQL, and modern data platform architectures including data lakes and data warehouses Knowledge of batch and streaming ingestion, CI/CD tools (Azure ...

years of hands-on experience in enterprise data modelling using tools such as ERwin, ER/Studio, or Power Designer Proven experience with Databricks, PySpark, Python, SQL, and modern data platform architectures including data lakes and data warehouses Knowledge of batch and streaming ingestion, CI/CD tools (Azure ...

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like ...

Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like ...

have delivered ML techniques to existing pricing models. Financial Services or Insurance experience would be preferable but not limited to. Full Tech Stack - Databricks, PySpark, Microsoft Azure, Azure ML, Azure Stream Analytics, Cognitive Services, Event Hubs, Synapse, Data Factory. This is a fantastic role for an experienced Machine Learning ...

analysis, governance, reporting and analytics. Hands-on delivery experience working with data, analysis and BI tools e.g. SQL, PowerQuery, Excel VBA, Python (e.g. Pandas, PySpark), DataBricks, Power BI, Tableau etc. The salary on offer for this Data Business Analyst Role is up to £120,000 + Bonus and Benefits … define functional and system requirements Hands-on delivery experience working with data, analysis and BI tools e.g. SQL, PowerQuery, Excel VBA, Python (e.g. Pandas, PySpark), DataBricks, Power BI, Tableau etc. Essential Skills for the Data Business Analyst: Senior IT Business Analyst/Data Analyst with experience of a Commodities ...

open-source data validation frameworks to ensure data accuracy, schema integrity, and quality across ingestion and transformation pipelines Test and validate data pipelines and PySpark notebooks developed by Data Engineers, ensuring they meet quality, reliability, and validation standards Defining and standardizing monitoring, logging, alerting, and KPIs/SLAs across … setting up Alert rules, building dashboards using data queried (KQL) from Log Analytics. Experience with Fabric Data Factory, Azure Data Factory, Synapse pipelines, and PySpark notebooks Hands-on experience calling REST/OData APIs for validating data. Experience writing SQL and scripts for programmatically doing data validations and reconciliation ...