1 to 25 of 105 PySpark Jobs in the UK

SKILLS • Bachelor's degree in Computer Science, Engineering, Data Science, Information Systems, or a related field. • Proficient in Python, including libraries like Pandas, NumPy, PySpark, and Scikit-learn. • Strong experience with SQL, ETL processes, and data pipeline development. • Expertise in Tableau BI for data visualization and dashboarding. • Hands ...

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

Microsoft Fabric, including OneLake, Lakehouse, Delta, Data Pipelines, Dataflows, and Power BI semantic models Strong SQL skills including performance tuning Experience with Python or PySpark for data transformations Practical experience building ETL or ELT pipelines Solid understanding of data modelling approaches such as dimensional modelling and medallion architecture Experience ...

data modelling and data warehousing concepts (star/snowflake schemas, SCD2, Dimensions/Facts) Proficient in SQL and Python, with hands-on experience using PySpark, Spark SQL, and/or Pandas. Experience in technical documentation of migration processes, data mappings, data quality checks, and testing outcomes. Ability to work ...

Strong proficiency in SQL , including Spark SQL and MS SQL Server , for querying, data manipulation, and performance optimization. Hands-on experience with Python and PySpark for data processing, transformation, and automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern ...

time of application). Proven expertise with: Azure Data Factory & Azure Synapse Azure DevOps & Microsoft Azure Power BI (including semantic models) Python (incl. PySpark) and SQL (advanced proficiency) dbt with SQL DBs (data transformation & modelling) Dimension data modelling Terraform for infrastructure-as-code deployments Experience delivering solutions with structured ...

Your Profile Essential Skills/Knowledge/Experience Strong working and technical knowledge of GCP (GCS Buckets, BigQuery, Dataproc, Pub/Sub), Airflow, Spark, PySpark, Spark SQL, Hive. Good knowledge of Python (Pandas, NumPy, Wiresafe), SQL, Linux CLI, BigQuery. Experience with DBMS, Delta Tables, Oracle, MS Access, SQL Server. ...

practices Promote and champion the exceptional work being accomplished. Skill/Experience Required Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package/role details include: Salary ...

have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package/role details include: Salary ...

have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package/role details include: Salary ...

accomplished. To be considered for this role, we would love you to have: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

experience with cloud-based data platforms (Azure, AWS, SQL, Snowflake, Springserv); Microsoft Fabric experience is a strong plus Strong proficiency in Spark SQL and PySpark , including complex transformations Experience building ETL/ELT pipelines using tools such as Azure Data Factory or equivalent Ability to write efficient, reusable scripts ...

added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction and transformation. Prior experience with Data warehousing and Data modelling (Star Schema or Snowflake Schema). Skilled in security frameworks ...

Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. Knowledge of querying API systems. Experience ...

Control Practical experience with Git (branching, merging, pull requests). Preferred Qualifications (A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure ...