1 to 25 of 100 Permanent PySpark Jobs

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

Microsoft Fabric, including OneLake, Lakehouse, Delta, Data Pipelines, Dataflows, and Power BI semantic models Strong SQL skills including performance tuning Experience with Python or PySpark for data transformations Practical experience building ETL or ELT pipelines Solid understanding of data modelling approaches such as dimensional modelling and medallion architecture Experience ...

Strong proficiency in SQL , including Spark SQL and MS SQL Server , for querying, data manipulation, and performance optimization. Hands-on experience with Python and PySpark for data processing, transformation, and automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern ...

time of application). Proven expertise with: Azure Data Factory & Azure Synapse Azure DevOps & Microsoft Azure Power BI (including semantic models) Python (incl. PySpark) and SQL (advanced proficiency) dbt with SQL DBs (data transformation & modelling) Dimension data modelling Terraform for infrastructure-as-code deployments Experience delivering solutions with structured ...

skills Desirable Minimum 2 years experience in Data related field Minimum 2 years in a Business or Management Consulting field Experience of Docker, Hadoop, PySpark, Apache or MS Azure Minimum 2 years NHS/Healthcare experience Disclosure and Barring Service Check This post is subject to the Rehabilitation ...

Transact-SQL to a highly proficient level Data transformation expressions in Data Factory/Synapse (desirable) Power Query M and DAX (desirable) Python; PySpark (desirable) Proven experience in a client facing data consultancy role designing, implementing, and supporting data solutions Ability to lead business and technical discussions Self-driven ...

Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. Knowledge of querying API systems. Experience ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package/role details include: Salary ...

have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package/role details include: Salary ...

have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package/role details include: Salary ...

experience with cloud-based data platforms (Azure, AWS, SQL, Snowflake, Springserv); Microsoft Fabric experience is a strong plus Strong proficiency in Spark SQL and PySpark , including complex transformations Experience building ETL/ELT pipelines using tools such as Azure Data Factory or equivalent Ability to write efficient, reusable scripts ...

Title: Databricks Developer Location: Hybrid, but local resources to Atlanta preferred Duration: 12 - 24 months Job Description: A Pyspark and Databricks Developer with a good understanding of the entire ETL/Azure lifecycle with a background of data projects. Responsibilities Design, develop, and maintain scalable data pipelines ...

Your Profile Essential Skills/Knowledge/Experience Strong working and technical knowledge of GCP (GCS Buckets, BigQuery, Dataproc, Pub/Sub), Airflow, Spark, PySpark, Spark SQL, Hive. Good knowledge of Python (Pandas, NumPy, Wiresafe), SQL, Linux CLI, BigQuery. Experience with DBMS, Delta Tables, Oracle, MS Access, SQL Server. ...

Analysis Services) Microsoft Fabric & Power BI On-prem equivalents (SSIS, SSAS, SSRS) welcome Highly proficient in T-SQL; experience with M, DAX, Python or PySpark beneficial Demonstrable background in client-facing consultancy roles Excellent communication skills and the ability to lead technical and business discussions SC Clearance ...

state compliance reporting remains uninterrupted. B. Modernization & Migration Execution (Future State) Cloud Development: Implement "Medallion Architecture" (Bronze/Silver/Gold) using Azure Databricks (PySpark/SQL) as designed by the Lead Architect. Pipeline Refactoring: Lead the transition of legacy SSIS logic into Azure Data Factory (ADF) and Databricks ...

demand delivery Provide technical guidance for team members Providing 2nd or 3rd level technical support About You Experience using SQL, SQL Server DB, Python & PySpark Experience using Azure Data Factory Experience using Data Bricks and Cloudsmith Data Warehousing Experience Project Management Experience The ability to interact with the operational ...

Designing and building cloud based data and machine learning pipelines that prepare data for analytics, AI, and product use ·Writing clear, well-structured Python, PySpark, and SQL to transform and validate data from multiple upstream sources ·Taking ownership of data quality, consistency, and reliability across the pipeline lifecycle ·Shaping ...