1 to 25 of 122 Permanent PySpark Jobs in the UK excluding London

transformation and orchestration pipelines, integrating data from cloud, on‐premises and third‐party business systems. Strong hands‐on capability with SQL, Python, Spark and PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation ...

models in data warehouses, lakehouse environments or analytics tools such as Power BI. Familiarity with modern data engineering frameworks and tools (e.g. Spark/PySpark, Pandas, orchestration tools). Experience with cloud data platforms on AWS or Azure (e.g. Databricks, Redshift, Microsoft Fabric). Understanding of software engineering fundamentals ...

standards and best practices. About you Extensive experience designing and delivering enterprise-scale data engineering solutions Strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark Knowledge of Azure Data Platform services ...

e.g. DAMA) • Strong expertise in Microsoft Azure, Fabric, Microsoft 365 platform • Fluency in one or more of the following programming languages (SQL, Python (pandas, PySpark, REST API integration), M Power Query, DAX, JavaScript) • Proven experience as a Data Architect, Data Engineer, or similar role. • Extensive experience with database management ...

would also be highly advantageous, particularly: Azure Data Factory Azure SQL Azure Data Lake/ADLS Azure DevOps Microsoft Fabric Azure Databricks Experience with PySpark, Airflow, Dagster, Prefect or other orchestration technologies would also be useful. We're particularly interested in people who have worked with modern data platforms ...

data quality best practice.Strong problem-solving skills and attention to detail.The ability to communicate effectively with both technical and business stakeholders.Desirable ExperiencePython or PySpark development within Microsoft Fabric.CI/CD practices for data engineering and data product delivery.Experience within legal services or another professional services environment.Exposure to systems such ...

deliver practical, value-driven data solutions. Drive continuous improvement across data engineering, reporting, and analytics capabilities. Essential Requirements Strong expertise in SQL and Python (PySpark desirable). Proven experience designing and building cloud-based data platforms from inception. Hands-on experience with Databricks, Spark, modern data lake/lakehouse ...

Databricks. Requirements Required Skills & Technologies Cloud Platforms: Hands-on engineering experience within the AWS ecosystem (S3, IAM, Glue) and deep expertise in Databricks (SparkSQL, PySpark, governed cataloging). Modern Data Stack: Strong proficiency in dbt (Core or Cloud) for data transformation and understanding of modern table formats, specifically Apache ...

Python/Data Engineering professionals with a solid Azure foundation and the ability to learn and work across the wider platform. Desirable Databricks/PySpark NoSQL/Cosmos DB Infrastructure as Code/DevOps automation AI/ML data integration Automotive or insurance industry experience If this sounds ...

EXPERIENCE You should have: Previous experience leading or managing Data Engineers Strong consulting or client-facing experience Advanced SQL and Python skills Experience with PySpark Experience with Azure, Microsoft Fabric and Databricks (or strong cloud data engineering experience) CI/CD and Git experience Power BI knowledge Experience building ...

knowledge: Experience of designing and implementing an Azure analytical platform including Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Delta Lake, Unity Catalog, PySpark, SQL, Python, and Azure DevOps. Experience of working with senior stakeholders to articulate the strategy, objectives and benefits of a central enterprise cloud data ...

analytics strategy AI & Automation Agentic AI patterns and intelligent automation solutions Document intelligence and AI-driven business use cases SQL Python and/or PySpark Data pipelines and transformation frameworks CI/CD concepts and deployment automation Azure DevOps and/or GitHub Infrastructure as Code awareness Environment promotion ...

contribute to long-term platform innovation Required Experience Strong experience designing enterprise data platforms within Microsoft Azure environments Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake, and Lakehouse architecture Strong hands-on experience with Snowflake architecture and optimisation Experience with Azure Data Factory, ADLS Gen2, Synapse ...

Exposure to metadata management, data governance, and data quality frameworks Experience with CI/CD (Azure DevOps, Gi t) and ideally scripting (Python/PySpark) Job Offer £700-£800 per day (Inside IR35) Hybrid working (2-3 days in London) Initial 6-month contract with extension potential ...

with both technical and non-technical audiences Nice to have: Production experience specifically in Microsoft Fabric Power BI, particularly Direct Lake mode Python/PySpark Data governance or security experience Experience enabling AI/ML workloads from a data platform, not just BI The details: Salary ...

OneLake, pipelines and notebooks, and how these can be used to build scalable enterprise data solutions. Strong experience with SQL, Python and/or PySpark and modern data engineering approaches. Strong understanding of data architecture and data modelling, including designing reusable and scalable data structures. Experience implementing modern software ...

control and documentationAct as a technical leader and mentor, raising standards across the data engineering communityWhat you’ll bringEssentialDeep expertise in Databricks (Spark/PySpark, Delta Lake, Unity Catalog, Workflows)Strong experience building ETL/ELT pipelines, both batch and streamingAdvanced Python and SQL skillsHands-on experience with cloud ...

Strong hands-on experience with Quantexa implementation and development. Proven experience building and supporting big data platforms . Advanced knowledge of Apache Spark/PySpark . Strong programming skills in Scala and/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across ...

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

hands-on experience with modern cloud data platforms (e.g. Databricks or Snowflake), ideally within AWS environments. Advanced programming and data engineering skills in Python, PySpark and SQL, with a solid understanding of ETL pipelines and data transformation. Proven experience in data modelling (end-to-end), including performance optimisation using ...

clear technical tasks. Mentorship: A proactive mindset, eager to provide guidance to less experienced developers and support collaborative pair-programming. Desirable Skills Experience with PySpark or PySQL. Experience in Dimensional Modelling and data warehousing principles. Experience with SQL Server SSAS Tabular and DAX. Exposure to SQL Server RDBMS ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

Hands-on expertise in Snowflake and Databricks Proficient in Microsoft Azure, including Azure Data Factory and Azure Data Lake Advanced SQL and Python or PySpark skills Experience building enterprise-level ETL/ELT pipelines Knowledge of data modelling, governance, and data quality Previous consultancy or client-facing delivery experience ...

pipelines. Experience working with cloud data platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models support ...