1 to 25 of 117 Permanent PySpark Jobs in England

transformation and orchestration pipelines, integrating data from cloud, on‐premises and third‐party business systems. Strong hands‐on capability with SQL, Python, Spark and PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation ...

using Azure Databricks. Build robust ETL/ELT solutions using Azure Data Factory and Microsoft Fabric. Develop high-performance data processing solutions using Python, PySpark, and SQL. Implement Delta Lake and Lakehouse architectures following industry best practices. Work with Azure Data Lake Storage (ADLS Gen2) to manage large-scale ...

standards and best practices. About you Extensive experience designing and delivering enterprise-scale data engineering solutions Strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark Knowledge of Azure Data Platform services ...

complex data workflows Excellent communication and collaboration skills in agile, cross-functional teams Ability to mentor junior engineers Nice to have: Experience with Databricks, PySpark, and Delta Lake Условия Competitive salary based on location, experience, and skills Comprehensive benefits package for employees and their families Continuous learning, structured development ...

Azure Databricks, Databricks, Azure Data Lake, ADLS, Azure SQL, Azure Synapse, Synapse Analytics, Azure PaaS, ETL, ELT, Data Pipelines, Data Integration, SQL, Python, PySpark, Azure DevOps, CI/CD, Data Governance, Data Quality, Cloud Security, Microsoft Fabric, Power BI, Power Platform. ...

understanding on Master Data Services, DQ profiling, cleansing, update, DQ reports, Purview. Strong experience with at least one of the programming languages (Python, Scala, PySpark). Knowledge and experience using the Microsoft technology stack and associated development tools. Experience working with SharePoint, PowerPivot, PowerBI and deep knowledge ...

understanding on Master Data Services, DQ profiling, cleansing, update, DQ reports, Purview. Strong experience with at least one of the programming languages (Python, Scala, PySpark). Knowledge and experience using the Microsoft technology stack and associated development tools. Experience working with SharePoint, PowerPivot, PowerBI and deep knowledge ...

experience building and maintaining production pipelines and data models. Deep proficiency with Databricks or similar platforms — Delta Live Tables, Unity Catalog, Delta Lake, and PySpark or Spark SQL as primary tools. Strong SQL skills: complex transformations, incremental materialization, schema evolution, and data quality validation. Solid AWS experience relevant ...

Support Stakeholder Engagement & Collaboration Independent Troubleshooting & Problem Solving Agile/Scrum Development Azure DevOps, CI/CD & Release Management Technical Documentation Technical Azure Databricks, PySpark, Python & SQL Azure Data Factory Azure Functions Azure Data Lake/Lakehouse REST APIs & Third-Party System Integration Azure SQL Logic Apps Azure DevOps ...

have To be considered for this role, we would love you to have: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

EXPERIENCE You should have: Previous experience leading or managing Data Engineers Strong consulting or client-facing experience Advanced SQL and Python skills Experience with PySpark Experience with Azure, Microsoft Fabric and Databricks (or strong cloud data engineering experience) CI/CD and Git experience Power BI knowledge Experience building ...

knowledge: Experience of designing and implementing an Azure analytical platform including Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Delta Lake, Unity Catalog, PySpark, SQL, Python, and Azure DevOps. Experience of working with senior stakeholders to articulate the strategy, objectives and benefits of a central enterprise cloud data ...

Skills Significant experience leading the design, development, and operation of enterprise‐scale data engineering platforms and teams. Strong technical expertise in SQL and Python, PySpark, or equivalent technologies for data ingestion, transformation, and validation. Experience with Microsoft Fabric or similar modern cloud‐based analytics and data platforms. Strong experience ...

analytics strategy AI & Automation Agentic AI patterns and intelligent automation solutions Document intelligence and AI-driven business use cases SQL Python and/or PySpark Data pipelines and transformation frameworks CI/CD concepts and deployment automation Azure DevOps and/or GitHub Infrastructure as Code awareness Environment promotion ...

contribute to long-term platform innovation Required Experience Strong experience designing enterprise data platforms within Microsoft Azure environments Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake, and Lakehouse architecture Strong hands-on experience with Snowflake architecture and optimisation Experience with Azure Data Factory, ADLS Gen2, Synapse ...

working in agile teams Strong judgment with the ability to balance strategic vision with pragmatic, incremental delivery Technical Skills Programming & Analysis: Python, R, SQL, PySpark Cloud Platforms: AWS, Azure, GCP Data Tools: Data profiling tools, data quality platforms, metadata management systems Visualization: Tableau, Power BI, or similar BI tools ...

storage Proficiency with Terraform (ideally the Databricks provider) and Gitbased CI/CD workflows Solid programming skills in Python and SQL; comfortable with PySpark and shell scripting Experience tuning Spark jobs and Delta tables (partitioning, Working knowledge of SSO/SCIM, identity providers and secretsmanagement Understanding of data security ...

Exposure to metadata management, data governance, and data quality frameworks Experience with CI/CD (Azure DevOps, Gi t) and ideally scripting (Python/PySpark) Job Offer £700-£800 per day (Inside IR35) Hybrid working (2-3 days in London) Initial 6-month contract with extension potential ...

OneLake, pipelines and notebooks, and how these can be used to build scalable enterprise data solutions. Strong experience with SQL, Python and/or PySpark and modern data engineering approaches. Strong understanding of data architecture and data modelling, including designing reusable and scalable data structures. Experience implementing modern software ...

Strong hands-on experience with Quantexa implementation and development. Proven experience building and supporting big data platforms . Advanced knowledge of Apache Spark/PySpark . Strong programming skills in Scala and/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across ...

Databricks Azure Data Lake/Lakehouse Good understanding of data architecture and data flows . Practical SQL experience. Experience with Python and/or PySpark . Experience with CI/CD and DevOps . Experience with Power BI and/or Power Apps . Strong understanding of data ingestion ...

hands-on experience with modern cloud data platforms (e.g. Databricks or Snowflake), ideally within AWS environments. Advanced programming and data engineering skills in Python, PySpark and SQL, with a solid understanding of ETL pipelines and data transformation. Proven experience in data modelling (end-to-end), including performance optimisation using ...

clear technical tasks. Mentorship: A proactive mindset, eager to provide guidance to less experienced developers and support collaborative pair-programming. Desirable Skills Experience with PySpark or PySQL. Experience in Dimensional Modelling and data warehousing principles. Experience with SQL Server SSAS Tabular and DAX. Exposure to SQL Server RDBMS ...

working across Architecture, Engineering, Product, and Business teams. Data Engineering & Platforms Strong hands-on experience with: Databricks Delta Lake Unity Catalog dbt Spark/PySpark Data pipeline development and optimisation Lakehouse architectures ETL/ELT frameworks Enterprise data platform implementation Cloud Technologies (AWS) Experience with: Amazon S3 AWS Glue ...

pipelines. Experience working with cloud data platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models support ...