26 to 50 of 150 PySpark Jobs in England

Databricks Azure Data Lake/Lakehouse Good understanding of data architecture and data flows . Practical SQL experience. Experience with Python and/or PySpark . Experience with CI/CD and DevOps . Experience with Power BI and/or Power Apps . Strong understanding of data ingestion ...

support migration planning, solution design and adoption. Data Engineering and Integration Design, build and optimise scalable data ingestion and transformation solutions using Python, PySpark, SQL and Delta Lake. Implement batch and incremental processing patterns, including Change Data Capture (CDC), schema evolution, reconciliation processes, data quality controls and error handling. ...

cross functional teams entrusted with business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong ...

relevant data solutions development qualifications (e.g. Microsoft certification; Databricks Certification; data apprenticeship qualifications)Additional InformationTech StackSQL Server, SSIS, T-SQLADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lakeSummaryType: Full-timeFunction: Analyst ...

They are also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them.Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.Key SkillsAzure Stack ELT Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub Actions ...

Microsoft Fabric, Azure Data Platform technologies, and modern cloud data architectures Hands-on experience with Databricks, Unity Catalog, and Delta Lake Advanced SQL and PySpark development skills Experience implementing Medallion Architecture principles Strong data modelling expertise, including Star Schema and Data Vault methodologies Solid understanding of data governance, security ...

Looking ForProven expertise with the Databricks platform, including Unity Catalog, Delta Lake, orchestration, and enterprise-scale Azure deployments.Strong technical skills in Python, PySpark, and distributed data processing frameworks, with experience building production-grade data platforms.Extensive experience implementing CI/CD pipelines using Azure DevOps, Jenkins, GitHub Actions, or equivalent ...

data engineering/integration/migration experience Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines Strong SQL - profiling, transformation, validation, reconciliation PySpark/Spark SQL notebook experience (Databricks or Fabric) Proven experience on a data migration project end-to-end (extraction through reconciliation) Microsoft Fabric experience ...

design and delivery of enterprise-scale Azure Data Platform and Databricks solutions. Strong hands-on expertise with Azure Databricks, Structured Streaming, Delta Live Tables, PySpark, Python and SQL, with a focus on performance optimisation. Strong understanding of cloud data architecture, data governance, data quality and engineering best practices. Excellent ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don’t meet every requirement below, feel free to still apply ...

required as well as a solid understanding of working in a cloud-based environment (AWS is preferred).Proficient using transformation tools such as PySpark/Pandas.Knowledge and practice of graph databases is preferred but not required.Key responsibilities/Skills and experienceFamiliarity using data quality frameworks, ie. Great Expectations.Experience building ...

present insights clearly to both technical and non-technical audiences.Some other highly valued skills include:Strong SQL and database experience.Knowledge of Python/PySpark and data analytics.Experience working in a Call Centre or Contact Centre environment.Strong communication and stakeholder management skills.Ability to lead technical teams and mentor junior developers.You ...

present insights clearly to both technical and non-technical audiences.Some other highly valued skills include:Strong SQL and database experience.Knowledge of Python/PySpark and data analytics.Experience working in a Call Centre or Contact Centre environment.Strong communication and stakeholder management skills.Ability to lead technical teams and mentor junior developers.You ...

with Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architecture Hands-on experience with Databricks, Unity Catalog and Delta Lake Strong SQL and PySpark skills Experience implementing Medallion Architecture principles Knowledge of data modelling methodologies including Star Schema and Data Vault Strong understanding of data governance, security ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

position requires comfort with ambiguity, strong execution discipline, and accountability for results.Essential Job FunctionsDesign, build, and maintain reliable, scalable data pipelines using Python and PySpark on the Microsoft Azure data platform.Develop and operate batch and incremental data pipelines leveraging Azure Data Factory for orchestration and Azure Data Lake Storage … active contributor.Proactively identify data quality issues, pipeline risks, and improvement opportunities, and communicate them clearly in a fast‐paced environment.DutiesDevelop and maintain PySpark notebooks and jobs to ingest, transform, and curate data within the enterprise data platform.Build and modify Azure Data Factory pipelines for batch and incremental data ingestion.Implement ...

that support operational, financial and client reporting. Key Responsibilities Design, develop and maintain Azure Data Factory pipelines Build and optimise Azure Databricks solutions using PySpark and SQL Support a large-scale enterprise data migration programme Develop scalable ETL/ELT processes and data ingestion frameworks Design data models using … working closely with both technical and non-technical stakeholders to deliver practical business solutions. Essential Skills & Experience Strong commercial experience with Azure Databricks and PySpark Azure Data Factory Advanced SQL, including query optimisation and complex transformations ETL/ELT pipeline development Dimensional modelling (Kimball, Star Schemas) Experience building modern ...

engineering best practicesYou have experience with Databricks, ideally also AzureYou have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and PandasYou're excited to join a start-up in a role that you can shape and influenceYou're collaborative with excellent communication skillsApply ...

fields. Proven track record of designing, developing, and deploying AI systems in production environments. Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers). Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph. Proven ...

deliver dashboards that meet Barclays standards and business needs.Some other highly valued skills may include:Experience with SQL and database technologies.Knowledge of Python/PySpark and data analytics.Experience in a Call Centre or Contact Centre environment.Strong communication and stakeholder management skills.Ability to collaborate effectively across technical and business teams.You ...

deliver dashboards that meet Barclays standards and business needs.Some other highly valued skills may include:Experience with SQL and database technologies.Knowledge of Python/PySpark and data analytics.Experience in a Call Centre or Contact Centre environment.Strong communication and stakeholder management skills.Ability to collaborate effectively across technical and business teams.You ...

fields.· Proven track record of designing, developing, and deploying AI systems in production environments.· Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers).· Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph.· Proven ...

Direct knowledge of Matillion’s Data Productivity Cloud/Matillion ETL, or primary competitive data integration platforms.Big Data & Analytics Ecosystems: Experience with Spark/PySpark, modern Data Lakes/Lakehouses, and MPP database architectures (Teradata, Vertica, Netezza).Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering ...

Logical, Physical and Dimensional) Extensive Azure Databricks experience within large-scale enterprise environments Databricks Lakehouse Architecture and Medallion Design Patterns Databricks Data Engineering using PySpark and Spark SQL Delta Live Tables (DLT) Unity Catalog implementation and governance Databricks Workflows Databricks Asset Bundles (DABs) Databricks Solution Accelerators Metadata-Driven Ingestion … Power BI semantic models and enterprise reporting environments Technical Environment Azure Databricks Delta Live Tables (DLT) Unity Catalog Databricks Asset Bundles (DABs) Databricks Workflows PySpark Spark SQL MLflow Mosaic AI Azure Data Factory Azure Synapse Azure Data Lake Storage Dynamics 365 Finance & Operations (D365 F&O) Azure DevOps Power ...