51 to 75 of 142 PySpark Jobs in the UK

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

connectors in Workato to trigger AI workflows from external business events is a strong plus. · Data & Traditional ML: Experience with Databricks for data engineering (PySpark) or building classical ML models (Scikit-Learn, XGBoost) is beneficial for handling complex data pre-processing and hybrid AI use cases. ...

skills/experience you'll already have? 6+ years commercial experience in Data Engineering Very strong SQL skills Spark SQL Strong Python coding skills PySpark Azure experience including Azure SQL, Data Factory and Functions Experience collaborating with Software and Test Engineers Creating, documenting and maintaining database schemas To find ...

notebooks) Experience building or working within modern data warehouse architectures Ability to get up and running quickly without heavy onboarding Nice to have: Python, PySpark or Spark experience Exposure to APIs and external data integration Experience working in evolving or transforming data environments Most importantly, youll be someone ...

notebooks) Experience building or working within modern data warehouse architectures Ability to get up and running quickly without heavy onboarding Nice to have: Python, PySpark or Spark experience Exposure to APIs and external data integration Experience working in evolving or transforming data environments Most importantly, you’ll be someone ...

notebooks) Experience building or working within modern data warehouse architectures Ability to get up and running quickly without heavy onboarding Nice to have: Python, PySpark or Spark experience Exposure to APIs and external data integration Experience working in evolving or transforming data environments Most importantly, youll be someone ...

teams. What we're looking for: Strong people leadership experience (5+ team size) Solid Data Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) + strong bonus ...

other MLOps and ML Lifecycle stacks Experience with Docker and Kubernetes Experience in creating production grade coding Experience in programming languages (eg Python, PySpark, R, SAS, SQL) Experience in GitHub Strong communication skills both verbally and written ...

other MLOps and ML Lifecycle stacks Experience with Docker and Kubernetes Experience in creating production grade coding Experience in programming languages (eg Python, PySpark, R, SAS, SQL) Experience in GitHub Strong communication skills both verbally and written ...

Data Engineer; Python, PySpark - Salford, Manchester, Onsite. We are seeking an experienced Data Engineer to join a growing Data Team within a fast-paced, e-commerce-led business that is growing at an astonishing rate. The company operates in the direct-to-consumer retail space, and the role will ...

Microsoft Data & Analytics within consultancy or large enterprise environments Strong expertise in Microsoft Fabric, Purview, Power BI , data architecture and modelling Experience with Python, PySpark and T-SQL Confident influencing senior stakeholders and shaping enterprise solutions Eligible for SC Clearance (five years continuous UK residency) Please apply with ...

architecture assessment, discovery, or technical review work Hands-on expertise with Azure data platforms (Databricks, Synapse, Fabric) Strong programming skills in SQL, Python, and PySpark Knowledge of streaming technologies (Kafka, Azure Event Hubs) ETL experience using Azure Data Factory Strong stakeholder management skills, including experience working with senior leadership ...

modelling techniques Understanding of metadata management, data governance, and data quality frameworks Proficiency with SQL and ideally one or more programming languages (e.g., Python, PySpark) Experience with database technologies and data warehousing principles (star schema, snowflake, data vault) Experience working with cloud data services specifically with AWS (including Redshift ...

/GCP (based on organization need) integrated with Databricks. Data Engineering & Platform Build Build and optimize large-scale ETL/ELT pipelines using PySpark, SQL, and Delta. Oversee data quality frameworks, metadata management, lineage, and monitoring. Leadership & Stakeholder Engagement Work closely with business leaders and product teams to translate … years overall experience in data engineering or data architecture. 5+ years of hands-on architecture experience specifically in Databricks . Expert in Apache Spark , PySpark , Databricks SQL , Delta Lake, and distributed systems. Strong understanding of Lakehouse architecture , BI ecosystems, and modern data platforms. Cloud expertise in Azure/ ...

basis, clarifying ownership and integration points, and capturing this information in a way that supports risk assessment and decommissioning decisions. Responsibilities: Python and PySpark are required as supporting capabilities, used where needed to analyse data pipelines and confirm how data moves and transforms in practice. The role also requires ...

outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

covered) Salary: £45,000 – £95,000 - dependent on level/experience (mid, senior, principle) Security Clearance: SC active Requirements: Databricks and Spark/PySpark (absolute must haves) Azure and AWS experience Data warehouses/lakehouse platforms CI/CD and modern engineering practices Public sector/Central government ...

platforms on Microsoft Azure. The role involves leading the development of secure, reliable, and efficient data pipelines using Azure Synapse Analytics, Azure Data Factory, PySpark, and Azu click apply for full job details ...

Working across medallion architecture layers (bronze/silver/gold) Troubleshooting and optimising performance What They're Looking For Strong hands-on experience with PySpark and SQL Proven experience working with Microsoft Fabric Experience in Azure Data Factory Background in enterprise-scale data environments Ability to work autonomously ...

dashboards, DAX, M queries and semantic modelling. Build robust, optimised SQL Server data models and queries. Work within a Databricks environment (SQL/PySpark exposure is beneficial; training provided if needed). Engage directly with business stakeholders to gather requirements, understand challenges and translate them into technical solutions. Support ...

data for critical client projects. How to develop and enhance your knowledge of agile ways of working and working in open source stack (PySpark/PySql). Quality engineering professionals utilise Accenture delivery assets to plan and implement quality initiatives to ensure solution quality throughout delivery. As a Data ...

data for critical client projects. How to develop and enhance your knowledge of agile ways of working and working in open source stack (PySpark/PySql). Quality engineering professionals utilise Accenture delivery assets to plan and implement quality initiatives to ensure solution quality throughout delivery. As a Data ...