26 to 50 of 142 PySpark Jobs in the UK excluding London

ability to work closely with both technical and non-technical stakeholders. Experience withtechnologies such as Azure SQL, Synapse, Data Factory, Python or PySpark wouldbe advantageous but is not essential. Why Apply? Newly created position offering excellent scope for growth. Opportunity to become a key member of an expanding analytics ...

security, and governance to support AI agent-driven data products. The ideal candidate has deep SQL skills (SQL Server/Azure SQL), strong Python (PySpark), and experience with Databricks, Synapse or Fabric, plus Power BI semantic modelling. A background in data security and Agile delivery is preferred. #J ...

will design data models, ensure data security, and govern data across the organisation. You'll work with SQL Server/Azure SQL, Python (PySpark), Databricks/Synapse, and Power BI modelling. Experience with Microsoft Fabric is a plus; you will shape data products and guardrails for AI agents. This ...

agents that underpin our data-driven decisions. The role requires deep SQL/T-SQL on SQL Server/Azure SQL, strong Python (PySpark) capabilities, and experience with Databricks, Synapse or Microsoft Fabric, plus Power BI semantic modelling. #J-18808-Ljbffr ...

record of development in Databricks* Proven track record of working with IaC* Proven track record of working with git* Strong working knowledge of Python (Pyspark) and SQL* Strong working knowledge of data management inside a datalake* Proven ability to explain technical issues and solutions to peers and customers* Proven ...

skills and ensure high-quality deliverables. Data Engineering: Strong proficiency in Python and at least one key programming language commonly used in data engineering (PySpark/SQL strongly preferred, Java/Scala beneficial). Data Modelling: Solid understanding and practical experience in designing and implementing effective data models (e.g. ...

record of development in Databricks* Proven track record of working with IaC* Proven track record of working with git* Strong working knowledge of Python (Pyspark) and SQL* Strong working knowledge of data management inside a datalake* Proven ability to explain technical issues and solutions to peers and customers* Proven ...

record of development in Databricks* Proven track record of working with IaC* Proven track record of working with git* Strong working knowledge of Python (Pyspark) and SQL* Strong working knowledge of data management inside a datalake* Proven ability to explain technical issues and solutions to peers and customers* Proven ...

record of development in Databricks Proven track record of working with IaC Proven track record of working with git Strong working knowledge of Python (Pyspark) and SQL Strong working knowledge of data management inside a datalake Proven ability to explain technical issues and solutions to peers and customers Proven ...

suit you. What we're looking for Microsoft Fabric, or another cloud data platform such as Synapse, Data Factory or Databricks Strong Python and PySpark, and solid MS SQL Power BI to a good standard, semantic models and DAX included, so you can build the reporting layer yourself rather ...

responsibilities. Ensure solutions are secure, scalable, maintainable, and aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines … duties as required. Skills and Experience Strong understanding of data engineering principles, data architecture, and cloud-based data platforms. Proficient in Python (PySpark) and SQL for building and optimising data transformations at scale. Strong hands-on Databricks experience. Experience with Azure data storage technologies (Azure SQL, Data Lakes, Blob ...

grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build … ongoing evolution of Envitia’s data engineering capability. Essential Skills & Experience Proven hands‐on experience building and supporting production‐grade data pipelines using Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ ...

Implement automated testing, CI/CD patterns + deployment best practices for Foundry-based data assets. Technical Environment: Data Engineering, Palantir Foundry, Python, SQL, PySpark, Spark SQL + Cloud (AWS, Azure, GCP), CI/CD, Git based workflows. Benefits: £75,000 - £80,000 (DOE) + Remote/Hybrid Working ...

services, and scripting and automation using common libraries and frameworks relevant to the role Experience with data engineering and analytics platforms such as PySpark, Databricks, Airflow, or similar orchestration tools Experience with relational databases and SQL; familiarity with NoSQL databases and data modeling concepts Knowledge across the data lifecycle ...

that deeply cares about its values. To use a range of different tools and technologies depending on the specific task, these include: Databricks, Python, PySpark, R, Excel, Palantir Foundry, SQL and PowerBI. Qualifications Even if you don’t meet every requirement below, feel free to still apply ...

audiences Essential knowledge, skills & experience (must-have): 4+ years of commercial experience in Data Science/Machine Learning Hands-on experience with: Databricks Notebooks PySpark Workflows Deployment through Asset Bundles Proven experience building, deploying, and maintaining production ML solutions Broad experience across multiple ML domains, including: Forecasting/Time ...

Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala or PySpark, data modelling techniques, database technologies, and SQL Confident communicator, able to explain technical concepts to non‐technical audiences and mentor junior colleagues For Senior ...

insights clearly to both technical and non-technical audiences. Some other highly valued skills include: Strong SQL and database experience. Knowledge of Python/PySpark and data analytics. Experience working in a Call Centre or Contact Centre environment. Strong communication and stakeholder management skills. Ability to lead technical teams ...

knowledge of Matillion’s Data Productivity Cloud/Matillion ETL, or primary competitive data integration platforms. Big Data & Analytics Ecosystems: Experience with Spark/PySpark, modern Data Lakes/Lakehouses, and MPP database architectures (Teradata, Vertica, Netezza). Education: Bachelor’s or Master’s degree in Computer Science, Data ...

making. Key Responsibilities: Lead the design and development of curated, analytics-ready dimensional and semantic data models. Build, maintain and optimise complex SQL and PySpark transformation pipelines within Databricks. Define and maintain KPI definitions, conformed dimensions and consistent business logic across data domains. Ensure data quality, integrity, testing, observability ...

Please note, this vacancy closes at 12pm, midday, on Monday 7th September. We reserve the right to close this vacancy early if we receive a high volume of suitable applications. Interviews will take place as ...

best practices Skills & Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis ...

Power BI expertise, including DAX, semantic modelling, security and performance - Strong SQL and data-modelling skills, with working knowledge of Python and/or PySpark - Experience of data integration, governance, quality controls, source control, testing and deployment - The ability to explain technical issues clearly, work collaboratively and develop colleagues ...

complex data led organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...