26 to 50 of 167 PySpark Jobs in the UK excluding London

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

Foundation: Practical experience with data modelling, ETL/ELT, and a variety of database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and an open-minded approach to tech stacks—ranging from SSIS and stored procedures to Airflow, Spark, Databricks, or Fabric. Cloud Capability: Experience with ...

clear technical tasks. Mentorship: A proactive mindset, eager to provide guidance to less experienced developers and support collaborative pair-programming. Desirable Skills Experience with PySpark or PySQL. Experience in Dimensional Modelling and data warehousing principles. Experience with SQL Server SSAS Tabular and DAX. Exposure to SQL Server RDBMS ...

enterprise-scale data products, defining technical strategy, architectural patterns and engineering standards while providing technical leadership across teams. Expert programming experience with Python/PySpark and advanced proficiency in SQL for large-scale data transformation, optimisation and analytics workloads. Extensive experience designing and implementing scalable data solutions on cloud ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

Hands-on expertise in Snowflake and Databricks Proficient in Microsoft Azure, including Azure Data Factory and Azure Data Lake Advanced SQL and Python or PySpark skills Experience building enterprise-level ETL/ELT pipelines Knowledge of data modelling, governance, and data quality Previous consultancy or client-facing delivery experience ...

stakeholders to translate business challenges into analytical solutions. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python and SQL skills, with strong PySpark experience Hands-on expertise with Microsoft Fabric and Databricks. Experience building production-grade data pipelines, reusable data assets and machine learning solutions. Experience communicating ...

Hands-on expertise in Snowflake and Databricks Proficient in Microsoft Azure, including Azure Data Factory and Azure Data Lake Advanced SQL and Python or PySpark skills Experience building enterprise-level ETL/ELT pipelines Knowledge of data modelling, governance, and data quality Previous consultancy or client-facing delivery experience ...

tools and approaches. Hands-on experience with Microsoft Azure technologies, including MS Fabric, Data Factory, Azure Synapse & RDS. Experience with Python or PySpark for scripting and automating data tasks. Knowledge of CI/CD approaches for Data Platforms Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. ...

Databricks Serverless configuration and workload optimisation* Databricks SQL and Delta Lake development* Cluster management, compute policies, autoscaling, and workload monitoring**Data Engineering*** Strong Python, PySpark, and SQL development skills* Design and build ingestion and transformation pipelines* Full and incremental data loading* CDC (Change Data Capture) implementation* Data quality controls ...

Generation), Serverless, DWH models, Data Mesh, Data Fabric, Medallion and Data Products. Hands on mindset : Fluent in the language of data, whether SQL, Python, PySpark, R or Scala. Open formats including Parquet, Iceberg and JSON. Agile Ways of Working Run and contribute to agile ceremonies, helping to shape ...

experience would be desirable Data warehousing, Power BI/Fabric administration or data governance experience would be advantageous DevOps, source control and Python/PySpark exposure would be useful but not essential The Opportunity There’s a lot happening across the organisation’s data landscape, including major data ...

actually trust and use. Essential Skills & Experience: Hands-on experience with Databricks and Microsoft Fabric Experience building and running production-grade pipelines Strong PySpark and SQL skills Experience with Delta Lake and Lakehouse architectures Good grasp of data modelling, orchestration and workflow automation Comfortable working with structured and semi ...

grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build … ongoing evolution of Envitia’s data engineering capability. Essential Skills & Experience Proven hands‐on experience building and supporting production‐grade data pipelines using Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ ...

Implement automated testing, CI/CD patterns + deployment best practices for Foundry-based data assets. Technical Environment: Data Engineering, Palantir Foundry, Python, SQL, PySpark, Spark SQL + Cloud (AWS, Azure, GCP), CI/CD, Git based workflows. Benefits: £75,000 - £80,000 (DOE) + Remote/Hybrid Working ...

Engineer Associate (DP-600), Power BI Data Analyst Associate (PL-300), or Azure Data Fundamentals (DP-900). Proficiency in Python and SQL, including PySpark and Spark SQL, used across our Microsoft Fabric data platform. Experience with ERP/finance systems data (NetSuite, SAP, Dynamics, etc.) Experience picking ...

would be beneficial, but we're open to candidates with transferable experience from other cloud platforms. (Desirable) Progress OpenEdge experience. (Desirable) Databricks, Spark or PySpark experience. (Desirable) Experience feeding data into AI systems, including RAG pipelines, vector stores, embedding workflows, or using Azure AI Foundry or similar AI/ ...

services, and scripting and automation using common libraries and frameworks relevant to the role Experience with data engineering and analytics platforms such as PySpark, Databricks, Airflow, or similar orchestration tools Experience with relational databases and SQL; familiarity with NoSQL databases and data modeling concepts Knowledge across the data lifecycle ...

Data Engineer Key skills: Python SQL Server/SQL Data Warehousing & Data Modelling Data Architecture Data Pipelines & Integration Solutions Microsoft Fabric Azure Cloud Technologies PySpark ETL/ELT Development Data Governance & Security Source Control (Git) Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

Data Engineer Key skills: * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * Microsoft Fabric * Azure Cloud Technologies * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

that deeply cares about its values. To use a range of different tools and technologies depending on the specific task, these include: Databricks, Python, PySpark, R, Excel, Palantir Foundry, SQL and PowerBI. Qualifications Even if you don’t meet every requirement below, feel free to still apply ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don't meet every requirement below, feel free to still apply ...

knowledge of Matillion’s Data Productivity Cloud/Matillion ETL, or primary competitive data integration platforms. Big Data & Analytics Ecosystems: Experience with Spark/PySpark, modern Data Lakes/Lakehouses, and MPP database architectures (Teradata, Vertica, Netezza). Education: Bachelor’s or Master’s degree in Computer Science, Data ...

Please note, this vacancy closes at 12pm, midday, on Monday 7th September. We reserve the right to close this vacancy early if we receive a high volume of suitable applications. Interviews will take place as ...

teamworkStrong problem-solving and analytical skillsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeHands-on expertise with Spark/PySpark and big data processing technologiesKnowledge of open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving ...