1 to 25 of 43 PySpark Jobs in the UK excluding London

enhance customer engagement, service delivery, and operational efficiencies. What you'll need to succeed Knowledge/Qualifications - Expert-level SQL and Python (ideally PySpark).- A strong understanding of DataSecOps; experience with PII handling, data obfuscation, and RBAC (Role-Based Access Control).- Proven ability to design data systems ...

environments. Strong hands-on expertise in Python Proven experience with Databricks, including notebooks, workflows, jobs and Delta Lake Strong knowledge of Apache Spark/PySpark Experience designing and delivering large-scale ETL/ELT pipelines Advanced SQL skills and experience with relational databases Experience working with cloud technologies such ...

assurance processes Excellent problem-solving skills with the ability to diagnose and resolve complex data issues Strong communication and stakeholder management experience Desirable Experience PySpark and/or Python development Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Storage Power BI development and data modelling Exposure ...

deliver practical, value-driven data solutions. Drive continuous improvement across data engineering, reporting, and analytics capabilities. Essential Requirements Strong expertise in SQL and Python (PySpark desirable). Proven experience designing and building cloud-based data platforms from inception. Hands-on experience with Databricks, Spark, modern data lake/lakehouse ...

Azure. Experience with other platforms like AWS, Snowflake, or Databricks is also beneficial. Hands-on expertise with Data Factory (Fabric or Azure), notebooks (Python, PySpark), advanced SQL, and robust data modelling and performance optimisation skills. Proven track record in building scalable data pipelines and implementing modern architectures such ...

working with flexibility and autonomy Key Experience Deep end-to-end experience delivering enterprise Databricks analytics solutions Expertise in Lakehouse Architecture, Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala ...

Experience managing multi-engine compute environments CI/CD experience with Azure DevOps, GitHub, and Databricks Asset Bundles Strong programming skills in PySpark, Databricks SQL, and T-SQL Understanding of Medallion Architecture and modern data modelling approaches (Star Schema, Data Vault 2.0) Experience with performance optimisation in Databricks ...

contribute to long-term platform innovation Required Experience Strong experience designing enterprise data platforms within Microsoft Azure environments Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake, and Lakehouse architecture Strong hands-on experience with Snowflake architecture and optimisation Experience with Azure Data Factory, ADLS Gen2, Synapse ...

including: CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, DynamoDB, Lake Formation Experience with Infrastructure as Code (Terraform) Proficiency in Python, SQL, and familiarity with PySpark Experience with Apache Spark and data processing frameworks Hands-on experience with Apache Airflow for workflow orchestration Experience using Jupyter Notebooks and/ ...

Data Lake and Azure Synapse Analytics Solid understanding of ETL processes, data integration and pipeline development Advanced SQL skills as well as Python/PySpark experience for data processing Exposure to Power BI or other reporting tools is beneficial What's on Offer Salary up to £65,000 Fully ...

Data Platforms: Hands-on experience with Databricks and Azure Data Lake . ETL: Proven ability to build efficient pipelines (ADF, SSIS, APIs). Desirable: PySpark, Dimensional Modelling, DAX/SSAS, or an interest in AI/ML applications. Interested in learning more? Send me a DM or comment below ...

platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Understanding of workflow orchestration and automation tools. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models ...

hands-on experience with modern cloud data platforms (e.g. Databricks or Snowflake), ideally within AWS environments. Advanced programming and data engineering skills in Python, PySpark and SQL, with a solid understanding of ETL pipelines and data transformation. Proven experience in data modelling (end-to-end), including performance optimisation using ...

years of proven experience delivering robust data engineering solutions. The Fabric Ecosystem: Demonstrable, hands-on expertise with Microsoft Fabric , SQL , and Python/PySpark Notebooks . Core Competencies: Proven skill in dimensional modeling, data governance, and data extraction from online platforms via SaaS and APIs. Analytical Mindset: Excellent ability ...

design decisions. Required Skills & Experience Strong analytical skills with experience working with large-scale and unstructured datasets. Python development experience, including technologies such as PySpark, Pandas and PyArrow. Expertise in distributed data processing frameworks, particularly Apache Spark. Experience building and maintaining ETL pipelines using technologies such as Apache Airflow ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

emerging data technologies Cloud experience across Azure, AWS or similar. The client is technology agnostic and values transferable skills over specific stack experience Python, PySpark or equivalent modern data engineering tooling Comfortable working at pace in a collaborative, fast-moving environment If you are an experienced Data Engineer with ...

wider data community Promote high coding and data practice standards Experiment with emerging data, ML and AI technologies What you'll need: Strong Python, PySpark, SQL and Databricks or Snowflake experience AWS cloud data engineering expertise Experience building scalable batch and real-time data pipelines Airflow, CI/ ...

looking for: Strong background in data engineering and software development Proven experience working with Databricks (essential) Hands-on expertise with tools such as Python, PySpark, Spark, and SQL Experience building and maintaining data pipelines and data platforms Solid understanding of data modelling and data architecture principles Experience working with ...

with various databases e.g. MS SQL, Azure Cosmos DB. Skilled at optimizing large and more complicated SQL statements. Proficiency in Python and experience with PySpark Experience of REST API standards. Proficiency in writing clean, readable, and secure code for Azure backend services, i.e. functions, utility functions etc. Experience ...

semantic model design Hands-on experience with Microsoft Fabric, particularly lakehouse architecture, notebooks and data pipelines Strong understanding of Apache Spark/PySpark and large-scale data processing Experience designing and operating modern data platforms Experience developing or enabling AI and machine learning capabilities using business data Strong understanding ...

hands-on experience with modern cloud data platforms (e.g. Databricks or Snowflake), ideally within AWS environments Advanced programming and data engineering skills in Python, PySpark and SQL, with a solid understanding of ETL pipelines and data transformation Proven experience in data modelling (end-to-end), including performance optimisation using ...

developers, architects and product teams to support analytics, machine learning and wider data-driven projects.Relevant experience includes:• Databricks or Snowflake, ideally within AWS• Python, PySpark and SQL• ETL pipelines and data transformation• End-to-end data modelling• DBT, SparkSQL, Airflow, Git, Jenkins or similar tools• Data quality, governance ...

apply Experience working as a Data Engineer Hands-on experience with Microsoft Fabric Experience with Azure Strong SQL skills Experience using Python, ideally PySpark Experience building and maintaining ETL or ELT pipelines Experience working directly with stakeholders Ability to gather requirements and translate them into technical solutions Experience with ...

expertise with strategic thinking. Essential Skills & Experience Strong Microsoft Fabric expertise (Lakehouse, Warehouse, Pipelines, Notebooks) OneLake architecture and management Advanced SQL/T-SQL PySpark and Spark optimisation Data warehousing, modelling and ETL/ELT development Power BI semantic modelling Experience delivering enterprise cloud data platforms Experience integrating multiple … deliver like a Senior Data Engineer . You'll be equally comfortable discussing strategic transformation plans with senior leadership as you are building PySpark pipelines, optimising Fabric workloads and solving complex data challenges. This is not a reporting role — it's a platform ownership role that will define ...