1 to 25 of 105 Permanent PySpark Jobs

/version control Strong communication skills with both technical and non-technical stakeholders Desirable Skills: Microsoft Fabric Azure Synapse Analytics Databricks Apache Spark/PySpark dbt Apache Airflow Power BI Azure DevOps CI/CD pipelines Terraform What's On Offer: £65k+ salary package Hybrid working model Company bonus ...

transformation and orchestration pipelines, integrating data from cloud, on‐premises and third‐party business systems. Strong hands‐on capability with SQL, Python, Spark and PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation ...

complex Power BI reports and dashboards. Proficiency in writing complex DAX formulas and strong understanding of Power Query. Programming Skills: Requires strong Python/PySpark for data manipulation, analysis, and automation, alongside advanced T‐SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within ...

test automation tools and frameworks Experience validating dashboards, reports, and datasets within Power BI Azure Data Factory Azure Synapse Analytics Microsoft Fabric Python or PySpark ...

have To be considered for this role, we would love you to have: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

will bring strong expertise in Power BI, Microsoft Fabric and associated languages such as DAX, SQL and Power Query. Familiarity with Azure DevOps and PySpark/Python would be beneficial as would experience of working with cloud-based data solutions. Principal Responsibilities Report Development: Develop and deploy Power ...

clear technical tasks. Mentorship: A proactive mindset, eager to provide guidance to less experienced developers and support collaborative pair‐programming. Desirable Skills Experience with PySpark or PySQL. Exposure to SQL Server RDBMS and Managed Instance. Working knowledge of Azure Event Hubs or Active Batch. A keen interest in applying ...

deliver practical, value-driven data solutions. Drive continuous improvement across data engineering, reporting, and analytics capabilities. Essential Requirements Strong expertise in SQL and Python (PySpark desirable). Proven experience designing and building cloud-based data platforms from inception. Hands-on experience with Databricks, Spark, modern data lake/lakehouse ...

need deep, hands‐on fluency across the modern Azure data stack — and strong bridging skills for the legacy environment you're migrating from. Python, PySpark, Azure Databricks (Delta Lake, Unity Catalog, pipelines, notebooks, jobs), Azure Data Lake Storage Gen2, Azure Data Factory, Azure Key Vault, Power BI (complex model ...

pipelines. Experience working with cloud data platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models support ...

platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Understanding of workflow orchestration and automation tools. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models ...

Complexity.* Strive for excellence and continuous improvement in software architecture, software delivery and best practices.* Hands on experience in C#, OOP python, Spark/PySpark and other C#, Python framework ecosystem.* Debug and resolve issues in large datasets quickly.* Co-ordinating handoffs between different time zones and allocating priorities ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

engagement skills, including requirements gathering, expectation management and delivery planning. Desirable Knowledge and practical experience of hospital systems and datasets (where relevant locally). PySpark experience. Experience with NLP and/or computer vision techniques (where relevant to Trust priorities). Experience using deep learning frameworks such as TensorFlow ...

customers’ pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark, Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

customers' pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark , Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

Hands-on Microsoft Fabric experience-Lakehouse, data pipelines, notebooks, and capacity monitoring.- Strong SQL and dimensional (star schema) data modeling; working proficiency in Python (PySpark).- Working knowledge of Dynamics 365 Finance & Operations and Dataverse data structures. Desired: Domain Knowledge (Preferred): Experience with manufacturing data including Bills of Materials ...

principles. Strong understanding of data modelling, governance and data quality frameworks. Experience delivering large-scale data transformation initiatives. Knowledge of technologies such as SQL, PySpark, Snowflake, Kafka and modern BI platforms including Power BI or Tableau. Excellent communication skills with the ability to influence senior technical and business stakeholders. ...

architectural direction, mentoring engineers, and defining standards in a data engineering context. Strong proficiency in Python, with experience applying data engineering frameworks (e.g. Spark, PySpark, Dask, pandas) to large, complex datasets. Familiarity with API‐driven data integration, including REST, GraphQL, and Foundry Action APIs. Experience with Git‐based development ...

5+ years of experience in one or more of the following statistical/analytic languages such as Python (Pandas, Scikit-Learn), Apache Spark (or PySpark), Hive, and Scala in a cloud computing environment 5+ years of experience in one or more of the following: database query and management tools ...

Engineer to join a key programme. You'll be responsible for building scalable data pipelines and data lake architecture across Azure Databricks , using Python, PySpark, SQL, Azure Data Factory and Microsoft Fabric . We're looking for someone who has previously delivered data engineering projects within the UK public ...

solution design, workshops and Proof of Concepts. What you'll bring: Proven experience designing enterprise data platforms using Databricks . Strong knowledge of Spark, PySpark, Delta Lake, SQL and modern data engineering. Expertise with Microsoft Azure Strong understanding of data modelling, governance and ETL pipelines. Excellent stakeholder management ...

also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them. Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role. Key Skills Azure Stack ELT Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub ...

design and delivery of enterprise-scale Azure Data Platform and Databricks solutions. Strong hands-on expertise with Azure Databricks, Structured Streaming, Delta Live Tables, PySpark, Python and SQL, with a focus on performance optimisation. Strong understanding of cloud data architecture, data governance, data quality and engineering best practices. Excellent ...

years consulting (or equivalent) experience required 7+ years Databricks solution design, implementation, engineering experience required Either 5+ years building data pipelines in Databricks using PySpark, Scala and/or Spark SQL and ability to work across structured, semi-structured and unstructured data OR 5+ years ML Engineering ...