1 to 25 of 146 Remote/Hybrid PySpark Jobs in the UK

Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial ...

Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial ...

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

ideally in enterprise-scale environments Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse, and Azure Data Lake Hands-on experience with Spark (PySpark/SparkSQL) and distributed data processing Strong data modelling skills (Dimensional, ODS, Data Vault) and data warehousing concepts Proficiency in SQL, version control ...

complex Power BI reports and dashboards. Proficiency in writing complex DAX formulas and strong understanding of Power Query. Programming Skills: Requires strong Python/PySpark for data manipulation, analysis, and automation, alongside advanced T-SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within ...

Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. Knowledge of querying API systems. Experience ...

Experience as a Senior Data Engineer or similar Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD. Experience with PySpark, Python, SQL and other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. Knowledge of querying API systems. Experience ...

patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data quality, data governance processes, Git version control + Agile development environments. Azure ...

more more) SQL, NoSQL, Data Lakes, Data Warehouses ELT/ETL tools: Databricks, Azure Data Factory, SSIS, Talend, Informatica, Palantir Python, PySpark managing and motivating teams, agile methodology Data governance and analytics expertise Strong communication skills to bridge business and technical requirements Salary & Benefits ...

more more) SQL, NoSQL, Data Lakes, Data Warehouses ELT/ETL tools: Databricks, Azure Data Factory, SSIS, Talend, Informatica, Palantir Python, PySpark managing and motivating teams, agile methodology Data governance and analytics expertise Strong communication skills to bridge business and technical requirements Salary & Benefits ...

Considerable experience designing and building operationally efficient pipelines, utilising core Cloud components, such as Azure Data Factory, Big Query, AirFlow, Google Cloud Composer and Pyspark etc Proven experience in modelling data through a medallion-based architecture, with curated dimensional models in the gold layer built for analytical use Strong ...

Fabric. Migrate on-prem data to Fabric Lakehouse/Warehouse, enabling Power BI analytics. Develop robust data pipelines, notebooks, and data models using: Python, PySpark, SQL, Synapse, and Data Warehousing principles. Implement CI/CD processes with GitHub integration for lifecycle management. Ensure governance, security, and best practices across ...

office. About you : You have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology ...

office. About you: You have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology ...

office. About you: You have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology ...

office. About you : You have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology ...

office. About you: You have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology ...

demand delivery Provide technical guidance for team members Providing 2nd or 3rd level technical support About You Experience using SQL, SQL Server DB, Python & PySpark Experience using Azure Data Factory Experience using Data Bricks and Cloudsmith Data Warehousing Experience Project Management Experience The ability to interact with the operational ...

manipulate data and building additional process to support data processing activities Experience manipulating, processing and storing data using tools such as SQL, dbt, pyspark and SSIS Comfortable building out and administrating data models, ensuring that they are accessible and used appropriately, leveraging platforms such as Databricks and Power ...

technical documentation including architecture diagrams and data flows To be successful in this role, you will have: Deep experience with Azure Databricks, SparkSQL and PySpark Experience working with Azure technologies such as Data Factory, Synapse and Azure Data Lake Storage Strong SQL skills Solid understanding of modern data modelling ...

technical documentation including architecture diagrams and data flows To be successful in this role, you will have: Deep experience with Azure Databricks, SparkSQL and PySpark Experience working with Azure technologies such as Data Factory, Synapse and Azure Data Lake Storage Strong SQL skills Solid understanding of modern data modelling ...

technical documentation including architecture diagrams and data flows To be successful in this role, you will have: Deep experience with Azure Databricks, SparkSQL and PySpark Experience working with Azure technologies such as Data Factory, Synapse and Azure Data Lake Storage Strong SQL skills Solid understanding of modern data modelling ...