6 of 6 Permanent PySpark Jobs in the West Midlands

from relational databases or operational systems 2. Modern data platforms and engineering tools: Practical knowledge of data engineering tools or approaches such as Python, PySpark, Microsoft Fabric, Azure Data Factory, Synapse, Lakehouse, OneLake or equivalent platforms 3. Data quality, validation and reconciliation: Good understanding of data quality, validation, reconciliation ...

including: Azure Synapse Databricks Microsoft Fabric Azure SQL Azure Data Factory (ADF) Cosmos DB Power BI Strong hands-on capability with: SQL/NoSQL PySpark Data streaming technologies Strong understanding of: Modern data architectures Lakehouse and cloud-native platforms Data integration patterns Enterprise cloud design Excellent communication and stakeholder ...

someone who combines strong engineering capability with a solid understanding of the cyber domain. Key skills required: Strong Python development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security ...

data pipelines within Azure Databricks and Azure Lakehouse environments. Work within established medallion architecture patterns. Develop data flows using Azure Data Factory , Python/PySpark, SQL, and Azure data services. Support data modelling, data integration, and data product development. Implement data quality, validation, lineage, and integrity controls. Work with … Strong hands-on experience with Azure Databricks . Experience with lakehouse platforms and medallion architecture. Strong Azure Data Factory, Azure Data Lake, Python/PySpark, SQL, MS SQL/Azure SQL experience. Good understanding of data modelling, ETL/ELT, data quality, governance, and lineage. Experience working in financial ...

high-quality, governed, and observable data platform . 🔧 What You’ll Be Doing Build and maintain Azure & Databricks pipelines Develop scalable ELT processes using PySpark Implement data quality, lineage, and security controls Own CI/CD pipelines and Infrastructure as Code (Terraform) Ensure pipelines are testable, observable, and easy … best practices 🧠 What We’re Looking For Strong experience with Azure Data Platform & Databricks Proven track record building scalable data pipelines Hands-on with PySpark/Spark-based processing Experience with Terraform & CI/CD pipelines Solid understanding of data governance, quality, and lineage Familiarity with Git-based workflows ...

This job is with LexisNexis Legal & Professional®, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Software Engineer III (Python ...