5 of 5 Permanent PySpark Jobs in the West Midlands

Strong experience building and delivering data pipelines using cloud platforms (AWS preferred) and big data tools like Kafka or Spark. Confident using Python (or PySpark) and SQL to process, transform and analyse data, and able to guide others in doing the same. Good understanding of modern data platforms (such ...

someone who combines strong engineering capability with a solid understanding of the cyber domain. Key skills required: Strong Python development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security ...

scalable, high-quality data platform from the ground up. The Role Design and build scalable ETL/ELT pipelines in Microsoft Fabric using PySpark and SQL Develop transformation logic within Fabric Lakehouses using Delta Lake and medallion architecture principles Integrate data from ecommerce, ticketing, and marketing platforms into … Microsoft Fabric (Lakehouse, Warehouse, pipelines). Azure Data Factory experience will also be considered if no working experience with fabric Advanced SQL and strong PySpark experience Proficiency in Python for data processing and API integration Experience building Power BI models and dashboards for business reporting Strong understanding ...

contribute to building scalable data pipelines and improving engineering standards across the platform. Responsibilities include: Building and maintaining robust data pipelines using Python and PySpark Supporting CI/CD processes and applying DevOps best practices Contributing to code deployment, testing, and release processes Collaborating with engineers, QA specialists … exposure to data modelling and machine learning workflows over time Your Skills & Experience Hands-on experience with Python and data engineering concepts Exposure to PySpark and large-scale data processing Familiarity with Databricks or similar modern data platforms Understanding of software engineering principles and version control Interest ...

Microsoft Azure Data stack. You will be building high-performance pipelines and data migration engines using Azure Synapse Analytics, Azure Data Factory (ADF), PySpark, Python, and robust SQL scripting. Design migration payloads: Construct optimized, transactional data packages and schema mappings Orchestrate ELT/ETL: Build fault-tolerant automated ingestion … pipelines using Azure Data Factory. Implement CDC: Configure Change Data Capture (CDC) logic in Azure Synapse Analytics for incremental delta loads Write PySpark notebook jobs: Develop data transformations, file partitioning, and data cleansing using Spark DataFrames. Create custom scripts: Build native object-oriented utility applications in Python for API ...