4 of 4 Permanent PySpark Jobs in the Midlands

scalable, high-quality data platform from the ground up. The Role Design and build scalable ETL/ELT pipelines in Microsoft Fabric using PySpark and SQL Develop transformation logic within Fabric Lakehouses using Delta Lake and medallion architecture principles Integrate data from ecommerce, ticketing, and marketing platforms into … Microsoft Fabric (Lakehouse, Warehouse, pipelines). Azure Data Factory experience will also be considered if no working experience with fabric Advanced SQL and strong PySpark experience Proficiency in Python for data processing and API integration Experience building Power BI models and dashboards for business reporting Strong understanding ...

contribute to building scalable data pipelines and improving engineering standards across the platform. Responsibilities include: Building and maintaining robust data pipelines using Python and PySpark Supporting CI/CD processes and applying DevOps best practices Contributing to code deployment, testing, and release processes Collaborating with engineers, QA specialists … exposure to data modelling and machine learning workflows over time Your Skills & Experience Hands-on experience with Python and data engineering concepts Exposure to PySpark and large-scale data processing Familiarity with Databricks or similar modern data platforms Understanding of software engineering principles and version control Interest ...

lead for complex data initiatives, providing guidance on solution design, engineering standards and implementation approaches Design, build and optimise distributed data processing pipelines using PySpark, Python, Airflow and AWS services Drive engineering excellence through code reviews, technical coaching, design reviews and adoption of software engineering best practices Partner closely … Lead Data Engineer, Principal Data Engineer or Technical Lead within a large-scale, data-driven organisation Strong hands-on software engineering expertise with Python, PySpark and Apache Airflow Deep experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern ...

Architectural Leaders hipDefine and evolve the enterprise data architecture strategy, with a primary focus on Cloud-scale Distributed Data Processing using Apache Spark and PySpark at the core of the platf ormEstablish and maintain architectural artefacts, reference architectures, Architecture Decision Records (ADRs), technical standards, and architecture roadmaps … large, complex, data-led organisation, operating at an influence and strategy level rather than hands-on de liveryExpert-level understanding of Apache Spark and PySpark as the foundation of distributed data processing architectures, including tuning, optimisation, and enterprise-scale deployment pa tternsDeep expertise in designing and evolving Data LakeHouse ...