13 of 13 PySpark Jobs in the Midlands

platforms on Microsoft Azure. The role involves leading the development of secure, reliable, and efficient data pipelines using Azure Synapse Analytics, Azure Data Factory, PySpark, and Azure Data Lake Storage. The engineer will work closely with cross functional teams to translate business requirements into technical solutions that support analytics ...

demand delivery Provide technical guidance for team members Providing 2nd or 3rd level technical support About You Experience using SQL, SQL Server DB, Python & PySpark Experience using Azure Data Factory Experience using Data Bricks and Cloudsmith Data Warehousing Experience Project Management Experience The ability to interact with the operational ...

Strong knowledge of data modelling, database design, and enterprise data architecture Experience with ETL/ELT frameworks and data integration patterns using Python or PySpark Experience with structured and semi-structured data, preferably in life sciences (e.g., omics, health records) Ability to translate business requirements into technical solutions ...

design and optimisation within Microsoft Fabric Lakehouse, including Data Pipelines, Notebooks, and cloud-based ingestion/transformation layers. Deliver complex SQL, Python, and PySpark solutions for large-scale distributed processing. Coordinate workloads across BI developers and mentor junior and mid-level team members. Ensure BI quality, governance, documentation ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

notebooks) Experience building or working within modern data warehouse architectures Ability to get up and running quickly without heavy onboarding Nice to have: Python, PySpark or Spark experience Exposure to APIs and external data integration Experience working in evolving or transforming data environments Most importantly, youll be someone ...

commercial or Agile environment. To be successful in this role it's essential that you will: Have experience of AWS , Python, SQL, Gitand PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation About ...

platforms on Microsoft Azure. The role involves leading the development of secure, reliable, and efficient data pipelines using Azure Synapse Analytics, Azure Data Factory, PySpark, and Azu click apply for full job details ...

timely, and built to last. What You'll Be Responsible For Developing and deploying scalable data engineering solutions on the Databricks Lakehouse platform using PySpark, Spark SQL, and Python Building batch pipelines that feed our Discovery Analytics platform, powered by Power BI, with accurate and reliable data Contributing … aware mindset — someone who understands how good data engineering creates real value, not just technical output Solid hands-on experience with Databricks, Delta Lake, PySpark, and Spark SQL Strong Python and SQL skills with a focus on clean, maintainable, production-ready code Working knowledge of CI/CD practices ...

lakes, lakehouse, distributed systems) Exposure to proof of concept (PoC) development Knowledge of object storage and distributed processing frameworks Familiarity with technologies such as: PySpark, Dremio, Apache Iceberg, Apache Airflow, S3/object storage concepts, IBM Cloud (or willingness to upskill) Experience in financial services or highly regulated environments ...

maintain scalable ETL/ELT data pipelines within Microsoft Fabric Lakehouse environments Develop and optimise data ingestion/transformation workflows Develop Python and PySpark processes for data transformation and large-scale processing Support the development and optimisation of Power BI datasets, reports and dashboards Build and maintain scalable semantic … data engineering solutions Skills and Experience Hands-on expertise with Microsoft Fabric, Lakehouse architecture and Data Pipelines Experience developing Python or PySpark solutions for large-scale data processing Understanding of ETL/ELT design patterns, data modelling and modern data platform architecture Experience developing Power BI datasets, semantic models ...

maintain scalable ETL/ELT data pipelines within Microsoft Fabric Lakehouse environments Develop and optimise data ingestion/transformation workflows Develop Python and PySpark processes for data transformation and large-scale processing Support the development and optimisation of Power BI datasets, reports and dashboards Build and maintain scalable semantic … data engineering solutions Skills and Experience Hands-on expertise with Microsoft Fabric, Lakehouse architecture and Data Pipelines Experience developing Python or PySpark solutions for large-scale data processing Understanding of ETL/ELT design patterns, data modelling and modern data platform architecture Experience developing Power BI datasets, semantic models ...

proven background and experience of full cycle development of a corporate, Microsoft based Data Warehouse. Desired skills: Design, Build, Test, Azure, Fabric Lakehouse, Spark, PySpark We are looking to recruit a high-calibre resource, so the client is happy to consider candidates from both a contract and permanent background. … your most recent CV to be considered for telephone screening. SQL/BI/ETL/DATAWAREHOUSE/AZURE/FABRIC/SPARK/PYSPARK/LEAD/MANAGER/HOME/REMOTE/MIDLANDS/BIRMINGHAM/SQL/BI/ETL/DATAWAREHOUSE/AZURE/FABRIC ...