12 of 12 PySpark Jobs in the West Midlands

overview of many different sectors. What We're Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience ...

overview of many different sectors. What We're Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience ...

overview of many different sectors. What We're Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience ...

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

demand delivery Provide technical guidance for team members Providing 2nd or 3rd level technical support About You Experience using SQL, SQL Server DB, Python & PySpark Experience using Azure Data Factory Experience using Data Bricks and Cloudsmith Data Warehousing Experience Project Management Experience The ability to interact with the operational ...

manage Ontology Objects, Links, and Actions to support downstream applications and workflows. Pipeline Development & Automation: Build scalable, fault-tolerant ETL/ELT pipelines using PySpark, SQL, and Foundry's proprietary tools like Pipeline Builder and Code Workbook. Productization & Scaling: Create Prototypes and Convert them into production-grade solutions ...

Continuously improve data systems and maintain awareness of best practice and emerging approaches Essential Skills Experience with large-scale analytics engines (e.g. Spark/PySpark) and scripting languages such as Python or Scala. Hands-on use of cloud data stacks (e.g. SageMaker Notebooks, S3, Glue, Athena) and modern storage ...

/Data Engineering role Large and complex datasets Azure, Azure Databricks Microsoft SQL Server Lakehouse, Delta Lake Data Warehousing ETL Database Design Python/PySpark Azure Blob Storage Azure Data Factory Desirable: Exposure ML/Machine Learning/AI/Artificial Intelligence ...

build skills and knowledge relevant to the role. Essential Skills Experience of using a unified engine for large-scale data analytics (e.g. Spark/PySpark) Experience in writing, testing and implementing scripts (e.g. Python, Scala) Experience of cloud data stack use (e.g. SageMaker Notebooks, S3, Glue, Athena) Communicating technical ...

Databricks-based data warehousing solution Designing and developing data models, ETL pipelines, and data integration processes Large scale data processing using PySpark Monitoring, tuning, and optimising data platforms for reliability and performance Upskilling the wider team in Databricks best practices, including modern architecture patterns Location: Atherstone (Hybrid – 3 days ...

doing: Building and maintaining a unified data platform for global data processing. Developing reusable and scalable data solutions using Databricks, Python/PySpark, and Azure. Working closely with the data visualisation team to align back-end and front-end needs. Designing secure data access models and integrating external data … Strong understanding of data engineering principles, Lakehouse architecture, ETL/ELT, warehousing, and stream processing. Hands-on experience with Azure Databricks, Python/PySpark, SQL Server, and Azure Blob Storage. A track record of building secure, scalable data pipelines and solving complex problems. Great communication and documentation skills with ...