14 of 14 PySpark Jobs in the West Midlands

security, and governance to support AI agent-driven data products. The ideal candidate has deep SQL skills (SQL Server/Azure SQL), strong Python (PySpark), and experience with Databricks, Synapse or Fabric, plus Power BI semantic modelling. A background in data security and Agile delivery is preferred. #J ...

Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala or PySpark, data modelling techniques, database technologies, and SQL Confident communicator, able to explain technical concepts to non‐technical audiences and mentor junior colleagues For Senior ...

agreed requirements. What youll work on The core environment is Microsoft Fabric (Lakehouse, Warehouse, OneLake, pipelines and notebooks) on a medallion architecture, alongside Python, PySpark and advanced SQL. Youll build and refine the pipelines, models and integrations that feed reporting, analytics and wider business data needs, including: Developing … like to hear how your solutions performed after launch and what you changed to make them better. Youll also have strong Python/PySpark and advanced SQL, a solid grasp of data modelling, orchestration and data quality, and real experience supporting production data workloads. An understanding of data governance ...

We are looking for an experienced Data Engineer to join our IT team and play a key role in the development of our firmwide data capability. This is a newly created position and our first ...

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Your locationYour locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Birmingham ...

opportunities and shaping hypotheses through to data exploration, feature engineering, model development, and deployment. Working with large and complex datasets, you'll use Python, PySpark, SQL, and Azure Databricks to develop robust predictive models and analytical solutions. Just as importantly, you'll be able to explain your findings ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...

team on an 18-month fixed-term contract. You will design, build, and maintain cloud-native data solutions, pipelines, and lakehouse components using Python, PySpark, and AWS services. The role is primarily remote with a monthly requirement to visit the Redditch office. Strong SQL, Linux, and version control experience ...

seeking a Data Scientist to shape data-driven decisions across customer experience, pricing and operations. You will build and deploy ML models using Python, PySpark, SQL and Azure Databricks, profile large datasets and translate insights into actions for stakeholders. You will collaborate with data engineers and ML engineers ...

progressing its implementation and ongoing development. Developing and extending a medallion lakehouse architecture across bronze, silver and gold data layers. Working hands-on with PySpark notebooks, SQL, Dataflows Gen2 and data integration technologies. Developing robust ETL/ELT pipelines, bringing data together from multiple business systems and sources. Applying … ideally bring: Strong hands-on experience with Microsoft Fabric, including Lakehouse architecture and its wider data engineering capabilities. Good working knowledge of PySpark and Spark notebooks, with the ability to understand, troubleshoot and extend existing code. A solid understanding of data warehousing, ETL/ELT processes, data integration ...

support production-grade ETL/ELT pipelines that source, transform and curate data for Internal Audit. Develop maintainable Python solutions using Pandas, Polars and PySpark, selecting fit-for-purpose approaches based on scale, performance and operational needs. Write advanced SQL for data transformation, reconciliation, profiling and analysis across OLTP … computer science, engineering or a related quantitative discipline. A master’s degree is welcome. Hands-on proficiency in Python, including Pandas, Polars and PySpark, with experience writing testable and maintainable code. Strong SQL proficiency and practical understanding of OLTP databases, relational design and query performance. Strong understanding of data ...

develop, and maintain cloud‐native data solutions that ensure data is accurate, accessible, and trusted. Designing and developing scalable data pipelines using Python and PySpark Building and optimising data workflows using AWS Glue, Athena, Redshift , and related AWS services Supporting modern lakehouse architectures, including Apache Iceberg Working with relational … solutions. Essential experience Experience as a Data Engineer, ETL Developer, Data Platform Engineer, or a similar role Strong hands‐on experience with Python and PySpark Experience with AWS Glue, Amazon Athena, Amazon Redshift , and cloud‐based data platforms Strong SQL skills and experience working with both relational and NoSQL ...

DV Cleared Data Engineer Location: West Midlands - Hybrid working Rate: Up to £600 per day Inside IR35 Contract: Until 31 March 2027, with extensions expected Clearance: Active DV Clearance essential The Role We are seeking ...

blend of experience is expected as the business transitions to Microsoft Fabric, with key skills and core technologies including: SQL, Microsoft Fabric, Python/PySpark, Data Factory, etc. Exposure to and working with AI based tools such as Microsoft Copilot will certainly enhance candidate applications. Managerial and leadership experience … forward your most recent CV for consideration. BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/ ...