1 to 25 of 26 PySpark Jobs in the Midlands

with Microsoft Fabric technologies including OneLake, Lakehouse, Warehouse, Data Factory, Spark and Power BI. Strong Engineering Skills - You're proficient in SQL, Python and PySpark, with experience developing scalable and maintainable data solutions. Modern Data Platform Experience - You’ve successfully built, enhanced or operated cloud‐based data platforms, ideally ...

Strong problem-solving and analytical skills. Desirable Experience with Microsoft Fabric. Experience with Azure Data Services. Working with multi-currency financial information Knowledge of PySpark or Spark SQL. Understanding of Microsoft Entra ID and security frameworks. Experience with DevOps and automated deployment pipelines. Knowledge of financial, legal, or professional ...

Experience of core MS Fabric features including: OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Gen2, Notebooks, Eventstreams + Eventhouses. Using SQL, T-SQL, Spark SQL, PySpark + Python for data ingestion, data transformation, data optimisation, data modelling, and converting structured/unstructured source data into validatd Delta tables. Using Power ...

Experience of core MS Fabric features including: OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Gen2, Notebooks, Eventstreams + Eventhouses. Using SQL, T-SQL, Spark SQL, PySpark + Python for data ingestion, data transformation, data optimisation, data modelling, and converting structured/unstructured source data into validatd Delta tables. Using Power ...

Data Engineering roles, including 3 years in a technical lead role managing end‐to‐end solutions. Hands‐on experience with Azure Databricks using PySpark, with the ability to undertake cluster capacity planning and workload optimisation. Holds Security Check (SC) clearance OR Eligible for Security Check (SC) clearance level ...

security, and governance to support AI agent-driven data products. The ideal candidate has deep SQL skills (SQL Server/Azure SQL), strong Python (PySpark), and experience with Databricks, Synapse or Fabric, plus Power BI semantic modelling. A background in data security and Agile delivery is preferred. #J ...

audiences Essential knowledge, skills & experience (must-have): 4+ years of commercial experience in Data Science/Machine Learning Hands-on experience with: Databricks Notebooks PySpark Workflows Deployment through Asset Bundles Proven experience building, deploying, and maintaining production ML solutions Broad experience across multiple ML domains, including: Forecasting/Time ...

Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala or PySpark, data modelling techniques, database technologies, and SQL Confident communicator, able to explain technical concepts to non‐technical audiences and mentor junior colleagues For Senior ...

insights clearly to both technical and non-technical audiences. Some other highly valued skills include: Strong SQL and database experience. Knowledge of Python/PySpark and data analytics. Experience working in a Call Centre or Contact Centre environment. Strong communication and stakeholder management skills. Ability to lead technical teams ...

business stakeholders to deliver dashboards that meet Barclays standards and business needs. Some other highly valued skills may include: Knowledge of Python/PySpark and data analytics. Experience in a Call Centre or Contact Centre environment. Strong communication and stakeholder management skills. Ability to collaborate effectively across technical ...

agreed requirements. What youll work on The core environment is Microsoft Fabric (Lakehouse, Warehouse, OneLake, pipelines and notebooks) on a medallion architecture, alongside Python, PySpark and advanced SQL. Youll build and refine the pipelines, models and integrations that feed reporting, analytics and wider business data needs, including: Developing … like to hear how your solutions performed after launch and what you changed to make them better. Youll also have strong Python/PySpark and advanced SQL, a solid grasp of data modelling, orchestration and data quality, and real experience supporting production data workloads. An understanding of data governance ...

We are looking for an experienced Data Engineer to join our IT team and play a key role in the development of our firmwide data capability. This is a newly created position and our first ...

trends using Tableau, Power BI and AWS Connect Customer, collaborating with business stakeholders to productionise solutions. The role requires strong SQL and Python/PySpark skills, plus experience leading technical teams and mentoring #J-18808-Ljbffr ...

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Your locationYour locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Birmingham ...

opportunities and shaping hypotheses through to data exploration, feature engineering, model development, and deployment. Working with large and complex datasets, you'll use Python, PySpark, SQL, and Azure Databricks to develop robust predictive models and analytical solutions. Just as importantly, you'll be able to explain your findings ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...

team on an 18-month fixed-term contract. You will design, build, and maintain cloud-native data solutions, pipelines, and lakehouse components using Python, PySpark, and AWS services. The role is primarily remote with a monthly requirement to visit the Redditch office. Strong SQL, Linux, and version control experience ...

seeking a Data Scientist to shape data-driven decisions across customer experience, pricing and operations. You will build and deploy ML models using Python, PySpark, SQL and Azure Databricks, profile large datasets and translate insights into actions for stakeholders. You will collaborate with data engineers and ML engineers ...

/Computing or equivalent, 5+ years in Data Engineering with 3 years in a technical lead role, and hands-on experience with Azure Databricks, PySpark, #J-18808-Ljbffr ...

progressing its implementation and ongoing development. Developing and extending a medallion lakehouse architecture across bronze, silver and gold data layers. Working hands-on with PySpark notebooks, SQL, Dataflows Gen2 and data integration technologies. Developing robust ETL/ELT pipelines, bringing data together from multiple business systems and sources. Applying … ideally bring: Strong hands-on experience with Microsoft Fabric, including Lakehouse architecture and its wider data engineering capabilities. Good working knowledge of PySpark and Spark notebooks, with the ability to understand, troubleshoot and extend existing code. A solid understanding of data warehousing, ETL/ELT processes, data integration ...

Join us, be part of more. We’re so much more than an energy company. We’re a family of brands revolutionising how we power the planet. We’re energisers. One team of 21,000 ...

Join us, be part of more. We’re so much more than an energy company. We’re a family of brands revolutionising how we power the planet. We're energisers. One team of 21,000 ...

support production-grade ETL/ELT pipelines that source, transform and curate data for Internal Audit. Develop maintainable Python solutions using Pandas, Polars and PySpark, selecting fit-for-purpose approaches based on scale, performance and operational needs. Write advanced SQL for data transformation, reconciliation, profiling and analysis across OLTP … computer science, engineering or a related quantitative discipline. A master’s degree is welcome. Hands-on proficiency in Python, including Pandas, Polars and PySpark, with experience writing testable and maintainable code. Strong SQL proficiency and practical understanding of OLTP databases, relational design and query performance. Strong understanding of data ...

develop, and maintain cloud‐native data solutions that ensure data is accurate, accessible, and trusted. Designing and developing scalable data pipelines using Python and PySpark Building and optimising data workflows using AWS Glue, Athena, Redshift , and related AWS services Supporting modern lakehouse architectures, including Apache Iceberg Working with relational … solutions. Essential experience Experience as a Data Engineer, ETL Developer, Data Platform Engineer, or a similar role Strong hands‐on experience with Python and PySpark Experience with AWS Glue, Amazon Athena, Amazon Redshift , and cloud‐based data platforms Strong SQL skills and experience working with both relational and NoSQL ...

DV Cleared Data Engineer Location: West Midlands - Hybrid working Rate: Up to £600 per day Inside IR35 Contract: Until 31 March 2027, with extensions expected Clearance: Active DV Clearance essential The Role We are seeking ...