13 of 13 PySpark Jobs in the Thames Valley

transformation and orchestration pipelines, integrating data from cloud, on-premises and third-party business systems. Strong hands-on capability with SQL, Python, Spark and PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation ...

transformation and orchestration pipelines, integrating data from cloud, on‐premises and third‐party business systems. Strong hands‐on capability with SQL, Python, Spark and PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation ...

3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. ...

quality practices - Promote and champion the exceptional work being accomplished. Essential Skills & Experience: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

control and documentationAct as a technical leader and mentor, raising standards across the data engineering communityWhat you’ll bringEssentialDeep expertise in Databricks (Spark/PySpark, Delta Lake, Unity Catalog, Workflows)Strong experience building ETL/ELT pipelines, both batch and streamingAdvanced Python and SQL skillsHands-on experience with cloud ...

Analytics capabilities. What you'll do Data Engineering Delivery: Design, build andoptimisescalable data pipelines, ETL/ELT workflows and data transformation solutions using Databricks,PySpark, SQL anddbtCloud, delivering trusted, high-quality data products that support reporting, analytics, AI and data science. Data Architecture & Modelling: Develop and maintain robustlakehousearchitectures ...

arePrevious experience assessing and improving data quality using SQL and/or Python. Ability to develop scalable data pipelines using technologies such as Spark, PySpark, Hive, and BigQuery. Vast experience working with large and complex codebases, using tools such as GitHub, GitLab, Gitflow, EnvFlow, or Fork/Pull workflows. ...

ability to work independently, challenge assumptions constructively and influence decision-making through evidence It would be beneficial if you also have: Experience with Databricks, PySpark, Azure or similar cloud-based data environments Experience within operational, retail, logistics or customer-focused businesses Exposure to AI solutions or emerging machine learning ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish ...

using modern data engineering patterns Develop robust orchestration workflows for dependable data ingestion, transformation, quality checks, and downstream consumption Apply strong SQL, Python, and PySpark skills to transform complex data into reliable, reusable, and performant data products SQL, Data Modelling & Analytics Enablement Create well-modelled, trusted datasets that support … analytics foundations Advanced SQL skills with the ability to design performant queries, data models, and transformation logic Hands‐on knowledge of Python and PySpark for large‐scale data processing and automation Curious, hands‐on problem solver who can engage with business stakeholders to understand the real requirement and deliver ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

At M&G our purpose is to give everyone real confidence to put their money to work. As an international savings and investments business with roots stretching back more than 170 years, we offer a ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...