126 to 141 of 141 PySpark Jobs in the UK

reduce false positives/negatives, and support downstream fraud and KYC models. Build and maintain scalable data pipelines and feature stores in Spark/PySpark (or Scala), including data normalization, deduplication, and feature computation across large PII datasets in AWS/Databricks environments. Lead A/B tests … proficiency in Python (preferred) or Scala, including experience with ML libraries such as scikit‐learn, XGBoost, TensorFlow or PyTorch. Extensive experience with Spark or PySpark and distributed data systems (e.g., AWS EMR, Databricks) working on very large, messy datasets. Deep understanding of supervised and unsupervised learning, feature engineering, model ...

reporting perspective *Design and build data pipelines and datasets for dashboards *Identify and mitigate data quality risks *Develop reusable code in Python and PySpark for data prep and analysis *Collaborate closely with Data Engineers, Analysts and UCD professionals *Work within modern engineering practices including CI/… strong engineering culture What I need from you (essential) To be considered, your CV must clearly show experience with the following: *Palantir (FDP) *Python *PySpark *Exploratory Data Analysis *Data pipeline design/data engineering concepts *Dashboard/reporting dataset development *BI tools (Redshift, Databricks or similar) *Agile delivery environments ...

challenges Communicate findings and recommendations to stakeholders in a clear and structured manner Learning & Professional Development Build practical expertise in React, TypeScript, Python, and PySpark within a Palantir Foundry environment Apply and develop best practices in data engineering, visualisation, and business intelligence Engage with mentorship and guidance from senior … appreciation for how data can be presented in ways that are both intuitive and impactful Working knowledge of SQL, with exposure to Python or PySpark desirable but not essential Strong analytical and problem-solving skills, with a passion for extracting meaning from complex datasets Effective communication skills, both written ...

Job Description Who we are At Grant Thornton we’re building something bold. We’re doing things differently - looking to the future, driving ambitious growth and pioneering positive change in our industry. Providing audit, tax ...

looks like from a reporting perspectiveDesign and build data pipelines and datasets for dashboardsIdentify and mitigate data quality risksDevelop reusable code in Python and PySpark for data prep and analysisCollaborate closely with Data Engineers, Analysts and UCD professionalsWork within modern engineering practices including CI/CD, TDD and DevSecOpsPair …/BA-style roleNot a role where you'll just "pick up tickets" with no ownershipNot suitable if your experience is light on Python, PySpark or PalantirKey Details£560 per day (Inside IR35)Start ASAPRunning until November 2026 (extensions very likely)Remote with occasional travel to LondonMust ...

digital Screening service. You will build and maintain data pipelines that ingest, transform and prepare data for reporting, developing ETL processes using PySpark and platform tooling. You will work within an Agile multidisciplinary team alongside Data Scientists, Analysts and UCD professionals. This is a largely remote role. Essential skills … experience Strong experience in data pipeline engineering, ETL development and PySpark Experience with Palantir products, including the NHS Federated Data Platform (FDP) Ability to ensure data quality, reliability and performance across reporting pipelines Experience supporting testing and validation of dashboards and underlying datasets Proven ability to work independently ...

also partner directly with teams across the company—from building embedded dashboards to driving strategic acquisition‐related projects. We work in Python, PySpark, AWS, and Terraform using Agile methodologies, but we welcome strong engineers with experience in other backend stacks who are excited to learn. What … working with large datasets (e.g. Spark, other big data frameworks) Excellent communication and cross‐functional collaboration skills Nice‐to‐Haves Experience with AWS, PySpark, or Terraform Strong problem‐solving skills related to data architecture and data analysis In addition to our core values, Addepar is proud ...

models. This isn't just a 'high-level' role-we need someone who can design the blueprint and then dive into the Python/PySpark code to ensure the foundation is rock solid. Key Responsibilities: Architect & Design: Lead the implementation of on-premises, cloud, and hybrid AI solutions. GenAI … certification. AI Specialization: Proven experience with Prompt Engineering, Azure OpenAI, Document Intelligence (Form Recognizer), and Cognitive Search. Data Engineering: Expert proficiency in Python and PySpark for large-scale data processing. Operations: Familiarity with MLOps or LLMOps frameworks to support production-grade AI. Seniority: 15+ years of total IT experience ...

calculations, including netting sets, supervisory factors and collateral/CSA logic. Design a modern Databricks architecture using Delta Lake, Unity Catalog and Spark/PySpark to support versioned, reproducible and regulator‐defensible exposure calculations. Develop high‐performance compute pipelines that support intraday recalculation, scenario testing and rapid exposure analytics … exposure methodology, netting sets, supervisory parameters and collateral/CSA design. Strong Databricks engineering capability , including Delta Lake versioning, Unity Catalog governance, Spark/PySpark optimisation and secure data architecture. Experience designing governed, audit‐ready systems , with a focus on lineage, reproducibility, evidence trails and internal/external audit ...

calculations, including netting sets, supervisory factors and collateral/CSA logic.* **Design a modern Databricks architecture** using Delta Lake, Unity Catalog and Spark/PySpark to support versioned, reproducible and regulator‐defensible exposure calculations.* **Develop high‐performance compute pipelines** that support intraday recalculation, scenario testing and rapid exposure analytics … exposure methodology, netting sets, supervisory parameters and collateral/CSA design.* **Strong Databricks engineering capability**, including Delta Lake versioning, Unity Catalog governance, Spark/PySpark optimisation and secure data architecture.* **Experience designing governed, audit‐ready systems**, with a focus on lineage, reproducibility, evidence trails and internal/external audit ...

insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting … code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory ...

workstreams from discovery through to validated delivery Architect and build the Claude Code agentic workflow: Parse existing data movement pipelines and logic Generate equivalent PySpark transformations Produce Airflow DAGs Operate, iterate, and scale across the full data pipeline estate Ensure rigorous creation and management of the PySpark data … architectural standards on complex, multi-workstream programmes Hands-on capability to build solutions as well as design them Deep expertise in Python and PySpark: Strong track record delivering large-scale distributed data systems Experience with Claude Code or similar agentic AI platforms: Prompt engineering Context management Workflow design ...

Amex GBT is a place where colleagues find inspiration in travel as a force for good and – through their work – can make an impact on our industry. We’re here to help our colleagues achieve ...

actions, this could be a great fit. What you'll be doing ✨ Investigating production data to identify issues, anomalies, and trends ✨ Using SQL and PySpark to explore data, validate assumptions, and uncover root causes ✨ Supporting data scientists and engineers with queries, investigations, and data related challenges ✨ Gathering requirements through … Experience working as a Business Analyst in a data focused environment ✔ Strong SQL skills and confidence working directly with production data ✔ Exposure to PySpark or large scale data platforms ✔ Excellent stakeholder engagement and communication skills ✔ Experience working within regulated or highly governed environments ✔ Someone who enjoys problem solving, digging ...

JPMorgan Chase & Co. is seeking a Site Reliability Engineer for their AI/ML Data Platforms team in Greater London. In this role, you will develop scalable and resilient data solutions, manage incident resolutions, and ...