15 of 15 PySpark Jobs in Central London

Strong hands‐on experience with Quantexa implementation and development. Proven experience building and supporting big data platforms . Advanced knowledge of Apache Spark/PySpark . Strong programming skills in Scala and/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across ...

designs & builds data solutions and mentor junior engineers. We’re looking for someone who can offer the following skills & experience. Strong experience in Python, PySpark/Spark, Databricks, Azure Data Factory, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest. Experience designing, building and supporting scalable data ...

Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL Confident communicator who is able to explain technical terms to non‐technical audiences and mentor junior colleagues Leads ...

truth. You will design homogeneous data repositories and oversee pipelines, working within a hybrid office setup at One New Change, London. You will apply PySpark, Python, SQL, and Kimball modelling to support BI, ML, and analytics while following DevOps practices and data governance standards. Strong collaboration and communication ...

data platform, architecture and engineering practices, collaborating with Finance, Operations, IT and vendors. You’ll build scalable data pipelines, develop lakehouse solutions with PySpark, and create trusted datasets for Power BI, while ensuring data quality, governance and security. This role is based in Covent Garden with 3 days ...

interest in developing into an architectural role Experience working closely with Data Engineers, Analytics teams, and business stakeholders Exposure to Microsoft Fabric, Databricks, Python, PySpark, or dbt would be beneficial Experience with data modelling tools such as Sparx EA, Sparx Enterprise Architect, Enterprise Architect, ER/Studio, ERwin, Erwin ...

influencing skills. Ability to think creatively and propose innovative solutions. To qualify for this role, you must have: Proven experience and knowledge with PySpark and Apache Spark including the fundamentals of how it works. Experience with cloud platforms (e.g., AWS, Azure, GCP) and data lake architectures. Strong experience ...

maintain scalable data pipelines and integrations Develop integrations across SaaS platforms including NetSuite, CRM and HR systems Build pipelines using Microsoft Fabric and PySpark Develop REST API integrations using Python Design data models within a modern lakehouse architecture Build trusted datasets for Power BI and analytics Implement data quality … future AI/Copilot initiatives Translate business requirements into practical technical solutions What They’re Looking For Advanced SQL and strong Python Hands-on PySpark/Spark Experience building production data pipelines and API integrations Experience with Microsoft Fabric or another lakehouse platform Good understanding of data modelling ...

Dataiku platform every day. Aside from the visual tools, our team mostly uses Python and SQL, with occasional work in other languages (e.g., R, PySpark, JavaScript). An ideal candidate is excited to learn complex new technologies and modelling techniques and to explain their work to other data scientists ...

will work with Data Scientists to validate models, document findings, and support the PoC migration and warranty period, while promoting best practices in PySpark and SQL. #J-18808-Ljbffr ...

GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW's Radar software Proficient at communicating results ...

Support data migration efforts from Azure to Databricks Use Terraform to manage and deploy cloud infrastructure Build robust data workflows in Python (e.g., pandas, PySpark) Ensure the platform is scalable, efficient, and ready for future AI use cases REQUIRED SKILLS & EXPERIENCE Strong experience with Azure and Databricks environments Advanced … Python skills for data engineering (pandas, PySpark) Proficiency in designing and maintaining ETL pipelines Experience with Terraform for infrastructure automation Track record of working on cloud migration projects, especially Azure to Databricks Comfortable working onsite in London 2 days/week and engaging cross-functionally Strong communication and problem ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...

leading Data Management consultancy in London seeks a skilled professional experienced in PySpark and Apache Spark for a hands-on role. You will work closely with clients and play a crucial part in developing innovative solutions using cloud technologies like AWS, Azure, and GCP. Excellent communication and ability ...

champion best practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … insurance pricing. Strong technical expertise in predictive modelling techniques (e.g. GLMs and machine learning models). Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software and optimisation tools. A quantitative degree ...