18 of 18 PySpark Jobs in the South East

working with flexibility and autonomy Key Experience Deep end-to-end experience delivering enterprise Databricks analytics solutions Expertise in Lakehouse Architecture, Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala ...

Experience* Proven experience delivering enterprise-scale Databricks solutions end-to-end.* Strong background in Lakehouse Architecture, including structured and unstructured data.* Expertise in Spark, PySpark, Delta Lake, and Databricks workflows.* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.* Strong programming skills in Python, Scala, or SQL. ...

beneficial: Proficiency in SQL , including Spark SQL and MS SQL Server , for querying, data manipulation, and performance optimization. Hands-on experience with Python and PySpark for data processing, transformation, and automation tasks. Proven ability to design, build, and maintain scalable data pipelines for batch and streaming data using modern ...

team supporting Azure based Production Data & Analytics ETL/integration solutions (Fabric, Databricks, Synapse, Data Factory, Function Apps, Power BI etc) against SLAs Python, PySpark, Scala, Spark SQL Ability to identify and investigate complex problems and implement resolutions Direct contact with customers/end-users on the phone ...

automation and optimization of data workflows Requirements: Experience in data engineering and pipeline development Strong expertise in Azure (Synapse, Data Lake) Proficiency in Python, PySpark, and T-SQL Knowledge of data warehousing, CDC, and incremental processing Familiarity with modern data architectures (e.g., medallion) Preferred Experience with Azure DevOps/ ...

best practices are followed Required Skills & Experience: Strong experience with Azure data platform (e.g., Data Factory, Data Lake, Synapse) Hands-on expertise with Databricks (PySpark or Spark) Solid SQL development skills Experience working with Kafka for streaming data pipelines Good understanding of lakehouse architecture, including bronze/silver/ ...

Financial Services experience is preffered, but not essential) Comfortable challenging existing approaches and offering fresh technical perspectives Nice to Have Exposure to Databricks, PySpark or Python-based data processing Experience optimising legacy or sub-optimal Azure implementations Familiarity with Agile delivery frameworks Please reach out to Adam Akhtar ...

Data Warehouse capabilities. Design, manage, and optimise data storage within OneLake , ensuring well-governed, well-structured, and shareable data assets. Develop scalable Spark (PySpark/Spark SQL) data transformations through Fabric notebooks to support high-volume processing. Create, orchestrate, and monitor robust data ingestion and transformation pipelines using Fabric ...

data for critical client projects. How to develop and enhance your knowledge of agile ways of working and working in open source stack (PySpark/PySql). Quality engineering professionals utilise Accenture delivery assets to plan and implement quality initiatives to ensure solution quality throughout delivery. As a Data ...

Data Scientist (Machine Learning) you will be responsible for: Build predictive, forecasting and anomaly-detection models Perform feature engineering & validation using Python/PySpark Work in Fabric Notebooks, Delta Lakehouse, and AutoML Embed models into production pipelines with our Data Engineering team Document and hand over deliverables ...

differences between different packages for some of these model types would be an advantage. Experience in statistical and data science programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience of WTW's Radar software is preferred. Proficient at communicating results in a concise manner both verbally and written. ...

maintain scalable ETL/ELT data pipelines within Microsoft Fabric Lakehouse environments Develop and optimise data ingestion/transformation workflows Develop Python and PySpark processes for data transformation and large-scale processing Support the development and optimisation of Power BI datasets, reports and dashboards Build and maintain scalable semantic … data engineering solutions Skills and Experience Hands-on expertise with Microsoft Fabric, Lakehouse architecture and Data Pipelines Experience developing Python or PySpark solutions for large-scale data processing Understanding of ETL/ELT design patterns, data modelling and modern data platform architecture Experience developing Power BI datasets, semantic models ...

Strong modelling background (such as): GLMs, GBMs, GAMs, Elastic Net, Trees/Random Forests, Neural Nets, Clustering . Strong coding capability in Python/PySpark/R/SAS/SQL . Experience with WTW Radar. Confident communicator. Salary: £75,000 - £90,000 p/a (d.o.e) + Bonus ...

Lead the engineering, optimisation and governance of Azure-based data platforms, spanning ADF, Data Lake, Azure Functions, Key Vault, Databricks, Delta Lake, PySpark and Unity Catalog . Collaborate closely with insurance domain teams- Underwriting, Actuarial, Delegated Authority, Bordereaux, Exposure Management, Reinsurance, Finance, Risk and Solvency II -delivering solutions aligned … Azure data services and Databricks in enterprise-scale environments. Strong knowledge of Delta Lake , Medallion architecture, distributed compute and Lakehouse engineering patterns. Advanced Python, PySpark and Spark SQL skills, including deploying data workloads through Azure DevOps CICD , branching/merging and automated testing. Solid understanding of data governance, lineage ...

data processing solutions Work with modern data platforms such as Microsoft Fabric, Databricks, or similar technologies Build and optimise data solutions using Python, Spark, PySpark, and/or SQL Collaborate with stakeholders to ensure high-quality, reliable data architecture Essential Skills & Experience Hands-on experience with Microsoft Fabric, Databricks … equivalent modern data platforms Strong coding experience in Python and/or Spark/PySpark Solid SQL skills and experience working with structured datasets Desirable Experience Knowledge of relational database design , normalisation , and data modelling ...

models within a Lakehouse environment Own dimensional and semantic modelling to enable consistent, trusted reporting across the business Build and maintain complex SQL and PySpark transformation pipelines using Databricks Drive data quality, testing, reliability and performance across the curated or gold data layer Work closely with data engineers … experience: Strong commercial experience as an Analytics Engineer within a modern data platform or Lakehouse architecture Expert level SQL and strong hands on PySpark capability Proven experience designing and owning dimensional data models for analytics and reporting Experience working with Databricks, including pipelines and governed data environments Solid understanding ...

Engineer and just want a better place to keep progressing. Whichever route you come from, the key thing is simple. You’ll need Python, PySpark and SQL. Your new role.. You’ll be joining a business where data genuinely matters. Not in the vague “we’re data-driven … questions, improve your engineering standards, and build proper experience in a setting where Data Engineering is already valued. You’ll be working with Python, PySpark and SQL on the kinds of problems that help you grow into a stronger all-round engineer. So if you want a role that ...

champion best practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … insurance pricing. Strong technical expertise in predictive modelling techniques (e.g. GLMs and machine learning models). Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software and optimisation tools. A quantitative degree ...