22 of 22 PySpark Jobs in the South East

Python/Data Engineering professionals with a solid Azure foundation and the ability to learn and work across the wider platform. Desirable Databricks/PySpark NoSQL/Cosmos DB Infrastructure as Code/DevOps automation AI/ML data integration Automotive or insurance industry experience If this sounds ...

have To be considered for this role, we would love you to have: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

will bring strong expertise in Power BI, Microsoft Fabric and associated languages such as DAX, SQL and Power Query. Familiarity with Azure DevOps and PySpark/Python would be beneficial as would experience of working with cloud-based data solutions. Principal Responsibilities Report Development: Develop and deploy Power ...

contribute to long-term platform innovation Required Experience Strong experience designing enterprise data platforms within Microsoft Azure environments Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake, and Lakehouse architecture Strong hands-on experience with Snowflake architecture and optimisation Experience with Azure Data Factory, ADLS Gen2, Synapse ...

Knowledge of data warehousing and modern data architectures Strong problem-solving and stakeholder communication skills Desirable Skills Experience with Azure Data Factory Python or PySpark development experience Experience working within cloud data transformation programmes Understanding of data governance and security best practices Contract Details 6-Month Contract ...

hands-on experience with modern cloud data platforms (e.g. Databricks or Snowflake), ideally within AWS environments. Advanced programming and data engineering skills in Python, PySpark and SQL, with a solid understanding of ETL pipelines and data transformation. Proven experience in data modelling (end-to-end), including performance optimisation using ...

data engineering/integration/migration experience Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines Strong SQL - profiling, transformation, validation, reconciliation PySpark/Spark SQL notebook experience (Databricks or Fabric) Proven experience on a data migration project end-to-end (extraction through reconciliation) Microsoft Fabric experience ...

Logical, Physical and Dimensional) Extensive Azure Databricks experience within large-scale enterprise environments Databricks Lakehouse Architecture and Medallion Design Patterns Databricks Data Engineering using PySpark and Spark SQL Delta Live Tables (DLT) Unity Catalog implementation and governance Databricks Workflows Databricks Asset Bundles (DABs) Databricks Solution Accelerators Metadata-Driven Ingestion … Power BI semantic models and enterprise reporting environments Technical Environment Azure Databricks Delta Live Tables (DLT) Unity Catalog Databricks Asset Bundles (DABs) Databricks Workflows PySpark Spark SQL MLflow Mosaic AI Azure Data Factory Azure Synapse Azure Data Lake Storage Dynamics 365 Finance & Operations (D365 F&O) Azure DevOps Power ...

methodology. Platforms & Tools Experience with Databricks (preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers ...

actively building, modernising and optimising data workloads within a large-scale, complex environment. What we’re looking for: Strong Spark/PySpark engineering Large-scale data pipeline development & modernisation Python and strong software engineering fundamentals Performance, scalability & workload optimisation Cloud data engineering – ideally AWS CI/CD and modern ...

Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms. Youll be responsible for: Leading the design, development, and implementation ...

experience using Pandas. Experience working with SQL and cloud-based data warehousing technologies. Knowledge of Google BigQuery would be highly beneficial. Exposure to PySpark and distributed data processing environments. Ability to analyse, transform, and optimise complex datasets. Strong problem-solving and stakeholder communication skills. How to Apply ...

data platforms and influencing architecture direction across multiple engineering and data teams. Key experience: Enterprise-scale Data Architecture AWS cloud data platforms Spark/PySpark/Python Airflow & ELT/data processing Data Lakehouse & Data Products Streaming/Event-Driven Architecture Data Governance Architecture standards, patterns & technical design reviews ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

within the Microsoft ecosystem or Azure Exposure to tools such as Sparx Enterprise Architect or similar modelling tools Familiarity with technologies such as DBT, PySpark or Python is beneficial Interest in progressing into a data architecture focused role Ability to engage with both technical and non technical stakeholders APPLY ...

platform using Microsoft Fabric, working within a wider Azure data environment. You'll design, build, and optimise scalable data pipelines using Fabric, Python and PySpark, while mentoring the existing BI team and helping shape best practice across the platform. Key Responsibilities Develop and maintain the enterprise data platform using … Lead Data Engineer who is passionate about building modern, scalable data platforms. You'll have strong hands-on experience with Microsoft Fabric, Python, PySpark and Azure, enjoy solving complex technical challenges, and thrive in a collaborative environment where you can make a real impact by setting best practice ...

Senior Data Scientist Welwyn Garden City, Hertfordshire or Slough, Berkshire | Hybrid (2 Days Office) | Python | SQL | PySpark | Azure | Databricks | Machine Learning | Statistics | Time Series Forecasting | Propensity Models Role: Senior Data Scientist, Lead Data Scientist, ML Scientist, AI Data Scientist, Statistical Data Scientist, Predictive Analytics Key Skills: Senior Data Scientist … Data Scientist, Machine Learning, Artificial Intelligence, Predictive Analytics, Statistical Modelling, Python, SQL, PySpark, Azure, Databricks, MLflow, GitHub Actions, CI/CD, Time Series Forecasting, Propensity Modelling, Feature Engineering, Data Engineering, Azure Machine Learning, Azure Data Platform, Experiment Design, A/B Testing, Hypothesis Testing, Predictive Modelling, Customer Analytics, Marketing ...

Senior Databricks Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … time data pipelines from legacy and modern source systems Implementing real-time and event-driven data processing solutions Developing data transformation frameworks using Spark, PySpark and SQL Designing Lakehouse architectures using Databricks and Medallion Architecture principles Creating scalable, reusable data products to support modern data operating models Integrating data ...

**Take the lead on meaningful, high-impact projects as a Senior Data Engineer.** We are seeking a Senior Data Engineer to join a growing organisation based in London, offering a hybrid work model. This role ...

adoption of modern data mesh principles across complex enterprise environments. What You'll Be Doing Architect and deliver modern data solutions using Databricks, Spark, PySpark and SQL Design scalable batch and real-time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based … making Provide technical leadership and architectural direction on large-scale transformation programmes Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good ...

required for the domain's data products, using the tools and guardrails provided by the Enablement team. Expected Skills : Advanced coding in Python and PySpark, strong SQL, expertise in building declarative pipelines (eg; Delta Live Tables), version control (Git), automated testing (eg; Pytest), and CI/CD deployment practices … automate data pipelines to ingest, transform, and model data specific to the squad's use cases. Write structured, scalable code (eg; Python/PySpark/SQL) and apply software engineering best practices, including version control (Git) and automated testing. Work closely with the Platform Enablement team to package their ...

Data Scientist Slough - 2 days per week Up to £520 per day - inside IR35 Initial 6 month contract SQL/Python/PySpark/NLP/Gen AI/Azure This is a hands-on Data Scientist role within the Journey Insights team, focused on building and delivering data … techniques, including text classification, summarisation, entity extraction, embeddings, retrieval-augmented generation (RAG) and LLM-enabled workflows Strong programming expertise in SQL, Python and PySpark, applying software engineering best practices such as code readability, version control, testing and reproducibility Experience deploying data science models and products in cloud environments, ideally ...