17 of 17 PySpark Jobs in the South East

ingestion and transformation pipelines from multiple source systems. Strong SQL skills and experience working with relational data models. Experience with Python and/or PySpark for data transformation and automation. Understanding of Power BI, semantic models, DAX and reporting requirements. Experience working with APIs, JSON, CSV, Parquet, Delta tables ...

working with flexibility and autonomy Key Experience Deep end-to-end experience delivering enterprise Databricks analytics solutions Expertise in Lakehouse Architecture, Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala ...

+ environment configurations. Analysing current Data Engineering solutions + identifying data migration requirements. Onboarding datasets, users + workloads onto target platform. Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation. AWS Cloud Platform, S3, IAM, CI/CD concepts, DevOps ...

Leadership (Azure + Databricks + Power BI) Lead architecture and execution of: Azure Data Platform (ADF, Synapse, Fabric, ADLS) Databricks (Lakehouse, Delta, ML workflows, PySpark pipelines) Power BI (semantic models, enterprise dashboards, self-service BI) Drive adoption of: Metadata-driven architectures Automation, orchestration, and reusable frameworks Ensure separation ...

level Performance tuning of complex SQL/T-SQL at scale Confidence taking ownership of workstreams and mentoring junior team members Desirable for both: PySpark/Python in Fabric Notebooks, Azure Data Factory/Synapse/Data Lake, Power BI, AI/ML exposure ...

Pipelines Databricks Data engineering, including data enrichment and validation. Database management, including partitioning of data ETL processes Azure - pipelines, data factory, function apps SQL Pyspark HDFS Big data, including how to optimise operations Core Competencies & Technical Skills (AI and emerging technology): Designs, integrates and operates AI-enabled solutions within ...

engineers on new capabilities Opportunity to gain exposure to data modelling and machine learning projects YOUR SKILLS AND EXPERIENCE: Experience with Python and PySpark (commercial, academic, or project-based) Exposure to Databricks or similar data platforms Strong desire to learn and develop within a collaborative team Understanding of data ...

Looking For: Proven experience working with Palantir Foundry in production environments Strong engineering background with expertise in at least one of: Python, SQL, PySpark, or TypeScript Strong understanding of modern data architectures & distributed systems Ability to work in fast-paced, ambiguous environments Excellent stakeholder engagement and communication skills Experience ...

leading Professional Services firm is looking to hire a Finance Data Engineering & Analytics Lead to join their team. You will develop Python/PySpark-based data pipelines, build data models and datasets for finance, actuarial and risk reporting. You will also develop analytics, dashboards and data validation tooling. ...

data platforms and cloud environments Collaborate with engineering and architecture teams to deliver high-quality solutions Key Skills & Experience Strong experience with Python and PySpark Hands-on expertise in AWS Experience working with Databricks Ideally 5+ years working with this tech stack as a data engineer Proven background delivering ...

ongoing basis. Contribute to the planning, research, recommendation, and implementation of current and future IT strategies. PERSON SPECIFICATION: Essential Demonstrable experience of Spark (PySpark) and SQL. Demonstrable experience of Fabric components. Demonstrable experience of working on enterprise environments. Experience of designing architectural Fabric processes. Experience of Azure Data Factory. ...

machine learning operations. Excellent communication skills with the ability to influence cross‐functional teams and stakeholders. Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferred. Well‐versed in design thinking principles. Great problem solving and analytical skills. #LI‐GM1 The total cash range for this ...

migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise, building and optimising PySpark pipelines Ensure data is secure, high-quality, accessible, and structured for maximum business value Drive best practice in data governance, cataloguing, lineage, and standards … reporting teams Ensure compliance with data protection regulations and internal policies What you'll bring Strong hands-on experience in data engineering, including PySpark and production data pipelines Experience with Microsoft Fabric, Azure Synapse, or similar platforms (e.g. Databricks, AWS) Proven ability to design and manage scalable data pipelines ...

Azure platform — including infrastructure-as-code (Pulumi), CI/CD automation, monitoring, security, and Databricks workspace administration. The ideal candidate combines strong Python/PySpark engineering skills with deep Azure platform knowledge and a service-excellence mindset. Duties and Responsibilities Lead solution design activities, collaborating with peers and mentoring … Databricks: hands-on experience building and optimizing pipelines, managing Delta Lake, and administering workspaces (cluster policies, Unity Catalog, Secret Scopes, Workflows). Python/PySpark: strong programming skills for data processing, automation, and scripting. Azure data stack: Synapse, Databricks, ADLS Gen2, Key Vault — including Linked Services, Managed Identity ...

Data Engineering Lead Certain Advantage are hiring for a Data Engineering Lead based in London. This role is on an initial contract till the end of the year and is required to be onsite 3 ...

Skills You’ll need to have experience with some of the following and be able to learn new technologies or concepts quickly: Python/PySpark - Experience using Python and PySpark to connect to APIs and extract data, with strong API design skills and familiarity with LLM orchestration frameworks ...

challenges Communicate findings and recommendations to stakeholders in a clear and structured manner Learning & Professional Development Build practical expertise in React, TypeScript, Python, and PySpark within a Palantir Foundry environment Apply and develop best practices in data engineering, visualisation, and business intelligence Engage with mentorship and guidance from senior … appreciation for how data can be presented in ways that are both intuitive and impactful Working knowledge of SQL, with exposure to Python or PySpark desirable but not essential Strong analytical and problem-solving skills, with a passion for extracting meaning from complex datasets Effective communication skills, both written ...