1 to 25 of 31 Permanent PySpark Jobs in the South East

Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines and data integration solutions Understanding of modern data warehousing ...

Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines and data integration solutions Understanding of modern data warehousing ...

Practical Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark In addition to the above, strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration Knowledge of Azure Data Platform services, including ADF, ADLS Gen2, Azure Synapse Analytics A strong background ...

data warehouses or similar analytical platforms. Experience developing reliable ETL or ELT processes in the Medallion architecture. Experience with Microsoft Fabric data engineering, including Pyspark and dbt. Practical knowledge of data quality, testing, monitoring and operational support. Strong problem-solving skills and attention to detail. Clear communication ...

enterprise-scale environments. Deep expertise in Azure Databricks , Azure Data Factory , Azure Synapse , and Azure Data Lake . Hands-on experience with Spark (PySpark/SparkSQL) , ETL/ELT design, and data pipeline orchestration . Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. ...

numbers just don’t look right, and work out why Engineering basics: comfortable with Git (branching, committing, reading diffs) Desirable (bonus points) Python, PySpark or Spark SQL, enough to read pipeline code and trace transformations Databricks, including Unity Catalog and medallion (bronze-silver-gold) architecture Azure or AWS data ...

Microsoft Azure environments Hands-on, current engineering skills: you still write the code, not just the diagrams Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake and Lakehouse architecture Strong Snowflake architecture and optimisation experience Experience with Azure Data Factory, ADLS Gen2, Synapse Analytics and/ ...

following technical expertise: Platform Experience: Strong, hands-on experience with Databricks or Snowflake on AWS. Programming & Orchestration: Proven Python skills, including deep expertise in PySpark (or Spark) and Airflow. Data Modelling: Advanced SQL skills and extensive experience with end-to-end data modelling. Data Integration: Proven experience building both ...

role would require you to be onsite 4 days per week with the final day being remote. Key Responsibilities Develop Databricks solutions using SQL, PySpark and Python. Build and maintain ETL/ELT pipelines across Azure, SQL Server and Databricks. Support Lakeflow pipelines, production jobs and data quality processes. ...

Azure environment. Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment. Experience on Python scripting, Spark SQL PySpark is a plus. We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience ...

data models and analytics; exposure to predictive modelling and machine learning is a plus. Proficient in SQL and Python, with bonus points for PySpark, SparkSQL, and Git. Skilled in data visualisation with tools such as Tableau or Power BI. Confident writing efficient code and troubleshooting sophisticated queries. Clear ...

work on much more than dashboard development. You will be involved in designing cloud-native data solutions, building data pipelines with Python and PySpark, implementing governance through Unity Catalog and helping define best practices for the next generation of the organisation's data platform. If you enjoy solving complex ...

enterprise reporting. Key Skills Required AWS (S3, Glue, Redshift, Athena, Kinesis, Lambda) Data Lake & Lakehouse architectures ETL/ELT & data pipelines Python, SQL & PySpark Data modelling (Kimball, Data Vault) Data governance & security Terraform/CloudFormation Real-time & batch processing Experience Designing and delivering enterprise AWS data platforms Building scalable ...

stakeholders to translate business challenges into analytical solutions. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python and SQL skills, with strong PySpark experience Hands-on expertise with Microsoft Fabric and Databricks. Experience building production-grade data pipelines, reusable data assets and machine learning solutions. Experience communicating ...

data warehousing, dimensional modelling, Kimball principles and data architecture Advanced SQL/T-SQL skills, including query development, optimisation and troubleshooting Strong Python, PySpark or similar programming skills for data manipulation and automation Experience integrating data from APIs, databases, files and other sources Experience with data quality, pipeline monitoring ...

Desirable Data science experience in operations, retail, supply chain, service or another operationally intensive environment Forecasting, optimisation, classification, anomaly detection, experimentation or causal methods PySpark, Databricks, Azure or similar cloud and big-data technologies Deploying, integrating or monitoring ML models in production Applying generative AI or other emerging ...

cloud providers, including storage, networking and identity management. Confidence using Terraform and Git-based deployment pipelines. Good Python and SQL skills, with experience using PySpark and scripting for automation. Experience diagnosing performance issues and optimising distributed data workloads. Familiarity with single sign-on, automated identity provisioning and secure credential ...

management (Metadata Driven Ingestion). Good working experience of database technologies and database integration, such as SQL, Postgres, MySQL or Oracle. Experience in Python (PySpark) Experience in working with DevOps capabilities like version control, automated builds, testing and release management capabilities using Microsoft DevOps and Git repositories. Good numerical … technology roles, such as architecture, operations, and design related disciplines. At least three years of experience in Azure (Azure Synapse, Azure Databricks, Fabric, PySpark). Comprehensive experience with data modelling Experience across a range of other IT functional disciplines will be of benefit, including: Data Platform tools CI/ ...

/silver/gold patterns, and model data optimised for BI and analytics, including Power BI integration through Databricks SQL.Use Databricks pipelines, jobs, notebooks, PySpark and SQL to perform large-scale transformations and implement data quality, monitoring and performance best practicesSupport Governance, Security & Compliance through Unity Catalog lineage, cataloguing … using Azure Databricks, and developing Delta Lake architectures using bronze/silver/gold patterns. Technical capability in large-scale data processing, including Python, PySpark and SQL for transformations and data quality, and designing performant BI/analytics data models with Power BI integration. About SSESSE has a bold ...

Terraform or BicepCI/CD – GitHub Actions and/or Azure DevOpsDatabricks workspace administration, Unity Catalog & governanceMonitoring & observability – Azure Monitor, Log Analytics & KQLPython/PySpark and scalable data pipelinesSecurity, access management, automation and platform operationsWe’re particularly interested in engineers with experience across the broader data platform, rather than ...

unexpected backgrounds. Desirable Experience Any exposure to Palantir Foundry or AIP is a bonus, but not required - this is where you will build it PySpark or experience with large-scale data processing Experience with ERP, supply chain, finance or commercial data in an industrial setting Consultancy or startup experience ...

keep ideas flowing, typically once a quarter. Prefer being in the office more often? That works for us too.If you’ve strong experience with PySpark, Python and SQL, we’d love to hear from you. Apply today to learn more about this exciting role.Core skills we’re looking … role: Cloud & Data Engineering: You’ll bring expertise in modern cloud platforms, delivering scalable and robust data solutions, with engineering and database skills in PySpark, Python, SQL Server and/or Azure (Data Factory, Synapse) and the associated ETL technologies.Problem-Solving & Innovation: You’ll thrive on tackling complex challenges ...

integration and multi-market SCI knowledge desirable. Role 2: BNA Production-Readiness, MLOps & Integration Engineer Must Have: Strong hands-on background in Databricks, PySpark, Python and SQL Production pipeline engineering and troubleshooting Workflow orchestration and dependency management Idempotency, retry/restart and failure-recovery patterns CI/CD, version … platforms Role 3: CIS/SCI Integration & Post-Migration Stabilisation Engineer Must Have worked with: Strong hands-on background with Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation ...

ensure reporting is accurate and useful, and improve engineering standards while supporting colleagues. What you'll do ·Build and optimise pipelines using Azure Databricks, PySpark, SQL, ADF and ADLS Gen2. ·Develop governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. ·Own Power BI semantic models, DAX measures … documentation, Git and CI/CD. ·Mentor colleagues and share good practice across the team. What you'll bring ·Strong production experience with Databricks, PySpark, Delta Lake and Unity Catalog. ·Hands-on Power BI expertise, including data modelling, DAX, RLS and performance optimisation. ·Strong SQL skills and experience with ...

highly visible to senior leadership. You Will Work With Designing and scaling Azure Databricks-based data platforms Building robust data pipelines using Databricks, PySpark, Delta Lake and Airbyte Developing AI and LLM-powered capabilities within customer-facing products Delivering data products that support commercial decision-making Optimising Azure … senior-level engineer who can operate independently and make an immediate impact. Essential experience: Strong Azure Databricks expertise Advanced Python, SQL and PySpark skills Experience designing and building modern data platforms and pipelines Databricks optimisation, performance tuning and cost management Experience with Delta Lake and Lakehouse architectures Strong Azure ...