26 to 50 of 112 PySpark Jobs in England

role: Strong experience with modern data engineering and reporting, data storage, data pipelines and analytical data reporting. Extensive knowledge using Python, Spark, SQL, PySpark, PowerBI Hands-on client facing roles, providing techical advise to clients or solving engineering challenges. Strong background in Software Engineering including Front-end technologies such ...

architects. Together, you will design and build modern machine learning and AI services that support analytics and improve products across the business. Experience with PySpark, Python, SQL and DataBricks (or Snowflake) is required for these roles. It's a chance to work on a very modern tech stack ...

looking for Practical experience of building and supporting modern cloud data platforms, ideally Microsoft Fabric or a comparable Azure environment. Strong Python, PySpark and SQL skills, together with experience of Lakehouse, Delta tables, medallion architecture and incremental loading. Experience of analytical data modelling, Power BI semantic models ...

architecture Experience with cloud data platforms (AWS preferred - Redshift, Athena, S3, Glue. Azure accepted) Understanding of workflow orchestration and automation tools Python experience (including PySpark) is beneficial but not essential Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models ...

Azure environment. Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment. Experience on Python scripting, Spark SQL PySpark is a plus. We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience ...

have: Proven experience as a Data Engineer working with large, complex datasets. Hands-on expertise with Apache Spark, and SQL. Strong proficiency in Python (PySpark preferred). Experience with AWS cloud services including S3, Glue, Lambda, IAM. Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. ...

architects. Together, you will design and build modern machine learning and AI services that support analytics and improve products across the business. Experience with PySpark, Python, SQL and DataBricks (or Snowflake) is required for these roles. It's a chance to work on a very modern tech stack ...

experience in data engineering, including 3+ years in a tech lead capacity Strong hands-on expertise in Databricks for enterprise-scale workloads Proficiency in PySpark, Spark Structured Streaming, and Delta Lake Solid programming skills in Python and demonstrated SQL performance optimization experience Deep understanding of Azure Data Platform services ...

API Gateway, and CloudWatch. Design, develop, and maintain data pipelines and ETL workflows using technologies such as Glue, Spark/PySpark, Kafka, or similar platforms. Implement and maintain Infrastructure as Code (IaC) using Terraform or equivalent tools. Drive observability, monitoring, logging, and operational readiness across software platforms and services. ...

payment, and transaction analysis. Strong Python skills for statistical modelling, cohort analysis, weighting, matching, and reproducible analytics. Hands-on experience with Databricks, Spark/PySpark, Delta tables, and automated data workflows. Proficiency with Git, Azure DevOps, and controlled production release processes. Strong data quality, reconciliation, and audit-trail practices. ...

platform or data warehouse migration (cutover, reconciliation, parallel running, decommissioning) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data ...

patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. Dimensional and data vault both useful Advanced SQL, Python or PySpark Declarative pipelines (Delta Live Tables or equivalent), Databricks Workflows, Auto Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data ...

work on much more than dashboard development. You will be involved in designing cloud-native data solutions, building data pipelines with Python and PySpark, implementing governance through Unity Catalog and helping define best practices for the next generation of the organisation's data platform. If you enjoy solving complex ...

enterprise reporting. Key Skills Required AWS (S3, Glue, Redshift, Athena, Kinesis, Lambda) Data Lake & Lakehouse architectures ETL/ELT & data pipelines Python, SQL & PySpark Data modelling (Kimball, Data Vault) Data governance & security Terraform/CloudFormation Real-time & batch processing Experience Designing and delivering enterprise AWS data platforms Building scalable ...

Data Engineer Key skills: * Microsoft Fabric * Azure Cloud Technologies * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

data warehousing, dimensional modelling, Kimball principles and data architecture Advanced SQL/T-SQL skills, including query development, optimisation and troubleshooting Strong Python, PySpark or similar programming skills for data manipulation and automation Experience integrating data from APIs, databases, files and other sources Experience with data quality, pipeline monitoring ...

standards and best practices. Required Experience Strong experience with Microsoft Fabric, Azure Databricks and Azure Data Factory. Solid knowledge of Delta Lake, Medallion Architecture, PySpark and SQL. Expertise in dimensional modelling and star schema design. Advanced Power BI development, including DAX and semantic modelling. Experience with Azure security, governance ...

development of scalable ETL/ELT pipelines. Proven experience working with SQL, relational databases and large datasets. Experience with data processing technologies such as PySpark, Spark or Pandas. Strong understanding of data quality, transformation and integration. Experience with Git, CI/CD and automated testing. Comfortable working in Linux ...

looking for: Previous experience as a Technical Lead (hands-on) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data ...

Desirable Data science experience in operations, retail, supply chain, service or another operationally intensive environment Forecasting, optimisation, classification, anomaly detection, experimentation or causal methods PySpark, Databricks, Azure or similar cloud and big-data technologies Deploying, integrating or monitoring ML models in production Applying generative AI or other emerging ...

driving a culture of continuous improvement. Requirements Candidates should have: 8+ years of experience in data engineering with a strong focus on Databricks (SQL & PySpark). Extensive experience with Azure data services, including ADF, ADLS, and Azure Functions. Proven track record of designing and implementing metadata-driven data pipelines. ...

across regulated industries. ResponsibilitiesImplement end-to-end Microsoft Fabric solutions based on approved architecture, including OneLake, Lakehouse, Warehouse, Data Factory pipelines, Dataflows Gen2, Notebooks (PySpark/Spark SQL) and Real-Time IntelligenceBuild medallion architectures (Bronze/Silver/Gold), including incremental loads, change data capture, slowly changing dimensions … ingestion from diverse sources (SQL databases, APIs, files, SaaS applications, SAP, streaming sources) using pipelines, shortcuts and mirroringWrite clean, reusable and tested code in PySpark, Spark SQL, T-SQL and KQL, optimizing Delta tablesAdd data quality checks, validation rules, logging and alerting to data pipelinesBuild enterprise semantic models (star ...

investigate complex problems and take ownership of technical solutions. Strong communication skills and a collaborative approach. Desirable Experience Data engineering technologies such as Databricks, PySpark or Spark. Cloud platforms, particularly AWS. Python frameworks such as FastAPI and PyTorch. Experience developing APIs and data pipelines. Infrastructure as Code, CI/ ...

across systems Proven skills in project management, solution delivery, and budget oversight within an IT/Cloud environment Technical proficiency with SQL, Python/PySpark, and Microsoft Power Platform Experience with CI/CD, DevOps practices, and system security considerations Ability to analyse, troubleshoot, and validate data solutions, ensuring ...

agentic capabilities, able to build production-grade applications not just prototypes. Strong proficiency in at least one relevant programming language such as Python or PySpark, Java, Typescript or SQL.Solid understanding of data engineering, data modelling, security and governance in enterprise settings. Experience with software engineering best practices including ...