26 to 50 of 70 PySpark Jobs in the UK

growth opportunities and helping expand a consulting business. A naturally curious mindset and a genuine passion for solving challenging problems. **Additional experience with Databricks, PySpark, R, Power BI or Palantir Foundry would be advantageous.** Why consider it? Continued development:** Dedicated training and certification budget. Variety:** Work on complex, interesting ...

engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache Airflow … transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform ...

engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache Airflow … transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform ...

unexpected backgrounds. Desirable Experience Any exposure to Palantir Foundry or AIP is a bonus, but not required - this is where you will build it PySpark or experience with large-scale data processing Experience with ERP, supply chain, finance or commercial data in an industrial setting Consultancy or startup experience ...

unexpected backgrounds. Desirable Experience Any exposure to Palantir Foundry or AIP is a bonus, but not required - this is where you will build it PySpark or experience with large-scale data processing Experience with ERP, supply chain, finance or commercial data in an industrial setting Consultancy or startup experience ...

Experience: 6-10+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse click apply for full ...

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records, entity ...

deliver high-quality data products and insights. We are looking for people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. ...

data. What Were Looking For Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field. Strong programming skills Python and SQL are essential; PySpark experience is highly advantageous. Experience with version control tools (e.g. GIT). Solid understanding of analytical technologies, tools, and techniques. Excellent logical thinking ...

integration and multi-market SCI knowledge desirable. Role 2: BNA Production-Readiness, MLOps & Integration Engineer Must Have: Strong hands-on background in Databricks, PySpark, Python and SQL Production pipeline engineering and troubleshooting Workflow orchestration and dependency management Idempotency, retry/restart and failure-recovery patterns CI/CD, version … platforms Role 3: CIS/SCI Integration & Post-Migration Stabilisation Engineer Must Have worked with: Strong hands-on background with Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation ...

small team of data engineers and own work end to end: talking to stakeholders, designing models, building and testing pipelines in Python and PySpark, and supporting BI. It's essentially remote, and the platform will grow from one business to the whole group, so there's plenty … conceptual, logical and physical data models for the new platform Building metadata-driven pipelines across Azure Synapse, Data Factory and PostgreSQL using Python and PySpark Migrating data from legacy reporting solutions onto the platform while protecting data integrity Releasing code through Azure DevOps and Git, and keeping documentation ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

performance optimisation. Hands-on delivery experience within hospitality reporting and commercial reporting environments. Experience working with Databricks is useful. Ability to interpret Python/PySpark is beneficial. If you are interested in this Power BI Developer role please apply with your most recent CV or reach out on jordan ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

ensure reporting is accurate and useful, and improve engineering standards while supporting colleagues. What you'll do ·Build and optimise pipelines using Azure Databricks, PySpark, SQL, ADF and ADLS Gen2. ·Develop governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. ·Own Power BI semantic models, DAX measures … documentation, Git and CI/CD. ·Mentor colleagues and share good practice across the team. What you'll bring ·Strong production experience with Databricks, PySpark, Delta Lake and Unity Catalog. ·Hands-on Power BI expertise, including data modelling, DAX, RLS and performance optimisation. ·Strong SQL skills and experience with ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to £80,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS business that … Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential Skills & Experience Degree ...

data science, statistical modelling and using data to solve problems. Some experience with programming languages or analytical tools, such as Python, SQL, SAS or PySpark, gained through university projects, placements, internships or employment. An understanding of statistical concepts and an interest in predictive modelling or machine learning. Strong analytical ...

DV Cleared Data Engineer Location: West Midlands - Hybrid working Rate: Up to £600 per day Inside IR35 Contract: Until 31 March 2027, with extensions expected Clearance: Active DV Clearance essential The Role We are seeking ...

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records, entity … entity matching, deduplication, and survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement data quality, standardization, reconciliation, and validation processes. Support Unity ...

Experience: 610+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common … entity matching, deduplication, and survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement data quality, standardization, reconciliation, and validation processes. Support Unity ...