51 to 70 of 70 PySpark Jobs in the UK

Data Engineer (Databricks) Leeds (Hybrid) 6 Month Contract £(Apply online only)/day (Inside IR35) Data Engineer needed with strong hands-on Databricks, PySpark, AWS, SQL + Python experience. 6 Month Contract based in Leeds (Hybrid). Start ASAP in October 2026. Hybrid Working Model - primarily working from home … month. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark + SQL skills. Hands-on Data Engineer to run + maintain production data pipelines on Databricks and AWS. Keeping scheduled data processing reliable, resolve ...

2026. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark and SQL skills. Hands-on Data Engineer to run + maintain production data pipelines on Databricks and AWS. Keeping scheduled data processing reliable, resolve … understanding of role-based access, KMS encryption + diagnosing data access failures. Owning incidents from investigation through recovery and closure. Diagnosing issues in Python, PySpark, SQL, Databricks jobs and AWS integrations + providing clear progress updates and timely escalation. Working knowledge of Git, code reviews, CI/ ...

personal technical development. To ensure data dictionaries and models are robust and maintained on a regular basis. Technical Skill Expert-level Databricks experience Advanced PySpark development Delta Lake architecture and optimisation Databricks SQL Data warehouse Dimensional modelling Data Lake Databricks Genie Python development Key Skills, Experience and Knowledge Extensive … within enterprise-scale data environments. Extensive hands-on experience delivering solutions using Databricks. Extensive experience designing and implementing Lakehouse architectures. Strong commercial experience using PySpark, Python, SQL and Delta Lake. Experience optimising Databricks workloads for performance, scalability and cost efficiency Previous experience delivering solutions within insurance, financial services ...

influence delivery standards and contribute to reusable frameworks and accelerators. What You'll Be Doing Building production-grade data pipelines with Databricks, PySpark and SQL Developing Lakehouse architectures using Delta Lake, Unity Catalog and medallion frameworks Gathering requirements and providing technical guidance to client teams Embedding CI/… team Modernising legacy data platforms to unlock more value from client data estates What You'll Bring Commercial Databricks delivery experience Strong hands-on PySpark and SQL Solid grounding in data engineering, data modelling and Lakehouse architecture Experience on Azure and/or AWS Source control, CI/ ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Snowflake – Warehouses, Streams/Tasks, Snowpipe, Snowpark, UDFs/Stored Procedures, Time Travel and Cloning. Snowpark and end-to-end pipeline development. Experience with PySpark, Polars or Dask is also valuable. Python, including testing, build tooling and engineering best practices. SQL, including Snowflake-optimised SQL. dbt, including Jinja templating … champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great opportunity to join a collaborative ...

Snowflake - Warehouses, Streams/Tasks, Snowpipe, Snowpark, UDFs/Stored Procedures, Time Travel and Cloning. Snowpark and end-to-end pipeline development. Experience with PySpark, Polars or Dask is also valuable. Python, including testing, build tooling and engineering best practices. SQL, including Snowflake-optimised SQL. dbt, including Jinja templating … champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great opportunity to join a collaborative ...

organisation. Youll design and optimise Spark workloads, build production streaming pipelines and deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong … Python and PySpark engineering capability Delta Live Tables, Workflows and Unity Catalog Terraform and Databricks Asset Bundles CI/CD and GitHub Actions Ability to work autonomously in a fast-moving environment Experience with Databricks Apps, Lakebase, Airflow, Azure Data Factory, monitoring platforms or financial services would be beneficial. ...

Inside IR35 via umbrella Remote Must be eligible to work in the UK Start ASAP Must have: Strong hands-on Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation … Clear handover into BAU CIS/SCI Integration & Post-Migration Stabilisation Data Engineer Key Skills: Must Have: Strong hands-on Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

blend of experience is expected as the business transitions to Microsoft Fabric, with key skills and core technologies including: SQL, Microsoft Fabric, Python/PySpark, Data Factory, etc. Exposure to and working with AI based tools such as Microsoft Copilot will certainly enhance candidate applications. Managerial and leadership experience … forward your most recent CV for consideration. BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/ ...

Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

development projects. The ideal candidate will have a strong background in ETL, data validation, and SQL, coupled with expertise in test automation engineering using PySpark, Python, and Databricks. You will play a critical role in ensuring the delivery of high-quality software solutions, employing AI-assisted testing and validation … maintain test plans and test cases for ETL processes. Conduct thorough data validation and verification using SQL. Develop and execute automated test scripts using PySpark, Python, and Databricks. Integrate AI-assisted testing methodologies to improve testing efficiency and accuracy. Collaborate with cross-functional teams to identify and resolve defects. ...

production Run discovery with senior stakeholders, shape scope, and translate ambiguous strategic problems into technical delivery plans Build data integrations and pipelines using PySpark, Python and SQL, working with complex internal and third-party datasets Design and implement AIP and workflow-driven solutions that put the platform deep into … solutions inside large enterprises Lead-level Palantir (Foundry/AIP) experience strongly preferred, or an equivalent enterprise data platform background Strong hands-on Python, PySpark and SQL. This is a building role, not an advisory one A track record of owning engagements end to end rather than delivering ...

Engineers/data science backgrounds with transaction monitoring background The role combines transaction monitoring domain expertise with technical skills in Data Science, Machine Learning, PySpark programming. Experience in designing and deploying AI/ML products, hands-on and as a manager Develop and maintain AI driven monitoring engines that … Machine Learning models on Transaction Monitoring systems. Significant experience as a Data Scientist for complex financial services environments. Technical skills in AI/ML, PySpark, Data Science and knowledge on banking regulatory compliances and financial crime domain knowledge. ...