151 to 175 of 201 PySpark Jobs in England

salary of up to £120,000. The successful candidate will engage with clients, focusing on architecture and data solutions while leveraging expertise in Spark, PySpark, and Delta Lake. You'll lead workshops, translate complex requirements, and contribute to modernizing enterprise data platforms. #J-18808-Ljbffr ...

requirements into technical solutions and actionable data initiatives Provide hands-on technical leadership across a Microsoft data stack, leveraging tools such as Databricks and PySpark Oversee end-to-end delivery of data solutions, ensuring designs are effectively implemented by engineering teams If this role sounds of interest ...

maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources Translate stakeholder requirements into scalable technical solutions Mentor team members and establish engineering standards, security, and governance … assisted development tools like GitHub Copilot, ChatGPT, and Fabric CopilotEssential Experience: Microsoft Fabric is essential Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stackIf you're an experienced Data Engineer with s... ...

maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources Translate stakeholder requirements into scalable technical solutions Mentor team members and establish engineering standards, security, and governance … assisted development tools like GitHub Copilot, ChatGPT, and Fabric Copilot Essential Experience: Microsoft Fabric is essential Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stack If you're an experienced Data Engineer with strong Microsoft Fabric and Azure experience, this ...

join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark , who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate … data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

dashboard content Identify and mitigate data quality risks and ensure data integrity Design, build, and maintain reusable data pipelines and datasets using Python and PySpark Develop and test datasets used in BI dashboards and reporting products Work with stakeholders to translate business needs into data solutions and insights Collaborate … DevSecOps Engage in pair programming and adhere to collaborative coding standards Essential Skills & Experience Strong hands-on experience with Python and PySpark Solid background in exploratory data analysis and data modelling Experience with Palantir platforms, ideally including the NHS Federated Data Platform (FDP) Proficiency with BI and data platforms ...

Lakes*** Experience with **Apache Airflow/MWAA** for workflow orchestration* Strong knowledge of **dbt (data build tool)** for data transformation* Experience with **EMR/PySpark** for large-scale data processing* Ability to create **Architecture Design Documents (ADDs)*** Deep understanding of **cloud-native design patterns*** Experience in **performance tuning** across ...

Job Title: Technical Delivery Lead - Data Engineering Lead (Hands-on Python/Databricks) Contract: 6 months - Potentially extension. Location: London Hybrid (5 days in 10 in the office) Rate: Highly competitive Status: Inside IR35 Working ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

Skills You’ll need to have experience with some of the following and be able to learn new technologies or concepts quickly: Python/PySpark - Experience using Python and PySpark to connect to APIs and extract data, with strong API design skills and familiarity with LLM orchestration frameworks ...

finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with data pipelines written in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs. This … meaningful collaboration in either Leeds or Thame. Key Responsibilities Ensure end-to-end data quality, from raw ingested data to business-ready datasets Optimise PySpark-based data transformation logic for performance and reliability Build scalable and maintainable pipelines in Databricks and Airflow Implement and uphold GDPR-compliant processes around ...