26 to 50 of 74 PySpark Jobs in the UK excluding London

someone who combines strong engineering capability with a solid understanding of the cyber domain. Key skills required: Strong Python development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security ...

practices You have experience with Databricks, ideally also Azure You have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You're excited to join a start-up in a role that you can shape and influence You're collaborative with excellent ...

ideally in a multi-site business environment Strong proficiency in Python and SQL, with hands-on experience in Spark/PySpark and modern table formats (e.g. Delta Lake, Iceberg, Hudi) Expertise in AWS data services (e.g. S3, Glue, Redshift, Lambda, Step Functions, Kinesis) and infrastructure-as-code (Terraform ...

Required Skills & Experience Proven experience in MLOps or DevOps roles within machine learning environments. Strong programming skills in Python, with hands‐on experience in PySpark and SQL. Deep understanding of ML lifecycle management and CI/CD best practices. Familiarity with cloud‐native ML platforms and scalable deployment strategies. ...

Engineer with a strong modelling focus Hands-on Databricks experience - certifications are a plus Solid understanding of Medallion/multi-hop architecture Proficiency in PySpark, Spark SQL, and Delta Lake Experience with Azure (ADF, Synapse, or similar) or AWS data services Strong communication skills - you'll be working closely ...

within NHS England, UK Health Security Agency, Department of Health and Social Care, or another central government data environment (Essential) Solid experience with Python, PySpark, Power BI, and AWS Strong communication skills - able to engage confidently with both technical peers and non-technical clinical or operational stakeholders Available ...

making Your Skills and Experience Strong commercial experience as a data engineer in modern, cloud based environments Advanced Python and SQL, with experience using PySpark or similar distributed processing frameworks Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS Hands on experience ...

learning tools such as Spark, Power BI. Experience with optimisation, simulation and data analysis tools such as Matlab Simulink (e.g. optimisation and ML toolboxes), PySpark and Jupyter notebooks. Work on projects on areas such as agentic AI, MCP, RAG, generative AI, trust and security, driving innovations from concept through ...

making Your Skills and Experience Strong commercial experience as a data engineer in modern, cloud based environments Advanced Python and SQL, with experience using PySpark or similar distributed processing frameworks Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS Hands on experience ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

TensorFlow Serving, TorchServe).* Familiarity with ML lifecycle tools such as MLflow, Kubeflow, or Azure ML Pipelines.* Experience working with distributed data processing (e.g., PySpark) and SQL.* Understanding of software engineering best practices, including version control (Git).* Knowledge of CI/CD principles in ML environments.* Experience with ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

leading Professional Services firm is looking to hire a Finance Data Engineering & Analytics Lead to join their team. You will develop Python/PySpark-based data pipelines, build data models and datasets for finance, actuarial and risk reporting. You will also develop analytics, dashboards and data validation tooling. ...

Data Engineer; Python, PySpark - Salford, Onsite. Be part of a retail phenomenon! This is a brand new role at a company experiencing huge growth, offering a lot of autonomy and the opportunity to grow as the company grows. My client is seeking an experienced Data Engineer to join ...

data platforms and cloud environments Collaborate with engineering and architecture teams to deliver high-quality solutions Key Skills & Experience Strong experience with Python and PySpark Hands-on expertise in AWS Experience working with Databricks Ideally 5+ years working with this tech stack as a data engineer Proven background delivering ...

understanding of DAG (Directed Acyclic Graphs) and their role in pipeline orchestration It would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic ...

genomic data. You have A BSc or MSc in computer science or related fields Expertise in Python, including popular Python libraries: NumPy, Pandas, PySpark and frameworks: Django, Django Rest Framework, FastAPI Hands-on experience with both relational (e.g. PostgreSQL) and non-relational databases (e.g. Elasticsearch, Redis) Extensive experience ...

commercial or Agile environment.To be successful in this role it’s essential that you will: Have significant experience of AWS , Python, SQL, Git and PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation ...

machine learning operations. Excellent communication skills with the ability to influence cross‐functional teams and stakeholders. Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferred. Well‐versed in design thinking principles. Great problem solving and analytical skills. #LI‐GM1 The total cash range for this ...

Snowflake optimised query design and features such as materialized views Knowledge of snowpark, or transferable knowledge from other dataframe based frameworks such as PySpark Experience implementing batch data ingestion pipelines using technologies such as Azure Data Factory, Openflow or similar Experience delivering data solutions on Snowflake hosted in Microsoft ...

Snowflake‐optimised query design and features such as materialized views Knowledge of snowpark, or transferable knowledge from other dataframe‐based frameworks such as PySpark Experience implementing batch data ingestion pipelines using technologies such as Azure Data Factory, Openflow or similar Experience delivering data solutions on Snowflake hosted in Microsoft ...

data pipelines within Azure Databricks and Azure Lakehouse environments. Work within established medallion architecture patterns. Develop data flows using Azure Data Factory , Python/PySpark, SQL, and Azure data services. Support data modelling, data integration, and data product development. Implement data quality, validation, lineage, and integrity controls. Work with … Strong hands-on experience with Azure Databricks . Experience with lakehouse platforms and medallion architecture. Strong Azure Data Factory, Azure Data Lake, Python/PySpark, SQL, MS SQL/Azure SQL experience. Good understanding of data modelling, ETL/ELT, data quality, governance, and lineage. Experience working in financial ...