76 to 100 of 141 PySpark Jobs in the UK

commercial or Agile environment.To be successful in this role it’s essential that you will: Have significant experience of AWS, Python, SQL, Gitand PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation About ...

commercial or Agile environment.To be successful in this role it’s essential that you will: Have significant experience of AWS , Python, SQL, Git and PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation ...

ongoing basis. Contribute to the planning, research, recommendation, and implementation of current and future IT strategies. PERSON SPECIFICATION: Essential Demonstrable experience of Spark (PySpark) and SQL. Demonstrable experience of Fabric components. Demonstrable experience of working on enterprise environments. Experience of designing architectural Fabric processes. Experience of Azure Data Factory. ...

machine learning operations. Excellent communication skills with the ability to influence cross‐functional teams and stakeholders. Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferred. Well‐versed in design thinking principles. Great problem solving and analytical skills. #LI‐GM1 The total cash range for this ...

workflow orchestration, and machine learning operations.Excellent communication skills with the ability to influence cross-functional teams and stakeholders.Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferredWell-versed in design thinking principlesGreat problem solving and analytical skills#LI-GM1The total cash range for this position in Seattle ...

Snowflake‐optimised query design and features such as materialized views Knowledge of snowpark, or transferable knowledge from other dataframe‐based frameworks such as PySpark Experience implementing batch data ingestion pipelines using technologies such as Azure Data Factory, Openflow or similar Experience delivering data solutions on Snowflake hosted in Microsoft ...

outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

complex technical architectures. Essential Skills Clearance: Active UK Government Security Check (SC). GenAI: Expertise in LLMs and RAG architectures. Python: Strong proficiency alongside PySpark for data engineering. Azure: Deep familiarity with native tools (AI Search, Document Intelligence). MLOps: Understanding of LLMOps frameworks for production deployment. 6 Months ...

complex technical architectures. Essential Skills Clearance: Active UK Government Security Check (SC). GenAI: Expertise in LLMs and RAG architectures. Python: Strong proficiency alongside PySpark for data engineering. Azure: Deep familiarity with native tools (AI Search, Document Intelligence). MLOps: Understanding of LLMOps frameworks for production deployment. 6 Months ...

impact. Key Responsibilities Design and deliver end-to-end technical solutions across complex data environments Build and maintain applications using technologies such as Python, PySpark, TypeScript, and React Develop AI-driven workflows and operational tooling Work directly with client stakeholders in fast-paced delivery environments Present demos, gather feedback ...

team What We're Looking For Proven experience in Data Analytics or a similar role Strong SQL skills and experience with Python/PySpark Experience with data visualisation tools (e.g. Tableau, Power BI) Hands-on experience with A/B testing and experimentation Familiarity with customer analytics tools (e.g. ...

strong background in the ML lifecycle, including expertise in NLP, time-series analysis, and predictive modelli ng.Technical Sta ck: Proficiency in Python, R, or PySpark is mandato ry.Cloud & Data Platfor ms: Architectural knowledge of one or more major platforms, such as AWS, Azure, Google Cloud Platform (GCP), or Databric ...

tools such as Grafana, Dynatrace, Prometheus, Datadog, and Splunk. Strong understanding of SLI/SLO/SLA and Error Budgets. Proficient in Python or PySpark for AI/ML modeling. Able to reduce toil by building automation tools for repeated tasks. Hands‐on experience in system design, resiliency, testing ...

similarly complex digital platforms Our technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More ...

Data Engineers. What You Bring: Extensive hands-on experience with Databricks and Synapse. Strong proficiency in Azure DevOps. Solid knowledge of SQL and PySpark within a Databricks environment. Experience using Databricks in a federated cloud setting. Proven leadership experience with small engineering teams. Skills in configuration management and documentation. ...

considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines and lakehouse solutions … time. Your Role: Design, develop, and maintain scalable data pipelines using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such ...

datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planningProvide hands-on data engineering expertise, building and optimising PySpark pipelinesEnsure data is secure, high-quality, accessible, and structured for maximum business valueDrive best practice in data governance, cataloguing, lineage, and standards across … operations, analytics, and reporting teamsEnsure compliance with data protection regulations and internal policiesWhat you'll bring Strong hands-on experience in data engineering, including PySpark and production data pipelinesExperience with Microsoft Fabric, Azure Synapse, or similar platforms (e.g. Databricks, AWS)Proven ability to design and manage scalable data pipelines ...

migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise, building and optimising PySpark pipelines Ensure data is secure, high-quality, accessible, and structured for maximum business value Drive best practice in data governance, cataloguing, lineage, and standards … reporting teams Ensure compliance with data protection regulations and internal policies What you'll bring Strong hands-on experience in data engineering, including PySpark and production data pipelines Experience with Microsoft Fabric, Azure Synapse, or similar platforms (e.g. Databricks, AWS) Proven ability to design and manage scalable data pipelines ...

connectivity issues across AWS, Databricks and downstream integrations. Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions. ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

tools such as Grafana, Dynatrace, Prometheus, Datadog, and Splunk Strong understanding of SLI/SLO/SLA and Error Budgets Proficient in Python or PySpark for AI/ML modeling Able to reduce toil by building automation tools for repeated tasks Hands‐on experience in system design, resiliency, testing ...

TensorFlow Serving, TorchServe, ONNX, and TensorRT. Build and manage ML pipelines using MLflow, Kubeflow, and Azure ML Pipelines. Work with large‐scale data using PySpark and integrate models into production environments. Monitor model performance and retrain as needed to ensure accuracy and efficiency. Collaborate with cross‐functional teams ...

reporting platforms such as Tableau Desirable Experience Machine Learning and predictive modelling experience Experience working with large datasets and big data technologies such as PySpark or Hive Familiarity with version control systems such as Git Understanding of MLOps principles and model deployment practices Exposure to containerisation technologies such ...

individual ownership of client problems, handling everything from deep data engineering that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos – to building user‐facing front‐end applications and widgets in TypeScript or React Client Advisory & Translation: Sit directly alongside clients, distinguish their ...