276 to 300 of 321 Permanent PySpark Jobs

Senior Data Engineer - Analytics Engineering - Databricks - Pyspark - Dimensional Models - Perm We're looking for a Senior Analytics Engineer to lead the design and delivery of curated, analytics-ready data within our Lakehouse environment. You'll translate complex business requirements into robust SQL and PySpark pipelines, own the data … deliver dimensional and semantic data models for analytics. Define and maintain KPIs, conformed dimensions and consistent data definitions. Develop and optimise SQL and PySpark pipelines using Databricks. Ensure high standards of data quality, testing, performance and observability. Lead modelling reviews and contribute to technical and architectural decisions. Work closely ...

deploying machine learning models in production, alongside strong hands‐on Python skills. You should be comfortable with distributed computing tools such as Spark or PySpark, cloud platforms and modern MLOps practices. Experience managing and developing data scientists is essential, as is the ability to explain technical decisions and work ...

deploying machine learning models in production, alongside strong hands-on Python skills. You should be comfortable with distributed computing tools such as Spark or PySpark, cloud platforms and modern MLOps practices. Experience managing and developing data scientists is essential, as is the ability to explain technical decisions and work ...

onsite capacity in Sheffield. You will focus on robust data pipelines and back-end data plumbing. You will work with Databricks and PySpark to ingest, transform and structure raw data into high-quality Delta tables for enterprise use, delivering scalable data infrastructure to support business decisions. Candidates must ...

Engineer to build and scale modern data platforms, focusing on robust data pipelines and Back End data plumbing. You'll work with Databricks and PySpark to ingest, transform, and structure raw data into high-quality Delta tables for enterprise use. We endeavour to process your personal data ...

support production-grade ETL/ELT pipelines that source, transform and curate data for Internal Audit. Develop maintainable Python solutions using Pandas, Polars and PySpark, selecting fit-for-purpose approaches based on scale, performance and operational needs. Write advanced SQL for data transformation, reconciliation, profiling and analysis across OLTP … computer science, engineering or a related quantitative discipline. A master’s degree is welcome. Hands-on proficiency in Python, including Pandas, Polars and PySpark, with experience writing testable and maintainable code. Strong SQL proficiency and practical understanding of OLTP databases, relational design and query performance. Strong understanding of data ...

ingest, analyse and visualise data, produce robust outputs, and collaborate across teams to meet Ofcom’s objectives. A quantitative degree and strong Python/PySpark skills are essential. #J-18808-Ljbffr ...

Data Science team. The Data Scientist will have strong hands-on experience writing technical code in python and have strong knowledge within PySpark optimisation. The ideal Data Scientist will be able to manage teams of Data Scientists and will be able to work closely with engineers and software developers. ...

engineering, or a related field Experience analysing gambling marketing activities The ability to write clear, well-structured code Hands‐on experience with Python, SQL, PySpark, or similar tools A flair for problem‐solving and storytelling with data — and the confidence to present findings to clients Sound like ...

facing team in London. You will mentor data scientists, oversee complex data products, and ensure analytical excellence. The ideal candidate has strong SQL and PySpark experience, excellent communication skills, and a Bachelor’s degree in a related field. This position offers a collaborative environment, competitive benefits, and a chance ...

maintain production-quality Python and SQL code.* Use Git-based source control and branch management practices across multiple deployment environments.* Work with Spark and PySpark to process and analyse large-scale datasets.* Develop and manage machine learning workflows within an MLOps environment.* Use tooling such as MLflow, VS Code … model validation.* Practical experience with Git, Agile delivery and collaborative software-development workflows.* Experience using distributed data-processing and MLOps tools such as Spark, PySpark, MLflow, JupyterHub or equivalent technologies.* Understanding of data-product lifecycles, data quality, governance, reproducibility and auditable insightful workflows.* Ability to translate operational or business ...

maintain production-quality Python and SQL code. Use Git-based source control and branch management practices across multiple deployment environments. Work with Spark and PySpark to process and analyse large-scale datasets. Develop and manage machine learning workflows within an MLOps environment. Use tooling such as MLflow, VS Code … model validation. Practical experience with Git, Agile delivery and collaborative software-development workflows. Experience using distributed data-processing and MLOps tools such as Spark, PySpark, MLflow, JupyterHub or equivalent technologies. Understanding of data-product lifecycles, data quality, governance, reproducibility and auditable insightful workflows. Ability to translate operational or business ...

improving data pipelines. Working with Databricks to improve the existing data platform. Getting hands-on with data transformation and modelling. Using Python, SQL and PySpark to deliver data solutions. Supporting the migration from QuickSight to Power BI. Working closely with teams across Finance, Pricing, Regulatory and Compliance. Helping … small team where everyone gets involved and priorities can change. Insurance experience would be useful, as would any Power BI, AWS and PySpark experience. What's on offer? £80,000–£85,000 salary. Generous bonus scheme 25 days' holiday, increasing to 30 with length of service. Hybrid working, with ...

data exploration skills Experience of working in Agile methodology Good knowledge and hands-on experience of developing Stored Procedures Experience of working with PySpark Notebooks for data ingestion and provision Practical experience of improving data quality and efficiency in data pipelines Solid understanding of DevOps and CI/… Understanding of compliance and lifecycle of data management Desirable Skills: Coding experience in any relevant language (Python, Pyspark etc.) Experience working with other Azure technologies such as Fabric, Power Automate Experience of working with non-relational databases (CosmosDB, MongoDB, etc.) and handling unstructured data in ETL pipelines Our values ...

develop, and maintain cloud‐native data solutions that ensure data is accurate, accessible, and trusted. Designing and developing scalable data pipelines using Python and PySpark Building and optimising data workflows using AWS Glue, Athena, Redshift , and related AWS services Supporting modern lakehouse architectures, including Apache Iceberg Working with relational … solutions. Essential experience Experience as a Data Engineer, ETL Developer, Data Platform Engineer, or a similar role Strong hands‐on experience with Python and PySpark Experience with AWS Glue, Amazon Athena, Amazon Redshift , and cloud‐based data platforms Strong SQL skills and experience working with both relational and NoSQL ...

maintainable solutions. What you'll be doing: Take ownership of designing, building, and maintaining scalable, production-ready data pipelines using Microsoft Fabric, Python, and PySpark, with minimal supervision Make sound technical decisions on pipeline architecture, data modelling, and tooling, weighing up trade-offs in performance, cost, and maintainability Mentor … domain-driven modelling) - this is the load‐bearing, provider‐agnostic skill underneath almost all of our pipeline work Have strong proficiency in Python and PySpark for batch data processing, with a track record of writing production‐grade, well‐tested code (this role is focused on batch/ELT pipeline ...

Senior Data Engineer – Contract £600 per day | Outside IR35 | Fully Remote | 2-Month Contract | Start: 1st November We are looking for a highly experienced Senior Data Engineer to support a critical data platform migration project ...

Databricks Model Serving, monitoring compute resource allocation and cold-start latency. Large-Scale Data & Feature Engineering: Design and implement scalable data transformation workflows using PySpark and maintain reusable features using the Databricks Feature Store. Governance & Security: Enforce end-to-end data and model lineage, role-based access control (RBAC … Advanced proficiency in Python (OOP, typing, design patterns, testing frameworks) and advanced analytical SQL. Distributed Computing - Deep hands-on knowledge of Apache Spark/PySpark, including distributed query optimization, partition tuning, memory management, and debugging skewed datasets. ML & MLOps - Strong experience with MLflow (Tracking, Model Registry, Projects), plus standard ...

helping to raise the bar on engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines … that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling ...

helping to raise the bar on engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines … that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling ...

helping to raise the bar on engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines … that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling ...

helping to raise the bar on engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines … that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling ...

influence delivery standards and contribute to reusable frameworks and accelerators. What You’ll Be Doing Building production-grade data pipelines with Databricks, PySpark and SQL Developing Lakehouse architectures using Delta Lake, Unity Catalog and medallion frameworks Gathering requirements and providing technical guidance to client teams Embedding CI/… team Modernising legacy data platforms to unlock more value from client data estates What You’ll Bring Commercial Databricks delivery experience Strong hands-on PySpark and SQL Solid grounding in data engineering, data modelling and Lakehouse architecture Experience on Azure and/or AWS Source control, CI/ ...

week. Inside IR35 via umbrella. Start – asap. Must be eligible to work in the UK. Must Have Skills Strong hands-on Databricks, PySpark, Python and SQL Production pipeline engineering and troubleshooting Workflow orchestration and dependency management Idempotency, retry/restart and failure-recovery patterns CI/… manual intervention Stable QA production deployment process Runbooks and operational handover Reduced runtime and production failures Key Skills Must Have: Strong hands-on Databricks, PySpark, Python and SQL Production pipeline engineering and troubleshooting Workflow orchestration and dependency management Idempotency, retry/restart and failure-recovery patterns CI/ ...

JOB ID: FEQ427R333 Location: The customer is based in Leeds or Manchester, United Kingdom Industry: Enterprise Retail or CPG (UKI Enterprise) - The customer is based in Leeds. You will be visiting the client or based ...