201 to 225 of 321 Permanent PySpark Jobs

Senior Data Engineer: Production Pipelines on Fabric & PySpark

Location
City of Edinburgh, Scotland, United Kingdom
CreateFuture is seeking a Senior Data Engineer to lead production data pipelines built on Microsoft Fabric, Python, and PySpark. You will translate data requirements into robust, maintainable solutions while mentoring engineers and shaping architecture with ...

Software Engineer III - Python / AI

Location
Glasgow, Scotland, United Kingdom
continuous integration/continuous delivery, application resiliency, and security Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, Databricks, PySpark, artificial intelligence, machine learning, mobile, etc.) Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding ...

Remote Azure Databricks Data Engineer | PySpark & ETL Lead

Location
United Kingdom
Ceox is recruiting a Data Engineer to design and deliver scalable data pipelines and data models in a modern Azure-based environment. You will collaborate with architects, analysts and engineers to implement data flows aligned ...

Senior ML Data Engineer — Production Pipelines & MLOps

Location
Manchester, England, United Kingdom
production ML systems. You will collaborate with data scientists and ML engineers, mentor junior engineers, and elevate engineering practices. The role emphasises Python, PySpark, and platforms like Databricks, Snowflake, or AWS. You will design and maintain data pipelines, ensure reproducible, point-in-time datasets, and support model versioning ...

Senior ML Data Engineer — Production Pipelines & MLOps

Location
Leeds, England, United Kingdom
production ML systems. You will collaborate with data scientists and ML engineers, mentor junior engineers, and elevate engineering practices. The role emphasises Python, PySpark, and platforms like Databricks, Snowflake, or AWS. You will design and maintain data pipelines, ensure reproducible, point-in-time datasets, and support model versioning ...

Senior ML Data Engineer — Production Pipelines & MLOps

Location
Greater London, England, United Kingdom
production ML systems. You will collaborate with data scientists and ML engineers, mentor junior engineers, and elevate engineering practices. The role emphasises Python, PySpark, and platforms like Databricks, Snowflake, or AWS. You will design and maintain data pipelines, ensure reproducible, point-in-time datasets, and support model versioning ...

Senior ML Data Engineer — Production Pipelines & MLOps

Location
City of Edinburgh, Scotland, United Kingdom
production ML systems. You will collaborate with data scientists and ML engineers, mentor junior engineers, and elevate engineering practices. The role emphasises Python, PySpark, and platforms like Databricks, Snowflake, or AWS. You will design and maintain data pipelines, ensure reproducible, point-in-time datasets, and support model versioning ...

Data Engineer: Build Scalable Pipelines on AWS & Databricks

Location
Swindon, England, United Kingdom
Responsável por colaborar com analistas de negócios, produzir relatórios de conformidade e propor melhorias contínuas na plataforma. Requer experiência com Databricks, IaC, Git, Python (Pyspark) e SQL e vontade de aprender novas tecnologias. #J-18808-Ljbffr ...

Palantir Foundry Engineer

Location
United Kingdom
embedded in the Ontology. - Collaborating with senior engineers on agent design, instructions, and evaluation using AIP's native features. Strong technical skills in Python, PySpark, SQL, and data modelling. Practical experience using or supporting AIP features such as RAG workflows, copilots, or agent-based applications. Ability to work independently ...

Forward Deployed Engineer - Senior Manager (Palantir)

Location
Greater London, England, United Kingdom
ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Lead Client Advisory: Sit directly alongside clients, goals ...

Data Science Consultant

Location
City Of London, England, United Kingdom
Physics, Statistics, or a related quantitative field. Core Technical Stack: Hands-on proficiency with Python, SQL, and Excel, alongside exposure to platforms like Databricks, PySpark, Palantir Foundry, or R. Specialized Experience: Proven track record in delivering advanced analytics, algorithm design, operational research, or big data engineering solutions. Energy & Utilities ...

Client Support Engineer

Location
Greater London, England, United Kingdom
platform environments, ideally supporting production systems and external clients Advanced working knowledge of at least one data/query language (e.g. SQL, Python, or PySpark), with the ability to debug complex issues, analyse data, and build queries/scripts independently Deep experience working with data pipelines, transformations, and diagnosing ...

Senior Applied AI Scientist

Location
Greater London, England, United Kingdom
technical content in commercial terms for non-technical stakeholders, such as customers, sales and product teams Desirable B2B product experience Experience with Spark SQL, PySpark, databricks Experience with CausalAI modelling frameworks (e.g. dowhy, econml) Diversity & Inclusion Intent HQ is an equal opportunities employer with an ethos of commitment ...

Senior Data Engineer: Azure Fabric & Data Platform

Location
United Kingdom
unlock business value. You will collaborate with data scientists, analysts and software engineers, implement governance and security, and contribute to engineering standards. Strong PySpark and SQL skills, plus experience with cloud platforms are essential for success. #J-18808-Ljbffr ...

Senior Data Engineer — Lakehouse & Azure Lead

Location
Manchester, England, United Kingdom
seeking an experienced Data Engineer lead in Manchester to drive the next generation of its data estate. You will mentor junior engineers, deliver scalable PySpark pipelines on Databricks, and collaborate with product owners to shape data roadmaps. The role blends hands-on data engineering with technical leadership, governance practices ...

Senior Data Engineer: AI-Powered Pipelines & Leadership

Location
Greater London, England, United Kingdom
security and governance, and mentor engineers while partnering with product, security and analytics teams. Applicants should have 5+ years of experience with Snowflake, dbt, PySpark and AWS, and proven ability to lead #J-18808-Ljbffr ...

Senior Data Operations Consultant

Location
Alderley Edge, England, United Kingdom
segmentation, digital marketing and CRM platforms. Knowledge of or interest to learn SQL, ETL processes and the data journey across multiple platforms. Knowledge of PySpark and the Databricks environment would be advantageous but not essential. If you think you would be a great fit for our team at Royal ...

CDI Data Engineer

Hiring Organisation
Michael Page Technology
Location
Ascot, Berkshire, United Kingdom
Employment Type
Full-Time
Salary
£400.00 - £500.00 per day
integration and multi-market SCI knowledge desirable. Role 2: BNA Production-Readiness, MLOps & Integration Engineer Must Have: Strong hands-on background in Databricks, PySpark, Python and SQL Production pipeline engineering and troubleshooting Workflow orchestration and dependency management Idempotency, retry/restart and failure-recovery patterns CI/CD, version … platforms Role 3: CIS/SCI Integration & Post-Migration Stabilisation Engineer Must Have worked with: Strong hands-on background with Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation ...

Data Lineage & Governance Analyst

Location
Greater London, England, United Kingdom
/ELT patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards, and control evidence packs. Technical … Skills Strong proficiency in Python (data analysis/automation for metadata extraction, validation scripts, rule checks). Hands‐on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases is preferred. Working knowledge of Autosys ...

Senior Data Engineer – Remote

Location
Guildford, England, United Kingdom
Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...

Senior Data Engineer – Remote

Location
Royal Leamington Spa, England, United Kingdom
Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...

Senior Data Engineer

Hiring Organisation
Jacobs
Location
Manchester, Lancashire, United Kingdom
Employment Type
Permanent
Salary
GBP Annual
query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

Data Engineering Lead

Location
Manchester, England, United Kingdom
insight, advanced analytics and AI/ML at enterprise scale.* Develop and optimise batch and streaming ETL/ELT pipelines using Azure Data Factory, PySpark, SQL, Apache Spark and Airflow, integrated with modern tooling like dbt and Git-based CI/CD.* Implement data cataloguing, lineage tracking and governance … engineering, including designing and delivering data lake or lakehouse architectures in an enterprise cloud environment, ideally Microsoft Azure.* Hands-on expertise with Databricks, Spark, PySpark, SQL and core Azure Data Services (Data Lake Storage, Synapse Analytics, Data Factory).* Experience with data governance and cataloguing tools such as Collibra ...

Consultant Data & AI Architect IRC303856

Location
Manchester, England, United Kingdom
Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

Consultant Data & AI Architect IRC303856

Location
City of Edinburgh, Scotland, United Kingdom
Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...