226 to 250 of 344 PySpark Jobs

Senior Data Operations Consultant

Location
Alderley Edge, England, United Kingdom
segmentation, digital marketing and CRM platforms. Knowledge of or interest to learn SQL, ETL processes and the data journey across multiple platforms. Knowledge of PySpark and the Databricks environment would be advantageous but not essential. If you think you would be a great fit for our team at Royal ...

CDI Data Engineer

Hiring Organisation
Michael Page Technology
Location
Ascot, Berkshire, United Kingdom
Employment Type
Full-Time
Salary
£400.00 - £500.00 per day
integration and multi-market SCI knowledge desirable. Role 2: BNA Production-Readiness, MLOps & Integration Engineer Must Have: Strong hands-on background in Databricks, PySpark, Python and SQL Production pipeline engineering and troubleshooting Workflow orchestration and dependency management Idempotency, retry/restart and failure-recovery patterns CI/CD, version … platforms Role 3: CIS/SCI Integration & Post-Migration Stabilisation Engineer Must Have worked with: Strong hands-on background with Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation ...

Data Lineage & Governance Analyst

Location
Greater London, England, United Kingdom
/ELT patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards, and control evidence packs. Technical … Skills Strong proficiency in Python (data analysis/automation for metadata extraction, validation scripts, rule checks). Hands‐on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases is preferred. Working knowledge of Autosys ...

Senior Data Engineer – Remote

Location
Guildford, England, United Kingdom
Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...

Senior Data Engineer – Remote

Location
Royal Leamington Spa, England, United Kingdom
Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...

Senior Data Engineer

Hiring Organisation
Jacobs
Location
Manchester, Lancashire, United Kingdom
Employment Type
Permanent
Salary
GBP Annual
query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

Data Engineering Lead

Location
Manchester, England, United Kingdom
insight, advanced analytics and AI/ML at enterprise scale.* Develop and optimise batch and streaming ETL/ELT pipelines using Azure Data Factory, PySpark, SQL, Apache Spark and Airflow, integrated with modern tooling like dbt and Git-based CI/CD.* Implement data cataloguing, lineage tracking and governance … engineering, including designing and delivering data lake or lakehouse architectures in an enterprise cloud environment, ideally Microsoft Azure.* Hands-on expertise with Databricks, Spark, PySpark, SQL and core Azure Data Services (Data Lake Storage, Synapse Analytics, Data Factory).* Experience with data governance and cataloguing tools such as Collibra ...

Consultant Data & AI Architect IRC303856

Location
Manchester, England, United Kingdom
Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

Consultant Data & AI Architect IRC303856

Location
City of Edinburgh, Scotland, United Kingdom
Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

Consultant Data & AI Architect IRC303856

Location
Greater London, England, United Kingdom
Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

Python Developer - Inside IR35 - Up to £700 per day - Hybrid

Hiring Organisation
Hunter Bond
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
GBP Daily
Capital Markets background Experience across Market Risk, CCR, PnL, Trade Lifecycle and Reconciliations Knowledge of derivatives, swaps, futures, options and fixed-income products Desirable PySpark or distributed data processing Exposure to quantitative models and pricing systems Global banking environment experience 9-15 years' relevant experience Please note: Candidates without ...

Cloud Data Engineer: Spark, Airflow & AWS | Hybrid UK

Location
Newcastle upon Tyne, England, United Kingdom
Data Engineer in the United Kingdom to design, build, and maintain data pipelines on a modern AWS-native stack. You will use Spark/PySpark for distributed processing, Airflow for orchestration, and Terraform for infrastructure as code in a hybrid work arrangement with weekly travel to Newcastle office. ...

Full Stack Developer

Location
Cambridgeshire and Peterborough, England, United Kingdom
supporting the Intelligence Community or Department of Defense environments Experience with Python and working with databases Experience with big data frameworks such as Spark, PySpark, or Elastic Search Experience with data visualization platforms such as Kibana, Foundry Workshop, or Palantir Knowledge of secure coding practices and development in classified ...

Senior Data Engineer: Synapse to Databricks (Remote)

Location
England, United Kingdom
Pool codebase to Databricks, delivering parity or improved performance and ensuring data accuracy. You will refactor ~72 T-SQL procedures, optimise Spark/PySpark queries and validate datasets for downstream consumption, addressing architecture differences between Synapse and Databricks. #J-18808-Ljbffr ...

MLOps & Data Integration Engineer (Remote)

Location
England, United Kingdom
will work on production-grade pipelines, ensure idempotent processing, monitor systems, and implement automated deployment and handover practices. This role requires strong Databricks, PySpark, Python and SQL skills in a production environment. #J-18808-Ljbffr ...

Remote Data Engineer: Cloud Pipelines & Lakehouse

Location
Redditch, England, United Kingdom
team on an 18-month fixed-term contract. You will design, build, and maintain cloud-native data solutions, pipelines, and lakehouse components using Python, PySpark, and AWS services. The role is primarily remote with a monthly requirement to visit the Redditch office. Strong SQL, Linux, and version control experience ...

Data Scientist: ML-Driven Personalisation & Pricing (Hybrid)

Location
West Midlands, England, United Kingdom
seeking a Data Scientist to shape data-driven decisions across customer experience, pricing and operations. You will build and deploy ML models using Python, PySpark, SQL and Azure Databricks, profile large datasets and translate insights into actions for stakeholders. You will collaborate with data engineers and ML engineers ...

Remote Lead Data Scientist, Customer Loyalty & Transactions

Location
United Kingdom
/RFM segmentation, and value estimates, delivering production-ready insights and dashboards. The ideal candidate has strong SQL/Python, experience with Databricks/PySpark, data governance, and familiarity with Delta #J-18808-Ljbffr ...

Remote Data Engineer: Azure Data Platform & Big Data

Location
West of England, England, United Kingdom
balance of on-site and hybrid working arrangements. Ideal candidates have hands-on experience with Azure data services, strong SQL and Python/PySpark skills, and a passion for engineering best practices, governance, and performance tuning. #J-18808-Ljbffr ...

SC Cleared Data Engineer

Hiring Organisation
Fuel Recruitment Limited
Location
Farnborough, Hampshire, United Kingdom
Employment Type
Contract
Contract Rate
£550 - £600/day outside IR35
deliver high-quality data products and insights. We are looking for people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. ...

Managing Consultant Data Science

Location
Greater London, England, United Kingdom
developed and sold analytical propositions Degree, MSc or PhD in data science, mathematics, OR, physics or statistics Hands-on credibility with Python, SQL, Databricks, PySpark, Palantir Foundry or R Security: British Citizenship or 5+ years' continuous UK residency required. The package: technical career progression, training budget, hybrid working, pension ...

Forward Deployed Engineer - Associate Manager (Palantir)

Location
Greater London, England, United Kingdom
ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

Forward Deployed Engineer - Specialist (Palantir)

Location
Greater London, England, United Kingdom
ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

Forward Deployed Engineer - Specialist (Palantir)

Location
City Of London, England, United Kingdom
ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

Data Scientist - Forecasting

Location
Greater London, England, United Kingdom
e.g. Mathematics, Statistics, Computer Science). Nice to Have: Familiarity with production environments, MLOps, or data pipelines. Experience working with large-scale data using PySpark or equivalent distributed data processing tools. Experience in gaming, e-commerce, or subscription-based products. Benefits: Discretionary bonus opportunity Private Medical Insurance Dental Scheme ...