276 to 300 of 395 PySpark Jobs

/PnL/Trade lifecycle/Reconciliation• Understanding of financial products such as: Derivatives (swaps, futures, options), bonds**Good-to-Have**• Exposure to **PySpark or large-scale data processing**• Experience working with **quants or pricing models**• Basic scripting (Unix/Bash) #J-18808-Ljbffr ...

Arbuthnot Latham is seeking a Senior Data Engineer to develop and maintain data systems that support the Bank's operations and reporting needs. The role involves ensuring compliance with standards while mentoring junior team members. ...

engineering, product and commercial teams. You Need Expert Python and SQL, with experience building production ML systems and data pipelines (PyTorch, XGBoost, Spark/PySpark, Apache Iceberg, Ray, MLflow, SageMaker, Airflow, or equivalent). Deep experimentation and statistical inference skills, and a strong grasp of optimisation under uncertainty (bandits ...

prestigious UK client. The role centers on designing and building data platforms and guiding the transition to Microsoft Fabric, with SQL, Python/PySpark and Data Factory as core technologies. The position offers a flexible base with the role primarily home-based across the UK, with offices for collaboration ...

analytics teams while applying modern data engineering patterns and strong software fundamentals. This role emphasizes ownership, observability, security, and scalable pipelines using Python, PySpark, #J-18808-Ljbffr ...

pipelines and multimodal models. You will collaborate with Applied Scientists, Data Engineers, PMs and business stakeholders to productionise solutions. Role requires strong Python, PySpark/Databricks experience, hands-on DL with PyTorch or TensorFlow, and a pragmatic, business-focused #J-18808-Ljbffr ...

+ 6.5% bonus Working Model: Primarily remote. Quarterly collaboration days in Haywards Heath or Manchester Tech Stack: Python, SQL, Databricks, PySpark, XGBoost, LightGBM, Statistical Modelling Visa Sponsorship: Available Interested? Please apply below. ...

analytical, detail‐oriented, and creative in problem solving Be self‐motivated, adaptable, and delivery‐focused Demonstrate strong organisational skills Have knowledge of Python, PySpark, and SQL Hold an Aerospace Engineering Degree or equivalent Have experience in Airline Engineering Operations, ideally Part‐CAMO Beneficial skills Be experienced with Palantir Foundry ...

strong organisational skills Hold a STEM degree or equivalent Beneficial skills: Experience with Palantir Foundry or Skywise Experience with any of the following: Python PySpark SQL HTML CSS Understanding of Airline Engineering Operations Join our exciting, forward-thinking team and be part of a dynamic business! At Jet2.com ...

high-performing engineering squad, owning technical challenges and driving best practices across the team. You’ll build scalable pipelines using Azure, Databricks and PySpark, collaborating with Product and Delivery to deliver reliable data platforms and business value. London-based with hybrid working conditions. #J-18808-Ljbffr ...

data validation and debugging, with transition into post go-live data pipeline development and reporting support. The candidate will bring strong Fabric exposure, Synapse, PySpark and SQL skills, plus experience in data pipelines and migrations. Hybrid Edinburgh working is offered. #J-18808-Ljbffr ...

Northampton, UK. This hybrid role involves working 2 days a week in the office. The ideal candidate will have expertise in Bigdata technologies, including PySpark and AWS services, as well as strong communication and problem-solving skills. You will be expected to collaborate effectively within a diverse team while ...

month fixed-term contract with hybrid work (onsite 2 days per week). The role requires strong Snowflake experience, including Snowflake ML, plus PySpark and SQL skills. DBT experience is advantageous as you build and migrate data pipelines for programme use cases from Pre-Prod to Prod. You will ...

Hybrid, 3 days onsite). This 12-month fixed-term contract role focuses on building and supporting modern cloud-based data platforms using AWS, PySpark, and IaC. You will work with Terraform, GitLab CI/CD, and collaborate with engineers to deliver secure, scalable cloud solutions. You’ll join ...

location strategy."I am the person Capital Group is looking for." Proven track record delivering solutions in complex organizations. Experience with AWS, Databricks, DBT, PySpark, React, JavaScript Terraform, etc. Fast learner, thrives in ambiguity, translates vision into product scope. Passion for automation and user experience innovation. Builds high-performing ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

analyst’s SQL at least once in writing, and they’ve shipped the result. What You Bring – Must Have Strong in Python (incl. PySpark) and SQL on a modern cloud lakehouse. Comfortable reading a query plan. Hands-on dbt — you’ve authored models, written tests, and reviewed others’ models … determine your own interest. There will be technical questions, focussed on d Online Programming Test (15-60 minutes). Focussed on PySpark and DBT. No hard algorithms – we just need to know you find easy programming questions easy (without an AI). 2 Part Final Interview (60min/30min ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating legacy … systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

that support critical business operations and analytics capabilities. This role requires deep hands-on expertise in Azure Databricks, Structured Streaming, Delta Live Tables (DLT), PySpark, Python, and SQL, alongside strong stakeholder management and leadership skills. The ideal candidate will have a proven track record of delivering large-scale cloud … platform performance and costs, and mentoring engineering teams to achieve successful business outcomes. Required Skills and Experience: Strong hands-on experience with Azure Databricks, PySpark, Python, and SQL Experience within financial trading, commodities trading, or energy trading environments Understanding of trading data models and trading business processes Experience building ...

using modern data engineering patterns Develop robust orchestration workflows for dependable data ingestion, transformation, quality checks, and downstream consumption Apply strong SQL, Python, and PySpark skills to transform complex data into reliable, reusable, and performant data products SQL, Data Modelling & Analytics Enablement Create well-modelled, trusted datasets that support … analytics foundations Advanced SQL skills with the ability to design performant queries, data models, and transformation logic Hands‐on knowledge of Python and PySpark for large‐scale data processing and automation Curious, hands‐on problem solver who can engage with business stakeholders to understand the real requirement and deliver ...

suit someone with strong analytical skills, a passion for data, and the ability to translate complex information into clear business insights. Experience with Python (PySpark) and/or Databricks would be particularly advantageous. The Business Intelligence Data Engineer will: Design, develop and optimise ETL pipelines and data integrations. Build … informed decision-making. It would be great if you also have: A degree in Computer Science, Engineering or a related discipline. Experience with Python, PySpark, Databricks or modern cloud data platforms. Experience building ETL solutions, APIs and data integrations. Experience with Power BI, Tableau, QlikView or Qlik Sense. Experience ...

using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Role Requirements Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge … data processing Build and maintain the Medallion Architecture silver & gold layer across shared storage Write optimised transformations in Fabric Notebooks and Databricks clusters using PySpark and SQL Configure data access, masking, and governance policies within Databricks Unity Catalog. Optimise Lakehouse table performance using Z-Order indexing, liquid clustering ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to 72,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS business that … Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential Skills & Experience Degree ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to £72,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS business that … Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential Skills & Experience Degree ...

including model registry Unity Catalog and AI Gateway (or equivalent governance tooling) Strong general Databricks knowledge – compute management, logging and monitoring Strong Python and PySpark Excellent consulting skills – communication, people leadership and technical advisory, with the confidence to lead a client's team through a technical journey Desirable Machine ...