226 to 250 of 334 PySpark Jobs in the UK

operational decisions. Join a flexible, collaborative team moving toward a new UK-based Support Centre in St Albans. You’ll work with Python, PySpark, SQL, Azure and Databricks in a modern data environment, communicating clearly with both technical and non-technical colleagues to drive value. #J-18808-Ljbffr ...

measurable outcomes. You will work with Fortune 500s and fast-growth clients, delivering end-to-end data integration, analytics dashboards, and tailored solutions using PySpark, Python, SQL and modern tooling. #J-18808-Ljbffr ...

analytics in enterprise environments. Demonstrated experience extracting meaningful signals from high-volume, high-noise telemetry or behavioural datasets. Proficiency in Python (pandas, scikit-learn, PySpark) and statistical modelling. Experience building structured, repeatable analytical frameworks — use case scoring, feasibility assessments, or prioritisation models — not purely ad hoc analysis. Background ...

performance optimisation. Hands-on delivery experience within hospitality reporting and commercial reporting environments. Experience working with Databricks is useful. Ability to interpret Python/PySpark is beneficial. If you are interested in this Power BI Developer role please apply with your most recent CV or reach out on jordan ...

unsupervised techniques Experience with tree-based and boosting algorithms such as XGBoost, LightGBM, and related approaches Experience working with large-scale datasets, ideally using PySpark Strong analytical and SQL skills for handling, querying, and interpreting complex datasets Ability to communicate insights effectively through visualisations using tools such as Matplotlib ...

teamWhat could set you apartExperience in the use of credit bureau dataExperience using Google Cloud Platform and/or Google Cloud Engineer qualificationsExperience of PySpark, BigQuery, Git and any/all of: DataFlow, DataProc, Airflow (or equivalents)We believe great things happen when teams connect. Our schedule is built ...

teamWhat could set you apartExperience in the use of credit bureau dataExperience using Google Cloud Platform and/or Google Cloud Engineer qualificationsExperience of PySpark, BigQuery, Git and any/all of: DataFlow, DataProc, Airflow (or equivalents)We believe great things happen when teams connect. Our schedule is built ...

closely with SMEs and the Data Architect to shape our data management strategy and meet business needs. Ideal candidates bring deep experience with Databricks, PySpark, Azure ecosystems, and ELT pipeline development, with an emphasis on data modelling and effective collaboration across IT and business teams. #J-18808-Ljbffr ...

standards, architect scalable ETL/ELT frameworks, and provide technical leadership across large transformation programmes. The role requires deep expertise in ADF, Azure Databricks, PySpark, SQL, XML and governance, with strong stakeholder engagement and delivery oversight. #J-18808-Ljbffr ...

IR35 . Rate: £650 - £750 Location: Hybrid – 2/3 days per week on-site Contract: 6 months | Outside IR35 Key Skills: Data Lakehouse PySpark DBT Iceberg AWS Strong data engineering and pipeline development experience You’ll be responsible for designing, building and optimising scalable data pipelines and lakehouse ...

hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets … data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable ...

/ELT patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards, and control evidence packs. Technical … Skills Strong proficiency in Python (data analysis/automation for metadata extraction, validation scripts, rule checks). Hands‐on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases is preferred. Working knowledge of Autosys ...

including architecture, development, deployment, and optimization. Define Databricks workspace architecture, clusterstrategies, security models, and operational standards. Design and developscalable data pipelinesusing Databricks, Apache Spark, PySpark, SQL, andDelta Lake . Implement data ingestionframeworks supporting batchand real-timedata processing. Design Delta Lake architectures including: Delta tables Medallion architecture (Bronze/Silver … reviews. Skills & Experience Strong experience in dataengineering, big data, or solution architecture. Strong hands-onexperience with Databricks Platform . Expert knowledge of: Apache Spark PySpark/Scala Delta Lake SQL Data Lakehouse architecture ETL/ELT development Experience designing anddelivering enterprise Databrickssolutions. Strong experience withcloud platforms: Azure Databricks (preferred ...

designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business … years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. If you're a detail-oriented problem solver with excellent analytical skills ...

Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

suit someone with strong analytical skills, a passion for data, and the ability to translate complex information into clear business insights. Experience with Python (PySpark) and/or Databricks would be particularly advantageous. The Business Intelligence Data Engineer will: Design, develop and optimise ETL pipelines and data integrations. Build … informed decision-making. It would be great if you also have: A degree in Computer Science, Engineering or a related discipline. Experience with Python, PySpark, Databricks or modern cloud data platforms. Experience building ETL solutions, APIs and data integrations. Experience with Power BI, Tableau, QlikView or Qlik Sense. Experience ...

using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Job Requirements Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge … data processing Build and maintain the Medallion Architecture silver & gold layer across shared storage Write optimized transformations in Fabric Notebooks and Databricks clusters using PySpark and SQL Configure data access, masking, and governance policies within Databricks Unity Catalog Optimize Lakehouse table performance using Z-Order indexing, liquid clustering ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to £80,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS business that … Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential Skills & Experience Degree ...

will play a key role in data-related activities for datasets used by Quants and Traders. The role requires strong SQL and Python skills (PySpark, Pandas, Jupyter Notebooks), plus experience with Airflow, Linux/Bash, and data-quality practices. You will collaborate with stakeholders and help improve data pipelines. ...

/PnL/Trade lifecycle/Reconciliation• Understanding of financial products such as: Derivatives (swaps, futures, options), bonds**Good-to-Have**• Exposure to **PySpark or large-scale data processing**• Experience working with **quants or pricing models**• Basic scripting (Unix/Bash) #J-18808-Ljbffr ...

Arbuthnot Latham is seeking a Senior Data Engineer to develop and maintain data systems that support the Bank's operations and reporting needs. The role involves ensuring compliance with standards while mentoring junior team members. ...