8 of 8 PySpark Jobs in Glasgow

services such as Synapse, Data Factory, Databricks or Fabric Strong SQL skills with experience building optimised, complex queries Proficiency in Python and/or PySpark for data transformation and automation Strong experience with Power BI and modern data modelling techniques Demonstrable experience leading data engineering initiatives or projects Excellent ...

accomplished. To be considered for this role, we would love you to have: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

reviews via Tabular Editor. Excellent design intuition-clean layouts, drill paths, and KPI logic. Nice to Have Python for automation or ad-hoc prep; PySpark familiarity. Understanding of Lakehouse patterns, Delta Lake, metadata-driven pipelines. Unity Catalog/Purview experience for lineage and governance. RLS/OLS implementation experience. ...

from scratch-this is the one. What You'll Be Doing Lakehouse Engineering (Azure + Databricks) Engineer scalable ELT pipelines using Lakeflow Declarative Pipelines , PySpark , and Spark SQL across a full Medallion Architecture (Bronze Silver Gold) . Implement ingestion patterns for files, APIs, SaaS platforms (e.g. subscription billing … Work With Databricks : Lakeflow Declarative Pipelines, Workflows, Unity Catalog, SQL Warehouses Azure : ADLS Gen2, Data Factory, Key Vault, vNets & Private Endpoints Languages : PySpark, Spark SQL, Python, Git DevOps : Azure DevOps Repos, Pipelines, CI/CD Analytics : Power BI, Fabric What We're Looking For Experience 5-8+ years ...

working with Databricks** You'll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn't just about coding - you'll also provide architectural guidance, mentor engineers, and ensure solutions … Develop automation for cluster management, integration runtimes, and networking Lead architectural design and ensure platform scalability, reliability, and governance Write efficient, maintainable code in PySpark, Python, and SQL Implement CI/CD pipelines and cloud infrastructure via Terraform/ARM Collaborate with data engineers, architects, and business stakeholders Mentor ...

Job Responsibilities: Payments and File Format Expertise Deep understanding of payment processing workflows, especially H2H and SWIFT. Hands-on experience with legacy formats (IDOC, EDIFACT) as well as ISO 20022 and GFF. Ability to interpret ...

Role Details Role/Job Title: Python/PySpark, Scala Developer Location: Glasgow (5 days onsite) Special Working Conditions (travel, on call etc.): 5 days onsite Glasgow city center Overview As a Python Lead Software Engineer With TATA Consultancy Services , you will play a crucial role in an agile … scalable manner. Key Responsibilities (Up to 10, Avoid repetition) Formal training or certification on software engineering concepts and advanced applied experience Advanced in Python & PySpark or Scala Experience in API development and exposure to Python Application development Hands-on practical experience delivering system design, application development, testing, and operational ...

Role Details Role/Job Title: Python/PySpark, Scala Developer Location: Glasgow (5 days onsite) Special Working Conditions (travel, on call etc.): 5 days onsite Glasgow city center Overview As a Python Lead Software Engineer With TATA Consultancy Services , you will play a crucial role in an agile ...