10 of 10 PySpark Jobs in the City of London

data engineering solutions using Python . Extensive hands-on experience with Databricks , including Workflows, Notebooks and Delta Lake. Strong experience with Apache Spark/PySpark . Proven experience building scalable ETL/ELT pipelines. Strong SQL and data modelling skills. Experience designing modern Lakehouse architectures. Experience working with cloud ...

improve performance and minimize RU consumption. Leverage Cosmos DB Change Data Feed (CDF) capabilities to support data integration and processing solutions. Design and implement PySpark data pipelines using Microsoft Fabric. Establish and maintain CI/CD pipelines using GitLab to support automated deployment and delivery. Develop and maintain unit ...

UKI.recruitment@tcs.com or call the TCS London Office on 020 3155 2100 . Please include the subject line: “Application Support Request” . Role: Developer (PySpark + Fabric) Job Type: Permanent Location: London, UK Mode of Working: Hybrid Working Hours: 40 hours per week (Full-time) Are you looking … build innovative data engineering solutions using PySpark, Microsoft Fabric, and Azure technologies? We have an exciting opportunity for you - Developer (PySpark + Fabric) Careers at TCS: It Means More TCS is a purpose-led transformation company, built on belief. We go beyond helping businesses transform through technology ...

solutions from concept to implementation. Qualifications Extensive experience with Azure Data Platform and Databricks. Hands-on expertise with Structured Streaming, Delta Live Tables (DLT), PySpark, Python, and SQL. Proven track record delivering large-scale enterprise data platforms. Strong leadership and mentoring capabilities, with the ability to guide engineering teams ...

considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines and lakehouse solutions … time. Your Role: Design, develop, and maintain scalable data pipelines using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such ...

Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics . Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake … Required Skills & Experience - Azure Data Engineer: Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) SQL & Python Understanding of CI/CD in a data environment , ideally with tools like Azure DevOps. Experience working within consultancy or client-facing ...

dimensional modelling approaches such as Kimball or Data Vault Experience working in modern cloud environments, ideally within Azure Exposure to technologies such as dbt, PySpark, Python, or similar tools Experience with data modelling tools is beneficial. Strong preference for Sparx Enterprise Architect, or similar tools such as Visual Paradigm ...

ownership of data pipelines and automation of data workflows. Finally have 5 years Strong programming experience at an advanced level in Python, PySpark, and SQL scripting. Benefits Salary: 55,000 - 60,000 per annum 25 day's holiday Company car/Allowance Private medical insurance Variable annual bonus based … leveraging tools such as Foundry Code Workbooks, Pipelines, and Object Explorer for efficient data processing and integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...