26 to 50 of 99 PySpark Jobs in England

Driving engineering best practice Mentoring engineers Working closely with senior business stakeholders Defining future-state data architecture Technical Environment Azure Databricks Apache Spark/PySpark Delta Lake Azure Data Factory Azure Data Lake Gen2 Azure Event Hubs Azure Synapse Python SQL Terraform CI/CD Medallion Architecture ...

customers’ pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark, Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

customers' pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark , Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them. Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role. Key Skills Azure Stack ELT Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub ...

years consulting (or equivalent) experience required 7+ years Databricks solution design, implementation, engineering experience required Either 5+ years building data pipelines in Databricks using PySpark, Scala and/or Spark SQL and ability to work across structured, semi-structured and unstructured data OR 5+ years ML Engineering ...

Desirable Skills Experience in data value management including governance, quality, and ownership Knowledge of cloud platforms such as Azure or AWS Familiarity with Python, PySpark, data lakes, and data warehousing concepts Understanding of DevOps, automated testing, and release management Knowledge of insurance principles or claims processes Experience working ...

UKI.recruitment@tcs.com or call the TCS London Office on 020 3155 2100 . Please include the subject line: “Application Support Request” . Role: Developer (PySpark + Fabric) Job Type: Permanent Location: London, UK Mode of Working: Hybrid Working Hours: 40 hours per week (Full-time) Are you looking … build innovative data engineering solutions using PySpark, Microsoft Fabric, and Azure technologies? We have an exciting opportunity for you - Developer (PySpark + Fabric) Careers at TCS: It Means More TCS is a purpose-led transformation company, built on belief. We go beyond helping businesses transform through technology ...

data engineering/integration/migration experience Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines Strong SQL - profiling, transformation, validation, reconciliation PySpark/Spark SQL notebook experience (Databricks or Fabric) Proven experience on a data migration project end-to-end (extraction through reconciliation) Microsoft Fabric experience ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

MLflow, Airflow, model monitoring, API monitoring, data validation, data drift detection, autoscaling and access management. Strong Python experience, with helpful knowledge of Spark or PySpark for working with large‐scale data and machine learning systems. An understanding of feature stores and related data technologies used to support operational machine ...

also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them. Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role. Key Skills: Azure Stack ELT Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub ...

experience with Azure AI Search or other vector/hybrid search solutions, including vector search, hybrid search, and retrieval evaluation. Experience with Databricks and PySpark for large‐scale data processing. Experience designing evaluation frameworks for LLM systems, including offline metrics, hallucination detection, and production monitoring. Experience implementing responsible ...

Platforms: Google Cloud Platform, Amazon Web Services, Microsoft Azure, and Databricks. Experience in one or more of the listed Languages such as: Python, R, PySpark Experience in one or more of the following Agentic & Gen AI Platforms: such as Microsoft Copilot Studio, Adept AI, UiPath, OpenAI GPT-5 Agents ...

expertise with strategic thinking. Essential Skills & Experience Strong Microsoft Fabric expertise (Lakehouse, Warehouse, Pipelines, Notebooks) OneLake architecture and management Advanced SQL/T-SQL PySpark and Spark optimisation Data warehousing, modelling and ETL/ELT development Power BI semantic modelling Experience delivering enterprise cloud data platforms Experience integrating multiple … deliver like a Senior Data Engineer . You'll be equally comfortable discussing strategic transformation plans with senior leadership as you are building PySpark pipelines, optimising Fabric workloads and solving complex data challenges. This is not a reporting role — it's a platform ownership role that will define ...

This job is with Capgemini, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With ...

outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Data Manager/Lead Location : London (Hybrid) Comp : £115,000 P/A (FTC) Duration: 12 Months Skills: Python (Programming Language), SQL, Apache Spark, PySpark, Azure Databricks, Data Lakes, Data Warehouse Architecture, Leadership, Software Development, Management The role We're partnering with a large, data-driven organisation seeking ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

solutions from concept to implementation. Qualifications Extensive experience with Azure Data Platform and Databricks. Hands-on expertise with Structured Streaming, Delta Live Tables (DLT), PySpark, Python, and SQL. Proven track record delivering large-scale enterprise data platforms. Strong leadership and mentoring capabilities, with the ability to guide engineering teams ...

Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms. You’ll be responsible for: Leading the design, development ...

Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms. Youll be responsible for: Leading the design, development, and implementation ...

Title : Cloud Data Engineer About the Job you are considering: We are seeking an experienced Cloud Data Engineer with expertise in AWS, Snowflake, dbt, PySpark, and SQL to design, build, and maintain scalable cloud-based data platforms and analytics solutions. The ideal candidate should have strong experience in cloud … data ingestion, transformation, validation, and reporting. Develop and maintain dbt models, tests, snapshots, macros, and documentation. Create high-performance data transformation solutions using PySpark and SQL. Design and optimize Snowflake data warehouse solutions. Integrate data from multiple sources including databases, APIs, cloud storage, and third-party systems. Implement data ...

considering: We are seeking an experienced Azure Data Engineering Lead with deep expertise in Azure Databricks, Azure Data Factory (ADF), PySpark, SQL, Delta Lake, and Azure cloud-native data services to drive the design and delivery of enterprise-scale data platforms for leading banking and financial services clients. … with Azure Databricks, Azure Data Factory (ADF), and ADLS Gen2. Expertise in designing scalable, resilient, and enterprise-grade Azure data solutions. Advanced proficiency in PySpark, Python, Spark SQL, and SQL. Strong experience with SQL optimization, performance tuning, joins, window functions, and stored procedures. Extensive experience in developing and optimizing ...

communicate future challenges, ensuring operational effectiveness. Skills and Experience: Essential: Full-stack Python Software Developer skills, specialising in numerical processing using Pandas, Numpy, Polars, PySpark, Coroutines, async tasks and Unix Building scalable applications, with intensive risk-based processing. Package software for distribution (eg Docker, Poetry, python-wheels, PyInstaller, Databricks ...