26 to 50 of 119 PySpark Jobs in the UK

good understanding of Azure PaaS management and resource monitoring CI/CD experience and DevOps Working knowledge of SQL and experience in Python/PySpark Microsoft Power Platform Ability to collect, organize, and analyze data from multiple sources to solve business challenges. Knowledge in testing and validating Analytical solutions ...

Qlik Cloud) Ability to use data science techniques and statistics, including use of Python/R Ability to manipulate data in data lakes using PySpark/Experience with cloud-based data architectures and scalable data solutions Personal Qualities Essential Excellent stakeholder management and interpersonal skills Highly developed negotiation ...

performance, scalability, and cost efficiency. Implement data quality controls, validation processes, and monitoring solutions. Data Transformation & Processing Develop complex data transformation logic using Spark (PySpark or Scala). Build data cleansing, enrichment, aggregation, and processing solutions. Ensure data accuracy, consistency, and reliability throughout the data life cycle. Azure Databricks … Experience 8+ years of Data Engineering experience (10+ years preferred). Minimum 3 years of hands-on Azure Databricks experience. Strong expertise in Python, PySpark, and/or Scala. Extensive experience with: Azure Databricks Azure Data Factory Azure Blob Storage Azure SQL Database Delta Lake Spark SQL Strong understanding ...

improve performance and minimize RU consumption. Leverage Cosmos DB Change Data Feed (CDF) capabilities to support data integration and processing solutions. Design and implement PySpark data pipelines using Microsoft Fabric. Establish and maintain CI/CD pipelines using GitLab to support automated deployment and delivery. Develop and maintain unit ...

looking for: Strong background in data engineering and software development Proven experience working with Databricks (essential) Hands-on expertise with tools such as Python, PySpark, Spark, and SQL Experience building and maintaining data pipelines and data platforms Solid understanding of data modelling and data architecture principles Experience working with ...

looking for: Strong background in data engineering and software development Proven experience working with Databricks (essential) Hands-on expertise with tools such as Python, PySpark, Spark, and SQL Experience building and maintaining data pipelines and data platforms Solid understanding of data modelling and data architecture principles Experience working with ...

optimisation, and software engineering best practices What We’re Looking For Proven hands-on experience with Databricks platform and orchestration Strong skills in Python, PySpark, and SQL, with knowledge of distributed data systems Expertise in developing full lifecycle data pipelines across ingestion, transformation, and serving layers Experience with data ...

data pipelines using Databricks and Apache Spark. Build and optimize data workflows for batch and real-time processing. Transform and process large datasets using PySpark, SQL, and Delta Lake. Implement data ingestion from multiple sources (APIs, streaming, databases). Your Skills: Python proficiency. AWS : Cloud formation , Service Catalog ...

data integrity Ability to use data science techniques and statistics, including use of Python/R Ability to manipulate data in data lakes using PySpark/Experience with cloud-based data architectures and scalable data solutions Highly data rational with the ability to use quantitative and qualitative information ...

considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines and Lakehouse solutions … initiatives. Review technical designs, data models, ETL/ELT pipelines, and engineering implementation. Provide architectural guidance to data engineers working on Azure Databricks, ADF, PySpark, SQL, and Delta Lake. Collaborate with enterprise architecture, solution architecture, security, infrastructure, DevOps, and business teams. Define CI/CD, DevOps, deployment, monitoring ...

with Agentic and Gen AI projects. Experience with energy system modelling, grid analytics, demand forecasting or energy market data. Familiarity with distributed computing, Spark, PySpark or cloud-native data platforms. Experience developing models for planning, scenario analysis or operational decision support. Knowledge of data governance, model risk management ...

customers’ pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark, Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

customers' pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark , Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

search solutions Designing scalable data and AI pipelines Implementing MLOps and LLMOps best practices We're interested in people with experience in: Python Databricks (PySpark, Delta Lake, Unity Catalog, MLflow, Mosaic AI) LLMs, GenAI and AI Agents MLOps and production ML systems CI/CD and DevOps ...

integrating Legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating Legacy data sources such ...

ensure scalable, high-performance applications: We use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI. What you can expect Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

well as a solid understanding of working in a cloud-based environment (AWS is preferred). \n Proficient using transformation tools such as PySpark/Pandas. \n Knowledge and practice of graph databases is preferred but not required. \n Key responsibilities/Skills and experience \n Familiarity using data ...

UKI.recruitment@tcs.com or call the TCS London Office on 020 3155 2100 . Please include the subject line: “Application Support Request” . Role: Developer (PySpark + Fabric) Job Type: Permanent Location: London, UK Mode of Working: Hybrid Working Hours: 40 hours per week (Full-time) Are you looking … build innovative data engineering solutions using PySpark, Microsoft Fabric, and Azure technologies? We have an exciting opportunity for you - Developer (PySpark + Fabric) Careers at TCS: It Means More TCS is a purpose-led transformation company, built on belief. We go beyond helping businesses transform through technology ...

internal capability development initiatives What We’re Looking For Proven experience with the Databricks platform, including Unity Catalog, DeltaLake, and orchestration Expertise in Python, PySpark, and distributed data processing frameworks Extensive background in CI/CD pipeline development with tools like Azure DevOps, Jenkins, GitHub Actions In-depth understanding ...

Databricks, Data Factory, and Data Lake. Strong understanding of Azure PaaS management, resource monitoring, and CI/CD processes. Proficiency in SQL, Python/PySpark, and the Microsoft Power Platform. This role offers a competitive annual salary of £70,000 and excellent employee benefits, including 16% non contributory pension ...

Databricks, Data Factory, and Data Lake. Strong understanding of Azure PaaS management, resource monitoring, and CI/CD processes. Proficiency in SQL, Python/PySpark, and the Microsoft Power Platform. This role offers a competitive annual salary of £70,000 and excellent employee benefits, including 16% non contributory pension ...

hands-on experience with modern cloud data platforms (e.g. Databricks or Snowflake), ideally within AWS environments Advanced programming and data engineering skills in Python, PySpark and SQL, with a solid understanding of ETL pipelines and data transformation Proven experience in data modelling (end-to-end), including performance optimisation using ...

trust in England. Job description Job responsibilities The postholder must have highly advanced computing skills (e.g. one or more of the following: SQL, Python,PySpark, Power Query, DAX) and the ability to adapt computing skills to any new software required.The Trust uses Microsoft Fabric as it's main data ...

MLflow, Airflow, model monitoring, API monitoring, data validation, data drift detection, autoscaling and access management. Strong Python experience, with helpful knowledge of Spark or PySpark for working with large‐scale data and machine learning systems. An understanding of feature stores and related data technologies used to support operational machine ...

Skills & Experience we’re looking for: Commercial experience in data engineering role Hands-on experience with tools such as Python, SQL, Spark/PySpark Understanding of data pipelines, ETL/ELT processes, and data storage solutions Exposure to data modelling and designing scalable data structures Background or grounding ...