3 of 3 Permanent Databricks Jobs in Kent

modern data engineering frameworks and tools (e.g. Spark/PySpark, Pandas, orchestration tools). Experience with cloud data platforms on AWS or Azure (e.g. Databricks, Redshift, Microsoft Fabric). Understanding of software engineering fundamentals, including Git, testing, CI/CD and modular design. Basic analytics and statistical understanding, including metrics ...

Apache Spark and Apache Flink.Strong understanding of Apache HTTP, Envoy, and REST API design.Experience working with Protobuf, Avro, and Parquet data formats.Knowledge of Iceberg, Databricks, and Hadoop ecosystems.Skills that will help:Follows TDD, ATDD and Clean Coding practices and used to setting up or working in an environment using ...

data zones (cleansed, conformed business layers) while securely handling identifiable data.Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark.Orchestration & Workflow: Build automated data workflows using Microsoft Fabric Data Factory and Azure Data Factory to move data efficiently across … with practical exposure to the Microsoft Fabric ecosystem (OneLake, Data Factory, Fabric Lakehouse).Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats.Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark).Security & Compliance: Direct experience ...