11 of 11 Delta Lake Jobs in Yorkshire

scalable data pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop semantic models … Notebooks and Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps and modern ...

cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge ...

shelf tools together. Solid experience with modern data engineering tools and patterns, with real depth in several of SQL, Spark, Databricks/Delta Lake, orchestration tools (Dagster, Airflow, Temporal), and dbt. Comfort with modern deployment practices: It's a bonus if you've shaped these for a team ...

problems you had to solve. Solid experience with modern data engineering tools and patterns, with real depth in several of SQL, Spark, Databricks/Delta Lake, orchestration tools (Dagster, Airflow, Temporal), and dbt. Comfort with modern deployment practices: CI/CD, containerisation (Docker), and cloud-based infrastructure. ...

contribute to deep technical discussions Nice to Have Experience with operating machine learning models (e.g., MLFlow) Experience with Data Lakes, Lakehouses, and Warehouses (e.g., DeltaLake, Redshift) DevOps skills, including terraform and general CI/CD experience Previously worked in agile environments Experience with expert systems Perks ...

contribute to deep technical discussions Nice to Have Experience with operating machine learning models (e.g., MLFlow) Experience with Data Lakes, Lakehouses, and Warehouses (e.g., DeltaLake, Redshift) DevOps skills, including terraform and general CI/CD experience Previously worked in agile environments Experience with expert systems Perks & Benefits Comprehensive benefits package ...

Python and relevant data science libraries, including NumPy, PySpark, Scikit-learn, TensorFlow, and/or PyTorch. Strong experience using Databricks, including Jobs, Asset Bundles, Delta Lake, and MLflow. Experience mentoring data scientists or providing technical leadership within a cross-functional team. Bachelor's degree or higher in Statistics ...

Python and relevant data science libraries, including NumPy, PySpark, Scikit-learn, TensorFlow, and/or PyTorch. Strong experience using Databricks, including Jobs, Asset Bundles, Delta Lake, and MLflow. Experience mentoring data scientists or providing technical leadership within a cross-functional team. Bachelor's degree or higher in Statistics ...

Python and relevant data science libraries, including NumPy, PySpark, Scikit-learn, TensorFlow, and/or PyTorch. Strong experience using Databricks, including Jobs, Asset Bundles, Delta Lake, and MLflow. Experience working with business stakeholders to define problems, scope solutions, and communicate outcomes effectively. Experience mentoring data scientists or providing ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience working within Agile delivery teams. Competitive base ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...