data-driven decision-making through scalable engineering practices. Key Responsibilities of the Database Engineer : Design and build scalable data pipelines and ETL processes using Databricks and Delta Live Tables Develop robust solutions on Azure, enhancing the lakehouse architecture with Spark technologies Implement automated CI/CD pipelines for streamlined testing … Collaborate with cross-functional teams to deliver data solutions that support analytics and AI initiatives Key Requirements of the Database Engineer: Proven experience with Databricks, Azure Data Lake, and Delta Live Tables Strong programming in Python and Spark (PySpark or Scala) Solid knowledge of data modelling, warehousing, and integration concepts More ❯
somerset, south west england, United Kingdom Hybrid / WFH Options
CA Tech Talent
data-driven decision-making through scalable engineering practices. Key Responsibilities of the Database Engineer : Design and build scalable data pipelines and ETL processes using Databricks and Delta Live Tables Develop robust solutions on Azure, enhancing the lakehouse architecture with Spark technologies Implement automated CI/CD pipelines for streamlined testing … Collaborate with cross-functional teams to deliver data solutions that support analytics and AI initiatives Key Requirements of the Database Engineer: Proven experience with Databricks, Azure Data Lake, and Delta Live Tables Strong programming in Python and Spark (PySpark or Scala) Solid knowledge of data modelling, warehousing, and integration concepts More ❯
processes and tools for handling large-scale datasets. Demonstrated ability to develop and deploy Feature Engineering and Modeling applications to data platforms built on Databricks or similar platforms and platform components (e.g., Snowflake, ML Flow, Airflow, etc.). Demonstrated experience in using Azure-based cloud applications, services and infrastructure or … errors, API statuses, data structure failures, and machine-based failures). Preferred Skills Preferred familiarity with cloud platforms and large dataset tools (e.g., Azure, Databricks, etc.). Ability to work with large datasets, ensuring data integrity and reliability. Strong problem-solving skills for complex energy scenarios. Clear and concise reporting More ❯
