4 of 4 Permanent Databricks Jobs in Somerset

expert working with databases and database architecture, SQL and Stored Procedures · Proven experience with Data integration technologies such as Azure Data Factory, Apache airflow, Databricks AutoLoader · Ability to build CI/CD pipelines and infrastructure as code · Experience with event driven data flows and message aggregators (Event Hub, Apache Kafka More ❯

Engineer, you will play a critical role in designing, developing, and maintaining scalable data solutions using Microsoft Azure’s ecosystem—including Azure Synapse Analytics, Databricks, and Microsoft Fabric—to deliver innovative solutions across various projects. You will empower our clients to harness their data, drive decision-making, and achieve their … re Looking For: 5+ years of experience in data engineering or a related field, delivering solutions across industries. Extensive experience with Azure Synapse Analytics, Databricks, and Microsoft Fabric. Proficiency in developing ETL/ELT pipelines using Azure Data Factory or similar tools. Strong understanding of data modelling, warehousing, and architecture More ❯

data-driven decision-making through scalable engineering practices. Key Responsibilities of the Database Engineer : Design and build scalable data pipelines and ETL processes using Databricks and Delta Live Tables Develop robust solutions on Azure, enhancing the lakehouse architecture with Spark technologies Implement automated CI/CD pipelines for streamlined testing … Collaborate with cross-functional teams to deliver data solutions that support analytics and AI initiatives Key Requirements of the Database Engineer: Proven experience with Databricks, Azure Data Lake, and Delta Live Tables Strong programming in Python and Spark (PySpark or Scala) Solid knowledge of data modelling, warehousing, and integration concepts More ❯

processes and tools for handling large-scale datasets. Demonstrated ability to develop and deploy Feature Engineering and Modeling applications to data platforms built on Databricks or similar platforms and platform components (e.g., Snowflake, ML Flow, Airflow, etc.). Demonstrated experience in using Azure-based cloud applications, services and infrastructure or … errors, API statuses, data structure failures, and machine-based failures). Preferred Skills Preferred familiarity with cloud platforms and large dataset tools (e.g., Azure, Databricks, etc.). Ability to work with large datasets, ensuring data integrity and reliability. Strong problem-solving skills for complex energy scenarios. Clear and concise reporting More ❯