such as JSON, Avro, and Parquet. Experience with event-driven architecture/systems and messaging platforms. Experience with Hive, open-source/data bricks deltalake or Iceberg or Hudi Experience with Google Cloud or a similar cloud provider. Thrive at BlackLine Because You Are Joining: A technology more »
Data Engineer Data Engineer - Azure Data Bricks, Azure Data Factory (ADF), Purview, Azure Event Hubs, Messaging, APIs, Medallion Architecture, Delta Tables, Delta Live Tables, Data Wrangling, Agile Methodology - Remote (Midlands) - £55-75k + bens An experienced Data Engineer is urgently required to take responsibility for helping to … programme from scratch - In-depth experience of Azure Data Factory for designing, implementing and maintaining data pipelines - Detailed knowledge of data platform technologies including DeltaLake/Medallion Architecture - Strong experience of Azure Data Bricks including knowledge of Delta Live Tables and Microsoft Purview for data governance … a software products environment would be ideal. Data Engineer - Azure Data Bricks, Azure Data Factory (ADF), Purview, Azure Event Hubs, Messaging, APIs, Medallion Architecture, Delta Tables, Delta Live Tables, Data Wrangling, Agile Methodology - Remote (Midlands) - £55-75k + bens Essential Recruitment is an IT recruitment business with more »
data-driven initiatives. Job Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, DeltaLake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and … Advanced proficiency in SQL, Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data lakes, data warehouses, data more »
of industry trends and emerging technologies related to Databricks and big data processing, recommending relevant advancements for consideration. Experience Required Azure Databricks (Unity Catalog, DeltaLake, Delta Live Tables, Apache Spark, Structured Streaming) Python3 Terraform in Azure Integration with Collibra Integration with Snowflake Experience with CI/ more »
Data Analytics workflows by managing DBT, implementing deployment rules, and handling DevOps processes. Skills & Experience: Proven Data Engineering experience, particularly with Azure, Databricks, and Delta Lake. Expertise in Kubernetes, Infrastructure as Code, and Terraform. Strong knowledge of Azure DevOps. Preference for simplicity and transparency in solutions, avoiding unnecessary complexity. more »
Data Analytics workflows by managing DBT, implementing deployment rules, and handling DevOps processes. Skills & Experience: Proven Data Engineering experience, particularly with Azure, Databricks, and Delta Lake. Expertise in Kubernetes, Infrastructure as Code, and Terraform. Strong knowledge of Azure DevOps. Preference for simplicity and transparency in solutions, avoiding unnecessary complexity. more »
Bristol, Avon, South West, United Kingdom Hybrid / WFH Options
Bowerford Associates
ETL Tools - Azure Data Fabric, Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, DeltaLake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not essential) Geospatial … CD, Deployment Pipelines, Data Pipelines, Data Architectures, Architecture Patterns, Cloud Data Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, DeltaLake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only more »