Delta Lake Jobs

16 Delta Lake Jobs

Reporting and ETL Developer

Greater London, England, United Kingdom
Catch Resource Management
Developer, Dynamics 365, D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client … enterprise data warehouse/BI projects. 4+ years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake, Lake House and Delta Lake Experience Responsibilities: Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics more »
Posted:

Azure Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Venturi
the project. There is a massive emphasis on Pyspark and Databricks for this particular role. Technical Skills Required: Azure (ADF, Functions, Blob Storage, Data Lake Storage, Logic Apps, DevOps) Databricks Spark Delta Lake SQL Python PySpark ADLS Soft Skills Required: Stakeholder Management Experience in a Senior Data … Strong support for Continuous Integration/Continuous Deployment (CI/CD) practices and an understanding of agile working methodologies. Knowledge and experience working with Delta Lake, a storage layer that brings ACID transactions to data lakes. Understanding of the Azure Platform setup including Subscriptions, Resource Group, IAM, Networking more »
Posted:

Databricks Engineer

Glasgow, Scotland, United Kingdom
Ansys
architecture, with a focus on Azure cloud technologies. Experience with Databricks Platform administration, cluster sizing and optimization, and CI/CD lifecycles. Experience with Delta Lake, Unity Catalog, Delta Sharing, Delta Live Tables (DLT). Experience with Power BI/Tableau/QuickSight. Good communication and more »
Posted:

Databricks Engineer

Cambridge, England, United Kingdom
Ansys
architecture, with a focus on Azure cloud technologies. Experience with Databricks Platform administration, cluster sizing and optimization, and CI/CD lifecycles. Experience with Delta Lake, Unity Catalog, Delta Sharing, Delta Live Tables (DLT). Experience with Power BI/Tableau/QuickSight. Good communication and more »
Posted:

Databricks Engineer

London Area, United Kingdom
Ansys
architecture, with a focus on Azure cloud technologies. Experience with Databricks Platform administration, cluster sizing and optimization, and CI/CD lifecycles. Experience with Delta Lake, Unity Catalog, Delta Sharing, Delta Live Tables (DLT). Experience with Power BI/Tableau/QuickSight. Good communication and more »
Posted:

Lead Data Engineer

Potters Bar, Hertfordshire, South East, United Kingdom
Canada Life Group (UK) Ltd (The)
hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern lake environment and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial … data) working directly with the business & data scientists. Ability to optimise data solutions for performance, scalability, and efficiency. Desirable: Experience in a financial corporation Lake House/Delta Lake and Snowflake Experience with Spark clusters, both elastic permanent and transitory clusters Familiarity with data governance, data security more »
Employment Type: Part Time
Posted:

Data Architect

London, England, United Kingdom
Hybrid / WFH Options
Aventum Group
Stack (Synapse, DataBricks, Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL more »
Posted:

Senior Data Engineer

England, United Kingdom
Hybrid / WFH Options
Venturi
structured data, with experience of schema evolution and/or serialisation. Extensive experience in building and optimizing data pipelines. Experience engineering and maintaining Data Lake, Data Lakehouse, Delta Lake environment. Hands-on familiarity with Azure DevOps, CI/CD pipelines, and release management. Person Specification: Passionate about more »
Posted:

Solution Architect

Greater London, England, United Kingdom
Hybrid / WFH Options
Verian Group
Terraform Experience with: Azure Synapse, Databricks, API Manager, Application Gateway, Function Apps, Logic Apps, Azure Networking, Power BI, SQL Server, Cosmos DB, Datalake Gen2, Deltalake, Data Factory, Event Hubs, Stream Analytics and more. Experience with Python, C#, Node.js and/or Java Experience with methodologies such as TOGAF and SAFe. more »
Posted:

Data Engineer

Stratford-Upon-Avon, England, United Kingdom
Impellam Group
Proficiency in designing and implementing data models, including star schemas and snowflake schemas. Expertise in SQL. · Data Storage Technologies - Experience in SQL, NoSQL, Blob, Delta Lake, and/or other enterprise scale data stores. · Data Processing Frameworks - Proficiency in designing and building data pipelines for data processing and more »
Posted:

Data Engineer

London Area, United Kingdom
RED Global
extracting information and identifying linkages across disparate datasets. • Expert in creating data structures optimized for storage and various query patterns for e.g. Parquet and Delta Lake • Experience in traditional data warehousing concepts (Kimball Methodology, Star Schema, SCD)/ETL tools (Azure Data factory, Informatica) • Experience in data modelling more »
Posted:

Data Engineer(Scala & Spark)

London Area, United Kingdom
Capgemini
join as you will be helping to shape the Reference Data Mastering and Distribution architecture and technology stack within our new cloud-based data lake-house. Qualifications Meaningful experience in following technologies: Scala , SQL Experience and interest in Cloud platforms such as AZURE Data Factory. Experience in Distributed Processing … information and identifying linkages across disparate data sets. Expert in creating data structures optimized for storage and various query patterns for e.g., Parquet and Delta Lake Meaningful experience in at least one database technology such as: Traditional RDBMS (MS SQL Server, Oracle) NoSQL (MongoDB, Cassandra, Neo4J, Cosmos DB … data landscape, obtain data extracts and define secure data exchange approaches. Acquire, ingest, and process data from multiple sources and systems into Cloud Data Lake Operate in the fast-paced, iterative environment while remaining compliant with bank’s Information Sec policies/standards Collaborate with others to map data more »
Posted:

Data Engineer

Birmingham, England, United Kingdom
Hybrid / WFH Options
Lorien
data platform. Design, develop, test, and deploy data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with the DevOps … data processing - Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory, Apache Airflow, Logic Apps more »
Posted:

Software Engineer

Gaithersburg, Maryland, United States
Leidos
the Washington Metro Area. This opportunity is contingent upon contract award. What you'll be doing: Analyze customer requirements to integrate data into Azure Delta Lake COTS product. Upgrade existing software as new increments are defined. Debug existing software and correct defects. Design or implement complex data repository more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Solution Architect - Data

Nottingham, England, United Kingdom
Boots UK
with Data Warehousing, Business Intelligence, Data Science and Data Engineering needs to fulfil data & analytics solutions Architecture experience in the cloud (Azure Storage, Databricks, Delta Lake, Lakehouse, Azure AI, ML Ops) It would be great if you also have Appreciation of Data Security and governance Exposure of working more »
Posted:

Senior Data Architect

Leeds, England, United Kingdom
Hybrid / WFH Options
Transition Partners
4+ years of technical experience with significant exposure to data-related roles. You bring hands-on experience in projects relating to data solutions (data lake, system integration, data migration, data warehousing experience with cloud-based data platforms) Curiosity and eagerness to explore new technologies, methodologies, and concepts in the … data realm (Data governance & management, data mesh, data vault 2.0, delta lake, DWH automation, event streaming) General knowledge of cloud-native computing either GCP, AWS or Azure Hands-on experience in data solution projects with cloud-based platforms. Proficiency in data modelling and familiarity with modern data solutions more »
Posted:
Delta Lake
10th Percentile
£53,250
25th Percentile
£66,500
Median
£80,000
75th Percentile
£90,000