Delta Lake Jobs

1 to 25 of 27 Delta Lake Jobs

Senior Data Engineer (IICS/ IDMC)

Liverpool, Merseyside, United Kingdom
Tiger Resourcing Group
Financial Services, Informatica IICS & IDMC, Databricks, Python/PySpark are essential**** Senior Data Engineer, Data, Data Modelling, Migration, ETL, ETL Tooling (Databricks, Delta Lake, Azure, ETL, Informatica IICS & IDMC ) SQL, Python or Pyspark, Agile, Financial Services experience, migrating data from on-prem to cloud. ****Financial Services industry experience … plus. Extensive hands on experience in SQL, Python, Data Integration/Ingestion and associated patterns - ETL tooling - Informatica IICS, ADF, Notebooks, Databricks, Delta Lake, Warehousing technologies and associated patterns, Cloud platforms - Azure preferred. Experience with on-prem and cloud versions of databases such as Oracle and SQL Server. …/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, AzureDevOps). Senior Data Engineer, Data, Data Modelling, Migration, ETL, ETL Tooling (Databricks, Delta Lake, Azure, ETL, Informatica) SQL, Python or Pyspark, Agile, Financial Services experience, migrating data from on-prem to cloud. more »
Employment Type: Permanent
Salary: £80000 - £90000/annum
Posted:

Azure Data Engineer - Remote - Up to GBP70,000

Olney, Buckinghamshire, United Kingdom
Hybrid / WFH Options
Nigel Frank International
working arrangement. I am looking for... * Previous experience working in a Data Engineering role * Experience working with Azure Technologies - Azure Data Factory, Synapse, Data Lake, Data Bricks * Experience working with SQL and Python * Experience designing and implementing ETL solutions This is a unique opportunity for a data engineer to … Send across your CV to d.moore1@nigelfrank.com or alternatively, give me a call on 0191 338 7577 Key Skills:Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLJob SummaryUp to 70,000 GBPDeveloper/Programmer RoleSkills … Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLLevel: Senior more »
Salary: £ 70 K
Posted:

Senior Azure Data Engineer

London Area, United Kingdom
Venturi
the project. There is a massive emphasis on Pyspark and Databricks for this particular role. Technical Skills Required: Azure (ADF, Functions, Blob Storage, Data Lake Storage, Logic Apps, DevOps) Databricks Spark Delta Lake SQL Python PySpark ADLS Soft Skills Required: Stakeholder Management Experience in a Senior Data … for Continuous Integration/Continuous Deployment (CI/CD) practices and an understanding of agile working methodologies. Knowledge and experience working with Delta Lake, a storage layer that brings ACID transactions to data lakes. Understanding of the Azure Platform setup including Subscriptions, Resource Group, IAM, Networking and DevOps. more »
Posted:

Business Intelligence Engineer

London, England, United Kingdom
Pantheon
in DevOps methodologies (Azure DevOps, Agile/Kanban/Scrum, CI/CD Pipeline etc.) Experience in Microsoft/Azure Stack (SQL Server, data lake, delta lake and Business Intelligence (SSIS, SSAS and SSRS)) Other BI tools such as QlikSense, Tableau, Looker, ThoughtSpot more »
Posted:

Senior Data Engineer

United Kingdom
La Fosse
SQL Server and PostgreSQL for data manipulation and querying. Extensive experience in data manipulation with Python, complemented by proficiency in Java. Familiarity with Data Lake, Delta Lake, and Lakehouse technologies. Strong grasp of data security, regional segregation, and effective management of large datasets. Proficient in leveraging cloud more »
Posted:

Senior Data Engineer - Azure

Olney, Buckinghamshire, United Kingdom
Hybrid / WFH Options
Nigel Frank International
that they can provide data and analytics to the business.They work on a modern Delta Lakehouse tech stack built on Databricks, Azure Data Lake, SQL and Python. This role is very much a hands-on role, and the leadership team are all still very hands-on.The ideal candidate … Plus more...Main Skill-Set We are looking for a good mix of the below skills, (not necessarily all of the below): * Azure Delta Lake * Databricks * Azure Data Lake * SQL * PythonMust HavesTo be successful, it is essential you have the following: * 3+ years' experience in a similar role … subject to successful background checks including a DBS and Credit Check.Job Summary65,000 to 90,000 GBPOther RoleSkills: Delta Lakehouse, Databricks, Azure Data Lake, SQL, Python, Data WarehouseLevel: Senior more »
Salary: £ 70 K
Posted:

Data Platform Engineer

Potters Bar, Hertfordshire, South East, United Kingdom
Canada Life Group (UK) Ltd (The)
is a technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern lake environment and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial … ll do Data Pipeline Development Design, model, develop and maintain data pipelines to ingest, store, process and present data (Azure Data Factory, Azure Data Lake Storage, Data Bricks, Power BI). Ensure data quality, accuracy, and consistency. Collaborate with data architects to ensure data pipelines align with the overall … preparing data for Data Science and Machine Learning as well as AI experience. DevOps experience using e.g., Azure CLI, YAML and Bicep. Understanding of Lake House/Delta Lake and Data Mesh concepts Skills in data acquisition (landing, ingestion and metadata) of various data types including Salesforce more »
Employment Type: Part Time
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Bristol, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Manchester, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Cambridge, Cambridgeshire, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Nottingham, Nottinghamshire, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Oxford, Oxfordshire, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Brighton, East Sussex, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Cardiff, South Glamorgan, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Milton Keynes, Buckinghamshire, United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Birmingham, West Midlands, West Midlands (County), United Kingdom
Hybrid / WFH Options
Nigel Frank International
of Databricks Coding experience with both Python and SQL Experience working with Azure Data Factory for creating ETL solutions Experience working with Azure Data Lake and Delta Lake storage This is just a brief overview of the role. For the full information, simply apply to the role more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Senior Data Engineer

United Kingdom
Hybrid / WFH Options
Primus Connect
and implement data models that effectively represent business processes and requirements. Optimise data storage in Databricks for efficient querying and analysis, leveraging Delta Lake for ACID transactions and versioned data management. Translate complex business requirements into technical specifications in collaboration with various teams. Implement and maintain data governance … delivered with hands-on experience in Databricks Expertise in data modeling, ETL development, and data warehousing. Familiarity with Databricks medallion architecture Experience working with Delta Live Tables Familiarity with Unity Catalog Strong programming experience using Python Experience with distributed computing with Spark Streaming experience using technologies such as Kafka more »
Posted:

Solution Architect

London, England, United Kingdom
Hybrid / WFH Options
Verian Group
Terraform Experience with: Azure Synapse, Databricks, API Manager, Application Gateway, Function Apps, Logic Apps, Azure Networking, Power BI, SQL Server, Cosmos DB, Datalake Gen2, Deltalake, Data Factory, Event Hubs, Stream Analytics and more. Experience with Python, C#, Node.js and/or Java Experience with methodologies such as TOGAF and SAFe. more »
Posted:

Lead Azure Databricks / Data Engineer

SE1, Chaucer, Greater London, United Kingdom
Hybrid / WFH Options
Logix Resourcing
loading, transformation and exploration including familiarity with Pandas), as well as a strong understanding of core Databricks and Spark concepts such as Delta Lake, Medallion Architecture, Dataframes, Workflows, Unity Catalogue, Delta Live Tables, and UDF’s. You will also be experienced with ADF, ADLS Gen2, and the more »
Employment Type: Permanent
Salary: £90000/annum
Posted:

Senior Data Engineer

United Kingdom
Hybrid / WFH Options
Impellam Group
other engineers. Design, develop, test, and deploy data pipelines and integrations using IPaaS technology. Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem. Modern big data architecture design. Ability to prioritise and meet deadlines. Attention to detail and solid … in leading the design and implementation of lambda architectures for scalable and reliable data processing. Data Stores - Technical excellence inSQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory, Apache Airflow, Logic Apps, DBT, SnapLogic more »
Posted:

Data Platform Operations Specialist (Azure)

London, United Kingdom
Hybrid / WFH Options
Hydrogen
+package)London/Remote (hybrid)Technical SkillsMicrosoft SQL Server (administration, T-SQL)Azure data technologies (ADLS, ADF, Azure SQL Database, Databricks, Delta Lake)Azure Databricks/Azure Data Factory (Optimisation)Python, Pyspark, or R an advantageSSISPowerBIPerformance optimisation and troubleshooting of data technologies, from SQL server to Azure data more »
Salary: £ 80 K
Posted:

Data Engineer - Azure - £650 p/d - Inside IR35 - Financial Services

London, England, United Kingdom
Harrington Starr
Databricks Workflows, and Unity Catalog setups for unified governance Skilled in data model management, designing and implementing Star Schema in Databricks with Delta Lake, and ensuring data quality through built-in testing and monitoring If interested please respond as soon as possible with a CV and contact number more »
Posted:

Azure Databricks Engineer

London, England, United Kingdom
Cititec Talent
Unity Catalog setups in a multi domain environment for unified governance for data, analytics and PowerBI accesses. Exposure of Data Points, Data Points History, DeltaLake, Databricks SQL, Dataflow, Datamart solutions more »
Posted:

Data Architect

London, United Kingdom
Hybrid / WFH Options
DVF Recruitment
well as the ability to design patterns that exploit the cloud capabilities of these tools. Examples include - Informatica IICS, ADF, Notebooks, Databricks, Delta Lake, Warehousing technologies and associated patterns, Cloud platforms.Experience with one of more cloud service providers – AWS, Azure, or GCP. Azure is preferred.Strong Database management systems more »
Salary: £ 80 K
Posted:
Delta Lake
10th Percentile
£52,500
25th Percentile
£65,000
Median
£80,000
75th Percentile
£90,000