and unit testing. Infrastructure-as-code expertise with CI/CD pipelines. Ability to communicate complex topics clearly. Nice to Have: Experience with Snowflake, Databricks, and GCP or Azure. Knowledge of streaming data architectures. Data security and compliance implementation. Machine Learning Operations (MLOps) experience. more »
Kimball & inmon, and hybrid data warehouse design. Cloud data products such as: Data factory Events Hubs Data Lake Synapse Azure SQL Server Experience developing Databricks and coding with PySpark and Spark SQL. Proficient in ETL coding standards Data encryption techniques and standards Knowledge of relevant legislation such as: Data Protection more »
warehouse design Detailed knowledge using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Detailed knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code is standardised, self-documenting and can be reliably tested Knowledge of more »
in the Banking and Financial Services sector is advantageous. Deep knowledge or experience with using as much of the following: Azure Cloud Data Components | Databricks | Python | PySpark | Terraform | APIs | Lakehouse | Data Mesh | Nosql DBs | GitHub Person Specification Self motivator with a desire to learn new skills and embrace new technologies more »
Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks Lakehouse Platform, working closely with our … impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools … to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and migration to production. - Serve as a Databricks SME, sharing knowledge, technical guidance, and troubleshooting. Basic skillset requirements - Proven experience in AWS and/or Azure data migrations - Databricks architecture, components more »
test plans to guarantee that our data solutions meet the highest standards. Key Responsibilities: - Develop, document, and execute manual test plans and scripts. - Utilise DataBricks for testing data pipelines and ensure data accuracy. - Perform automated testing using Selenium. - Write and execute SQL queries to validate data integrity. - Generate data reports more »
Central London, London, United Kingdom Hybrid / WFH Options
Viqu Limited
Azure. The Platform Engineer also have a focus on Azure data platform services with skills in Azure Data Factory (ADF), Data Analytics, and Azure Databricks and DevOps practices. Primary requirements for the Platform Engineer will include: Experienced Platform Engineer - CAF (Cloud Adoption Framework) Strong experience and understanding of Infrastructure as more »
storage Highly Preferred Technical Skills: Experience with Kubernetes for container orchestration and data platform scalability Expertise in database tuning for performance optimization Familiarity with Databricks for large-scale data processing If interested, please apply or message me directly at more »
a Developer within banking, financial services or another commodity trading business. Deployment experience using Docker or Kubernetes Knowledge of Azure cloud development and Azure Databricks Experience working with Javascript/Angular/React Demonstrate high quality design and development to large, distributed platforms applying modern architectural best practice Highly motived more »
Shefford, Bedfordshire, South East, United Kingdom Hybrid / WFH Options
Central Bedfordshire Council
variety of data-related projects over the next two years. You will have an opportunity to work with cutting-edge Azure ecosystem tools, including Databricks and Synapse Analytics. Key Responsibilities: Lead migrations from on-premises SQL Server to CBC Microsoft Azure SQL and/or 3rd Party hosted platforms Execute … be beneficial Write Python/PySpark scripts and T-SQL for Lakehouse/Database management (tables, views, indexes, stored procedures) Use Azure Data Factory, Databricks, and Synapse for advanced data engineering tasks Work with related Azure resources, including Key Vault, Storage Accounts and understanding of Azure DevOps Support reporting and … Synapse Serverless SQL and associated technologies It is essential that you have experience in Python/PySpark and T-SQL scripting, Azure Data Factory, Databricks, and Synapse Analytics, designing and implementing Data warehouses and associated dimensional models, and proficiency in reporting and analytics tools, such as PowerBI A strong background more »
South East London, London, United Kingdom Hybrid / WFH Options
The Bridge (IT Recruitment) Limited
on a long term contract, inside IR35 on a remote basis. The key skills required for this Python Developer role are: Python ETL Azure Databricks Pyspark If you do have the required skills for this remote Python Developer contract, please do apply. more »
CX with potential extension Requirements: 5+ Years as an Azure Data Architect Must have Active SC Clearance Background in financial services Experience working with Databricks Extensive data modelling knowledge Will have designed data lakes more »
the achievement of prioritised Use Cases and Business Objectives. Technical and Business Metadata Management: Develop a strategy for technical and business metadata capture on Databricks Unity Catalog and Purview, ensuring seamless integration between the two. Define the technical and business metadata required at different layers (Bronze, Silver, Gold). Implement more »
Senior Data Engineer | DataBricks | AWS/Azure | Full Remote Outside IR35 up to £500 per day 6 months initial Start - Immediate FRG Data are looking for a Senior Data Engineer with strong DataBricks experience. Skills & Experience: We are looking for someone that has a strong mix of the following skills … experience utilising the Microsoft Azure stack for data engineering ie Azure Functions * Core skills in coding with SQL, Python and Spark * Proven experience using DataBricks ie lakehouse, delta live tables, Pyspark etc more »
Birmingham, West Midlands, West Midlands (County), United Kingdom
Randstad Technologies Recruitment
Azure Data Engineer- Birmingham - £500pd Outside I'm currently looking for a Data Engineer to join a company that is based in Birmingham. They need someone to start in the next few weeks. Location: Birmingham (on site 2 times a more »
AWS Data Engineer - DataBricks - Outside IR35 Duration: 6 months Rates Outside IR35: £350 - £450 per day Full Remote Working FRG Consulting are looking for AWS Data Engineers with good DataBricks experience to on-board with a consultancy client of ours who have won a large DataBricks migration project with a … new end user. Must Haves: Strong understanding and hands on experience with AWS technologies Strong understanding and hands on experience with DataBricks, particularly in migration projects Good communication skills more »
Northamptonshire, United Kingdom Hybrid / WFH Options
Hays Specialist Recruitment
Your new company You will be working for a large, well-known organisation whoa re a big name within their sector. Your new role The ideal candidate will have experience with using Azure data platform, data bricks, and PowerBI datasets more »
Platform Engineer – 6 - month contract My customer requires an experienced Platform Engineer to join an existing team for an initial 6-month engagement. This Platform Engineer will be responsible for managing and leading the operation of Cloud Infrastructure (Azure). more »
Data Scientist 6-Month Contract £600/day-£640/day (Inside IR35) London - Hybrid - 1 day per week in the office We are representing a large-scale B2C Tech company who are looking for a Data Scientist to join more »
Birmingham, West Midlands, West Midlands (County), United Kingdom
Randstad Technologies Recruitment
Azure Data Engineer- Birmingham - £350pd Outside I'm currently looking for a Data Engineer to join a company that is based in Birmingham. They need someone to start in the next few weeks. Location: Birmingham (on site 2 times a more »