Exposure to some of the following technologies: React, C#, Next JS and Chakra UI Experience of data platforms such as Azure Data Factory, Azure Databricks and Azure Data Lake Exposure to AWS and Azure As a Senior Automation Test Engineer, you must have strong verbal and written communication skills with more »
S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. Hands on experience on design solutions using Snowflake and DBT. Familiarity with Databricks or Informatica. Hands on experience in designing data models aligned to functional and non-functional requirements, and business objectives. Expert in data modelling and latest more »
Greenford, London, United Kingdom Hybrid / WFH Options
Brompton Bicycle
data models that enhance data accessibility and facilitate deeper analysis. Implement and manage Unity Catalog for centralized data governance and unified access controls across Databricks Maintain technical documentation for the entirety of code base. End to end ownership of the Data Engineering Lifecycle. Implement and manage Fivetran for efficient and … equivalent experience. Extensive experience as a Senior Data Engineer/Cloud Data Architect, or similar role. Deep knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD Extensive experience migrating on-premises data warehouses to the cloud. Proficiency with Spark, SQL, Python, R, and other data engineering more »
City of London, London, United Kingdom Hybrid / WFH Options
TALENT INTERNATIONAL UK LTD
solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards are met, including self-documenting code and reliable testing. Apply best practice data encryption techniques and … warehouse design. Extensive experience with Azure data products including Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Proficient in developing with Databricks, PySpark, and Spark SQL. Strong understanding of ETL coding standards, including standardized, self-documenting code and reliable testing. Knowledge of data encryption techniques and standards. more »
Lead Data Engineer - Python/SQL/Azure My client, a London Market Specialty Insurance company are currently recruiting for a Lead Data Engineer to join their team on a Permanent basis. This is a great opportunity for an experienced more »
Southampton, Hampshire, South East, United Kingdom
Ordnance Survey Limited
highly motivated Data Engineer to join Ordnance Survey's Data Derivation team in developing our next generation geospatial data. Using big data technologies (primarily Databricks, an implementation of Apache Spark) you will develop, support, and maintain automated processes that enrich and transform Ordnance Survey's large-scale data. Working in … best practice Providing technical coaching and mentoring Advocating software engineering industry best practice Interpreting detailed specifications and translating into simple solutions Apache Spark/Databricks experience (desirable) Experience of working in Microsoft Azure (desirable) Experience of working with the Scala language (desirable) The rewards We want you to love what more »
Manchester, North West, United Kingdom Hybrid / WFH Options
DWP Digital
is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your career and … make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes An understanding of dimensional modelling Details. Wages. Perks. You'll join us more »
Birmingham, West Midlands, United Kingdom Hybrid / WFH Options
DWP Digital
is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your career and … make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes An understanding of dimensional modelling Details. Wages. Perks. You'll join us more »
Southampton, Hampshire, South East, United Kingdom Hybrid / WFH Options
Ordnance Survey Limited
is about, we're looking for someone that can demonstrate skills and experience in: Ability to design, write and maintain test frameworks. Experience of Databricks & Azure Data Factory. Experience working in Agile environment and Cross Functional teams. Participate in feature/story definition and refinement, including identifying risks and acceptance more »
Bachelor's degree or equivalent experience Experience selling open source software Experience in database/data analytics/data warehouse technologies such as Snowflake, Databricks, Pinot, MongoDB, CockroachDB, Starburst, Clickhouse more »
with A/B testing platforms Essential: Knowledge of querying and transforming data using SQL Preferred : Familiarity with cloud based analytical platforms such as Databricks Familiarity with SaaS ecommerce platforms You might not tick all the boxes, and thats okay, we still encourage you to apply. Here at Brompton we more »
Southampton, Hampshire, South East, United Kingdom
Ordnance Survey Limited
and incremental development. Track record in problem resolution & selection of technical solutions. Qualified to relevant development certification (or equivalent experience). Experience working with Databricks/Apache Spark. Experience working with infrastructure-as-code. Desirable: Experience working with Geospatial Data. Experience using Terraform. The rewards: We want you to love more »
storage Highly Preferred Technical Skills: Experience with Kubernetes for container orchestration and data platform scalability Expertise in database tuning for performance optimization Familiarity with Databricks for large-scale data processing If interested, please apply or message me directly at more »
create effective data models supporting business processes, including knowledge of dimensional modeling and normalization. Familiarity with big data technologies on Azure, such as Azure Databricks and Azure Stream Analytics. Knowledge of data security practices, cloud architecture principles, scripting languages for automation, data visualization tools, DevOps practices, machine learning frameworks, performance more »
ensure data quality, and escalate technical issues as necessary. What you’ll be getting up to: Monitoring and recovery of Azure Data Factory and Databricks jobs Proactive monitoring of data quality Becoming a subject matter expert on the company's data sources and ingestion methods. Assisting in developing and adhering more »
Greenwich, England, United Kingdom Hybrid / WFH Options
Source Recruit
and unstructured data, including cloud data products such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. * Proficiency in developing with Databricks and coding with PySpark and Spark SQL. * Experience in delivery of data and analytics solutions/applications to automate business processes and meet user function more »
London, England, United Kingdom Hybrid / WFH Options
TALENT INTERNATIONAL UK
solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards are met, including self-documenting code and reliable testing. Apply best practice data encryption techniques and more »
Clerkenwell, England, United Kingdom Hybrid / WFH Options
McGregor Boyall Associates
Kimball & inmon, and hybrid data warehouse design. Cloud data products such as: Data factory Events Hubs Data Lake Synapse Azure SQL Server Experience developing Databricks and coding with PySpark and Spark SQL. Proficient in ETL coding standards Data encryption techniques and standards Knowledge of relevant legislation such as: Data Protection more »
Manchester, England, United Kingdom Hybrid / WFH Options
Michael Page
creative approach to problem-solving and the ability to drive innovation.#Technical skills: Knowledge of the Microsoft Platform I.E Azure Data Factory, Azure Synapse Warehouse, DataBricks etc. Data modelling I.E Inmon/Kimball/Data Vault etc. Prior exposure to working with Data warehouse, data lakes, delta lakes etc.Job Offer In more »
an organization who are committed to utilizing the latest Microsoft technologies! Requirements: Hands-on experience with Azure Data Factory Hands-on experience with Azure Databricks Excellent SQL and T-SQL skills Visualisation experience using Power BI and use of DAX Experience of working in Agile teams Excellent communication and stakeholder more »
Clerkenwell, England, United Kingdom Hybrid / WFH Options
SUMMER-BROWNING ASSOCIATES LIMITED
hybrid data warehouse design. Knowledge using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Knowledge in developing in Databricks and experience in coding with PySpark, Spark SQL. Experience in design and development of complex data and analytics solutions in an iterative manner for large more »
a Data Engineer Experience with analytical reporting and reporting tools - Tableau, Powerbase, SAP BO, Cognos (or similar) Experience with Data Integration tooling/Frameworks - Databricks, Oracle Data, Oracale Warehouse, AWS Glue, Azure Data Factory (or similar) Extensive experience with Python, Spark, SQL, SAS, MATLAB Strong SQL experience Good understanding of more »
Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch for efficient data storage and retrieval. Demonstrate proficiency in programming languages including Python, Spark, Databricks, Pyspark, SQL, and ML Algorithms. Implement Machine Learning models and algorithms using Pyspark, Scikit Learn, and other relevant tools. Manage Azure DevOps, CI/CD … pipelines, GitHub, and Kubernetes (AKS) for efficient software development and deployment. Implement ML/OPS solutions using Azure ML, Databricks MLFlow, and LLMOps for streamlined Machine Learning operations. Ensure data governance and data cataloging standards are maintained, utilizing tools such as Collibra and Talend Data Catalogue. Collaborate with stakeholders to … Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL, ML Algorithms, Gen AI. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Experience with ML/OPS tools such more »
City of London, England, United Kingdom Hybrid / WFH Options
Nigel Frank International
a brand new Snowflake Data Warehouse . They are looking for a candidate that has experience in… Azure Data Platform Strong knowledge of ADF, Databricks, ADL & Synapse along side Data Modelling, Experience performing data warehouse architecture development and management Working knowledge of SAS and R code used in data processing more »
in PowerBI, DAX, Power Query, and SQL Strong understanding of data modelling and database concepts Familiarity with data visualisation techniques Experience with Azure and Databricks is a plus Prior experience in financial services or commodities is a must If interested please come back with an updated CV and contact number more »