ETL best practices. You have experience with GitHub and with one or more ML cloud compute solutions : AWS SageMaker , Microsoft Azure, Google Cloud, Kubeflow, Databricks, etc. You have excellent project management, organizational, and collaboration skills. You enjoy working in global teams , assisting and educating less experienced members, while also learning more »
data requirements and deliver solutions that drive business value. Requirements: 7+ years in a Data Engineering Role Excellent proficiency in SQL, Python, Microsoft Azure, Databricks, PySpark, Experience managing a team Details: Start Date: ASAP Duration: 3 months, option for permanent extension Day rate: Up to £400Ltd, depending on experience Annual more »
Luton, England, United Kingdom Hybrid / WFH Options
Ventula Consulting
data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data solutions on a cloud based, big data distributed system (AWS/Azure etc.) Hands-on more »
data processing and integration. Collaborating cross-functionally to translate complex data requirements into actionable technical solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability more »
through to completion Implementation of data platform using Microsoft Azure stack Experience of using technologies such as Azure Data Factory, Azure Data Lake, Azure Databricks etc. along with Power BI. If you are a Senior Solutions Architect with strong experience in the data services space and expert knowledge in strategic more »
Business Intelligence products and solutions Strong ability to coach, guide and motivate junior team members Deep understanding of the Microsoft technology stack, specifically PowerBI, Databricks & Azure Cloud Proficiency in SQL, strong understanding of ETL and ELT processes Strong communication skills, ability to translate complex messages into concise, easy-to-understand more »
management, governance, data & modelling lifecycles (ML Ops). Seek to improve model efficiency, performance, and scalability Microsoft Technology Stack experience sought (Azure Data Lake, Databricks, Azure ML, Power BI), and capabilities of programming in and understanding R & Python. You will also likely have: A passion for problem-solving and innovation more »
Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired more »
timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience with real-time data processing and streaming technologies like Apache Kafka or Azure Event Hubs Knowledge of data visualization tools, such as more »
SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark etc. Experience being customer-facing on numerous data focused projects with a consultative approach Ability to deliver high to low-level more »
SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark etc. Experience being customer-facing on numerous data focused projects with a consultative approach Ability to deliver high to low-level more »
ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks and Functions Essential Experience Experience in supporting traditional Data Warehouses Exposure in building Azure based data ingestion and transformation pipelines, data lake, data warehouse/ more »
and data and information systems design Experience with data management, database management systems, data services (including APIs), and enterprise data platform technologies (e.g. Fabric, Databricks, Snowflake, etc.) Experience architecting data-centric solutions at a conceptual, logical and physical level Experience in architecting, designing and implementing solutions on AWS and Microsoft more »
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around 2 times per month. This … Data Engineer to mentor and lead the Data Engineering team, undertaking a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in Databricks, coding in PySpark, and supporting internal applications as they are moving away from a legacy application into … encourage you to provide thought leadership, and to innovate and experiment with new technologies to deliver benefits to the business. Requirements Excellent skills in Databricks and Pyspark Excellent experience with SQL and T-SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including more »
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around 2 times per month. This … Data Engineer to mentor and lead the Data Engineering team, undertaking a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in Databricks, coding in PySpark, and supporting internal applications as they are moving away from a legacy application into … encourage you to provide thought leadership, and to innovate and experiment with new technologies to deliver benefits to the business. Requirements Excellent skills in Databricks and Pyspark Excellent experience with SQL and T-SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including more »
etc. Knowledge of Azure Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache Flink. Experience scaling an “API more »
Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch for efficient data storage and retrieval. Demonstrate proficiency in programming languages including Python, Spark, Databricks, Pyspark, SQL, and ML Algorithms. Implement Machine Learning models and algorithms using Pyspark, Scikit Learn, and other relevant tools. Manage Azure DevOps, CI/CD … pipelines, GitHub, and Kubernetes (AKS) for efficient software development and deployment. Implement ML/OPS solutions using Azure ML, Databricks MLFlow, and LLMOps for streamlined Machine Learning operations. Ensure data governance and data cataloging standards are maintained, utilizing tools such as Collibra and Talend Data Catalogue. Collaborate with stakeholders to … Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL, ML Algorithms, Gen AI. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Experience with ML/OPS tools such more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Adria Solutions
high-quality data outcomes via modern data sourcing, integration and modelling techniques. Youll gain exposure to a wide range of modern technology (e.g. Snowflake, Databricks, Spark) and be continually learning. Requirements of the Data Engineer: Strong experience with data analysis, data modelling (Kimball) and governance, with excellent analytical and problem more »
undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks PySpark SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would more »
develop in to a rounded consultant Any of the following would be a real plus but not necessary: Relevant Microsoft Certifications (DP900, DP203), ADF, Databricks, Synapse knowledge. As the successful Data Consultant/BI developer you will: Deliver effective Data solutions to a variety of customers Migrate on-prem to more »
with internal senior stakeholders and board members to help design business strategy. Skills & Qualifications Strong knowledge of Azure Cloud Data platform, experience working with Databricks, Azure Data Factory and SQL Server. Experience of Python and Terraform would be beneficial. Strong stakeholder management and great communication skills to build upon and more »
with internal senior stakeholders and board members to help design business strategy. Skills & Qualifications Strong knowledge of Azure Cloud Data platform, experience working with Databricks, Azure Data Factory and SQL Server. Experience of Python and Terraform would be beneficial. Strong stakeholder management and great communication skills to build upon and more »
with internal senior stakeholders and board members to help design business strategy. Skills & Qualifications Strong knowledge of Azure Cloud Data platform, experience working with Databricks, Azure Data Factory and SQL Server. Experience of Python and Terraform would be beneficial. Strong stakeholder management and great communication skills to build upon and more »
with internal senior stakeholders and board members to help design business strategy. Skills & Qualifications Strong knowledge of Azure Cloud Data platform, experience working with Databricks, Azure Data Factory and SQL Server. Experience of Python and Terraform would be beneficial. Strong stakeholder management and great communication skills to build upon and more »
Birmingham, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
wider organisation using the tech you think is required! Skills desired/what you will learn: Microsoft Azure Azure SQL Microsoft Fabric Delta Lake, Databricks and Spark Statistical Modelling Azure ML Studio Python and familiarity with libraries and frameworks for data analysis and machine learning (e.g., TensorFlow, sci-kit-learn more »
