architecture approaches, requirements analysis, design, and testing techniques. Familiarity with established and emerging data management and reporting technologies, including columnar and NoSQL databases, predictive analytics, data visualization, and unstructured data. Ability to create diagrams of key data entities and relationships and generate a component list for system construction. Strong … conceptualization and optimization. Problem-solving attitude and effective troubleshooting skills. What you’ll be using: Platforms & Tools : Cloud Computing platforms (ADLS Gen2), Microsoft Stack (Synapse, DataBricks, Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake … Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL, SSIS and high-level programming knowledge on Spark is a plus. DB: Azure SQL Database, Cosmos DB, NoSQL more »
Data Engineer – SQL/Azure Data Factory/Power BI * Sponsorship is not available with this position * Role – Data Engineer Salary – £60k - £70k DOE Location – Remote - London HQ Due to success, a key client of mine is going through an expansion and are now looking to add a Data … to the team as they undergo a technology transformation to the cloud. They are looking for someone experienced in building a data warehouse and analytics platform based on Azure. You will be working collaboratively with the rest of the Data team as well as other key stakeholders within the … years BI/Data experience Working with and understanding complex data sets Good data design and management experience including data cleansing Experience in using Azure data Factory, AzureSynapseAnalytics and Power BI Knowledge of on-prem technologies - SSRS, SSIS, SSAS, SQL Knowledge of AI and more »
Senior Azure Data Engineering Consultant Home-based with occasional customer travel £65,000 - £85,000 + bonus and benefits I'm working with a leading Microsoft Gold Partner who specialise in data. They are true experts when it comes to data strategy, data platforming, analytics, artificial intelligence and … alongside experienced professionals to boost your learning day to day. The successful candidate will have the following skills and experience: Expert with SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks … AzureSynapse, Python, Pyspark etc. Experience being customer-facing on numerous data focused projects with a consultative approach Ability to deliver high to low-level designs for Data Solutions and have a good understanding of the full data lifecycle. This is a great opportunity to join an organisation more »
Data Architect - Azure/Spark/Databricks Role: Data Architect Location: London (3 days a week) Salary: £100k - £110k A leading technology firm, renowned for connecting people globally, is looking for a skilled Data Architect to join their expanding team. You will be spearheading Azure-based data solutions … role, you'll be responsible for leading the design and implementation of cutting-edge data solutions. Key Responsibilities: Lead the design and implementation of Azure-based data solutions, leveraging services like Spark, AzureSynapseAnalytics, and Databricks. Working closely with other Architects and Senior leadership across … and active participation in monthly design forums. Produce comprehensive data design documents to articulate architecture decisions and implementation plans clearly. Requirements: Strong proficiency in Azure services, including Spark, Data Lake, Synapse, and Databricks. Exceptional stakeholder management skills with the ability to communicate effectively with both technical and non more »
City of London, London, United Kingdom Hybrid / WFH Options
Adecco
infrastructure that powers innovative solutions within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from … pipelines to ensure optimal performance. Stay up-to-date with the latest trends and technologies in data engineering. Requirements : Strong hands-on experience with Azure, Synapse, and Databricks Excellent programming skills in SQL and Python Proficiency in building and optimising data pipelines, architectures, and datasets Familiarity with Medallion … skills. Excellent communication and collaboration skills. Ideally we would be looking for 2-5 years' experience in a similar role of data engineer or analytics engineer. more »
We are currently seeking a Snr Data Engineer who has experience with the Azure Data stack to join the Business Intelligence team. The team is part of a wider team that includes the MS D365 implementation team (on-going project), Oracle ERP team and Digital Applications team. We are … business stakeholders, process owners and BAs to understand requirements. To build data pipelines, reading data from various on-premise or cloud services to the Azure datalake. To design and build data models suitable for reporting. To design and build Reports. Implementation of Data Quality, Data Governance, Data Security processes … as part of the solution design About the Candidate Essential experience Experience with the following technologies AzureSynapse, Data Factory, Databricks, SQL Db, Datalake, Key Vault Azure Dev Ops and CI/CD pipelines Coding in SQL and PySpark/Python DW/Data Vault concepts Power more »
Central London, London, United Kingdom Hybrid / WFH Options
Franklin Bates Limited
solutions. If you have experience in the below blend of areas and skills, you will excel in this role: Integration Application architecture and design Azure cloud-based infrastructure solutions Azure Integration services, Azure API management Azure Data Lakes, AzureSynapse Networking, security and storage more »
City of London, London, United Kingdom Hybrid / WFH Options
Tech Talent Identified Ltd
A Data Platform Product Manager required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. You will be required to build strong relationships across the client and use a strong commercial … expert within the data platform domain, with strong technical knowledge and demonstrable passion, including understanding on (some of): Data lakes, data marts, data warehousing (Azure Data Bricks, Azure Data Factory, AzureSynapse, HD Insight) SQL, NoSQL and Graph databases Processing structured and unstructured data, data models more »
model factories, along with proven mentoring abilities and good critical thinking with problem-solving skills. Nice to Have: Experience with relevant technologies such as Synapse, Azure Data Lake, Azure Data Factory, and Databricks. Why Join: This is an opportunity to join a collaborative environment that encourages innovation more »
Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's insurer whose size offers agility and allows … you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be designed and implemented from … scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within the business, understand decision more »
Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 2 days in the office per week (Central London) A leading global insurer is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of-the-art Data … and Analytics strategy, we are redefining client intimacy and decision-making accuracy through a unified data ecosystem. As the Chapter Lead for Data Engineering, you will spearhead the creation and implementation of a comprehensive data strategy that empowers our business users across the globe. Your role is crucial in … Responsibilities: Develop and execute data strategies in alignment with the company's goals. Lead the design and implementation of our data engineering frameworks on AzureSynapse, creating a unified version of truth. Drive the adoption of self-service tools and capabilities, enabling non-technical users to leverage data more »
Senior Data Engineer - Azure/Databricks - £75-80,000 Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on … is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer and more consistent. This role would suit someone who is currently working as a Senior Data Engineer and who wants a … a leadership position, as that is the longer term plan for this role. Key Experience Required: In-depth knowledge of and experience with Databricks Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python more »
Senior Analytics Data Engineer 🌐 Global Insurance Leader 💵 £120,000 + 20% Bonus 🏠 1-2 days in the office (Central London) 🌐 Join a Global Insurance Leader: Exceptional Opportunity for a Visionary Data Engineering Expert! Are you an experienced Senior Analytics Data Engineer who thrives on transforming data into actionable … a prestigious global insurer, is at the forefront of leveraging data and technology to revolutionize decision-making across the organization. Their ambitious Data and Analytics strategy aims to provide a 360-degree view of data to empower every team member to make informed decisions based on a single version … of truth. As a Senior Cloud Analytics Engineer, you will play a pivotal role in turning data into valuable insights that enable better decision-making across all functions. You will create cutting-edge visualizations and analytical views, support the creation of a self-service data mining environment, and develop more »
team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business Intelligence, Analytics and Data Science. Develop and optimise large-scale data pipelines that ingest data from a variety of sources Work in a dynamic and exciting … required You Have These: Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. AzureSynapse, Snowflake, Amazon Redshift) Awareness of data governance and all surrounding legislation Interest in security and how to handle PII data Excellent written … as PowerBI, Looker or Tableau Experience with data pipeline tools such as DBT, Airflow or Luigi are a plus! Experience using cloud environments e.g. Azure or AWS Understanding of the Agile delivery method Working Conditions: · Permanent, London Chiswick Park · Working hours are: 9am-5pm · Working days are: Mon-Fri more »
within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must! Including, Azure SQL, Data Lakes and AzureSynapse Analytics. Ready to Apply? If you are reading this and more »
South West London, London, United Kingdom Hybrid / WFH Options
83zero Limited
within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must! Including, Azure SQL, Data Lakes and AzureSynapse Analytics. Ready to Apply? If you are reading this and more »
experience in financial services, particularly with Kimball methodology and extensive knowledge of MS SQL. Minimum of 5 years of Solution Delivery experience utilising Microsoft Azure BI stack (Azure ADF, Azure Blob storage, Synapse, CI/CD, and PowerBI). Experience with managing internal data engineers and more »
for leading and contribute to data engineering projects, designing and implementing efficient and scalable data pipeline. The ideal candidate will be an expert with azure cloud, python and SQL. Responsibilities: Lead and contribute to data engineering projects, designing and implementing efficient and scalable data pipelines. Demonstrate proficiency in data … database systems, with a strong command of programming languages. Design and optimise data models to ensure efficient storage, retrieval, and processing of data Requirements: Azure cloud experience is essential (Data Factory, Data Bricks, AzureSynapse) Strong expertise in designing, implementing, and optimising Extract, Transform, Load (ETL) processes more »
organizational initiatives. Work in a multi-disciplinary team environment, collaborate with all stakeholders and work toward consensus building while working on various data and analytics projects. Key Result Areas and Activities: Collaborate with stakeholders to gather, analyse, and document business requirements. Translate business needs into technical requirements for data … engineering and analytics solutions. Understand business source system like SAP and business meaning of the data. Design, estimate, plan and implement the data migration projects from one platform/tool to another. Utilize Azure environment to extract, transform, and load (ETL) data from various sources. Design and implement …/tool to another Able to define/implement data governance and management best practices and industry standards for the organization. Strong experience on Azure cloud services like Azure, ADF, ADLS, Synapse Proficiency in querying languages such as SQL, Pyspark, Python and familiarity with data visualization tools more »
instances. Their models are a mixture of well-known classical ML systems and highly bespoke deep learning models. They run on AWS and soon Azure, with plans to also add GCP and on-prem. They are adding extensive usage of distributed compute on Spark, starting with their more complex … ETL and advanced analytics functions, e.g. Time Series Processing. They soon plan to integrate other approaches, including native distributed PyTorch/Tensorflow, Spark-based distributor libraries, or Horovod. TECH STACK: Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; AzureSynapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES Lead the productionisation of Monolith’s ML models and data processing pipelines, both mid-low-level system and design and exemplary hands-on implementations using Spark and other tech stacks Shape the ML engineering culture and practices around model & data versioning more »
is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer and more consistent. This role would suit someone who is currently working as a Data Engineer and who wants a role … the longer term plan for this role. Key Experience Required: In-depth knowledge of and experience with Databricks 3+ years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python more »
Azure Data Engineer - £60,000 + Benefits, London, weekly on-site You must have full right to work authorisation. No sponsorship available. Azure data platform technologies, including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Working in a leading UK and global business you will … service, at the forefront of the technical development of cloud data platforms, offering near real-time process reporting solutions. Your Profile : Extensive experience with Azure data platform technologies, ideally including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Proven skills with Azure Data Factory & Databricks … Embracing development design principles to ensure excellence whilst developing and scaling cloud data platforms using CI/CD pipelines and Terraform. Collaborating with the analytics and insights team to build solutions that combine internal insights, customer outcomes, and external data feeds, unlocking the potential of big data and machine more »
Senior Azure Data Engineer (Consultancy) £70,000-£80,000 salary Hybrid (London) Immediate start One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out with an urgent … hire for a Senior Azure Data Engineer to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** They have a new project starting in mid-February, so are looking ideally for immediately … candidates for interviews next week, and they are looking to have this position filled by next Friday . Essentials: Experience in a consultancy . Azure Data Engineer certification . Experience working with Dynamics 365 Experience with AzureSynapse , Data Factory , Data Lakes 4+ years as a Data more »
of shaping this vibrant expansion. About the Role You'll play a key role in supporting the design, development, and technical implementation of advanced analytics and AI solutions. Your responsibilities will include collaborating on both new and existing products, delivering actionable insights to clients, and harnessing advanced data methodologies … sklearn, pytorch, langchain, llamaindex, bedrock, sagemaker, huggingface, mlflow, gradio, Flask, FastAPI, SQLAlchemy, psycopg2, boto3, gunicorn, pytest, and scrapy Experience with cloud services like Microsoft Azure (Data Factory, ML Studio, SynapseAnalytics, etc.) Interest in researching, testing, and implementing state-of-the-art technologies to address challenges We more »
by helping to identify and especially remove impediments impacting the team's ability to deliver Building, testing and deployment of optimised data solutions for analytics and reporting (for example DataMart’s, views, perspectives, cubes). Supporting the planning of data platform services including sizing, configuration, and needs assessment. You … These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. AzureSynapse, Snowflake, Amazon Redshift) Awareness of data governance and all surrounding legislation Interest in security and how to handle PII data Excellent written more »