Data Engineer - Coding skills: Pyspark or Scala(level to troubleshoot issues) and SQL. Must have good pyspark knowledge to build data transformation. Hands on Azure data platforms i.e; Azure Datafactory, Databricks, Synapse, SQL, Data lake storage. Experience building and optimizing ‘big data’ data pipelines, architectures and data … environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments. Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow. Good Data analytics skill and able to communicate with customers/business users. more »
Data Engineer – Coding skills: Pyspark or Scala(level to troubleshoot issues) and SQL. Must have good pyspark knowledge to build data transformation. Hands on Azure data platforms i.e; Azure Datafactory, Databricks, Synapse, SQL, Data lake storage. Experience building and optimizing ‘big data’ data pipelines, architectures and data … environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments. Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow. Good Data analytics skill and able to communicate with customers/business users. more »
Location: Surrey The 4 main things we need are.... Someone who's a good team player Experience with Python programming A good understanding of Azure technologies Insurance domain knowledge Do you tick these 4 boxes? If so, please read on..... Must haves: Python Data modelling, data warehousing and ETL … frameworks Oracle, PostgreSQL Synapse, Hadoop, Spark, Kafka Exciting times to be part of an enterprise environment like this one, there won't be many on the same scale! The experience you'll gain from this opportunity will be invaluable. This is not only a great career opportunity, you'll more »
Exeter, England, United Kingdom Hybrid / WFH Options
BJSS
highly skilled consultants, delivering modern data platforms into large organisations. You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. more »
Nottingham, England, United Kingdom Hybrid / WFH Options
BJSS
highly skilled consultants, delivering modern data platforms into large organisations. You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. more »
Birmingham, England, United Kingdom Hybrid / WFH Options
BJSS
highly skilled consultants, delivering modern data platforms into large organisations. You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. more »
insurance space. There are two main programmes of work that are mid flight with plenty of work left to do. The first is an Azure platform build and migration the second is (can you guess it?) a data transformation to Azure using Synapse. These programmes are being managed … Lloyd's of London syndicate experience Proven expertise in designing and implementing enterprise-level architectures Business and Technology driven Enterprise Architecture Experience working on Azure cloud migrations/platform build programmes Able to face off to C-Level Stakeholders - technical and non-technical. Any relevant certifications - TOGAF, ITIL etc. more »
insurance space. There are two main programmes of work that are mid flight with plenty of work left to do. The first is an Azure platform build and migration the second is (can you guess it?) a data transformation to Azure using Synapse. These programmes are being managed … Lloyd's of London syndicate experience Proven expertise in designing and implementing enterprise-level architectures Business and Technology driven Enterprise Architecture Experience working on Azure cloud migrations/platform build programmes Able to face off to C-Level Stakeholders - technical and non-technical. Any relevant certifications - TOGAF, ITIL etc. more »
Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are recognised … for the impressive high standard of work they conduct. They are looking for an Azure Data Engineer, you will play a pivotal role in this journey, leveraging your expertise to architect, design, and implement scalable data solutions on the Azure platform. You will collaborate closely with stakeholders to … and achieve their business objectives. Key Responsibilities: Collaborate with clients to gather and analyze business requirements. Design and implement scalable data solutions on the Azure platform, leveraging services such as Azure SQL Database, Azure Data Lake, and AzureSynapse Analytics. Develop and maintain ETL pipelines more »
Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the biggest and … most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to combine the latest … thinking with traditional military functions. *Must have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory, Azuremore »
Azure Data Engineer An Azure Data Engineer is required by Whitehall Resources for our client based in the south of England. This is a permanent role and can be done from the comfort of the successful candidate’s home with travel into the office one to two times … successful candidate will come from a Data Engineering background and have experience with the latest Microsoft technologies. Strong knowledge of MS SQL Server on Azure with proficiency in SQL will also be needed. Do you have? Azure Data Engineering experience? Strong knowledge of MS SQL Server on Azure … the design, build, and maintenance of ADF data pipelines to extract, transform, and load (ETL) data from various sources into Data Warehouses? Exposure to AzureSynapseAnalytics? Excellent communication skills? Would you like? Work for an exciting end user? Have a great work and personal life balance more »
Data Engineer – SQL/Azure Data Factory/Power BI * Sponsorship is not available with this position * Role – Data Engineer Salary – £60k - £70k DOE Location – Remote - London HQ Due to success, a key client of mine is going through an expansion and are now looking to add a Data … to the team as they undergo a technology transformation to the cloud. They are looking for someone experienced in building a data warehouse and analytics platform based on Azure. You will be working collaboratively with the rest of the Data team as well as other key stakeholders within the … years BI/Data experience Working with and understanding complex data sets Good data design and management experience including data cleansing Experience in using Azure data Factory, AzureSynapseAnalytics and Power BI Knowledge of on-prem technologies - SSRS, SSIS, SSAS, SQL Knowledge of AI and more »
to streamline processes Requirements Possess modern Data Engineering experience Demostrate In-depth knowledge of large-scale data platforms (Databricks, Snowflake) and cloud-native tools (AzureSynapse, RedShift) Experience of analytics technologies (Spark, Hadoop, Kafka) Have familiarity with Data Lakehouse architecture, SQL Server, DataOps, and data lineage concepts … Demonstrate In-depth knowledge of large-scale data platforms (Databricks, Snowflake) and cloud-native tools (AzureSynapse, RedShift Work in a way that works for you We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous … development resources - Access to employee discounts scheme via Perks at Work About the Business LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital more »
Southampton, England, United Kingdom Hybrid / WFH Options
Spectrum IT Recruitment
Data Architect SQL, PowerBI, Azuresynapse data warehouse, ETL Leading data transformation & strategy within the business Southampton based 2-3 days per week Spectrum IT has partnered with a leading green energy consultancy who supports and empowers companies with the journey to net zero. With a unique range … NHS and within private sector companies across the UK. As part of a large Data transformation within the business they are building a new Azuresynapse data warehouse and consolidating multiple forms and streams of data into 1 centralised platform. The Data architect will be a crucial part … data strategy. Key Skills: Highly advanced level of SQL querying & database management Advanced level PowerBI & strong experience building reports & dashboards A strong understanding of Azure data warehouses and/or data lakes An ability to analyse the companies data estate and identify strengths, weaknesses and opportunities Prior experience designing more »
Senior Azure Data Engineer £85K - £90K (D.O.E) Hybrid: 2 - 3 days a week on-site in London Must be already eligible to work in the UK and not Sponsoship dependant Previous exclusive(ly) contracting experience will not be considered (unfortunately) As the Senior Azure Engineer, you will oversee … Azure governance, manage Azure subscriptions, and provide architectural design oversight for Azure infrastructure. Additionally, you will lead the Service Team within the Data Center Department. Responsibilities: Establish and enforce Azure usage standards. Manage budgets and provide cost reporting for Azure resources. Collaborate with various teams … to design, deploy, and optimize Azure cloud solutions. Define responsibilities and set guardrails for Azure usage. Support application teams for effective Azure utilization. Ensure high availability, scalability, and performance of cloud resources. Support Microsoft Power Platform components including CRM, Power Apps, Power Automate, and Power BI. Share more »
Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's insurer whose size offers agility and allows … you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be designed and implemented from … scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within the business, understand decision more »
Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 2 days in the office per week (Central London) A leading global insurer is on a transformative journey to become the benchmark for quality across all its insurance markets. Leveraging a state-of-the-art Data … and Analytics strategy, we are redefining client intimacy and decision-making accuracy through a unified data ecosystem. As the Chapter Lead for Data Engineering, you will spearhead the creation and implementation of a comprehensive data strategy that empowers our business users across the globe. Your role is crucial in … Responsibilities: Develop and execute data strategies in alignment with the company's goals. Lead the design and implementation of our data engineering frameworks on AzureSynapse, creating a unified version of truth. Drive the adoption of self-service tools and capabilities, enabling non-technical users to leverage data more »
Senior Analytics Data Engineer 🌐 Global Insurance Leader 💵 £120,000 + 20% Bonus 🏠 1-2 days in the office (Central London) 🌐 Join a Global Insurance Leader: Exceptional Opportunity for a Visionary Data Engineering Expert! Are you an experienced Senior Analytics Data Engineer who thrives on transforming data into actionable … a prestigious global insurer, is at the forefront of leveraging data and technology to revolutionize decision-making across the organization. Their ambitious Data and Analytics strategy aims to provide a 360-degree view of data to empower every team member to make informed decisions based on a single version … of truth. As a Senior Cloud Analytics Engineer, you will play a pivotal role in turning data into valuable insights that enable better decision-making across all functions. You will create cutting-edge visualizations and analytical views, support the creation of a self-service data mining environment, and develop more »
organizational initiatives. Work in a multi-disciplinary team environment, collaborate with all stakeholders and work toward consensus building while working on various data and analytics projects. Key Result Areas and Activities: Collaborate with stakeholders to gather, analyse, and document business requirements. Translate business needs into technical requirements for data … engineering and analytics solutions. Understand business source system like SAP and business meaning of the data. Design, estimate, plan and implement the data migration projects from one platform/tool to another. Utilize Azure environment to extract, transform, and load (ETL) data from various sources. Design and implement …/tool to another Able to define/implement data governance and management best practices and industry standards for the organization. Strong experience on Azure cloud services like Azure, ADF, ADLS, Synapse Proficiency in querying languages such as SQL, Pyspark, Python and familiarity with data visualization tools more »
instances. Their models are a mixture of well-known classical ML systems and highly bespoke deep learning models. They run on AWS and soon Azure, with plans to also add GCP and on-prem. They are adding extensive usage of distributed compute on Spark, starting with their more complex … ETL and advanced analytics functions, e.g. Time Series Processing. They soon plan to integrate other approaches, including native distributed PyTorch/Tensorflow, Spark-based distributor libraries, or Horovod. TECH STACK: Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; AzureSynapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES Lead the productionisation of Monolith’s ML models and data processing pipelines, both mid-low-level system and design and exemplary hands-on implementations using Spark and other tech stacks Shape the ML engineering culture and practices around model & data versioning more »
streaming data pipelines (e.g., Beam, Flink etc) Proven expertise in designing and constructing data lakes and data warehouse solutions utilising technologies such as BigQuery, AzureSynapse, Redshift, Oracle, Teradata, and more. Familiarity with Agile methodologies, particularly Scrum, to support dynamic project management. Valuable contributions to open-source projects more »
with a leading legal & financial services body at a critical and exciting point in their data journey, who are subsequently looking for an experienced Azure Data Engineer (ideally with ADF and Synapse experience), to help drive forward change. Amazing company with a great mission statement, alongside huge scope … progression within a growing team – would suit someone with 4+ years working in Data Engineering/Platforms. Two stage interview process and fully remote. Azure stack SQL ADF Synapse Experience mentoring junior team members Please apply for full info. Candidates must have full UK right to work without more »
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near Victoria station … days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support the ongoing development of … and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics and reporting, working very closely with the Power BI Engineer. This is a really exciting opportunity for a Data Engineer to work for an more »
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near Victoria station … days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support the ongoing development of … and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics and reporting, working very closely with the Power BI Engineer. This is a really exciting opportunity for a Data Engineer to work for an more »
This role in question will sit between an Architect and a Principle Engineer. For this role, you need to have extensive experience in the Azure Ecosystem and experience in building pipelines. Main Responsibilities: Vast knowledge of working within the Azure environment. Using AzureSynapse with utilising more »