76 to 100 of 233 Data Lake Jobs in the UK

Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Vivo Talent are engaged with an organisation who is going through a huge transformation in how their data is used and managed. They require a Data Architect who is passionate … utilising their understanding of Azure data tools to implement and maintain an effective platform. Skills Azure Stack (SQL, Synapse, Data Lake) Power Bi Demonstrated experience in a similar position Strong stakeholder management skills both internal and external If you are interested in hearing more about … this opportunity, please get in touch. Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent more »

Data Engineer – London - £100,000 Description My client, a prominent figure in the insurance industry are on the hunt for a Data Engineer to join there ever growing Data team. The right individual will have a passion for Data as well as … being able to communicate to non-technical stakeholders. The right Data Engineer will ideally have experience working with Azure however my client are open to seeing people equally AWS/GCP. Responsibilities Designing and implementing scalable and efficient data storage solutions on Azure. Building and maintaining … a Data Engineer, preferably on the Azure platform. Strong knowledge of Azure data services, such as Azure Data Lake Storage, Azure Databricks, and Azure SQL Database. Proficiency in SQL and programming languages like Python or Scala. Experience with data modeling and more »

detriment and business impact through swift and accurate analysis. Additionally, you'll assist the Incident Manager in building and overseeing the reporting and data infrastructure for the Next Customer Service Online Operations across our contact centres. What you’ll be doing: Take ownership of report implementation from understanding … through to development and implementation. Support project with expertise and knowledge of reporting systems advising of best practices and optimum set up of data structures. Create, analyse and then provide accurate management information/reporting and forecasting as required by the department/business on a daily/… Experience of working with Contact Centre Metrics. Experience of change management. Experience in working with Microsoft Azure Platform eco-system ( Azure data lake , Azure data factory, Azure Synapse Analytics , Data bricks , Power BI etc) would be highly desirable. Experience in Data more »

on delivering quality services and solutions. Able to distill complex technical challenges to actionable and explainable decisions. Having in-depth knowledge on Azure data components with this feature to provide solutions and necessary recommendations on the architecture. Inspire teams by building consensus and mediating compromises when necessary. Demonstrate … as a new product within a platform & product landscape. Having knowledge on the data components such as Azure datafactory, data lake, Azure SQL DB, Synapse and visualization with expertise skills in terms of performance tuning and advanced troubleshooting. 8+ years of experience in data architecture, analytics, design and development Good working knowledge in trouble shooting data warehouse/analytical systems using Azure Synapse. Strong, in-depth experience in data modelling and experience with business intelligence Design and develop batch and real-time streaming of data loads more »

Senior) Engineering Manager – Data & ML GlobalAXA XL recognizes digital, data and information assets are critical for the business, both in terms of managing risk and enabling new business opportunities. Data Science and Applied AI assets should not only be high quality, but also drive … a sustained competitive advantage and delivering a superior experience to our internal, external customers and improving efficiency. Our Innovation, Data and Analytics function is focused on driving innovation by optimizing how we leverage digital, data and AI to drive strategy and differentiate ourselves from the competition.As … applications – from data engineering to ML operations (training, serving, monitoring), and microservice/web application engineering.Our tech stack: Azure Data Lake, Azure Databricks (Notebooks, APIs, Workflows), MLflow, dbt, Harness CI/CD, OpenShift, Docker, GitHub, JIRADISCOVER your opportunity What will your essential responsibilities include?· Set more »

Role: Senior Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B and … SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit firms … for you to excel in. We believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility more »

can be throughout the recruitment process; if you require any additional adjustments please let us know.The Platform tribe is looking for a talented Data Engineering manager to lead our Data Engineering Squads building data platforms that power the rest of Dojo’s Tribes design … develop and maintain data products and solutions to the most prevalent problems and needs across the business. Driving thought leadership across Platform (not just data engineering) driving a data-led approach to building Platforms that power the rest of the businessOur Platform tribe is … familiar with cloud-based data warehouses such as BigQuery and Snowflake, as well as the principles of a modern data lake based on Apache Avro and ParquetExperience managing data platforms as a product is essential and ability to measure value delivery in Platform more »

safe, and designed for the future.Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and … public-sector, Methods is now building a significant private sector client portfolio.Methods was acquired by the Alten Group in early 2022.As a Lead Data Engineer at Methods you will be expected to get involved with projects from conception to delivery - leading and supervising other engineers to meet requirements … JSON, Parquet, XML etc.Experience with or developed understanding of the application of ETL/ELT tools.Experience with NoSQL type environments, Data Lakes, Lake-Houses (Cassandra, MongoDB or Neptune).Experience with distributed storage, processing engines such as Apache Hadoop and Apache Spark.Experience with message brokering/stream processing more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data …/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data … data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. Participate in code reviews and provide constructive feedback to peers. Required Skills and Experience more »

Azure Developer (C#, DevOps, Data Lake, Logic Apps) Havant, Portsmouth (1-2 days per week in the office). £45000 - £62000 + Benefits Your new company I’m working with an energy provider with a focus on modern DevOps practices that have considerably grown their Development team … Azure Developer strong fundamental C#. Deep knowledge of Azure is essential – Azure DevOps (Functions, Redis, Service Bus etc), plus knowledge of Data Lake, Logic Apps, Power BI etc. Working here you’ll use the latest versions of .Net daily to build complex applications. You should have good more »

App Services, virtual networks, Exchange Online, Intune). * Implement Azure security best practices and Microsoft Defender. * Monitor and mitigate security incidents. * Protect sensitive data and ensure data governance compliance. * Collaborate … with Data and AI teams on Azure-based solutions. * Guide on Azure services for Data and AI (Data Lake, Data Factory, OpenAI). * Integrate Data and AI solutions with existing systems. * Maintain on-premises infrastructure (Windows Server, Active Directory … CV to connor . thomas @ nextech - group . co . uk. They are interviewing IMMEDIATELY!! Keywords: Azure, Entra ID, SQL, Exchange Online, Intune, Data, Windows Server, Active Directory, Oracle, VMware, Red Hat, Enterprise, Linux, Cisco Switches, Palo Alto Firewalls, PowerShell, Python more »

Data Analyst X 2 - Manchester Our Manchester client is looking for two Data Analysts to join our friendly and diverse team. Your role will involve turning data into insightful analysis and models to drive business growth. You will help develop customer analysis, provide insights … identify opportunities for strategic improvements. Key Responsibilities: Analyse and interpret large datasets to identify trends, patterns and insights Develop statistical models and perform data mining techniques to support business decisions Work closely with various teams across the organization to understand their data needs and provide appropriate … research on business challenges Generate reports from both structured and unstructured data in our Data Warehouse and Data Lake Assist in regulatory and compliance tasks by creating detailed reports Develop, prototype, and maintain reports in Power BI utilizing SQL and DAX Engage in more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

Data Engineer – Azure A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment. Based in either Derby or … the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward. Key Responsibilities As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented team … Microsoft Azure experience Proficiency in Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc. Strong Python and SQL skills for data manipulation Experience with Apache Spark and/or Databricks. Familiarity with BI visualization tools more »

Master Data Transformation Lead 12 Month Contract Our Global Retail Client has a brand new role as a Master Data Programme Lead to oversee every aspect of a programme from conception to implementation. You will provide expertise, tools and frameworks to ensure successful delivery of programme … and in function especially in cases of high demand where value is at risk and additional effort is needed. Programme Experience & Skills Master data Led Master Data strategy and implementation programs focused on creating a Master Data Function and Governance at Group level to … volume, data environments designed for analytics and CRM use cases. Led projects to select, design, implement and manage data lake/data warehouse platforms. (Some of the following types of providers: AWS, Microsoft Azure, Google Cloud Platform, Databricks, Snowflake, Cloudera, Spark, MongoDB more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

/programmes, developing architecture blueprint, high level design and implementation of the following aspects of solution architecture: Services, Applications, Integration, Technology, Security and Data Experience of working with and across multiple methodologies and technologies to ensure delivery of critical projects and programmes. As well as the above core … candidates to work on one of five different Bank initiatives, depending on your following additional skills: CRM, Integration API, MS Azure, MS SQL Data Warehousing, XBRL taxonomies, Data Collection systems & Data lifecycle management Integration - MQ, API's, SWIFT, .Net Development, Portal Development, MS SQL … MS Azure, MS SQL Data Warehousing, XBRL taxonomies, Data Collection systems &Data lifecycle management Azure Data Lake, Synapse, Elastic Search, Data lifecycle management & Data Sourcing (Bloomberg, Reuters, ONS etc.). In addition, you can expect a planned more »

the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … Essential Requirements: Proven track record in designing and building data infrastructure and ETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps etc. SQL Server, including Store Procedures, T-SQL, or similar enterprise database toolset. Familiarity more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and … implementation of a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology experience. more »

SC Cleared) London (Hybrid) Permanent £70,000 - £90,000 (DOE) Software Developer needed with active SC Security Clearance and strong Python, SQL + Data Visualisation tools (PowerBI/Tableau). Working in London on a hybrid remote basis (typically 2-3 days/week in the office). … + implementing innovative banking applications and systems. Python and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: Banking, JavaScript, HTML, CSS + front-end more »

SC Cleared) London (Hybrid) Permanent £70,000 - £90,000 (DOE) Software Developer needed with active SC Security Clearance and strong Python, SQL + Data Visualisation tools (PowerBI/Tableau). Working in London on a hybrid remote basis (typically 2-3 days/week in the office). … + implementing innovative banking applications and systems. Python and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: Banking, JavaScript, HTML, CSS + front-end more »

Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »