1 to 25 of 84 Data Lake Jobs in the UK excluding London

indicators. the NIS CMDB module into ServiceNow and streamline the process by aligning it with the NIS Changes Power App. Work on systemising data transfers into Maximo (asset management system). the overall Digital monthly reporting covering both IT and OT to reduce manual effort. Enhance ServiceNow to … Skills: with OTSM, including OT CMDB, OT Incident, OT Change, and Problem. of Reporting & Performance Analytics. with Power BI integration and Data Lake Sync. Benefits: work lifestyle with 75% remote and 25% office-based. to work with a collaborative team on meaningful projects. If you are a more »

Job title – Analyst Developer (Data engineering, Databricks, python) Location – Birmingham We will consider new graduates with some knowledge or classwork in SQL and python who are passionate about data engineering and learning Azure Databricks, but may not have a full complement of relevant work experience. About … of the development lifecycle including support. The primary focus for this candidate will be on data engineering, using Azure Data Lake, Azure Databricks with python and other related Azure Data services to support the strategic and tactical goals of Federated Hermes’ data … architecture • active engagement in knowledge sharing • develop Azure Databricks pipelines to interact with data held in Azure SQL, Azure Data Lake ,and Azure Synapse SQL Pool (data warehouse) facilitating operational and analytics data use cases (In lieu of specific Azure Databricks more »

Description Due to continued growth we are currently looking for Senior Data Engineer to join our Professional Services division - you will be part of a cross functional Data consulting team spanning data engineering, visualisation, analytics and science. You will be working with our clients … across multiple sectors, helping them to explore next-generation data techniques and tools to drive incremental business value from their data assets. A day in the life of an Aiimi Senior Data Engineer: You will be responsible for collaborating with business subject matter experts …/Tools SQL coding skills (essential) Python coding skills (essential) Experience with Azure, or other cloud platform, tools (ADF, Azure, Databricks, Data Lake Storage, SQL DWH) Familiarity with distributed systems (Spark, Databricks etc.) Familiarity with semi-structured and unstructured data Benefits Up to 10% of more »

is an exciting opportunity to join our team of technology experts here at Carpetright. You’ll be the technical and design lead on data management and security for all our projects whilst helping to develop the technical team’s skillset. You’ll act as the interface to integrate … DevOps work management to orchestrate and manage team workloads. Solid experience with building data platforms on cloud (Microsoft Azure Data Lake, Synapse, Fabric, Data Warehouse environment) You’ll be an expert in SQL writing in SQL Server/SQL Azure Data Warehouse You will definitely have strong technical understanding of data modelling, design and architecture principles and techniques across master data, transaction data and derived/analytic data. Experience in working across Product Technical teams, Business Market teams to realize their business needs more »

Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/… Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure … Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache more »

Experienced SQL Data Engineer Prestigious Client/Home An innovative client, making a significant impact within their sector, my client is going through a major business/systems transformation programme with a core focus of that being centred around their Data and BI/Reporting. The … client is a reputable global brand and this role is integral to the success of their long-term vision for their Data Strategy, Platform and BI reporting. Forming part of an established Data team, the successful candidate will have a proven background of designing, delivering and … cube development Data processing and ETL Data Modelling Data security Azure Data Factory, Data Lake Please forward your most recent CV to be considered and contact Stewart Lloyd at Integrity Recruitment Solutions via LinkedIn, or our website. SQL/ more »

will include… You will be able to produce a variety of reports focusing on a range of areas, including; Security, Performance, compliance audits, data collected from various IT Systems and tools. Strong ability to maintain and develop technical documentation, including system configurations, network diagrams, operating procedures to support … clients IT Environments. You will be analysing large data-sets to identify trends, patterns and anomalies, and have the ability to extract worthwhile insight to be included in the reports. Be an SME around identifying opportunities where automation report created can be used, using scripting languages and reporting … tools to enhance efficiency and scalability. What you've got… Experienced background in Report Writing, Data Analysis, or technical documentation within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must more »

Data Architect SQL, PowerBI, Azure synapse data warehouse, ETL Leading data transformation & strategy within the business Southampton based 2-3 days per week Spectrum IT has partnered with a leading green energy consultancy who supports and empowers companies with the journey to net zero. … having impacts across the education sector, parts of the NHS and within private sector companies across the UK. As part of a large Data transformation within the business they are building a new Azure synapse data warehouse and consolidating multiple forms and streams of data into 1 centralised platform. The Data architect will be a crucial part of this project helping to analyse the current data estate, identify opportunities and weaknesses then build a roadmap for the data strategy. Key Skills: Highly advanced level of SQL querying more »

Hoist Finance is a leading financial services company committed to innovation and excellence and is currently looking to recruit a Data Engineer to join their team. The purpose of the role is to integrate data from all types of sources into the Hoist Finance data platforms. Key Skills Needed: 3 years experience as a Data Engineer Intermediate knowledge of one of the popular RDBMS (e.g. SQL Server, Oracle, MySQL, PostgreSQL) Knowledge of BI Stack design and implementation Any … knowledge in some of the following areas is an advantage:- Snowflake, DBT, Azure Technologies including Azure Data Factory, Azure Data Lake, Azure DevOps, Powershell, GIT, Python. Excellent communication and interpersonal skills As a Data Engineer you will be: Developing data integration more »

Job : Data Architect Salary : £80,000 - £90,000 Type : Permanent As a Data Architect, you will you will play a critical role in driving our data strategy, data architecture and designing data solutions. You will contribute and oversee the implementation … of our data strategy that supports our financial services operations by providing data architecture consultancy, collaborating with all areas of our organisation to understand business requirements and develop scalable data architectures that enable efficient data management, analytics, and integration. You will be … and their integration with data architectures. Comprehensive knowledge of data modelling, data design principles, and data lake and warehousing concepts. Leadership qualities with a collaborative and team-oriented approach. Strong analytical mindset and problem-solving abilities to address complex technical challenges. more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global … when needed, accurate and understood. Key Technical Skills required: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server … . Metadata management/Data quality Profile Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data … requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Datalake and Databricks. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in … successful digital transformation initiatives involving data engineering and analytics. Significant hands-on Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data into data lake storage areas, physical databasemodels and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. Build more »

Due to continued growth within our professional services, we are looking for a Solution Architect to join our data practice - working with some of the best data professionals in the country. You will play an integral part in taking our data services to market … providing technical and strategic thought across the whole lifecycle of data projects from presales through to sign-off and support. A day in the life of an Aiimi Solution Architect: Taking on technical ownership of data projects and transitioning them from presales to delivery Translating customers … and/or GCP would be of added benefit) Experience of using technologies such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Analysis Services, Databricks and Power BI (or equivalent technologies within AWS or GCP stack) Experience of implementing centralised data more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Role : Data Product Owner … Location : Leeds UK- Hybrid Type of resource : Contract 6+ Months Must Have : Primary POC to Stake holders, Strong Understand of Azure Data Lake & Data Bricks Data product owner responsibilities includes the following: Act as the primary point of contact for the data … prioritize requirements. Develop and maintain a product roadmap, aligning it with business goals and technical capabilities. Play a crucial role in establishing robust data pipelines, defining data models, setting up data governance systems, and ensuring the secure and efficient processing of data more »

in X++ and T-SQL, experience in developing within the Power Platform, and familiarity with Azure integration technologies (Functions, Logic Apps, Data Lake, Synapse, ADO). Key Responsibilities System Integration: Collaborating with stakeholders to understand business requirements and designing integration solutions to connect Dynamics 365 Finance and … Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies (such as X++, C#, SQL, XML, JSON) to create seamless data … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

The Role - This growing manufacturing company are increasing their IT function capability in the area of Data Analytics, having a need to improve visibility of data to help with business decisions, interpret results, identify trends and opportunities to ensure the business is achieving the most value … Ensure there is appropriate reporting consumption methods for the different data paths. Drive the BI strategy using the Microsoft data lake and Power BI data sets as the primary data source. Maintain the Power BI first approach. Build and lead a … elements of master data. Skills & Qualifications - Experience implementing enterprise BI and reporting solutions. Experience of Microsoft BI technology such as Microsoft Data Lake, Dataverse, Power BI, Azure Synapse with a Data First Approach. Able to own the analysis, design and delivery of reporting. Proficient formatting more »

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test … deploy data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with … enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory more »

Data Engineer/Architect (GCP) Google Cloud Platform | Fully Remote | £55,000 The Role: My client are a leading digital consultancy, specializing in delivering innovative solutions to businesses worldwide. With a focus on leveraging cutting-edge technologies and strategic insights, they empower our clients to thrive in the … digital age. Position Overview: We are seeking a talented Data Engineer/Architect with expertise in Google Cloud Platform (GCP) to join our team. This position is fully remote, with the option to work from offices based in Cardiff, United Kingdom. As a Data Engineer/… Architect, you will play a pivotal role in designing, implementing, and optimizing data solutions that drive business value for our clients. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure the successful delivery of projects. Key Responsibilities more »

What you’ll do We are looking for a Data Platform Engineer, someone who can deliver operational excellence and stability in our data platforms that underpin the services we deliver for our customers. You’ll be part of the team helping to build strong, collaborative relationships … help define the future of hospitality both in the UK and abroad. Responsibilities will involve:- Implement and maintain secure, scalable, and highly available data platforms within our datacentre and public cloud environments. Build and continually improve tooling, monitoring, and security controls. Own the data platform aspects … d like you to have experience in design, implementation and day-to-day running of enterprise level data platforms, data lake concepts and data handling. We’d also like you to have experience of solid monitoring and tuning skills in highly available transactional more »

Data Analyst/Engineer - £50,000 - £60,000/Carmarthenshire (South Wales) + Hybrid 2 days on-site Are you looking to join an exciting business as they continue their scale-up plans in 2024? This is a fantastic opportunity with a business proud to be expanding in … Wales. This is a great opportunity for a Data Engineer or Data Analyst/BI dev who wants to develop their skills in Data Engineering. If you have a background in creating dashboards in Power BI feel free to apply or reach out for … ll be doing: You’ll be the brain behind developing and putting into action strategies to gather, process, and dissect large sets of data, all aimed at giving clients actionable insights. You’ll focus on crafting and maintaining data pathways to ensure data accuracy more »

Lead Data Engineer - £70k plus benefits - hybrid 2 days in Manchester An exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid). The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with … other data engineers in the team as well as the analytics team, architecture team and stakeholders. You will be responsible for the development, operation and maintenance of data pipelines to extract, load and transform data sources from both internal and external/third-party … candidate will have led a team or projects and used to working in an Azure environment with a focus on Azure Data Lake, Databricks, Azure Data Factory and Power BI architectures. Working with Python, SQL, Spark and Databricks, you will build, rebuild and maintain data more »

change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role … who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data technology , steering our organization towards cutting-edge platforms and methodologies. Architect and execute comprehensive data projects, ensuring robust scalability and performance from conception to deployment . Collaborate with a team of ML Engineers, Data Scientists, and other key stakeholders to design, implement, and maintain more »

Azure is our main offering, but experience with AWS/GCP is a strong plus! Containerization: Docker and/or Kubernetes Bonus: Big Data processing (BI systems, Data lakes) Excited to learn more? 🤔 Feel free to reach out, and I'll happily share all the details. more »