1 to 25 of 76 Data Lake Jobs in the UK excluding London

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

will love at Sidetrade As a key member of our team, you will join a technical squad composed of QA, Software Engineers, Devops, Data Scientists, and Data Engineers to take up challenges related to new functionalities, scalability, security, ergonomy, etc. You will participate in the quality … language Familiar with the issues involved in web development Understand and challenge a rich technical stack (Micro-services, High-availability, Multitenancy, Data Lake) Knowledge of Gherkin is a plus Your first 90 days... Join our Immersive Bootcamp Collaborate with the team and participate to the roadmap to more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. … About you We know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing … service components. implement data solutions using a range of Azure cloud data services such as Azure storage (data lake), Cosmos DB and Azure SQL (inc. Synapse) work with members of the Data Science team, supporting and building data processing more »

Data Product Manager – Supply Chain - £585 pd Outside IR35 Our pharmaceutical client now requires a talented Data Product professional to join their Global Supply Chain strategy team. This is a great opportunity to join a globally recognised brand and be a key interface between business customers … and technical teams. The Data Product Manager will be supporting the design, build and iteration of the data products across the Global Supply Chain in line with a pre-existing strategy. They will create data product roadmaps and lead the delivery and management of … the product from inception to maturity. Key Skills: Experience in Data Product Management (data governance/data architecture) Knowledge of Supply Chain Management Background in data engineering concepts (ie. ETL, data modelling, data lakes, master data more »

Job Description Summary The Senior Data Architect is accountable for enabling the technical vision and strategy for the organisations use of data. You will be accountable for defining and maintaining the technical data architecture roadmap offering advise and guidance to business stakeholders. You will ensure that … data architect solutions align with business requirements and data policies and regulations. You will be accountable for the choice of the toolsets required to design, build, manage and maintain the data storage facility within an agreed budget. You will lead a team of people … to deliver a simplified data solution ensuring that data is secure, available, and accurate to business stakeholders. Job Description You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across more »

We're on the hunt for a top-tier Data Product Manager obsessed with all things data product, BI & AI centred to join the exhilarating journey of a cutting-edge digital tech company's Data Tribe! Workplace Policy | Location: Hybrid Working between … up to £55,000 You will play a key role in delivering outcomes and quantifying real customer problems. Utilising the brand's extensive data, you will lead the product management framework and define/solve customer problems using BI & AI. Excellent communication and product management skills are essential … a great client... what more could you ask for? What else will you be doing? Take ownership of all aspects of the new data platform and ensure it remains aligned with the rest of the business Uncover and measure real customer issues using data analysis tools more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an a mid -weight Data … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. (You more »

team, passionate about success, doing good and having fun along the way. Your new role I am seeking a highly skilled and motivated Data Engineer to join a dynamic team. The successful candidate will collaborate closely with IT, Finance, and Operations departments to fulfil the business reporting requirements … in a timely and consistent manner. This role is pivotal in developing and providing trusted data on performance and financial positions to facilitate informed decision-making across the company. Key Accountabilities: Manage and enhance presentational reporting to support decision-making by Management, Committees, and Board. Contribute to the … ongoing data strategy in collaboration with management. Automate the aggregation of disparate data sources into Data Lakes and Data Warehouses. Develop SQL-based solutions (tables, views, stored procedures, SSIS packages) to produce critical datasets. Liaise with subject-matter experts to ensure data more »

Our client is a successful financial services provider offering an exciting opportunity for a Data Engineer who will have the chance to work with new technology and delve deep into data. The Data Engineer will work closely with IT, Finance and Operations to deliver the business … reporting requirements within a timely and consistent manner. They are required to develop and provide trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. The role is offered on a hybrid basis … but you should live within commutable distance of Wimborne, Dorset. Responsibilities of the Data Engineer Manage presentational reporting to support decision making Automate the collection of disparate data sources to Data Lakes and Data Warehouses Work across all functions to test and more »

implemented by a Sales focused Cloud Architect with an ability to secure UK eDV security clearance. With Machine Learning techniques, Encryption and Big Data tools, this firm have solved a critical privacy issue that will benefit National Security and Intelligence clients across the world and is equally impactful … for other sectors, allowing private access to Neural Networks and Data sets for knowledge growth. If you are interested in delivering impactful product presentations and able to highlight mission-critical benefits of a software product, you will be highly valued in this role. Youll need to lead during … consultative selling of B2B software Demonstrable experience working with Privacy technologies such as homomorphic encryption, SMPC, Federated Learning, TEE. Any prior experience with Data management or tooling hugely beneficia (Data Lakes, Snowflake or Databricks). Experience working closely with engineering teams (particularly those working on Machine more »

Open Targets (OT) is a unique public-private partnership working to deliver experimental data and informatics platforms that enable researchers to make more informed decisions about target selection for drug discovery. OT is a shared initiative between the European Bioinformatics Institute (EMBL-EBI), a global leader in the … management, integration and analysis of public domain life science data; world-leading pharmaceutical companies GSK, Sanofi, Bristol Myers Squibb, Pfizer and Genentech; and the Wellcome Sanger Institute. Generative AI has revolutionised the way we interact with knowledge. To benefit from the advances in LLM technology inside Open Targets … collaborative, and international team, you will be responsible for: Developing and implementing a knowledge graph framework on top of the existing data lake to improve our data sharing and analysis pipelines to assist drug discovery user stories. Working closely with data provision and more »

note: you must have the right to work in the UK without the requirement of a Skilled Worker Sponsorship. Duties and Responsibilities Perform data analysis and modeling for development and maintenance projects; participate in the development of standards and procedures affecting Dynamics reporting. Provide development, support, maintenance, governance … storage, processing, and analytics. Azure Synapse Serverless Leveraging Azure Synapse Serverless for scalable and cost-effective data analytics. Data Lake, Lake House and Delta Lake Experience Familiarity with Data Lake and Delta Lake technologies for storing and processing … of years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake Experience Following Tools Experience : Microsoft Power BI Synapse Paginated Report Builder Power Platform KBR Company Information When you become part of the KBR team more »

Senior Data Architect About Mars Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL … Associates into taking action every day towards creating the world we want tomorrow. Job Description: We are searching for an experienced Senior Data Architect to join our team and lead our data architecture initiatives. The ideal candidate will possess a deep understanding of data … techniques, database normalization, and denormalization strategies. Strong understanding of data integration patterns, ETL processes, data warehousing, and data lake architectures. Experience with a variety of database systems, such as relational databases (e.g., SQL Server, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity more »

JOB DESCRIPTION About The Role We are recruiting for a Senior Data Architect to join our team. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior … Data Architect , you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated … Proven experience in defining data architectures to satisfy multiple stakeholders with varying data proficiency Thorough understanding of data lake and data warehousing principles and full project involvement in one or more major technology platforms, e.g. Snowflake, Databricks Proven experience with one more »

understand business requirements and designing integration solutions to connect Dynamics 365 Finance and Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies … such as X++, C#, SQL, XML, JSON) to create seamless data flow and functionality between different systems. API Development: Utilizing APIs (Application Programming Interfaces) provided by Dynamics 365 Finance and Operations and other systems to facilitate data exchange and communication between them. Data Mapping … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

Data Engineer £35,000 To £45,000 (Dependent on Experience) Norwich Hybrid (2/3 Days per Week Onsite) An exciting opportunity for a data engineering professional to take full ownership of new projects. Join a longstanding business with a talented and dedicated internal IT team … as well as an environment that fosters personal progression. This job role is ideal for someone with a strong background in data engineering and an interest in data analysis. Duties: Lead the implementation and ongoing management of data strategy and analysing raw data for trends and patterns Design & build robust data systems Conduct advanced data analysis Participate in Agile ceremonies and practices Required Skills: ETL Data Pipeline development experience Designing, developing and maintaining data lakes and warehouses SQL Database Design, Coding and Maintenance more »

and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and … analysis of large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and … platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or Google Cloud Platform (e.g., Cloud Storage, BigQuery). Deep understanding of cloud computing concepts, including infrastructure as code, serverless computing, and containerization. more »

Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/… Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure … Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache more »

Azure Head of Data Engineering Salary- £90,000 - £110,000 + Excellent benefits Location - Birmingham/Hybrid Key skills - Azure - Databricks - Data factory - Data Lakes - Synapse - Modelling - Agile Role purpose: We are actively seeking a dynamic professional to play a pivotal role in the … organisation and contributing to the exciting digital transformation journey. Reporting directly to the Chief Data Officer, you will lead team of skilled data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive our digital transformation initiatives and support … to-date and accessible to relevant stakeholders. Technical/Professional Qualifications/Requirements: Significant Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Extensive experience in data engineering and in a leadership or management position. Strong in more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data into data lake storage areas, physical databasemodels and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. Build more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

in X++ and T-SQL, experience in developing within the Power Platform, and familiarity with Azure integration technologies (Functions, Logic Apps, Data Lake, Synapse, ADO). Key Responsibilities System Integration: Collaborating with stakeholders to understand business requirements and designing integration solutions to connect Dynamics 365 Finance and … Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies (such as X++, C#, SQL, XML, JSON) to create seamless data … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

The Role - This growing manufacturing company are increasing their IT function capability in the area of Data Analytics, having a need to improve visibility of data to help with business decisions, interpret results, identify trends and opportunities to ensure the business is achieving the most value … Ensure there is appropriate reporting consumption methods for the different data paths. Drive the BI strategy using the Microsoft data lake and Power BI data sets as the primary data source. Maintain the Power BI first approach. Build and lead a … elements of master data. Skills & Qualifications - Experience implementing enterprise BI and reporting solutions. Experience of Microsoft BI technology such as Microsoft Data Lake, Dataverse, Power BI, Azure Synapse with a Data First Approach. Able to own the analysis, design and delivery of reporting. Proficient formatting more »

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test … deploy data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with … enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory more »

a comprehensive plan for implementation. Responsibilities: Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and … analysis of large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and … platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or Google Cloud Platform (e.g., Cloud Storage, BigQuery). Deep understanding of cloud computing concepts, including infrastructure as code, serverless computing, and containerization. more »