1 to 25 of 310 Permanent Data Lake Jobs

Building a sustainable tomorrow BAM UK and Ireland is recruiting a Data Engineer to join the team. This role can be based out of any of our UK & Ireland offices. BAM operates a flexible working policy. Your mission • Collaborate with stakeholders to understand their requirements and translate them … into effective data integrations and/or Power App solutions. • Create and maintain ETL processes for extracting, transforming and loading data from various sources into our systems – integrate diverse data sources to provide a unified view ensuring seamless data availability to various … business applications. • Create entity relationship diagrams, write database queries, maintain data warehouses and data lakes. • Ensure data accuracy, consistency, security, scalability and reliability in the ETL processes. • Optimise and enhance existing Power BI reports, DAX and dashboards and pipelines and PowerApps for improved performance more »

Data Engineering Group building greenfield pipelines, frameworks, APIs and core Data store (Data warehouse and Data Lake) to enable the ingestion and provision (upstream and downstream) of traditional and alternate datasets in partnership with Quant Research and Trading teams firmwide (X … Asset - Equities, Rates, Commodities, FX and Crypto). Key Skills required 3+ years of exp. as a Software Developer/Data Engineer with Python as your core language Extensive API and Microservices development experience 3+ years SQL Strong DB skills ideally in both SQL and NoSQL based inc. more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead … the development of robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise … in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data more »

LEAD DATA ARCHITECT All candidates must be located in the UK Are you looking for a company where YOUR VOICE is heard? Where you can MAKE A DIFFERENCE ? Do you THRIVE in a FAST-PACED work environment? Do you wake every morning EXCITED to work with GREAT PEOPLE … teamwork and transparency. We hold each other accountable and always have each other’s back! About the role: We are seeking a Lead Data Architect to oversee the design and implementation of our organization's data architecture. The ideal candidate will have a strong understanding of … governance Experience leading teams of data architects and engineers Strong understanding of data warehousing and data lake principles and technologies Experience with data governance frameworks and tools Excellent communication and collaboration skills Strong problem-solving and analytical skills Diversity more »

Role: Mid-Level Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B … and SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit … excel in. We believe in the power of being... YOU! About the role We are looking for a skilled and motivated Mid-Level Data Engineer to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute to our data more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data … Azure stacks, including data pipelines, security and networking Expertise with data warehousing, data lakes and data lake houses Experience with master data management software and technologies Experience with ETL technologies including SQL Server, SSIS, Azure Data Factory more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day more »

what role you come in and do, we will have a plan targeted to help you advance. What you’ll do As a Data Architect will be required to analyse an array of product offerings and business requirements within Mercury, to create and own the overall data architecture spanning the Mercury product suite. You will work with the product development teams (e.g. Core, Web, Integration, Data Practice and product owners) to evaluate and identify solutions that meet the needs of the business and customers, utilising industry standard best practices, patterns and creative design … support of Microsoft cloud-based services and products including (but not limited to): Azure Fabric Azure Data Factory Azure Data Lake Store Azure Data Lake Analytics Azure Storage Azure AI Search Azure Cosmos DB Azure SQL, Azure DW, Synapse and Azure Analytics more »

Lead Data Engineer A brand-new and exciting opportunity has arisen for a Lead Data Engineer with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Lead Data Engineer will be intrumental … engineering function. If you are currently a Lead Data Engineer who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step up then this would be perfect for you! Skills that … are required for the Lead Data Engineer are: Experience in Azure (ADF, Databricks and Data Lake) Experience leading/mentoring/managing a team and keen to manage a bigger team Strong data engineering principles working with SQL, ETL Pipelines and Cloud infrastructure more »

with Data Architecture, Data Management, The EDP product owner and the Technology team delivering the EDP. Responsibilities: Data Lake Structure and Design:  Validate the medallion model data lake structure (bronze, silver, gold) as the optimal approach and recommend alternatives if … needed.  Create a data lake design including namespace hierarchy, and naming standards. Design to optimise storage and retrieval based on data types, usage patterns, and the Bank’s emerging Data Domain segregation.  Establish policies for moving data between different storage tiers … within the data lake (e.g. hot, warm, cold storage) based on access frequency and cost considerations.  Establish policies for data integrity, consistency, conformance, and accuracy when transforming data from Bronze to Silver, and Silver to Bronze.  Develop a Data Modelling Design more »

I am searching for a talented Data Architect to join my client, a leading Fintech company in London. In this exciting role, you'll be responsible for designing, developing, and implementing the data architecture that forms the backbone of their data-driven strategy. You … ll work closely with stakeholders across the business to understand their needs and translate them into robust, scalable data solutions. Job Title: Data Architect Location: London (Hybrid) Salary: £95,000 - £100,000 Industry: Fintech Start: ASAP What you'll be doing: Design and develop enterprise-level … data architectures and solutions. Select and implement appropriate data management tools and technologies. Ensure data quality, consistency, and security across the organization. Collaborate with data engineers and analysts to deliver successful data projects. Stay up-to-date on the latest more »

Senior Data Engineer Up to £70k plus bonus Manchester Are you looking to take your Data Engineer career to the next level?? This company use extremely modern technologies, and you can be certain you will grow within a technical environment. The career advancement and progression opportunities … is building, planning, and constructing pipelines, in a technical role, working predominantly within the Azure Cloud. Your new challenge Working alongside the Lead Data Engineer, you’ll be working within a small, friendly team, working on exciting technical … projects. You will be using your technical expertise with Microsoft Azure to conduct data ingestion, extractions, and transformations in Data Lake, and developing new database structures and data warehouse strategies. This company need someone who can work on business procedures and data more »

Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees’ well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. … About you We know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing … service components. implement data solutions using a range of Azure cloud data services such as Azure storage (data lake), Cosmos DB and Azure SQL (inc. Synapse) work with members of the Data Science team, supporting and building data processing more »

Role: Mid-Level Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B … and SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit … excel in. We believe in the power of being... YOU! About the role We are looking for a skilled and motivated Mid-Level Data Engineer to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute to our data more »

We are currently seeking a Data Engineer to join our client, a unique scale-up business who have received significant investment, that is entering a phase of large scale growth. This role will be a pivotal role in shaping the organisation’s data operations, as the … company grows and matures. As a Data Engineer you will design and build data pipelines that will fuel our client’s groundbreaking product lines. You'll collaborate across multiple disciplines to ensure seamless data flow, and go beyond pipelines to champion data … familiarity with RDBMS (Relational Database Management Systems). Experience working with cloud-based data warehousing solutions like Snowflake and data lake architectures. Experience in designing, developing, and maintaining data pipelines for efficient data movement. Experience with message brokers like Kafka or more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning more »

global Fintech and Payments organisation. The team are building a next generation Machine Learning platform on top of one of the largest fintech data lakes, and you'll be working on this exciting project. The role as an ML Cloud engineer will be building and deploying Notebook, ML more »

Job Description Summary The Senior Data Architect is accountable for enabling the technical vision and strategy for the organisations use of data. You will be accountable for defining and maintaining the technical data architecture roadmap offering advise and guidance to business stakeholders. You will ensure that … data architect solutions align with business requirements and data policies and regulations. You will be accountable for the choice of the toolsets required to design, build, manage and maintain the data storage facility within an agreed budget. You will lead a team of people … to deliver a simplified data solution ensuring that data is secure, available, and accurate to business stakeholders. Job Description You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across more »

are a tech for good business dedicated to promoting transparency in the corporate world they are seeking a highly skilled and experienced Lead Data Engineer. You will be the first hire in the Data Engineering team allowing you to take the drivers seat regarding the direction … taken by the data team to follow. Key Responsibilities: Platform Development: Design, develop, maintain, test, and optimise a scalable and reliable data platform for collecting, processing, and transforming large volumes of company data from various sources. Collaboration: Work with cross-functional teams to understand … data platform requirements and deliver solutions that meet business needs. Optimisation: Enhance data storage and retrieval systems for high performance and data integrity. Quality Assurance: Implement and maintain a data quality and observability framework to ensure data accuracy, completeness, and more »

s biggest brands, including Uber, Major League Baseball, NHS, Disney, Standard Chartered, Mediacom and British Airways. Our services support the whole organisation with data-driven performance insights for leaders, training for managers, wellbeing tools for all employees, as well as access to a global network of accredited mental … hiring process more accessible, just let us know when you apply, or email talent@unmind.com. The Role – Analytics Engineer The core mission of data analytics is to provide actionable insights to all Unmind Teams that drive product and business decisions that build the best version of Unmind. As … within reports that surface relevant trends. In this role you'll get to: Own - You will take the architectural lead for the key data models in the company, and guide your team in finding the right balance between technical excellence and delivery of value that brings you closer more »

best airline in the history of aviation. Our team designs, develops and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions. Key Responsibilities: United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative … architectures, data analytics, and digital solutions. We're seeking a top-tier Principal Data Architect to be a key leader in shaping our organization's data strategy and infrastructure. You will be responsible for the overall vision, design, and implementation of our data architecture, ensuring it aligns with our business goals and drives maximum value. Design and implement secure, scalable, and cost-effective cloud data architectures on platforms like AWS Develop data pipelines for data ingestion, transformation, and loading into cloud data warehouses more »

execution of successful objective implementation for Bank products and customer experience. Solves unique problems with broad impact on the business; requires an innovative, data-driven approach to decision making including allocating funds and developing and tracking OKRs that drive product success. Accountable for setting and delivering against Bank … years preferred Preferred to have had previous experience as an Agile Product Owner Business Architecture/Human Centered Design background familiarity Data Lake/Data Design background is preferred Fraud Background is a bonus Process Engineering familiarity US military experience through military service or a … all the work requirements that may be performed in the job. What we offer: Compensation: USAA has an effective process for assessing market data and establishing ranges to ensure we remain competitive. You are paid within the salary range based on your experience and market data more »

execution of successful objective implementation for Bank products and customer experience. Solves unique problems with broad impact on the business; requires an innovative, data-driven approach to decision making including allocating funds and developing and tracking OKRs that drive product success. Accountable for setting and delivering against Bank … years preferred Preferred to have had previous experience as an Agile Product Owner Business Architecture/Human Centered Design background familiarity Data Lake/Data Design background is preferred Fraud Background is a bonus Process Engineering familiarity US military experience through military service or a … all the work requirements that may be performed in the job. What we offer: Compensation: USAA has an effective process for assessing market data and establishing ranges to ensure we remain competitive. You are paid within the salary range based on your experience and market data more »