51 to 75 of 331 Permanent Data Lake Jobs

Job Responsibilities The Data Analytics Tester works closely with business stakeholders and the technology team to review and test Business Intelligence (BI) solutions firmwide including but not limited to validating the quality accuracy, reliability, compliance and performance of reports, dashboards, data pipelines, and general data analysis solutions. Develop and execute comprehensive test scenarios for BI reports and dashboards. Ensure data accuracy, security and compliance around legal performance metrics are accurately presented on BI reports and dashboards. Verify, validate, and analyse accuracy of data models used in reports to ensure … environment Proficiency in SQL or other data analysis tools and languages Experience with Azure Data Services (Azure Data Lake, Data Factory, Synapse Analytics, Fabric) highly desirable. Experience with data analytics, report curation, data modelling, data more »

our Azure landscape such as Azure VM, Azure Storage, Azure Backup, Azure Application Gateway, Azure Files, Azure Blob Storage, and Azure Data lake store. Azure AD setup and design, SQL MI and PaaS setup, sizing, monitor, data migration. In-depth experience in Azure subscription VNET … management model and framework, design, and setup of Azure Modern Data Warehouse components such as Synapse, Azure data lake, and Power BI. Large scale design, implementation, and operations of OLTP, OLAP, DW and NoSQL data storage technologies such as SQL Server, Azure SQL … Azure SQL DW, Azure Data Lake Store, MySQL, Oracle Enterprise Databases. Strong solution design experience using Azure Stream Analytics, Azure Analysis Services, Data Lake Analytics, HDInsight, HDP, Spark, Databricks, design and configuration of data movement, streaming and transformation (ETL) technologies such as more »

Job Description Summary The Senior Data Architect is accountable for enabling the technical vision and strategy for the organisations use of data. You will be accountable for defining and maintaining the technical data architecture roadmap offering advise and guidance to business stakeholders. You will ensure that … data architect solutions align with business requirements and data policies and regulations. You will be accountable for the choice of the toolsets required to design, build, manage and maintain the data storage facility within an agreed budget. You will lead a team of people … to deliver a simplified data solution ensuring that data is secure, available, and accurate to business stakeholders. Job Description You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data … Azure stacks, including data pipelines, security and networking Expertise with data warehousing, data lakes and data lake houses Experience with master data management software and technologies Experience with ETL technologies including SQL Server, SSIS, Azure Data Factory more »

Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees’ well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »

Job DescriptionLead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/CharityRate: £500-650 per dayDuration: 6-12 monthsIR35: OutsideLocation: Remote with occasional travel to London (Once every two months max)Essential skills required:Azure – solid experience required of the Azure Data ecosystemPython - ESSENTIAL as PySpark is used heavily. You will be tested on PySparkAzure Synapse - ESSENTIAL as is used heavilySparkAzure Data Lake/Data Bricks/Data FactoryBe happy to act as a lead and mentor to the other permanent Azure Data … and lineageThis is an urgent contract, so if you are interested apply ASAP.Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good/Charity more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. … About you We know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing … service components. implement data solutions using a range of Azure cloud data services such as Azure storage (data lake), Cosmos DB and Azure SQL (inc. Synapse) work with members of the Data Science team, supporting and building data processing more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day more »

are a tech for good business dedicated to promoting transparency in the corporate world they are seeking a highly skilled and experienced Lead Data Engineer. You will be the first hire in the Data Engineering team allowing you to take the drivers seat regarding the direction … taken by the data team to follow. Key Responsibilities: Platform Development: Design, develop, maintain, test, and optimise a scalable and reliable data platform for collecting, processing, and transforming large volumes of company data from various sources. Collaboration: Work with cross-functional teams to understand … data platform requirements and deliver solutions that meet business needs. Optimisation: Enhance data storage and retrieval systems for high performance and data integrity. Quality Assurance: Implement and maintain a data quality and observability framework to ensure data accuracy, completeness, and more »

what role you come in and do, we will have a plan targeted to help you advance. What you’ll do As a Data Architect will be required to analyse an array of product offerings and business requirements within Mercury, to create and own the overall data architecture spanning the Mercury product suite. You will work with the product development teams (e.g. Core, Web, Integration, Data Practice and product owners) to evaluate and identify solutions that meet the needs of the business and customers, utilising industry standard best practices, patterns and creative design … support of Microsoft cloud-based services and products including (but not limited to): Azure Fabric Azure Data Factory Azure Data Lake Store Azure Data Lake Analytics Azure Storage Azure AI Search Azure Cosmos DB Azure SQL, Azure DW, Synapse and Azure Analytics more »

Data Engineer Full time - 40hrs a week Head office based - Leeds Salary- Competitive Hybrid Founded in 1975, Moda in Pelle has been crafting beautiful shoes for over 40 years. We take great pride in combining British sophistication with fine Italian quality and gorgeous leathers. We believe in creating … fashionable footwear that combines affordable luxury, stunning design and complete comfort for our customers The Data Engineer is responsible for designing, building, and maintaining the company's data infrastructure. They work closely with the Head of Technology, analysts, and software developers to ensure that the data is accurate, reliable, and accessible to those who need it. Key Responsibilities: Design, build, and maintain the company's data infrastructure, including data warehousing, data lakes, and data pipelines. Collect, process, and cleanse data from a variety of more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead … the development of robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise … in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data more »

Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In … engineering stack. Key Responsibilities: Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices. Lead and mentor a … with remote teams, leveraging your experience in leading distributed teams to drive success. Requirements: Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks. Proficiency in coding with Spark and a strong understanding of design aspects. Deep understanding of engineering best practices and the ability more »

Senior Data Engineer - Azure Paying up to 70K Hybrid: 2 days onsite About the Role My food retail business client is looking for a senior Data Engineer to join the team. My client operate on a global scale, but their Data and Analytics function … career progression opportunities as part of our technology transformation journey. Paying up to £70K Hybrid (2 days onsite) Main Duties Design and deliver data pipelines. Build and manage Azure Data Factory data flows. Ingest data into an Azure Data Lake. … and other ETL tools. Develop solutions with SSIS, SSRS, T-SQL (On-prem/Cloud). Manage NoSQL environments, Data Lakes, and Lake-Houses (e.g., Cassandra, MongoDB, Neptune). Use Python for data engineering tasks. Apply statistical principles to interpret data and develop more »

Data Product Manager – Supply Chain - £585 pd Outside IR35 Our pharmaceutical client now requires a talented Data Product professional to join their Global Supply Chain strategy team. This is a great opportunity to join a globally recognised brand and be a key interface between business customers … and technical teams. The Data Product Manager will be supporting the design, build and iteration of the data products across the Global Supply Chain in line with a pre-existing strategy. They will create data product roadmaps and lead the delivery and management of … the product from inception to maturity. Key Skills: Experience in Data Product Management (data governance/data architecture) Knowledge of Supply Chain Management Background in data engineering concepts (ie. ETL, data modelling, data lakes, master data more »

We are currently seeking a Data Engineer to join our client, a unique scale-up business who have received significant investment, that is entering a phase of large scale growth. This role will be a pivotal role in shaping the organisation’s data operations, as the … company grows and matures. As a Data Engineer you will design and build data pipelines that will fuel our client’s groundbreaking product lines. You'll collaborate across multiple disciplines to ensure seamless data flow, and go beyond pipelines to champion data … familiarity with RDBMS (Relational Database Management Systems). Experience working with cloud-based data warehousing solutions like Snowflake and data lake architectures. Experience in designing, developing, and maintaining data pipelines for efficient data movement. Experience with message brokers like Kafka or more »

I am searching for a talented Data Architect to join my client, a leading Fintech company in London. In this exciting role, you'll be responsible for designing, developing, and implementing the data architecture that forms the backbone of their data-driven strategy. You … ll work closely with stakeholders across the business to understand their needs and translate them into robust, scalable data solutions. Job Title: Data Architect Location: London (Hybrid) Salary: £95,000 - £100,000 Industry: Fintech Start: ASAP What you'll be doing: Design and develop enterprise-level … data architectures and solutions. Select and implement appropriate data management tools and technologies. Ensure data quality, consistency, and security across the organization. Collaborate with data engineers and analysts to deliver successful data projects. Stay up-to-date on the latest more »

Data Engineering Group building greenfield pipelines, frameworks, APIs and core Data store (Data warehouse and Data Lake) to enable the ingestion and provision (upstream and downstream) of traditional and alternate datasets in partnership with Quant Research and Trading teams firmwide (X … Asset - Equities, Rates, Commodities, FX and Crypto). Key Skills required 3+ years of exp. as a Software Developer/Data Engineer with Python as your core language Extensive API and Microservices development experience 3+ years SQL Strong DB skills ideally in both SQL and NoSQL based inc. more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

Data Architect - Azure/Spark/Databricks Role: Data Architect Location: London (3 days a week) Salary: £100k - £110k A leading technology firm, renowned for connecting people globally, is looking for a skilled Data Architect to join their expanding team. You will be spearheading … Azure-based data solutions and helping them further the development of their award winning data platform. In this pivotal role, you'll be responsible for leading the design and implementation of cutting-edge data solutions. Key Responsibilities: Lead the design and implementation of Azure … data design documents to articulate architecture decisions and implementation plans clearly. Requirements: Strong proficiency in Azure services, including Spark, Data Lake, Synapse, and Databricks. Exceptional stakeholder management skills with the ability to communicate effectively with both technical and non-technical audiences. Experienced and knowledgeable of more »

subject matter experts, solving interesting problems, and building the products of tomorrow, this opportunity is for you. On our mission to revolutionize the Data Strategy & Management space, we are seeking a dynamic and seasoned Solution Architect with a stellar track record in Data Products. As our … client navigates the complexities of a legacy IT landscape, we need someone who can not only conceptualize, design and build robust data platforms but also provide strategic guidance and stakeholder management expertise. Leveraging your software engineering expertise, you'll play a pivotal role in ensuring the integrity, efficiency … innovative solutions in challenging environments. Bachelor’s degree in computer science, computer engineering, or a relevant field. Responsibilities: Design and implement scalable database and datalake solutions tailored to client requirements. Evaluate client operations, applications, and programming to identify database structural necessities and ensure alignment with organizational goals. Create robust data more »

s biggest brands, including Uber, Major League Baseball, NHS, Disney, Standard Chartered, Mediacom and British Airways. Our services support the whole organisation with data-driven performance insights for leaders, training for managers, wellbeing tools for all employees, as well as access to a global network of accredited mental … hiring process more accessible, just let us know when you apply, or email talent@unmind.com. The Role – Analytics Engineer The core mission of data analytics is to provide actionable insights to all Unmind Teams that drive product and business decisions that build the best version of Unmind. As … within reports that surface relevant trends. In this role you'll get to: Own - You will take the architectural lead for the key data models in the company, and guide your team in finding the right balance between technical excellence and delivery of value that brings you closer more »

Data Product Owner London Hybrid – 3 days pw onsite £50,000 - £55,000 We have an exciting opportunity for a Data Product Owner working for a unique customer centric within the financial services industry, which is undergoing the biggest transformation it has ever seen. The Data Product Owner will join a newly formed data team. This role will ensure systems are fit for purpose today and ready for the challenges of the future, providing a bridge between operational teams and the technology department and facilitating better data decision making for … acting on user feedback and effectively communicating on updates and issues. Collaborate with key business stakeholders from a variety of teams, including Analytics, Data Engineering, Pricing, Risk, and Economic Capital to develop backlog and priorities in-line with business requirements. Proactively investigate and understand issues and pain points more »

Job Description Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop … and provide trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits • Up to 10% matched pension scheme with Standard Life • Death in Service: 4 x salary • Annual Car Parking permit • Purchase … Children under the age of 24 can be covered free of charge. Skills • Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences • Experienced in working Microsoft Cloud Data and Automation technologies • Experienced working with Tableau and or Power BI • Experienced in data more »

Security Audits and Assessments regularly.Create and maintain the Security Architecture for the company and maintain network securityEnsure the continual security of the sensitive data that is held within the company.💸The salary on offer for this Lead InfoSec Engineer Role, is paying £75,000 + Benefits Package + … threats. Strong understanding of key aspects of data security including encryption methods, access management, data warehouse/data lake security etc. Experience with tools like PowerBI, Nessus, CrowdStrike and Sentinel or similar.Experience in leading internal security audits and developing and embedding comprehensive infosec … strategies across the business.Experience managing cyber incident response processes and working with specialist partners.Experience with SQL-based data warehouse solutions.Understanding of network-level security principles and practices Strong understanding of security frameworks and standards such as ISO 27001, NIST, or CIS.Relevant certifications such as CISSP, CISM, CompTIA Security more »