1 to 25 of 209 Data Lake Jobs

Azure Cloud Data Architect This role defines best practices in the evaluation, selection and design of the architecture of software components and related hardware/infrastructure requirements of the applications and its data, and the development of the application, including evaluation and selection of development methods … also be considered based on relevant experience. Job responsibilities Architecture of solutions Cert in Cloud Azure (pref)AWS/GCP DevOps, Deployments, Releases Data Models, Data Bricks, Data Lakes Visualisation (Power BI, Qlik/Tableau) Architecting Enterprise Data Platform on Cloud particularly … solution and infrastructure environment Required knowledge and experience 10-15 years of experience in Cloud Data Warehouse, Data Lake, Hyperscalers specially Microsoft Azure technologies across the Data Lifecycle. Have experience in architecting and solutioning Azure based projects. Hands on knowledge in more »

Position: Azure Data Architect Location: Remote Type: 6 Month Contract (Outside IR35) Rate: £550 to £600 Per Day Role: This is a fantastic opportunity to work for a leading Consultancy, my client is currently looking for an experienced Senior Data Architect to act as client architecture … lead for various programmes of work. Data Architect is a multi-disciplinary role, requiring collaboration with a wide range of stakeholders, from developers to C-level executives. You will be responsible for working with customers to influence and shape the end-to-end data management and … data solution designs and execution of data models for these solutions such as Data Warehouse, Data Lake, and Data Lakehouse Work with Data Engineers and Analysts to architect scalable and secure solutions across Data Integration more »

D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client … with Microsoft Dynamics 365 Finance Operations and Project Operations 4+ years' experience working with Microsoft Power BI 4+ years' experience working with enterprise data warehouse/BI projects. … 4+ years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake, Lake House and Delta Lake Experience Responsibilities: Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics and more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »

We are searching for an experienced and talented Head of Data Engineering for a critical role working for a successful and expanding business, a company that is a market leader in its field, producing award-winning software solutions and services for a diverse portfolio of customers. The role … UK without company sponsorship. In this role you will be responsible for the following: - Creating and managing a complex service model that delivers data timely and accurately to a wide variety of stakeholders and downstream consuming applications and services. Defining and managing the cost model for the Data Platform and the staff who work on the platform. Working hand-in-hand with Data Operations and Data Insight teams to build key data pipelines and platform processes, deploying models and implementing orchestrations. Implementing governance models for data access, data more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … Technical Skills – Deep hands on experience with the following data technologies: Stack including, Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, primarily power BI Data Lake & Data Mesh implementation The rewards more »

for designing, developing, and maintaining data pipelines and systems in Azure Cloud environments, with a strong emphasis on Azure Data Lake, Azure Data Factory, and Microservices architecture. Key Responsibilities: Develop and maintain data pipelines in Azure Cloud environments, leveraging Azure Data Lake, Azure Data Factory, and Microservices architecture. Design and implement scalable and efficient data processing solutions using technologies such as ServiceBus, REST API, App Service, SQL Data Warehouse, and Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch … engineering. Bachelor’s Degree or higher in Computer Science or a related field. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL more »

Job : Data Architect Salary : £80,000 - £90,000 Type : Permanent As a Data Architect, you will you will play a critical role in driving our data strategy, data architecture and designing data solutions. You will contribute and oversee the implementation … of our data strategy that supports our financial services operations by providing data architecture consultancy, collaborating with all areas of our organisation to understand business requirements and develop scalable data architectures that enable efficient data management, analytics, and integration. You will be … and their integration with data architectures. Comprehensive knowledge of data modelling, data design principles, and data lake and warehousing concepts. Leadership qualities with a collaborative and team-oriented approach. Strong analytical mindset and problem-solving abilities to address complex technical challenges. more »

Senior Data Architect About Mars Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL … Associates into taking action every day towards creating the world we want tomorrow. Job Description: We are searching for an experienced Senior Data Architect to join our team and lead our data architecture initiatives. The ideal candidate will possess a deep understanding of data … techniques, database normalization, and denormalization strategies. Strong understanding of data integration patterns, ETL processes, data warehousing, and data lake architectures. Experience with a variety of database systems, such as relational databases (e.g., SQL Server, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity more »

Retail and CPG, and Public Services. Consolidated revenues as of $13 billion. Job Description - Job Description- We are seeking a talented and experienced Data Architect to join our team. The ideal candidate will have a strong background in designing and implementing data solutions in an AWS … DevOps microservices environment using Kafka and Snowflake. As a Data Architect, you will play a crucial role in defining and implementing the data architecture, data modeling, and data integration solutions for our organization. Responsibilities : Design and implement scalable and efficient data architecture solutions in an AWS environment, leveraging microservices architecture and DevOps principles. Work closely with development teams to understand data requirements and design appropriate data models and schemas for various applications and services. Implement and maintain data pipelines using Kafka for real more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data … engineering design patterns and best practice, including data pipelines. Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Cosmos DB, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d more »

Contract/Permanent Opportunity Azure Cloud Data Architect Hybrid (London 2x per Week) Must have Active Security Clearance Job responsibilities Architecture of solutions Architecting Enterprise Data Platform on Cloud particularly on Azure to support regulatory financial institution Designing Functional Architectures for Service Quality Designing and maintaining … Non-Functional Requirements, e.g., Capacity planning, availability, performance, housekeeping, monitoring and foundational capabilities of the Enterprise Data Platform Designing the application solution delivery and good understanding of Cloud Infrastructure solutions Leading technical teams as appropriate in data and analytics delivery implementation and support Performing technical assessment … solution and infrastructure environment Required knowledge and experience 10-15 years of experience in Cloud Data Warehouse, Data Lake, Hyperscalers specially Microsoft Azure technologies across the Data Lifecycle. Have experience in architecting and solutioning Azure based projects. Hands on knowledge in more »

This is an exciting opportunity for a Data Architect to join a growing Data & AI team. The successful applicant will work alongside architects and consultants to deliver high-quality data solutions to help customers become more successful in becoming a data-guided … platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage Building conceptual, logical and physical data models … in Data Warehouse methodologies Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI Strong experience in SQL Good understanding of Azure infrastructure more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business … business hours and weekends when required You Have These: Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Our client within the Education sector are looking for a Senior Data Engineer to join them on a contract basis. Inside IR35 … month contract Hybrid 1 – 2 days per week onsite Technical Skills: In depth knowledge of relevant Azure services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Stream Analytics, etc. Strong Python or Scala with Spark … and analytics. Apache Spark: Deep understanding of Apache Spark for large-scale data processing. Azure Blob Storage and Azure Data Lake Storage: Expertise in setting up and optimizing Azure Data Lake Storage for storing and managing large volumes of data. Cloud Experience more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global … when needed, accurate and understood. Key Technical Skills required: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server … . Metadata management/Data quality Profile Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server more »

Data Architect (SC Cleared/Banking), London (Hybrid) 6 Month Contract £550-625/day (Outside IR35) Data Architect needed with active SC Security Clearance , Banking domain experience , data transformation and COTS products experience on Data modernization and Transformation Programs. 6 Month … work with a leading digital transformation business on large-scale IT modernisation programmes for Government clients. Key skills, experience + tasks will include: Data Architect with strong experience with COTS data flows, product architecture, and integration with data sources. Strong Banking/Financial Services … domain experience. Working Data Modernization and Transformation Programs including Data Cleansing and Migration. Good understanding of security measures and regulations in the Banking and Financial industry. Experience with COTS products and solutions for Data Integration and management. Evaluate and recommend COTS products and solutions more »

Data Architect (SC Cleared/Banking), London (Hybrid) 6 Month Contract £(Apply online only)/day (Outside IR35) Data Architect needed with active SC Security Clearance , Banking domain experience , data transformation and COTS products experience on Data modernization and Transformation Programs. … work with a leading digital transformation business on large-scale IT modernisation programmes for Government clients. Key skills, experience + tasks will include: Data Architect with strong experience with COTS data flows, product architecture, and integration with data sources. Strong Banking/Financial Services … domain experience. Working Data Modernization and Transformation Programs including Data Cleansing and Migration. Good understanding of security measures and regulations in the Banking and Financial industry. Experience with COTS products and solutions for Data Integration and management. Evaluate and recommend COTS products and solutions more »

Job Description Summary The Senior Data Architect is accountable for enabling the technical vision and strategy for the organisations use of data. You will be accountable for defining and maintaining the technical data architecture roadmap offering advise and guidance to business stakeholders. You will ensure that … data architect solutions align with business requirements and data policies and regulations. You will be accountable for the choice of the toolsets required to design, build, manage and maintain the data storage facility within an agreed budget. You will lead a team of people … to deliver a simplified data solution ensuring that data is secure, available, and accurate to business stakeholders. Job Description You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across more »

Role: Senior Data Analyst Location: Remote Salary: £45,000 - £47,000k per annum + benefits About Company: Join us in our partnership with a leading for-profit organization in the education sector, committed to delivering exceptional services to students globally. Job Purpose: As a Senior Data … actionable insights. Key Responsibilities: Conduct complex statistical analysis on diverse data sets, focusing on data warehousing and data lake solutions. Translate findings into actionable insights, utilizing tools such as Power BI, Tableau, and others, to visualize and communicate data effectively. Lead … record of effectively engaging with stakeholders, including senior executives and technical specialists. Ideally, hands-on experience with SQL Server, Microsoft Azure Data Lake, Oracle databases, and data warehouses. Highly desirable expertise in Alteryx and familiarity with R and/or Python programming languages. Knowledge/ more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data into data lake storage areas, physical databasemodels and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. Build more »

Title: Data Architect Reporting to: Head of Data Location: Hybrid - London office 2/3 days a week Job description The role of a Data Architect is a visionary who translates business requirements into technology requirements and defines data standards and principles. … The data architect is responsible for visualizing and designing the organisation's enterprise data management framework for how IT infrastructure supports our data strategy. This role aims to show the company's infrastructure how data is acquired, transported, stored, queried, and secured. … Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL, SSIS, and high-level programming knowledge on Spark is a plus. more »

Due to continued growth within our professional services, we are looking for a Solution Architect to join our data practice - working with some of the best data professionals in the country. You will play an integral part in taking our data services to market … providing technical and strategic thought across the whole lifecycle of data projects from presales through to sign-off and support. A day in the life of an Aiimi Solution Architect: Taking on technical ownership of data projects and transitioning them from presales to delivery Translating customers … and/or GCP would be of added benefit) Experience of using technologies such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Analysis Services, Databricks and Power BI (or equivalent technologies within AWS or GCP stack) Experience of implementing centralised data more »

JOB TITLE: Lead Data Architect (Cloud) SALARY: The salary banding for this role is £121,023 - £142,380 LOCATION: Manchester, Leeds, Halifax, Bristol or Edinburgh HOURS: 35 hours, full time WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week, or … architecture experience; Leading or being part of transformation in Data (e.g., move to advanced analytics/machine learning, data lake, big data, data democratisation) Data modelling and how that can help accelerate reuse of data and … delivery of data consumption use cases Modern data technologies understanding e.g. Machine Learning and Generative AI Experience with data management capabilities like metadata, lineage, data quality, data privacy and data lifecycle management Familiarity with data regulations more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data … technologies (ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks and Functions Essential Experience Experience in supporting traditional Data Warehouses Exposure in building Azure based data ingestion and transformation pipelines, data lake, data warehouse/data marts etc. Experience working with Agile development methodologies such as Kanban/Scrum A natural problem-solving attitude. Conversant with current industry and technology trends. Experience with dealing directly with stakeholders more »