1 to 25 of 266 Data Lake Jobs

Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/… Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure … Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache more »

Description Due to continued growth we are currently looking for Senior Data Engineer to join our Professional Services division - you will be part of a cross functional Data consulting team spanning data engineering, visualisation, analytics and science. You will be working with our clients … across multiple sectors, helping them to explore next-generation data techniques and tools to drive incremental business value from their data assets. A day in the life of an Aiimi Senior Data Engineer: You will be responsible for collaborating with business subject matter experts …/Tools SQL coding skills (essential) Python coding skills (essential) Experience with Azure, or other cloud platform, tools (ADF, Azure, Databricks, Data Lake Storage, SQL DWH) Familiarity with distributed systems (Spark, Databricks etc.) Familiarity with semi-structured and unstructured data Benefits Up to 10% of more »

more liquid world. The more we share, the more we all gain. Responsibilities Sharegain is currently in the process of seeking a dedicated Data Engineer to become an integral member of our innovative R&D team. You will play a vital role in managing the entirety of our … data processing framework and infrastructure. Your valuable contributions will not only steer data-centric decision-making but also actively contribute to the evolution of Data monitoring and management solutions across our organization. Within this role, your tasks will encompass the design and execution of … teams (R&D, architects, business) to devise and actualize tailored solutions for their unique operational needs Expand the capabilities of the Data Lake by seamlessly incorporating different data sources Requirements "Can do attitude" Bring over 3 years of hands-on experience in the realms of more »

indicators. the NIS CMDB module into ServiceNow and streamline the process by aligning it with the NIS Changes Power App. Work on systemising data transfers into Maximo (asset management system). the overall Digital monthly reporting covering both IT and OT to reduce manual effort. Enhance ServiceNow to … Skills: with OTSM, including OT CMDB, OT Incident, OT Change, and Problem. of Reporting & Performance Analytics. with Power BI integration and Data Lake Sync. Benefits: work lifestyle with 75% remote and 25% office-based. to work with a collaborative team on meaningful projects. If you are a more »

Develop and optimize MS SSAS cubes (tabular and dimensional) Develop and improve solutions spanning data processing activities from the data lake (stage) to star schemas and reporting view’s/tables and finally into SSAS. Desired Skills and Experience: You have 5 years experience building … domain understanding, Ideally in finance, marketing, CRM, compliance. You should have a strong understanding of data. Have experience working with large volumes of data (millions or records per day). Can build tabular (or OLAP) cubes properly (with DAX or MDX). Advanced SQL knowledge and ability to … write performance optimized queries. You should have industry standard Data Modelling skills (i.e. Kimball) Whats in it for you? A regular bonus. Competitive salary. Healthcare support, including dental, private medical, and health screening. Wellbeing support And so much more... If the above sounds like it could be you more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data … technologies (ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks and Functions Essential Experience Experience in supporting traditional Data Warehouses Exposure in building Azure based data ingestion and transformation pipelines, data lake, data warehouse/data marts etc. Experience working with Agile development methodologies such as Kanban/Scrum A natural problem-solving attitude. Conversant with current industry and technology trends. Experience with dealing directly with stakeholders more »

Job title – Analyst Developer (Data engineering, Databricks, python) Location – Birmingham We will consider new graduates with some knowledge or classwork in SQL and python who are passionate about data engineering and learning Azure Databricks, but may not have a full complement of relevant work experience. About … of the development lifecycle including support. The primary focus for this candidate will be on data engineering, using Azure Data Lake, Azure Databricks with python and other related Azure Data services to support the strategic and tactical goals of Federated Hermes’ data … architecture • active engagement in knowledge sharing • develop Azure Databricks pipelines to interact with data held in Azure SQL, Azure Data Lake ,and Azure Synapse SQL Pool (data warehouse) facilitating operational and analytics data use cases (In lieu of specific Azure Databricks more »

as a Power BI Expert Analyse large datasets and draw on your expertise with Power BI to provide expert reporting and intelligence into data driven decision making for key Customer Focused areas across the business. Work with data engineers across IT & Data teams to … provide guidance and consultancy on producing an efficient and accurate reporting infrastructure. To mentor and provide training to the Data Team, to develop their skills with Power BI and surrounding processes. Experience & Skills Required Expertise with Data Visualisation and Report Presentation using Power BI. Able to … design, data transformation and engineering for reporting purposes. Proficiency with the Azure Suite, Data Factory, SQL DB, Data Lake Storage What’s in it For You? Amazing company to work for! Exciting project at SME level within a large enterprise. 9 months contract more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »

Job Title: Data Engineer Location: London (Fully remote) - All employees must be eligible to work in the UK without sponsorship Salary: £55,000 - £60,000 The Role: Design, develop & maintain applications to enable ingestion, rapid access, & analysis of data to accelerate discovery & enable decisions across Products … teams. Collaborate with colleagues to rapidly specify, implement & deploy fit-to-purpose data pipelines. Evaluate commercial & open-source tools to improve the data pipelines. Maintain data engineering documentation. Data Engineer Requirements: GCP/Google Cloud Platform experience Able to design complex queries … to generate clear representations of data from complex relational schemas across SQL/NoSQL platforms Programming experience in scripting languages such as Python or Go Data Engineer Desirable's: Experience with a cloud data warehouse/data lake. Experience of cloud migrations more »

What can you expect as a Senior Data Engineer... Working for a respected Microsoft Solutions Partner that will help you gain Microsoft certifications; Joining a rapidly expanding and innovative organisation with exciting plans for 2024, that will give you the freedom to grow as an Azure Data … Working with clients across various industries on exciting projects that will see you utilising the latest products within the Microsoft Azure and SQL Data analytics stack; A flat hierarchy and no-door policy. You won’t have a “manager” but a mentor who will help you grow from … experience working with one or more of the following Azure data services (ADS): Azure Data Factory, Azure Data Lake Store and Azure Data Lake Analytics with uSQL, Azure Databricks, Azure SQL DB and Azure SQL DW/Azure Synapse Analytics more »

An opportunity is available through organic growth for an experienced Senior Data Engineer to join a prestigious company renowned for its commitment to excellence in the realm of professional services research and analysis. This organisation stands at the forefront of providing invaluable insights and intelligence to professional services … and leveraging cutting-edge technologies, they empower the team to drive impactful solutions that shape the future of professional services. As a Senior Data Engineer, you'll be part of a dynamic team dedicated to harnessing the power of data to deliver unparalleled value and insights … of schema evolution and/or serialisation. Extensive experience in building and optimizing data pipelines. Experience engineering and maintaining Data Lake, Data Lakehouse, Delta Lake environment. Hands-on familiarity with Azure DevOps, CI/CD pipelines, and release management. Person Specification: Passionate more »

Contract Data Engineer: Fintech | AWS | Airflow | Glu This dynamic FinTech are looking to add to their already strong DataOps team. As a Data Engineer, you will be working closely with devOps and analytics teams building out and supporting the Data Warehouse (Redshift, migrating to … Snowflake), core data pipelines, and supporting our data infrastructure, and analytics capabilities. The role will also have DBA responsibilities for databases across our estate on Aurora MySQL, RDS MySQL, PostgreSQL, MSSQL. You will be responsible for (not limited to): Contributing to the data architecture … and evolution of our Data technology stack Working and communicating effectively with other data engineers, DevOps engineers, data modellers, data scientists and analysts Designing and building new data pipelines as well as maintenance and support of existing data more »

have created is unique and difficult to replicate, with our ‘best of both’ approach combining deep human expertise with advanced digital, tech and data capabilities. This combination not only allows us to deliver excellent customer experiences, but to do so efficiently and at scale. We are proud of … of a business that cares too Want to continue to grow professionally and be the best version of yourself Job Description The Lead Data Engineer is a key role to ensure Shawbrook unlocks the value contained in its data across the organisation in a well-governed … and table formats (Delta etc) This is an incredibly exciting role that rarely becomes available. You will own a well-designed data lake serving a 50+ user community who run '000s of queries across TBs of data each month with a mandate to take it more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business … business hours and weekends when required You Have These: Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

is an exciting opportunity to join our team of technology experts here at Carpetright. You’ll be the technical and design lead on data management and security for all our projects whilst helping to develop the technical team’s skillset. You’ll act as the interface to integrate … DevOps work management to orchestrate and manage team workloads. Solid experience with building data platforms on cloud (Microsoft Azure Data Lake, Synapse, Fabric, Data Warehouse environment) You’ll be an expert in SQL writing in SQL Server/SQL Azure Data Warehouse You will definitely have strong technical understanding of data modelling, design and architecture principles and techniques across master data, transaction data and derived/analytic data. Experience in working across Product Technical teams, Business Market teams to realize their business needs more »

Digital are happy to be supporting one of our clients in the Research sector who are currently on the look-out for a Data Engineer. Data Engineer Tech Stack & Experience; Python & large volumes of data. SQL. Google DataFlow would be handy. Cloud Experience (AWS, Google, Azure … a mindset to grow into more of a leadership position would be very helpful. Have come from a highly statistical/mathematical background. Data Engineer Responsibilities; Design, develop, and maintain scalable data pipelines. Implement ETL/ELT processes to extract data from a variety … of sources and load it into the data warehouse or data lake. Collaborate with data scientists and analysts to understand their requirements and design data models that support their needs. Write efficient Python code to perform data transformation, cleaning, and more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … and needs assessment. You Have These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data … engineering design patterns and best practice, including data pipelines. Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Cosmos DB, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d more »

Data Engineering in Animal Health London/Kent – approx. 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for … good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to hugely improve outcomes for pets – and their two-legged friends[MW1] . It's a role with the potential to be both personally and professionally … a UK work visa already in place. Able to set up, maintain and support a cloud data platforms/data lake such as Snowflake A solid understanding of analytics, reporting and dashboarding technologies Proficiency in API integration, and data extraction methodologies. Strong coding more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. more »

Review clients' requirements Working closely with key business stakeholders Experience: Around 3 years' experience developing with SQL MSSQL, T-SQL Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

Review clients' requirements Working closely with key business stakeholders Experience: Around 3 years' experience developing with SQL MSSQL, T-SQL Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

solutions. As a BI Architect, you will be responsible for leading the migration process, designing and implementing Azure-based BI solutions, and optimising data management and analytics capabilities in the cloud. This role requires strong technical expertise in Azure Cloud services and a deep understanding of BI architecture … premise BI solutions to Azure Cloud, ensuring seamless transition and minimal disruption to business operations. Design and develop Azure-based BI solutions, including data warehousing, data lakes, data integration, and analytics services. Collaborate with stakeholders to gather business requirements and translate them into technical … specifications for BI solutions. Develop and implement data governance and security policies to ensure data integrity and compliance with industry standards. Optimise data management and performance by leveraging Azure Cloud technologies, such as Azure Synapse Analytics, Azure Data Factory, and Azure Analysis more »