101 to 125 of 360 Data Lake Jobs

Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and … implementation of a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

tools. Thorough experience in understanding, analyzing, and white-box testing (end-to-end) of integrations built using/with Azure integration tools like Data factory, LogicApps, Functions, API Management, Data catalog, WebApps, Integration service environment … configuring monitoring & diagnostics, etc., and connectivity & security configurations. Experience in understanding, analyzing, and white-box testing Azure data storage (Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL solutions. In-depth understanding of and experience with SOAP, XML, REST, JSON, EDI, XSLT, Async … identifying and high-level investigating performance issues to pin-point problem areas Experience with MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc., is a big plus. The role will be based in more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology experience. more »

years of design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … and connectivity & security configurations (certificates, encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online … DevOps and CI/CD pipeline. Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Informatica, BI tools, etc. is a big plus. General business skills: Clear communication to translate and more »

A Senior Data Engineer required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. As a senior member of the data practice you will - Promote best … practice for data related projects Mentoring engineers Coordinating resources Aim for continuous improvement of the team Innovate with the use of new technologies Ideally you can demonstrate experience across a breadth of tools and technologies, including - Demonstrable professional Data experience Experience of working with semi or … warehouses and data lakes. Knowledge of Azure Cloud Services Good understanding T-SQL programming Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse Good knowledge of Data Governance, Data Catalog, Master Data Management Knowledge more »

regulations, security, operations, and infrastructure teams to create and/or review integration-focused project documents to cover all the relevant aspects including data, tools, security, compliance, and operations requirements. Develop/Program proofs-of-concept. Support developers in problem-solving. Conduct code-reviews. A bachelor's degree … and connectivity & security configurations (certificates, encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes. In-depth knowledge & experience using Visual Studio, with one of the programming languages C# … systems Experience working with Azure DevOps and CI/CD pipeline. Experience working with MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse Experience or knowledge of Informatica, BI tools, etc. is a big plus. The position will be more »

years of design and development. experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … and connectivity & security configurations (certificates, encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online … DevOps and CI/CD pipeline. Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Informatica, BI tools, etc. is a big plus. General business skills: Clear communication to translate and more »

years of design and development. experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … and connectivity & security configurations (certificates, encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online … DevOps and CI/CD pipeline. Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Informatica, BI tools, etc. is a big plus. General business skills: Clear communication to translate and more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead … the development of robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise … in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data more »

Data Engineer (Azure, Delta Lake, SQL) - O/S IR35 - Hybrid A top specialist IT Consultancy are urgently seeking an experienced Data Engineer to support with a variety of end client projects. The assignment will be outside IR35 and require a 50/50 working … Experienced Data Engineer (7+ Years) Strong Azure data skills, including: Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball Datamodelling more »

Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In … engineering stack. Key Responsibilities: Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices. Lead and mentor a … with remote teams, leveraging your experience in leading distributed teams to drive success. Requirements: Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks. Proficiency in coding with Spark and a strong understanding of design aspects. Deep understanding of engineering best practices and the ability more »

We are currently seeking a Snr Data Engineer who has experience with the Azure Data stack to join the Business Intelligence team. The team is part of a wider team that includes the MS D365 implementation team (on-going project), Oracle ERP team and Digital Applications … part of the solution design About the Candidate Essential experience Experience with the following technologies Azure Synapse, Data Factory, Databricks, SQL Db, Datalake, Key Vault Azure Dev Ops and CI/CD pipelines Coding in SQL and PySpark/Python DW/Data Vault concepts Power … AP, AR etc) - Highly desirable Preferred experience Knowledge of D365 Finance module and building data models and reports from the export to Datalake functionality Working knowledge with Microsoft D365 Data (Dataverse) Integration with datalake Understanding of core Finance principles and terminology. Knowledge of Azure AI services more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. more »

Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £60,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great opportunity … to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely with … be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as more »

Job DescriptionLead Data Engineer - Azure/Spark/DatabricksRole: Lead Data EngineerLocation: London (3 days a week)Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In this … engineering stack. Key Responsibilities:Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks.Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices.Lead and mentor a team of … effectively with remote teams, leveraging your experience in leading distributed teams to drive success.Requirements:Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks.Proficiency in coding with Spark and a strong understanding of design aspects.Deep understanding of engineering best practices and the ability to implement more »

Role Title: Senior Data Engineer Reports to: Tech Lead Data Engineering Location: Hybrid working environment (Remote and Paddington, London) Role Type: Permanent, Full-time How do we say our name, well it sounds like 'view'. It's also a lot shorter than saying 'Viewed Impressions … are a dynamic team building a global platform which automates the buying and selling of outdoor advertising, enables programmatic trading and delivers dynamic, data -driven content to screens in locations and moments to better resonate with and influence consumers. We’ve recently redesigned our people strategy to create … have key capabilities which will be released such as data intensive services and real time dashboards based on our data lake and our data gateway, in addition to complex infrastructure upgrades. You will be involved in the design and construction of new data more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »