101 to 125 of 288 Data Lake Jobs

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data … requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Datalake and Databricks. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in … successful digital transformation initiatives involving data engineering and analytics. Significant hands-on Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … Technical Skills – Deep hands on experience with the following data technologies: Stack including, Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, primarily power BI Data Lake & Data Mesh implementation The rewards more »

for designing, developing, and maintaining data pipelines and systems in Azure Cloud environments, with a strong emphasis on Azure Data Lake, Azure Data Factory, and Microservices architecture. Key Responsibilities: Develop and maintain data pipelines in Azure Cloud environments, leveraging Azure Data Lake, Azure Data Factory, and Microservices architecture. Design and implement scalable and efficient data processing solutions using technologies such as ServiceBus, REST API, App Service, SQL Data Warehouse, and Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch … engineering. Bachelor’s Degree or higher in Computer Science or a related field. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL more »

Retail and CPG, and Public Services. Consolidated revenues as of $13 billion. Job Description - Job Description- We are seeking a talented and experienced Data Architect to join our team. The ideal candidate will have a strong background in designing and implementing data solutions in an AWS … DevOps microservices environment using Kafka and Snowflake. As a Data Architect, you will play a crucial role in defining and implementing the data architecture, data modeling, and data integration solutions for our organization. Responsibilities : Design and implement scalable and efficient data architecture solutions in an AWS environment, leveraging microservices architecture and DevOps principles. Work closely with development teams to understand data requirements and design appropriate data models and schemas for various applications and services. Implement and maintain data pipelines using Kafka for real more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Deltalake, BigQuery, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, Azure ML is a plus Experience with Azure more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data into data lake storage areas, physical databasemodels and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. Build more »

Due to continued growth within our professional services, we are looking for a Solution Architect to join our data practice - working with some of the best data professionals in the country. You will play an integral part in taking our data services to market … providing technical and strategic thought across the whole lifecycle of data projects from presales through to sign-off and support. A day in the life of an Aiimi Solution Architect: Taking on technical ownership of data projects and transitioning them from presales to delivery Translating customers … and/or GCP would be of added benefit) Experience of using technologies such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Analysis Services, Databricks and Power BI (or equivalent technologies within AWS or GCP stack) Experience of implementing centralised data more »

Role: Data Engineer - Tech Lead Job Type: Permanent Location: London, UK Do you strive for engineering excellence and are ready to lead a modern tech transformation ? Do you have experience as a Azure, Pyspark, Cloud? We have the perfect role for you- Data Engineer - Tech Lead … analysis on large datasets. Architect Data Storage Solutions: Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with Cross-functional Teams: Collaborate with cross-functional teams including data … effectiveness, leveraging Azure monitoring and logging services. Your Profile Expertise in Azure cloud services, Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage. Expertise in Data Engineering, Solution designing and Cloud Computing. Programming skills in Python, with developing data processing applications using more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Role : Data Product Owner … Location : Leeds UK- Hybrid Type of resource : Contract 6+ Months Must Have : Primary POC to Stake holders, Strong Understand of Azure Data Lake & Data Bricks Data product owner responsibilities includes the following: Act as the primary point of contact for the data … prioritize requirements. Develop and maintain a product roadmap, aligning it with business goals and technical capabilities. Play a crucial role in establishing robust data pipelines, defining data models, setting up data governance systems, and ensuring the secure and efficient processing of data more »

in X++ and T-SQL, experience in developing within the Power Platform, and familiarity with Azure integration technologies (Functions, Logic Apps, Data Lake, Synapse, ADO). Key Responsibilities System Integration: Collaborating with stakeholders to understand business requirements and designing integration solutions to connect Dynamics 365 Finance and … Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies (such as X++, C#, SQL, XML, JSON) to create seamless data … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

The Role - This growing manufacturing company are increasing their IT function capability in the area of Data Analytics, having a need to improve visibility of data to help with business decisions, interpret results, identify trends and opportunities to ensure the business is achieving the most value … Ensure there is appropriate reporting consumption methods for the different data paths. Drive the BI strategy using the Microsoft data lake and Power BI data sets as the primary data source. Maintain the Power BI first approach. Build and lead a … elements of master data. Skills & Qualifications - Experience implementing enterprise BI and reporting solutions. Experience of Microsoft BI technology such as Microsoft Data Lake, Dataverse, Power BI, Azure Synapse with a Data First Approach. Able to own the analysis, design and delivery of reporting. Proficient formatting more »

Join Ascent and help us do extraordinary things with data for our customers! About Us We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to … create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as … integration solutions Good knowledge of the Azure data engineering stack - Azure Data Factory, Azure Synapse, Azure Data Lake, Azure Blob, Cosmos DB Capability in using Databricks and Informatica Good experience in a general programming – ideally Python Prior experience with Lloyds of London more »

Data Engineer | Hybrid | £70,000 - £85,000 + Bonus | Professional Services Are you looking to join a global professional services organisation? Are you looking to join a technical team full of driven and passionate people? Are you looking to work with cutting-edge technology? As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure on the Azure cloud platform. You will be responsible for building and optimizing data pipelines, integrating various data sources, and ensuring the reliability and scalability of our … scalable data pipelines on Azure cloud platform. Integrate and transform data from diverse sources into a unified data lake environment. Implement data governance and security best practices to ensure data integrity and compliance. Optimize performance and efficiency of data more »

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test … deploy data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with … enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »

the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … similar role. Proven track record in designing and building data infrastructure and ETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps. SQL Server, including Store Procedures, T-SQL, or similar enterprise database toolset. Familiarity with more »

Contract Relevant context A fast growing Energy & Commodities trading company is embarking on a transition from a CTRM-centric technology architecture to a data-centric model, termed as the Digital Data Hub (DDH), to enhance scalability and stability. The first phase involves the integration of a … Allegro to Topaz derivatives integration project. Engage in the development of various test automation frameworks targeting web applications, thin client, microservices, real-time data processors, data analytics/visualizations reports. Ensure the automation test frameworks and tests are aligned with the existing programme test automation strategy … experience, backend test experience. Exposure/experience in cosmos dB and azure event hub. in data quality assurance around Data Lake, Data bricks and ETL. Exposure working with Power BI. Knowledge and experience of implementing test best practice. This is an Outside IR35 more »

Data Engineer/Architect (GCP) Google Cloud Platform | Fully Remote | £55,000 The Role: My client are a leading digital consultancy, specializing in delivering innovative solutions to businesses worldwide. With a focus on leveraging cutting-edge technologies and strategic insights, they empower our clients to thrive in the … digital age. Position Overview: We are seeking a talented Data Engineer/Architect with expertise in Google Cloud Platform (GCP) to join our team. This position is fully remote, with the option to work from offices based in Cardiff, United Kingdom. As a Data Engineer/… Architect, you will play a pivotal role in designing, implementing, and optimizing data solutions that drive business value for our clients. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure the successful delivery of projects. Key Responsibilities more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As … they continue to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase … carbon neutrality. Role Overview: As a Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be more »