1 to 25 of 136 Data Lake Jobs with Hybrid or WFH Options

Previous experience working in a Data Engineering role * Experience working with Azure Technologies - Azure Data Factory, Synapse, Data Lake, Data Bricks * Experience working with SQL and Python * Experience designing and implementing ETL solutions This is a unique opportunity for a data … to d.moore1@nigelfrank.com or alternatively, give me a call on 0191 338 7577 Key Skills:Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLJob SummaryUp to … GBPDeveloper/Programmer RoleSkills: Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLLevel: Senior more »

Data Scientist (Pharma) Fully remote (UK/Ireland/Europe) Salary up to £75k depending on experience MBN Solutions are delighted to have been retained by their client, a powerhouse in the Pharmaceuticals industry, to onboard a talented and innovative Data Scientist to join the team. … This Data Scientist will help rocket the business into the future, masterfully crafting, launching, and fine-tuning cutting-edge Advanced Analytics Models. You will be the person behind transforming raw data into actionable insights, ensuring the organisation makes decisions that are not just informed but inspired. … & modelling lifecycles (ML Ops). Seek to improve model efficiency, performance, and scalability Microsoft Technology Stack experience sought (Azure Data Lake, Databricks, Azure ML, Power BI), and capabilities of programming in and understanding R & Python. You will also likely have: A passion for problem-solving more »

LOCATION: Chicago, IL Hybrid 3 days in office and 2 days remote Looking for a candidate that does data architecture and design. Datalakes, data warehouse solutions. schema designs relational nonrelational data messaging design of data science data analytics Kafka and … ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the primary functions. Experience in design of data lake/warehouse solutions, preferably in the cloud Experience in schema design for relational and non-relational data and messaging protocols Experience in … databases Expertise with BI tools (Tableau, Power BI etc) Expertise with federated query tools such as Presto/Trino Experience with data lake file formats such as Avro, Parquet, ORC [Required] Experience in extracting and developing technical requirements from business goals and needs. [Required] Experience in solution more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »

We are searching for an experienced and talented Head of Data Engineering for a critical role working for a successful and expanding business, a company that is a market leader in its field, producing award-winning software solutions and services for a diverse portfolio of customers. The role … UK without company sponsorship. In this role you will be responsible for the following: - Creating and managing a complex service model that delivers data timely and accurately to a wide variety of stakeholders and downstream consuming applications and services. Defining and managing the cost model for the Data Platform and the staff who work on the platform. Working hand-in-hand with Data Operations and Data Insight teams to build key data pipelines and platform processes, deploying models and implementing orchestrations. Implementing governance models for data access, data more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … Technical Skills – Deep hands on experience with the following data technologies: Stack including, Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, primarily power BI Data Lake & Data Mesh implementation The rewards more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data … engineering design patterns and best practice, including data pipelines. Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Cosmos DB, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d more »

This is an exciting opportunity for a Data Architect to join a growing Data & AI team. The successful applicant will work alongside architects and consultants to deliver high-quality data solutions to help customers become more successful in becoming a data-guided … platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage Building conceptual, logical and physical data models … in Data Warehouse methodologies Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI Strong experience in SQL Good understanding of Azure infrastructure more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Deltalake, BigQuery, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, Azure ML is a plus Experience with Azure more »

Data Architect (SC Cleared/Banking), London (Hybrid) 6 Month Contract £(Apply online only)/day (Outside IR35) Data Architect needed with active SC Security Clearance , Banking domain experience , data transformation and COTS products experience on Data modernization and Transformation Programs. … work with a leading digital transformation business on large-scale IT modernisation programmes for Government clients. Key skills, experience + tasks will include: Data Architect with strong experience with COTS data flows, product architecture, and integration with data sources. Strong Banking/Financial Services … domain experience. Working Data Modernization and Transformation Programs including Data Cleansing and Migration. Good understanding of security measures and regulations in the Banking and Financial industry. Experience with COTS products and solutions for Data Integration and management. Evaluate and recommend COTS products and solutions more »

LondonLondon – Data Science & AI/Full Time Contract/HybridLondon – Manager, Data Science, AI & StrategyEkimetrics UKJob DescriptionAbout EkimetricsEkimetrics is a leader in data science and AI-powered solutions. Since 2006, we’ve pioneered the use of AI and data science applied to … unified marketing measurement and holistic business optimization aligned with sustainability performance. Our goal: Combine high-impact AI and data science solutions for sustainable business performance.At Ekimetrics, we help companies seize their data opportunities by creating new data and analytics capabilities … and deploying data science solutions that power-up their revenue strategy (MMM, customer analytics, brand tracking...) or business model (data lake implementation, data strategies, data transformation...).ðKey figures about Ekimetrics• 400+ data science experts globally • 1000+ diverse projects for more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data … of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Data Lake and Databricks. This is a predominantly remote role, however some office visit will occasionally be required, therefore you must be able to travel to … successful digital transformation initiatives involving data engineering and analytics. Significant hands-on Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data into data lake storage areas, physical databasemodels and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. Build more »

provide data and analytics to the business.They work on a modern Delta Lakehouse tech stack built on Databricks, Azure Data Lake, SQL and Python. This role is very much a hands-on role, and the leadership team are all still very hands-on.The ideal candidate … reporting. * Plus more...Main Skill-Set We are looking for a good mix of the below skills, (not necessarily all of the below): * Azure Delta Lake * Databricks * Azure Data Lake * SQL * PythonMust HavesTo be successful, it is essential you have the following: * 3+ years' experience in a … to successful background checks including a DBS and Credit Check.Job Summary65,000 to 90,000 GBPOther RoleSkills: Delta Lakehouse, Databricks, Azure Data Lake, SQL, Python, Data WarehouseLevel: Senior more »

Data Delivery Lead Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision of … superior data services. The Data Delivery Lead is responsible for ensuring the successful and timely delivery of data projects and initiatives. You will lead a team of Brown & Brown and third-party data specialists, manage resources, and act as a bridge between … patterns and best practice, including data pipelines delivering projects in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, Power BI The rewards: negotiable basic salary and all the normal benefits you’d expect more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data … requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Datalake and Databricks. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in … successful digital transformation initiatives involving data engineering and analytics. Significant hands-on Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data more »

Azure Data Engineer Perm Cheltenham/Hybrid working (2/3 days per week onsite) Up to £65,000pa Candidates must be eligible for SC Clearance We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: · Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. · Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Hi Professionals, Greetings From Ampstek!! Hope you are high in your spirits. Please stay safe. Our client is looking for Data Architect to join a high-growth organization. If you are interested share you resume sudhakaran.m@ampstek.com Role: Data Architect Location: London, UK (Hybrid) Duration: Contract … data with existing data architecture (called as UDP but essentially on Azure that consists of Stream Analytics, Data Lake, Ingestion and orchestration layers) Analysing existing solution (Legacy MES) to extract the data from its complex data model Skills needed … solution – SSRS) Should be well versed with Azure/Amazon cloud data architecture (Data Ingestion, Stream Analytics, Data Lake and Orchestration) Should have knowledge on Unified Namespace or equivalent standards Should be well versed with potential solutions options that can be used to more »

A Data Platform Product Manager required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. You will be required to build strong relationships across the client and use … a strong commercial mindset and data expertise to define and execute the roadmap and backlog for the data engineering and products. Experience should include: Significant experience 3 years+ as a data business partner/manager/product owner/data analyst or … technical business analyst in a data platform domain Be an experienced subject matter expert within the data platform domain, with strong technical knowledge and demonstrable passion, including understanding on (some of): Data lakes, data marts, data warehousing (Azure Data more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning more »

Are you an experienced best in class data engineer with 5-10 years' experience? Do you have experience or capability for a senior data engineering role ? If so, we want to hear from you ! We are currently recruiting for 2 experienced data engineers who … can support the data manager implementing and maintaining an effective business intelligence technical services . Support cloud platform and reporting, assisting in design and developing a data acquisition strategy, reporting to customers, and maintaining datasets. Key Responsibilities are: Monitor and maintain ETL processes , ensure accurate reporting … can best be gathered. Skills and knowledge needed: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, extensive Power BI experience Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

non-technical deliverables. As an integral team member, you will play a key role in advancing Study Group's transition to a more data-driven culture, all while supporting data governance initiatives. ABOUT THE ROLE Undertake simple and complex statistical analysis of a variety of different … establishing and maintaining automated data processes. This will involve working with the Data Architecture Team around the data lake by identifying and revising reporting requirements. Will need to develop and maintain MI/data reports and dashboards. Reports often must be … initiative to manage competing priorities and requirements, whilst ensuring the delivery of key objectives. Ideally, experience using SQL servers, Microsoft Azure Data Lake, or Oracle databases and data warehouses. Highly desirable if there is experience with Alteryx. Highly desirable if there is experience with R more »