51 to 75 of 246 Permanent Data Lake Jobs

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. … About you We know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing … service components. implement data solutions using a range of Azure cloud data services such as Azure storage (data lake), Cosmos DB and Azure SQL (inc. Synapse) work with members of the Data Science team, supporting and building data processing more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day more »

experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in … or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data … integration workflows. Strong understanding of data modelling, database design, and data warehousing concepts. Experience with data lake architectures and big data technologies. Hands-on experience with SQL and NoSQL databases. AWS certifications (such as AWS Certified Solutions Architect, AWS more »

crucial role in the Trust.The Trust has made a significant investment in BI because it recognises the impact that the intelligent use of data makes to the delivery of high quality and efficient health services. Having developed most of the infrastructure, our focus is now two-fold. Not … in community events. Relevant training in the use of elements of Microsoft Azure Technologies (Azure Analysis Service, Data Factory, Data Lake Storage/Analytics, Databricks, Synapse, Purview, Fabric etc.) Experience Essential Significant experience in two or more of the following: Designing and Building Data … and data warehouse design principles. Knowledge of latest Microsoft Cloud based technologies (Azure Analysis Service, Data Factory, Data Lake Storage/Analytics, Databricks, Synapse, Purview, Fabric etc.) Desirable Knowledge of cloud technologies and concepts Knowledge of NHS Information requirements, datasets, data more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … requirements. Design and implement scalable data solutions on the Azure platform, leveraging services such as Azure SQL Database, Azure Data Lake, and Azure Synapse Analytics. Develop and maintain ETL pipelines to ingest, transform, and load data from various sources. Optimize data … SQL, T-SQL, and data modelling concepts. Hands-on experience with Azure services such as Azure SQL Database, Azure Data Lake, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Familiarity with data governance, security, and compliance frameworks. Excellent communication and more »

Data Migration Developer (SC Cleared) London (Hybrid) Permanent £7 0,000 - £90,000 (DOE) + Benefits A highly experienced Data Migration Developer wanted with active SC clearance.This fantastic opportunity will involve playing a dual role as a Migration Specialist and Developer. Hybrid working with the expectation … to write high-quality, maintainable code using languages such as Python, SQL Server. PC, PowerShell, Sharepoint, Azure, Desktop Support , Snowflake, Azure Data Lake services (ALA) Gen 2. Expertise in development, testing Proof of Concepts (PoCs), delivering Minimum Viable Products (MVPs) is essential for achieving project success. Develop … Plan, design, and execute PoCs to validate new technologies, frameworks, or solutions. Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2. Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Familiarity with data more »

Data Migration Developer (SC Cleared) London (Hybrid) Permanent £7 0,000 - £90,000 (DOE) + Benefits A highly experienced Data Migration Developer wanted with active SC clearance.This fantastic opportunity will involve playing a dual role as a Migration Specialist and Developer. Hybrid working with the expectation … to write high-quality, maintainable code using languages such as Python, SQL Server. PC, PowerShell, Sharepoint, Azure, Desktop Support , Snowflake, Azure Data Lake services (ALA) Gen 2. Expertise in development, testing Proof of Concepts (PoCs), delivering Minimum Viable Products (MVPs) is essential for achieving project success. Develop … Plan, design, and execute PoCs to validate new technologies, frameworks, or solutions. Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2. Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Familiarity with data more »

with major global brands are entering a period of growth within their new office location in Llandysul… They are currently seeking an experienced Data Architect to play a crucial role in designing and managing their data infrastructure. You’ll leverage your technical expertise and join a … of learning, who are not afraid of making mistakes and thinking outside of the box. You’ll develop innovative solutions and transform complex data into meaningful insight, using your experience in data modelling, database design, and data governance. You will spend time collaborating with …/GCP/Azure/Cosmos) Knowledge of data governance and modern concepts e.g., data mesh and data lake houses Knowledge of data science and ML platforms e.g., Databricks, Vertex, Fabric Applicants must be within commutable distance of Llandysul for more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … Engineering. 1+ years in a Lead/Principal Engineer role. 3+ years of experience with GCP. Extensive experience with SQL and Data Lake/Warehouse solutions. Proficiency in languages such as SQL, Python, Java, or Scala. In-depth knowledge of query optimization techniques and experience in fine more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 15 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »

Join Ascent and help us do extraordinary things with data for our customers! About Us We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to … create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as … integration solutions Good knowledge of the Azure data engineering stack - Azure Data Factory, Azure Synapse, Azure Data Lake, Azure Blob, Cosmos DB Capability in using Databricks and Informatica Good experience in a general programming – ideally Python Prior experience with Lloyds of London more »

Azure Data Engineer - £60,000 + Benefits, London … weekly on-site You must have full right to work authorisation. No sponsorship available. Azure data platform technologies, including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Working in a leading UK and global business you will be a key part of the … platforms, offering near real-time process reporting solutions. Your Profile : Extensive experience with Azure data platform technologies, ideally including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Proven skills with Azure Data Factory & Databricks/Apache/Sparx, along with extensive more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … years in a Lead/Principal Engineer role. l 3+ years of experience with GCP. l Extensive experience with SQL and Data Lake/Warehouse solutions. l Proficiency in languages such as SQL, Python, Java, or Scala. l In-depth knowledge of query optimization techniques and experience more »

what role you come in and do, we will have a plan targeted to help you advance. What you’ll do As a Data Architect will be required to analyse an array of product offerings and business requirements within Mercury, to create and own the overall data architecture spanning the Mercury product suite. You will work with the product development teams (e.g. Core, Web, Integration, Data Practice and product owners) to evaluate and identify solutions that meet the needs of the business and customers, utilising industry standard best practices, patterns and creative design … support of Microsoft cloud-based services and products including (but not limited to): Azure Fabric Azure Data Factory Azure Data Lake Store Azure Data Lake Analytics Azure Storage Azure AI Search Azure Cosmos DB Azure SQL, Azure DW, Synapse and Azure Analytics more »

Azure Data Engineers wanted by a London based company at the forefront of revolutionising healthcare through cutting-edge technology and data-driven solutions. Our mission is to improve patient outcomes and streamline healthcare processes by leveraging the power of data. We are looking for a talented … Azure Data Engineer to join our dynamic team and help us drive our mission forward. As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure. You will work closely with our data science … analytics, and engineering teams to ensure that data systems are robust, scalable, and secure. Your expertise will help us harness the full potential of our data to deliver innovative healthtech solutions. The business is already a well established leader within their domain. However, they like to more »

Principal Data Engineer Northwest Up to £76,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team … across numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … roles - Demonstrated leadership experience. - Over 3 years of hands-on experience with Google Cloud Platform (GCP) - Deep expertise in SQL and Data Lake/Warehouse solutions - Advanced skills in programming languages such as SQL, Python, Java, or Scala - Extensive knowledge of query optimisation techniques and a proven more »

Lead Data Engineer A brand-new and exciting opportunity has arisen for a Lead Data Engineer with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Lead Data Engineer will be intrumental … engineering function. If you are currently a Lead Data Engineer who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step up then this would be perfect for you! Skills that … are required for the Lead Data Engineer are: Experience in Azure (ADF, Databricks and Data Lake) Experience leading/mentoring/managing a team and keen to manage a bigger team Strong data engineering principles working with SQL, ETL Pipelines and Cloud infrastructure more »

Principal GCP Data Engineer Remote Up to £85,000 VIQU are seeking Principal GCP Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a … numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal GCP Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … database performance. Minimum of 3 years hands-on and expert proficiency in GCP (Google Cloud Platform) Deep expertise in SQL and Data Lake/Warehouse solutions Advanced skills in programming languages such as SQL, Python, Java, or Scala Extensive knowledge of query optimisation techniques and a proven more »

Data Engineering Manager A brand-new and exciting opportunity has arisen for a Data Engineering Manager with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Data Engineering Manager will be intrumental … engineering function. If you are currently a Data Engineering Manager who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step up then this would be perfect for you! Skills that … are required for the Data Engineering Manager are: Experience in Azure (ADF, Databricks and Data Lake) Experience leading/mentoring/managing a team and keen to manage a bigger team Strong data engineering principles working with SQL, ETL Pipelines and Cloud infrastructure more »

Data Engineering Manager A brand-new and exciting opportunity has arisen for a Data Engineering Manager with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Data Engineering Manager will be intrumental … engineering function. If you are currently a Data Engineering Manager who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step up then this would be perfect for you! Skills that … are required for the Data Engineering Manager are: Experience in Azure (ADF, Databricks and Data Lake) Experience leading/mentoring/managing a team and keen to manage a bigger team Strong data engineering principles working with SQL, ETL Pipelines and Cloud infrastructure more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Job descriptionData Platform Product Manager26092023VSNFI4_1695726294An industry-leading organisation are looking for a passionate Data Product Owner to join their team as a Data Platform Product Manager. This role can be largely remote, with occasional travel to their Central London Head Office, likely up to … times per month.This organisation have invested a lot into their data function in recent years, and they are now fully operating on Azure (including use of data bricks), with a desire to start utilising Artificial Intelligence and Machine Learning in the near future, making this is … balance both transformation and business-as-usual work in an Agile (Scum) environment, with a real opportunity to contribute to their longer-term data strategy.You will collaborate with both internal and external teams to understand requirements, user stories and data needs, ensuring that solutions are prioritised more »

Senior Analytics Data Engineer 🌐 Global Insurance Leader 💵 £120,000 + 20% Bonus 🏠 1-2 days in the office (Central London) 🌐 Join a Global Insurance Leader: Exceptional Opportunity for a Visionary Data Engineering Expert! Are you an experienced Senior Analytics Data Engineer who thrives on … transforming data into actionable insights? Are you ready to join a top-tier global insurer on an ambitious journey to become the industry's gold standard in data-driven decision-making? Look no further - this is your chance to make a difference and shape the future … of insurance! Our client, a prestigious global insurer, is at the forefront of leveraging data and technology to revolutionize decision-making across the organization. Their ambitious Data and Analytics strategy aims to provide a 360-degree view of data to empower every team member more »

part of the Top Employer Institute annual listings. We were assessed on several key HR practices including Diversity and Inclusion. Role : Data Lake Engineer Key Responsibilities Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR … and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration of … Computer Science, Engineering, Mathematics or a related field Experience of IT platform implementation in a technical and analytical role Experience of Data Lake/Hadoop platform implementation Hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop ecosystem Experience more »

Data And Reporting Lead Main Job Purpose OmniTech is working with a confidential client to source a Data & Reporting Lead. The potential candidate will be supporting the development of business intelligence solutions using Microsoft Power Bi to the business. We have a mature reporting environment that … Microsoft application stack and works using the Agile Scrum Development methodology. The role compromises the following activities: • Various Integration activity (ETL) using Azure Data Factory, SSRS and C#. Connecting multiple data sources to our Datawarehouse and integration into our data model • Data … Management Server, SSRS, SSIS and other related systems • Experience with Microsoft Azure stack and related technology such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query etc • Experience in Low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi etc • ETL Related experience more »