76 to 100 of 319 Data Lake Jobs

pipelines using Databricks on Azure. Build and optimize data solutions leveraging Azure Data Services (e.g., Data Lake, Synapse). Work with large datasets to enable advanced analytics and reporting. Collaborate with stakeholders to deliver high-quality data solutions aligned … standards. Essential Skills Proven experience in Data Engineering within complex environments. Strong hands-on expertise with Databricks and Azure (Data Lake, Synapse, etc.). Solid understanding of cloud-based data platforms and ETL processes. Active SC Clearance (must be in place before starting ...

Project: Implement data flows to connect operational systems, analytics platforms, and Business Intelligence (BI) systems. Document source-to-target mappings and define data architecture. Re-engineer manual data flows to enable scalability and reusability. Support the build of data streaming and batch … Platform to deliver new Business Intelligence solutions and maintain existing solutions Basic DBA skills. Report development in Power BI. Experience with data lake and cloud data warehousing. Please note: This is hybrid role with 2 days onsite + travel to other client sites ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

Role: Cloud Data Architect Location: Bristol, London/Hybrid (2 days a week on site, with travel to client sites as required) RoleType: Permanent/Full-Time Salary: Depends on experience Role Summary: As a Senior/Principal Consultant Cloud Data Architect, you will lead … design and implementation of secure, scalable and resilient cloud data platforms in highly regulated environments. Youll guide architectural decision-making, advise stakeholders, and mentor engineers within Techmodals technical delivery teams. You will work collaboratively across the business and customer domains to deliver successful projects. Youll be experienced with ...

Data Engineer | Hybrid | London | Databricks | Azure | 85k I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation … forefront of the data engineering field. You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards and analytics ETL & Data Modelling: T-SQL, metadata-driven pipelines Design ...

Data Engineer | Hybrid | London | Databricks | Azure | 85k I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation … forefront of the data engineering field. You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards and analytics ETL & Data Modelling: T-SQL, metadata-driven pipelines Design ...

looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects … experience with data engineering coding languages such as Python, R, or Spark. Understanding of data warehouse and data lake principles. Experience with data visualisation tools such as PowerBI or Tableau. Leadership or mentoring experience within a technical team. Agile and/ ...

work closely with internal teams to design, build, and optimise data models and ingestion pipelines, contributing to a new data lake and a robust gold-layer architecture. You'll also have the chance to shape ML-ready pipelines and mentor more junior data engineers. What you'll be doing Building scalable data models and ingestion pipelines for a new data lake Working across multiple data domains and supporting internal partners Designing and delivering high-quality datasets for BI, insights, and analytics use cases Collaborating ...

Were looking for a Data Engineer who loves building and managing data solutions. This is a fully remote, career opportunity with a forward looking marketing company with a national footprint. Youll be working in the Azure cloud, creating reliable pipelines, making sure data is clean and accessible, and helping the business make smarter decisions. If you enjoy solving problems, working with all kinds of data, and collaborating with both technical and non-technical teammates, this role is for you. What Youll Do Build and manage data pipelines ...

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders … define and implement data product solutions that are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that ...

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders … define and implement data product solutions that are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that ...

Data Architect - £60,000-£80,000 | Hybrid (Hatfield, 2 Days Onsite) | January Start A leading UK utility company is seeking an experienced Data Architect to join their team and play a pivotal role in shaping and governing their enterprise data landscape. This … . Embed data governance and data quality frameworks across pipelines. Work with the existing technology stack (Redshift Data Lake, Talend, Oracle, QlikView) while leveraging knowledge of modern platforms such as Snowflake, Databricks, Synapse. Engage with senior stakeholders and lead architectural decisions that align ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...