126 to 150 of 409 Permanent Data Lake Jobs

Role: Data EngineerEvery functional area, in every industry, is on an AI Journey. The power of machine learning to dramatically improve company key performance indicators is being proven every day. But, although we feel every large organisation is on an AI journey, the path to value is unclear.There … Redshift/RDS, Kafka/Spark, AWS Security, IAMOR Azure Data factory, Azure Data bricks, Azure Data Lake, Azure SQL DW & Azure SQL, Azure Storage, HDInsight (Spark/Kafka),Azure Event Hub, Azure AD/IAM and Data CatalogORCloud DataFlow, DataPrep ...

more liquid world. The more we share, the more we all gain. About the role Sharegain is looking for an experienced and driven Data Team Lead to join our R&D organization. In this role, you will lead a team of data engineers while taking hands … Engineering & Architecture Define and drive the data architecture strategy, including the design of scalable pipelines, ETL workflows, and Data Lake expansion. Oversee the design and maintenance of schemas, data structures, and data organization standards. Own data quality, integrity ...

BROADBEAN_918351784287114Location: London, Greater LondonContract: ContractIndustry: BankingSalary: 987.64 - 1177.86/DailyRecruiter: Andrew BrindleyE-Mail: andrew.brindley.91835.9115@adeccops.aplitrak.com**Azure Databricks Data Lake Deployment Squad Lead** (Contract)Duration: Up until 31 March 2026 (Possibility for extension)Location: London/Hybrid (3 days per week on site)Rate: A highly competitive … Umbrella Day Rate is available for suitable candidatesRole ProfileThis role will manage a scrum team that will ingest data required for the ECB Onboarding program into the EMEA Data Platform with a focus on data required by the EUAG Finance Department.Key Responsibilities:Facilitate efficient ...

home, there’s nothing we can’t achieve. Basic qualifications- Experience implementing AWS services in a variety of distributed computing environments- Data lake architecture and design (Lake Formation, S3-based architectures)- Medallion architecture implementation (bronze/silver/gold layer design)- Data strategy … governance frameworks- Data modeling and schema design for analytics workloads- Modern data platform design and implementation- ETL/ELT pipeline development and optimization (Glue, EMR)- Data warehousing solutions (Redshift)- Data catalog management and metadata governance- Data quality and lineage frameworksPreferred ...

platform administration experience across Microsoft cloud data technologies, including Azure Databricks, Microsoft Fabric, Azure Data Factory, Azure Data Lake, Azure SQL and Power BI. Operational mindset with experience managing, monitoring and supporting data platforms in production environments. Experience working in controlled … Skills & Experience Current SC Clearance. Hands‐on administration experience across Azure Databricks, Microsoft Fabric, Azure Data Factory, Azure Data Lake, Azure SQL and Power BI. Strong understanding of cloud data platform operations, monitoring, access management and environment support. Experience working within controlled ...

Senior Data Engineer – Azure/Databricks £70,000 + bonus Hybrid Working – 1 day on-site per week East Midlands based I'm working with a business that's continuing to invest in its Azure data platform and is looking for a Senior Data … evolution of the Azure data platform Key experience: Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Advanced SQL and Python CI/CD with Azure DevOps Strong stakeholder engagement and communication skills What's on offer: Flexible hybrid working ...

bringing innovative solutions to life. Your visionary leadership and pursuit of excellence makes a lasting impact on the firm and industry.As a Principal Data Engineer at JPMorganChase within the [insert LOB or sub LOB], you provide expertise and data engineering excellence as an integral part … analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimizationExperience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure, GCP), including migration from legacy systemsAdvanced proficiency ...

Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

Closing date 20 May 2026 What is the purpose of this job? As the Data Engineering Lead, you will provide senior technical leadership and oversight for the RDG’s current AWS-based data platform, ensuring it is robust, scalable and able to support RDG and wider … DataOps is essential, ideally including the development of pipelines and tooling. You will champion best‐practice data warehouse and data lake design, driving automation and high standards in code quality. You’ll lead by example, be curious about data and eager to uncover ...

multidimensional models. Investigate and resolve complex technical, functional, and performance-related issues. Develop and support data integration processes, including Data Lake implementations and associated workflows. Build and maintain API-based integrations between Infor EPM and third-party business applications. Monitor platform performance and implement improvements … within Infor EPM. Advanced knowledge of EPM modelling, business rules, application engine functionality, and associated platform components. Experience implementing and managing Data Lake solutions and related data management processes. Proven experience integrating applications through APIs, web services, or similar technologies. Strong SQL and data ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

validate all technical designs and implementation plans of the 3rd party SI/vendors Provide technical knowledge and understand of existing applications, data & integration configuration Own collation and delivery of Control Risks’ Non‐Functional Requirements to the project Accountable for the assurance of the technical design, system configuration … Agile environment Desirable Implementing and supporting Microsoft D365 solutions, Microsoft Power Platform solutions and Microsoft Data solutions (Data Lake, Data Factory, Data Warehouse) MS SQL DB, TSQL language, ETL, SSRS, SSIS Experience Dataverse, Common Data Services, Synapse Experience Strong ...

team you'll be working with:We are seeking a hands-on Enterprise Architect with deep experience in healthcare data and platform architectures to support large-scale transformation across the NHS ecosystem. This role sits at the intersection of enterprise governance and practical delivery, requiring strong architectural judgement … technical credibility, and the ability to operate effectively across complex organisational and data landscapes.The Enterprise Architect will provide architectural leadership across data platforms, analytics, and interoperability initiatives, ensuring solutions align with enterprise standards, national policy direction, and the evolving NHS operating model (DHSC, ALBs, ICBs, Care ...

Cloud Data Architect (Manager) – BIP xTechAbout BIPBIP is an international consultancy working with leading organisations to deliver transformation, create long-lasting value and shape the future with confidence. We bring together deep industry expertise, innovative thinking and a collaborative approach to help our clients solve complex challenges … ValueWe Are Creators of Our Own FutureTogether We Go FurtherAbout BIP xTechBIP xTech is BIP’s Centre of Excellence for Artificial Intelligence, Big Data, and Modern Data Platforms. We work with our clients to design and deliver scalable, cloud-native data platforms that enable ...

goals. Valo is targeting airliner-level safety certification in 2029 ahead of entering service with our airline and operator customers.What to ExpectAs a Data Architect, you will be responsible for defining and maintaining the target data architecture across the organisation. This includes how data … shaping and implementing pipelines, models, and platform components. The role requires balancing longer-term architectural direction with practical delivery, working closely with data engineers, BI developers, and software teams to ensure solutions are both well-designed and delivered effectively.What You’ll DoDefine and maintain the target data ...

This is a remote position. Job Summary We are seeking a skilled and detail-oriented Data Engineer to design, build, and maintain scalable data infrastructure and pipelines. In this role, you will be responsible for ensuring reliable data flow, optimizing data systems … enabling analytics and business intelligence across the organization. Key Responsibilities Design, develop, and maintain scalable data pipelines (ETL/ELT processes) Build and optimize data architectures, including data warehouses and data lakes Develop and maintain robust data models to support ...

initiatives for the Technology and Compliance departments, alongside our Contact Centre partners, leveraging tools such as Azure stack (Azure Data Factory, Azure Datalake), Databricks and PowerBI to innovate and streamline workflows. As part of a product team, you will develop solutions tailored to meet business requirements, including initiatives … infrastructure. Technical Expertise Languages: Strong proficiency in SQL and Python. Data Platform: Hands‐on experience with Azure Data Lake and Databricks. Data Integration (ETL): Proven capability in building efficient data pipelines using Azure Data Factory (ADF), SSIS ...

feedback and validate all technical designs and implementation plans of the 3rd party SI/vendorsProvide technical knowledge and understand of existing applications, data & integration configurationOwn collation and delivery of Control Risks’ Non-Functional Requirements to the projectAccountable for the assurance of the technical design, system configuration, data … DevOps projects in an Agile environmentDesirableImplementing and supporting Microsoft D365 solutions, Microsoft Power Platform solutions and Microsoft Data solutions (Data Lake, Data Factory, Data Warehouse)MS SQL DB, TSQL language, ETL, SSRS, SSIS ExperienceDataverse, Common Data Services, Synapse ExperienceStrong ...

Senior Google Cloud Architect Shape the Future of AI & Data with Us At Datatonic, we are Google Cloud's premier partner in AI, driving transformation for world-class businesses. We push the boundaries of technology with expertise in machine learning, data engineering, and analytics on Google …/streaming data pipelines such as Beam and Flink. Data Architecture: Proven ability in designing and building data lake and data warehouse solutions with technologies like BigQuery, Azure Synapse, Redshift, Oracle, Teradata, etc. Analytics Tools: Experience creating analytical products using tools ...

# Senior Data Architect - London, UK - FulltimeLondonApply for this job* Permanent* Experienced Professionals* Architecture* ID 522521-en\_GB**About the Job you are considering:**Join Capgemini’s **Integration & Data (I&D)** practice, where we **Consult with Purpose, Continuously Evolve, and Architect Tomorrow**. As a **Data … Cloudera in AWS taking the lead on the delivery from an data design perspective* Design end-to-end data lake and distributed data solutions to meet business needs within the context of a broader solution implementation* Contributor to overall solution planning providing input ...

impressive multinational firm is looking for an accomplished Data Engineer to join its team. Please note the role is hybrid – you will work from the office 3 days per week with 2 from home. In this role, you will be responsible for designing, developing, and maintaining scalable data … Data Engineer with hands-on experience with Azure data services, including Databricks, Data Factory and Data Lake solutions. You will have a proven track record of designing and optimising data warehouses and large-scale data platforms, supported ...

Senior Data Modeller Location: Glasgow or Manchester Working: Hybrid, 50% office/50% home Type: Permanent We’re looking for a Senior Data Modeller to join a large-scale data transformation programme in a pensions & investment firm, helping build trusted data products … that support analytics, reporting, data science and AI. The Role Design and maintain enterprise and domain-based data models Analyse and integrate complex data sources Develop source-to-target mappings across batch, real-time and streaming data Support the evolution ...

scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data … Functions, etc.).Databricks or AWS certifications.Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning).Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats.J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy ...

strategic decision-making. You'll contribute to the migration from a legacy data warehouse into a modern Azure Data Lake, develop Power BI dashboards and reporting solutions, support data engineering activities using Databricks and Azure Data Factory, and work closely with … Azure Data Factory and Power BI, including DAX and semantic modelling. You'll have a solid understanding of Azure Data Lake architecture, ETL processes, dimensional modelling and modern reporting principles, with the ability to translate complex business requirements into practical, scalable data solutions. ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what you'll help … platforms providers (e.g., AWS, Azure, GCP, Snowflake, Databricks) and their data and AI services (e.g., S3, Azure Data Lake, BigQuery, Azure ML, Vertex AI)Connect to your business - Technology and TransformationDistinctive thinking, deep expertise, innovation and collaborative working. That’s what connects us. ...