101 to 125 of 569 Permanent Data Lake Jobs

all. We make it, store it, move it, sell it, and mend it. Join a team at the heart of Centrica's data transformation journey, building the data products and platforms that power insight, customer experiences and business decision-making across the organisation. As a Data Engineer, you will design and develop scalable data solutions that underpin strategic assets such as Centrica's Single Customer View and Property View, enabling trusted, governed and accessible data for analytics, operational processes, customer engagement, AI and digital use cases across the business. ...

products including data transformation, data modelling, and reporting on both on-premises and cloud environments Build modern data lake/lakehouse architectures that support scalable, flexible data processing Enhance platform integration by leveraging domain events to enable more efficient and real … data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

global enterprise. Role Overview: This position is for a technical lead for data acquisition within the AI Labs/Data Lake team. We are seeking a Lead Java Software Engineer to join our Wholesale Data and Operations Technology team. This position will serve … acquisition processes and will be instrumental in shaping the architecture, implementation, and ongoing evolution of our comprehensive AI Labs/Data Lake platform. This role demands a seasoned professional who can seamlessly blend hands-on technical expertise with strategic leadership capabilities to deliver robust, scalable data ...

global enterprise. Role Overview This position is for a technical lead for data acquisition within the AI Labs/Data Lake team. We are seeking a Lead Java Software Engineer to join our Wholesale Data and Operations Technology team. This position will serve … acquisition processes and will be instrumental in shaping the architecture, implementation, and ongoing evolution of our comprehensive AI Labs/Data Lake platform. This role demands a seasoned professional who can seamlessly blend hands‐on technical expertise with strategic leadership capabilities to deliver robust, scalable data ...

shape the future of motor insurance? Prima could be the place for you. Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly … expanding to help millions more drivers in the UK and Spain. To help fuel that growth, we need a Senior Data Engineer to join our Engineering team. This team is the beating heart of Prima. You’ll be joining over 350 engineers across software development, infrastructure, operations ...

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Engineer in a Data Field Strong Azure data skills, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps& Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data ...

ownership of our data transformation and orchestration tooling; batch and streaming infrastructure and exploration tools (Databricks, Airflow, dbt) and look after our Datalake (ingestion, storage, governance, privacy). You’ll work with a modern, cutting‐edge data stack and play a key role in shaping data … design within a modern cloud‐based environment Advanced experience working and understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi Experience working with lakehouse/medallion architectures in Databricks Experience with experimentation support tooling ...

Type: Permanent Location: United Kingdom Number of hours: 40 hours per week – full time Ready to utilize your experience and expertise in Data Engineer We have an exciting role for you Data Engineer ! Careers at TCS: It means more TCS is a purpose-led transformation company … maintain Azure-based data pipelines and ETL solutions. Work with Azure Data Factory, Databricks, Synapse, and Data Lake to support data integration, migration, and analytics requirements. Collaborate with stakeholders to understand business needs, troubleshoot data issues, and ensure secure ...

OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Supporting existing Synapse solutions during the transition The client … experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing, deploying and supporting production solutions Azure Synapse would be useful but isnt ...

team you'll be working with: We are seeking an accomplished and detail-oriented Snowflake Data Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data engineering, ETL/ELT pipelines, and cloud-native data platforms … platforms (AWS, Azure, GCP).Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon).Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop).Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. Understanding of data ...

role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. We're looking for a Data Engineering Lead to join our team in Milton Keynes on a permanent basis. This role offers a salary of £75,000 - £85,000 per annum … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands-on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

month-end close, and business reviews Partner with Accounting, FP&A, and Treasury teams to automate recurring reporting packages and reduce manual data extraction activities Financial Systems & Data Platform Design, develop, and maintain financial data pipelines within the Microsoft Fabric ecosystem (Data … valuation, yield/cost accounting, and intercompany transfer pricing Knowledge of Azure cloud services relevant to financial data: Azure Data Lake, Azure Synapse, Azure DevOps Project management certification (PMP, PRINCE2, or SAFe Agile) is a plus Interested in hearing more? Easy Apply now by clicking ...

communications there is always a talented team working to maximise the potential of the sport. Role Overview: We are looking for a Data Analyst to join our IT department. Reporting into our IT Systems Manager, this role will maintain, develop and optimisation of data enterprise solutions. … capture processes Monitor data quality, integrity and performance across data platforms Maintain medallion architecture layers in a data lake to manage structured and semi-structured data Apply data modelling best practises to support enterprise reporting and analytics Building data ...

Blood and Transplant (NHSBT) is a unique organisation that works to save and improve lives every day. Are you a skilled data engineering professional who thrives on transforming complex data into powerful insights that support vital services? This is an exciting opportunity to join NHS Blood … Server Tools. Experience with MS Azure technologies such as Azure Data Factory, Synapse Analytics, Databricks, Azure SQL, Azure Data Lake Storage etc. Knowledge of data modelling, architectural principles and big data tools. Experience in diagnosing and troubleshooting complex data ...

seeking a Data Infrastructure Architect with 7+ years of experience in designing and governing enterprise-scale data platforms within regulated environments. The role ensures data is accessible, trusted, secure, and optimized for analytics, machine learning, and AI-driven solutions. Ideal candidates will either already … have transitioned to or be ready to transition from a hands-on delivery role to strategic influence, shaping data architecture standards and guiding technology decisions across the organization. The Architecture & Modernization (A+M) team drives the Firm's multi-year technology modernization roadmap, focusing on architecture frameworks, product delivery ...

annum. 37 Competency and value framework (CVF) level? 2 24/09/2026, 12:00 Permanent Full Time Leek Wootton As anAssociate Data Engineer,with a specialization inPower BI, your primary responsibility will be to build and maintain data pipelines and reporting solutions using Power … into a variety of data stores e.g. databases and data lakes. You will work closely with data analysts, and business stakeholders to ensure data accessibility and quality. Main Responsibilities: Work with the Data Engineer to ensure the data ...

Responsibilities Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2). Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed … Fabric Lakehouse). Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing security controls ...

realized as secure and robust solutions. Apply AI tools and techniques to improve Solution Architecture practices - including accelerating requirements analysis, pattern identification, data modeling, and architecture documentation. Ensure full conformance with firm-wide, CIB, and sub-Line of Business (sub-LOB) architecture patterns and standards, participating in architecture … Persistence, Data Streaming, Data Quality and Metadata Management. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Demonstrated ...

opportunity to discuss your flexible working requirements during the interview process, and at offer stage. We’re reshaping our Digital, Technology and Data function for the future, creating new opportunities, strengthening our capability, and building clearer, more resilient ways of working so we can deliver even better services … with Power BI or Strategy Experience with working within the MS Azure Cloud data platform (Data Factory, Data Lake and Databricks) Strong SQL skills with experience of Microsoft SQL Server Management Studio or equivalent Experience working on data warehouse projects ...

Contract Business Analyst | Data Lake Migration | Outside IR35 | 6 Months Role: Business Analyst Day rate: £550 p/d (Outside IR35) Location: London – 1 day in the office every fortnight Duration: 6 months Start: ASAP We’re looking for a Business Analyst to join a data lake migration/carve-out project on an initial 6-month contract. You’ll be working between the technical teams and business stakeholders, helping to make sure the right data, reports and applications are identified, tested and signed off as part of the data ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … everyone and prioritise work within the engineering team. Experience of working with data platforms (data warehouse/data lake) and understanding the core elements that make up these platforms. Experience of working with Data Scientists, Analysts and/or BI teams ...