101 to 125 of 498 Data Lake Jobs

Purpose Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data platform, tools … engineering role, ideally within a regulated environment Knowledge of the following is required: Modern Data platform concepts; Data Lake, Lakehouse, Data Warehouse, Data Vault ETL/ELT processes and designing, building and testing data pipelines Building data ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Agency: Omd Job Function: Consulting Job Subfunction: Technology Consulting The successful Data Solutions Manager will: Support onboarding of new clients and projects in a standardised way, making sure that we can deliver data solutions in the most efficient and quality-driven way possible. Work with appropriate … stakeholders exploring data requirements and documentation for data projects (e.g. Dashboards, automated reports) Define/Create documentations and training content for any changes in policies, or data requirements for our client projects Work with Data SMEs (subject matter experts) to ensure compliance ...

and AI strategies, translating requirements into scalable Salesforce solutions. • You’ll define enterprise customer data architectures including Data Lake Objects, Data Model Objects, identity resolution rulesets, unified individual profiles, calculated insights and segmentation frameworks. • You’ll design scalable ingestion, harmonisation, transformation … frameworks, MuleSoft and event-driven architectures. • You’ll have experience integrating Salesforce with enterprise platforms such as Snowflake, Databricks, Azure Data Lake, AWS, Google Cloud or similar technologies. • You’ll understand batch, streaming, near-real-time, zero-copy and data federation approaches and know when ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … integration , ideally in enterprise-scale environments. Deep expertise in Azure Databricks , Azure Data Factory , Azure Synapse , and Azure Data Lake . Hands-on experience with Spark (PySpark/SparkSQL) , ETL/ELT design, and data pipeline orchestration . Strong data modelling ...

workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets … Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring ...

shape the future of motor insurance? Prima could be the place for you. Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly … expanding to help millions more drivers in the UK and Spain. To help fuel that growth, we need a Senior Data Engineer to join our Engineering team. This team is the beating heart of Prima. You’ll be joining over 350 engineers across software development, infrastructure, operations ...

Engineer in a Data Field Strong Azure data skills, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps& Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data ...

Rate: £550 per day (Inside IR35) Sector: UK Public Sector/Government Clearance: Active SC Clearance Required Overview We are seeking an experienced Data & Analytics Architect to join a high-profile public sector programme. This role will play a key part in defining, designing and governing enterprise-scale … data architecture solutions, enabling data-driven decision making and supporting the delivery of modern digital services across government. The successful candidate will work closely with business stakeholders, technical teams, delivery leads, and data professionals to establish strategic data architectures, analytics capabilities ...

About the role As a Data Engineer at Tecknuovo, you will design, build and maintain reliable data solutions that enable our customers to make better use of their data. Working as part of multidisciplinary delivery teams, you will turn complex requirements into scalable data … solutions using Databricks or Snowflake, alongside AWS and/or Azure cloud platforms. You will have experience delivering new data lake patterns or helping to transform existing data lake environments, with a strong understanding of how to build scalable, secure and maintainable ...

Location: Milton Keynes (Hybrid) or remote working/home based within the UK with very occasional office visits Are you a Data Engineer passionate about cloud data solutions, modern data architectures, and scalable ETL/ELT processes? Join a forward-thinking organisation … structured and unstructured data with a snowflake environment Enhance cloud data capabilities, working with AWS S3, Azure Data Lake, and Apache Spark Collaborate with cross-functional teams to ensure data availability for advanced analytics and reporting Automate workflows, implement CI/ ...

Data Scientist Data Science and Artificial Intelligence Department The Bermuda Monetary Authority (Authority or BMA) is seeking the services of a skilled and capable individual to work as a Data Scientist in our Data Science and Artificial Intelligence Department. Reporting … effective data visualisation techniques Designing, developing and implementing modern and scalable data management platforms (including ‘Modern Data Lake’ and ‘Enterprise Data Warehouse’ solutions as well as consolidated and modern data pipelines (extract, transform, load) to extract, aggregate and manipulate ...

qualification is beneficial Skills: Experience with cloud data platforms including Azure, Databricks, Snowflake, and Denodo preferred Working knowledge of Data Lake design principles Experience with data pipeline monitoring, troubleshooting, and incident management Familiarity with Power BI and data visualization tools Experience … with cloud data platforms preferably Azure, Databricks, Snowflake, and Denodo Proven experience supporting or operating within Medallion Architecture-based Data Lake environments Experience managing LII support functions including escalation management and SLA ownership Track record of leading and developing teams of 10 or more technical ...

global community. Our employees dedicate their time to helping our clients transform their business, from strategy through implementation and business transformation. As a Data Solutions Architect , you will lead the strategy, architecture and delivery of enterprise-scale data and analytics solutions for our clients. Working across … data architecture, software engineering, cloud platforms, analytics engineering and client advisory, you will translate business priorities into secure, scalable, well-governed and cost-effective solutions. You will partner with executive stakeholders, business leaders and technical teams to define data roadmaps and target-state architectures, evaluate technology ...

This team sits at the heart of the organisation, bringing together data from across the business into a centralised data lake and transforming it into reporting, analytics and insight that supports operational, tactical and strategic decision-making. You'll work with a collaborative team based … customers. Centralise, cleanse, validate and model data from multiple business systems within modern data platforms and data lake environments. Build and maintain data pipelines, automated solutions and analytical tools using technologies including Python, SQL and Power BI. Design and deliver forecasting ...

years of experience as a Product Manager/Owner of a data product, managing data & analytics solutions (Data Lake/DWH/Cloud Service).Experience in the iGaming or iLottery industry is highly beneficial.Proficiency in data modeling, infrastructure, and analytics.Experience working … pipelines, ELT workflows, and contemporary cloud data architectures.Experience with current cloud data platforms such as Snowflake, Azure Data Lake, Azure SQL, dbt, Airflow, or similar tools.Ability to understand and work with SQL queries and data models.Knowledge of data governance ...

work in regulatory change at the society. We’re looking for a Scrum Master to support the delivery of our Data Lake programme. This is an opportunity to join a growing team delivering strategic data and reporting capabilities that support important business and regulatory outcomes. … each team member delivers value towards the overall project goals. The team works across multiple deliverables covering regulatory reporting and strategic data lake work and upcoming Virgin Money integration activities. We support all reporting across the Finance function. In this role you’ll get to experience ...

Services. You will help migrate data from the Council’s existing data warehouse into a new Data Lake environment , ensuring data is accurate, reliable and fit for reporting. A significant part of the work will involve HR data , working … Extract, cleanse, validate and analyse data from multiple sources. Support the migration of data into a new Data Lake environment. Develop and maintain Power BI dashboards and reports . Use SQL to extract and manipulate data. Produce performance and management information. Analyse large ...

seeking a Principal Data Engineer who can work across the full stack of Anaplan’s data platform, setting the technical direction for how we ingest, transform, store, serve, and govern data at scale. You will build highly performant, robust data pipelines that … orchestration tools (e.g., Apache Airflow, Dagster). Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg). Advanced SQL skills and proficiency in Python. Strong background in modern software development practices (testing ...

tools for software development? If yes, come join Paloma’s 14-person team of software engineers and product experts as our first Data Engineer! As we are a rapidly scaling organisation, you will have multiple opportunities to develop. With demonstrated success in the role, you can progress … Working alongside product and clinical teams to translate business questions into data models and metrics Familiarity with data lake concepts and architecture, organising raw, cleansed, and curated data layers (bronze/silver/gold or equivalent), and working with large volumes ...

years of experience as a Product Manager/Owner of a data product, managing data & analytics solutions (Data Lake/DWH/Cloud Service).Experience in the iGaming or iLottery industry is highly beneficial. Proficiency in data modeling, infrastructure, and analytics. … workflows, and contemporary cloud data architectures. Experience with current cloud data platforms such as Snowflake, Azure Data Lake, Azure SQL, dbt, Airflow, or similar tools. Ability to understand and work with SQL queries and data models. Knowledge of data ...

Responsibilities Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2). Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed … Fabric Lakehouse). Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing security controls ...

Title: Data Delivery Lead/Data Squad Lead - Corporate & Investment Banking Location: London - Liverpool Street Contract: 6 months (potential extension) Working pattern: Hybrid - 2-3 days per week in the office Job Type: Full-time Rate: Circa £745/Day We are looking for an experienced … Data Delivery Lead/Data Squad Lead to join a leading financial services organisation, supporting its Corporate & Investment Banking data platform and delivery function. This is an excellent opportunity for someone with a strong background in Corporate or Investment Banking, combined with experience leading ...

company where people truly BELIEVE in what they are doing! We’re committed to bringing passion and customer focus to the business. Senior Data Engineer West London Onsite 2-3 days per week Fractal is a strategic AI partner to Fortune 500 companies with a vision to power … Watch’ by Gartner. Please visit Fractal | Intelligence for Imagination for more information about Fractal We are seeking a skilled and detail-oriented Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. You will be responsible for transforming raw data into ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … operations for the worlds leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others. Headquartered ...