1 to 25 of 150 Remote Data Lake Jobs

Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and … or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. To be considered for this role you MUST have in-depth experience … Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms … that help organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In … this role, you will help design and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big More ❯

Job Description: BLN24 is seeking a highly skilled Data Engineering Specialist with demonstrated experience in developing data models for implementation in a data lake architecture. The ideal candidate will have a proven track record of successfully handling projects of similar size and scope. Key Responsibilities: Design and develop data models for … implementation in a data lake architecture. Collaborate with cross-functional teams to understand data requirements and translate them into effective data models. Ensure data models are optimized for performance and scalability. Implement and maintain data pipelines to support data lake architecture. Monitor and troubleshoot data … guidance and support to team members and stakeholders. Qualifications: Bachelors of Science in relevant field of study Proven experience in developing data models for data lake architectures. Strong understanding of data modeling principles and best practices. Proficiency in data modeling tools and technologies. Excellent problem-solving and analytical skills. Strong communication More ❯

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … unusual data profiles and establish recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions … implementing ETL processes. Experience in using SQL to query and manipulate data. Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory. Understanding of data extraction from vendor REST APIs. Spark/Pyspark or Python skills a bonus More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits … like S3/GCS, Glue, BigQuery, Pub/Sub, SQS/SNS, MWAA/Composer, and more to create a seamless data experience. (Required) Data Lake , Data Zone, Data Governance: Design, build, and manage data lakes and data zones within our cloud environment, ensuring data … direct impact. Cloud Expertise: Proven hands-on experience with AWS and/or GCP, including a deep understanding of their data analytics service offerings. Data Lake/Zone Experience: Demonstrable experience designing, building, and managing data lakes and data zones. IaC Proficiency: Solid experience with Terraform and preferably Harness, Tekton, or More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our … data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test and … warehousing, and real-time streaming. Knowledge of developing and processing full and incremental loads. Experience of automated loads using Databricks workflows and Jobs Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow. Strong experience with Azure Data Factory (ADF) for data integration and orchestration. Hands-on experience with Azure DevOps, including pipelines, repos More ❯

Join to apply for the Data Architect (Trading) role at Keyrock Join to apply for the Data Architect (Trading) role at Keyrock About Keyrock Since our beginnings in 2017, we've grown to be a leading change-maker in the digital asset space, renowned for our partnerships and innovation. Data Architect About Keyrock Since … s progress with our research and governance initiatives. At Keyrock, we're not just envisioning the future of digital assets. We're actively building it. Position Overview The Data Architect is responsible for designing, implementing, and maintaining an organization's data architecture and strategy, ensuring that data is collected, stored, and processed efficiently and … securely to support business intelligence, data analytics, and machine learning operations (MLOps) practices. Key Responsibilities Designing Data Architecture: Plan and implement a robust, scalable data architecture that integrates data from various sources and supports diverse analytical needs, while optimizing costs and meeting business requirements. Implementing Data Engineering Pipelines: Design and More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with good Fabric experience looking to join a new, growing team … Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data engineers within the team … end project lifecycle Strong experience with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing and data transformation More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

bad debt improvements: Support the Bad Debt Transformation programme by providing data-led insights that drive operational improvements and policy recommendations. Transition to the Data Lake: Support the transition to a data lake environment, allowing us to link together big data sets and unlock insights that we have not had … Python and/or R for data manipulation, modelling, and visualisation. Familiarity with cloud-based data platforms and tools, such as Azure Data Lake, AWS, or Google Cloud. Degree, or equivalent experience, in a quantitative field such as Data Science, Mathematics, Statistics, Computer Science, or related discipline. Strong working knowledge of … Microsoft Office products, specifically MS Excel. Desirable Experience Prior involvement in transitioning data environments, such as migrating from traditional databases to a data lake architecture. Experience within Utilities or Financial Services. Location: Hybrid - Walnut Court - SN2 8BN. Hours: 36 hours per week, Monday to Friday. What's in it for you? Competitive starting salary of More ❯

the interaction of incoming and outgoing data flows from the Core Accounts DDA platform to Reference Data platforms, Data Warehouse, Data Lake as well as other local reporting systems which consume data from Core Accounts Drive the data architecture and roadmap for eliminating non-strategic point to … point connections and batch handoffs Define canonical data models for key entities and events related to Customer, Account, Core DDA in line with the Data Standards Assess opportunities to simplify/rationalize/refactor the existing database schemas paving way for modularization of the existing stack Provide technical guidance to Data Engineers responsible for … designing an Operational Data Store for intra-day and end-of-day reporting. Implementing data strategies and developing logical and physical data models. Formulate efficient approach to rationalize and formulate strategy to migrate reports Build and nurture a strong engineering organization to deliver value to internal and external clients Acts as SME to senior More ❯

Azure Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central London. They are seeking an experienced Azure Data … Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data … commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) Azure Synapse Analytics Azure Data Lake Storage (Gen2) SQL & Python Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps. Experience working within consultancy or client-facing projects More ❯

Senior Data Platform Engineer page is loaded Senior Data Platform Engineer Apply remote type Open to Remote locations Depop - London time type Full time posted on Posted 10 Days Ago job requisition id JR4859 Company Description Depop is the community-powered circular fashion marketplace where anyone can buy, sell and discover desirable secondhand fashion. With a … across the organisation, including taking ownership of our data transformation and orchestration tooling; batch and streaming infrastructure and exploration tools (Databricks, Airflow, dbt) and look after our Datalake (ingestion, storage, governance, privacy). You'll work with a modern, cutting-edge data stack and play a key role in shaping data-as-a-product … including AWS primitives such as IAM, S3, RDS, EMR, ECS and more Advanced experience working and understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi Previous h ands-on expertise with Spark Experience working with containerisation technologies - Docker, Kubernetes Streaming Knowledge: Experience with Kafka More ❯

been turning down headhunters for years. Whatever your priorities work/life balance, career progression, sustainability, volunteering youll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on Azure and Databricks ? Do you … optimising for performance, scalability, and security. Collaborate with business stakeholders, data engineers, and analytics teams to ensure solutions are fit for purpose. Implement and optimise Databricks Delta Lake, Medallion Architecture, and Lakehouse patterns for structured and semi-structured data. Ensure best practices in Azure networking, security, and federated data access . Key Skills & Experience 5+ … years of experience in data architecture, solution architecture, or cloud data engineering roles. Strong expertise in Azure data services , including: Azure Databricks (Delta Lake, Unity Catalog, MLflow) Azure Event Hub and Azure Data Explorer for real-time and streaming data pipelines Azure Storage (ADLS Gen2, Blob Storage) for scalable More ❯

Role: Contract Business Analyst Domain: Shipping, maritime & energy Project: Data warehouse & data lake implementation Location: London (Hybrid) Rate: £700/d (Inside IR35) Contract: 6 months (multi-year scope) X4 Technology are partnered with a global energy leader on an exciting contract opportunity for a detail-orientated contract Business Analyst. You'll support the development … to optimise vessel operations across LNG and Products fleets. You'll play a key role designing, building and implementing large-scale data warehouse and data lake platforms , shaping how vessel performance data is captured, modelled and visualised within the dashboard. Requirements for the Business Analyst - Data Platforms in Shipping & Energy Proven … BA experience on large-scale Data Warehouse or Data Lake platform implementations, particularly in SAP or Azure Strong analytical skills with the ability to interpret complex datasets Excellent stakeholder management and communication skills Familiarity with data visualisation tools (eg Power BI , Tableau ) Nice to have: Experience in maritime, logistics, or energy sectors; exposure More ❯

Role: Contract Business Analyst Domain: Shipping, maritime & energy Project: Data warehouse & data lake implementation Location: London (Hybrid) Rate: £700/d (Inside IR35) Contract: 6 months (multi-year scope) X4 Technology are partnered with a global energy leader on an exciting contract opportunity for a detail-orientated contract Business Analyst. You'll support the development … to optimise vessel operations across LNG and Products fleets. You'll play a key role designing, building and implementing large-scale data warehouse and data lake platforms , shaping how vessel performance data is captured, modelled and visualised within the dashboard. Requirements for the Business Analyst - Data Platforms in Shipping & Energy Proven … BA experience on large-scale Data Warehouse or Data Lake platform implementations, particularly in SAP or Azure Strong analytical skills with the ability to interpret complex datasets Excellent stakeholder management and communication skills Familiarity with data visualisation tools (eg Power BI , Tableau ) Nice to have: Experience in maritime, logistics, or energy sectors; exposure More ❯

An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be … a lot of stakeholder engagement, so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements and help More ❯

An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be … a lot of stakeholder engagement, so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements and help More ❯