26 to 50 of 606 Permanent Data Lake Jobs

Data Architect (Journeyman) Redstone Arsenal/Huntsville AL IPT Associates (IPTA) is passionate about providing our customers with technical solutions that satisfy their business needs. Through collaborative interactions with customers, team members, subject matter experts (SMEs), technical leaders, and partners we design practical solutions that solve real problems … Ability to solve challenging technical business problems Self-directed professionals Hunger to continually learn and grow We are looking to hire a Senior Data Architect to join our Enterprise IT Support Services Team supporting the Army Aviation and Missile Center (AvMC), Redstone Arsenal. AvMC is the Army's … the best technology today and tomorrow. Responsibilities: Translating business needs into long-term architecture solutions. Designing, developing, and maintaining the organization's future data architecture, including creating and implementing data models, data dictionaries, and data flow diagrams. Developing and implementing cloud-based More ❯

is diverse and equitable, building a culture of collaboration and inclusion. Position Overview Ithaca Energy is accepting applications for the position of Senior Data Engineer located in our Aberdeen Office. Reporting to the Analytics and Integration Lead, the Senior Data Engineer will play a pivotal role … stakeholders and business users to understand data utility, and analyze, model, and organize data into the medallion data lake for reporting. Ensure data quality and data reliability: Drive improvements in data quality assessments, ensure effective, efficient, robust … solutions. Expertise with Synapse (notebooks and data flows) is essential. Working knowledge of PySpark is essential. Experience with Azure Data Lake Storage is essential. Understanding of medallion data lakehouse architecture is essential. Strong problem-solving skills for complex data challenges. Background More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

less development, testing, bug/defect resolution, coding, design, customization and documentation of micro services, creating/developing new cloud service patterns, scripting, data management/enrichment, consolidation of metadata, user-interface development, container (e.g. K8s) integration & design, encrypting data at rest & in transit • Technically integrate … Recover) customer mission goals. • Integrate cloud security solutions with existing on premise operational cybersecurity platforms (e.g. SIEM systems, elastic system, and data lake asset). • Overall desire to automate sundry of cybersecurity-related workflows, develop solution patterns with cloud-managed resources & features, implement automated solution(s) where … tools and software, such as Apache or Confluent Kafka • Experience with Data Integration, Data Engineering and Data Lake implementations using ETL, Big Data and Cloud Technology. • Experience with JIRA Confluence • Familiarity with Security Information and Event Management (SIEM) software • Experience More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

Delivery Consultant - Data Analytics, AWS Professional Services Are you a Data Analytics specialist? Do … you have Real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake and Data engineering experience? Do you like to solve the most complex and high scale (billions+ records) data challenges in … as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker and Amazon Quicksight. Solutions - Deliver technical engagements with partners and customers. This includes participating in pre-sales visits, understanding More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … a Data Engineer with a focus on Azure Cloud data Services (e.g. Azure Data Factory, Data Lake, etc.) Database Skills (MS SQL Server, MySQL, PostgreSQL, MongoDB, Cassandra or similar) Excellent SQL skills. Skills in developing data visualizations (e.g. Power … collaborate with cross-functional teams effectively. Inquisitive with an eagerness to learn. Preferred Qualifications Experience with additional Azure services like Azure Data Lake , Azure SQL Database , or Azure Databricks . Familiarity with Infrastructure-as-Code (IaC) practices. Strong knowledge of data governance and security best More ❯

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … a Data Engineer with a focus on Azure Cloud data Services (e.g. Azure Data Factory, Data Lake, etc.) Database Skills (MS SQL Server, MySQL, PostgreSQL, MongoDB, Cassandra or similar) Excellent SQL skills. Skills in developing data visualizations (e.g. Power … collaborate with cross-functional teams effectively. Inquisitive with an eagerness to learn. Preferred Qualifications Experience with additional Azure services like Azure Data Lake , Azure SQL Database , or Azure Databricks . Familiarity with Infrastructure-as-Code (IaC) practices. Strong knowledge of data governance and security best More ❯

daily towards creating the world we want tomorrow. Job Description: Lead Platform Engineering is responsible for architecting, building, and managing the organization's data platform foundations. This role involves designing, implementing, and maintaining scalable, reliable, and secure data platforms to support business insights, analytics, and other … Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and data … Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data More ❯

About Exsolvæ: Exsolvæ is a Brussels-based consultancy at the forefront of Data and Artificial Intelligence innovation. We specialize in providing expert Consultancy, Audit, and Solution Development services to empower our partners in overcoming unique challenges. Our holistic approach fosters collaboration across diverse domains, including Data … AND Cloud hands on Data Engineering experience Azure Expertise : Extensive experience with Azure Data Factory, Synapse Analytics, Data Lake Storage, and Azure Databricks. Programming Skills : Proficiency in Python and SQL, with experience in big data tools like Apache Spark. Cloud Proficiency … processing and storage. Data Ecosystem Implementation : Design and implement solutions leveraging Azure Synapse Analytics, Data Factory, Databricks, Data Lake Storage, and related tools. Pipeline Optimization : Develop and maintain robust ETL/ELT pipelines to ensure efficient data ingestion and transformation. Technical More ❯

services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … ll work closely with their marketing, analytics, and product teams to build and optimize a scalable architecture, including managing an Azure Data Lake Gen2, Azure Data Factory, Snowflake warehouse, and RudderStack for customer data flows. Your responsibilities will include designing and maintaining data … experience you will bring: Experience: 3+ years in data engineering or martech engineering roles. Technical Proficiency: Expertise with Azure Data Lake Gen2, Azure Data Factory and Snowflake. Experience with Looker Studio for visualization. Proficiency with RudderStack or similar customer data platforms. More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of … Microsoft BI software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design … solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports, and dashboards; inline with the company data management framework and More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of … Microsoft BI software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design … solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports, and dashboards; inline with the company data management framework and More ❯

Assistance Services as a Space Domain Awareness (SDA) Software Integration Engineer/Architect supporting the US Space Force, Space Systems Command, Global Mission Data Dominance Branch (USSF SSC/BCTD). SDA is foundational to Protecting and Defending US Space Systems that provide space-based Intelligence, Early Warning … team of dedicated professionals in the SDA workforce! The Global Mission Dominance Branch executes activities in support of the alignment of key space data initiatives. The portfolio includes data as service and data platform initiatives to meet evolving Space Domain Awareness (SDA) user data … agile DevOps, and SecDevOps processes. Knowledge of cyber-security activities relative to data platforms a plus Fundamental knowledge of data lake architectures in cloud and hybrid cloud environments Able to brief and interact comfortably and professionally with senior leadership. Ability to communicate clearly, concisely, and More ❯

an opportunity as a Space Domain Awareness (SDA) Software Integration Engineer/Architect supporting the US Space Force, Space Systems Command, Global Mission Data Dominance Branch (USSF SSC/BCTD) in Colorado Springs, CO. The Global Mission Dominance Branch executes activities in support of the alignment of key … space data initiatives. The portfolio includes data as service and data platform initiatives to meet evolving Space Domain Awareness (SDA) user data needs and objectives. The mission includes the execution of system acquisition, modernization, and sustainment for ground- and space-based SDA … agile DevOps, and SecDevOps processes. Knowledge of cyber-security activities relative to data platforms a plus. Fundamental knowledge of data lake architectures in cloud and hybrid cloud environments. Able to brief and interact comfortably and professionally with senior leadership. Ability to communicate clearly, concisely, and More ❯

at one of the UK's most iconic train operating companies. You'll be the strategic and technical backbone behind our data lake, engineering pipelines, and analytics-ready data assets - driving smarter decisions, better customer experiences, and genuine innovation across every part of the business. … Within this role you'll also be involved in; Own our Data Lake and Catalogue: Lead the management of LNER's data infrastructure, ensuring data is accessible, high-quality, and built to scale. Build the Roadmap: Collaborate across departments to shape and deliver … to a range of stakeholders. Desirable: Experience using Terraform and Github specifically for CI/CD. Experience with AWS Data Lakes including Lake Formation. Experience with AWS Kinesis/Firehose for real-time data pipelines. Experience of rail, airline or leisure industry. What you'll More ❯

Join our Cardiff Bay team as a Data Warehouse Developer within the Cardiff office. You are expected, if successful, to work 50% of the week in the office. WHO ARE WE? Privately owned and independently minded, Creditsafe operates with the singular vision of powering business decisions. We do … business information accessible to all. Twenty-five years later, we've not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened up new avenues of data intelligence for businesses with machine … quality, consistency, and performance across the warehouse. Work with Azure Data Services (Synapse, Data Factory, Data Lake, SQL DB, etc.) to build scalable solutions. Implement data governance, security, and best practices for the warehouse. Develop and maintain documentation on More ❯

Head of BI to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities: Lead the global BI organisation across APAC … Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation. Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data … a modern, cloud-based BI ecosystem, including: Data Integration: Fivetran, HVR, Databricks, Apache Kafka, Google BigQuery, Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and … communicating enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience … advise clients on reference architectures Design and develop scalable Databricks solutions on both Azure and AWS environments Lead the architecture and deployment of data solutions using Databricks Requirements: Expert in capturing end-user requirements and aligning technical solutions to the business objectives Experience in leading, designing, and implementing More ❯

My client is based in the London area are currently looking to recruit for an experienced Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Data … Your role will include: Responsible for designing and developing conceptual/logical/physical data models for Enterprise scale data lake and data warehouse solutions. Create functional & technical documentation - e.g. data integration architecture documentation, data models, data … ERwin, PowerDesigner, Dimensional Modelling) An understanding of SQL/database management. Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around AWS. My client is providing access to; Hybrid 2/3 days (London), 28 Days Holiday, Plus Bank Holiday Private Medical More ❯

Senior Data Architect (Azure) Insurance/ReInsurance Location: London Hybrid:3 Days a week Position Overview: As a Senior Data Architect, you will be responsible for designing, implementing, and optimising our data architecture/data lakehouse to support cloud-based ETL processes … and digital transformation projects. Key Responsibilities: Design and develop scalable data architectures for cloud-based environments. Lead the implementation of ETL processes to ensure efficient data extraction, transformation, and loading. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Ensure data quality, integrity, and security across all data platforms. Optimize data storage and retrieval processes to enhance performance and scalability. Provide technical guidance and mentorship to junior data engineers and developers. Stay up-to-date with emerging technologies and industry trends to drive More ❯

Senior Data Architect (Azure) Insurance/ReInsurance Location: London Hybrid:3 Days a week Position Overview: As a Senior Data Architect, you will be responsible for designing, implementing, and optimising our data architecture/data lakehouse to support cloud-based ETL processes … and digital transformation projects. Key Responsibilities: Design and develop scalable data architectures for cloud-based environments. Lead the implementation of ETL processes to ensure efficient data extraction, transformation, and loading. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Ensure data quality, integrity, and security across all data platforms. Optimize data storage and retrieval processes to enhance performance and scalability. Provide technical guidance and mentorship to junior data engineers and developers. Stay up-to-date with emerging technologies and industry trends to drive More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement … so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and … efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial More ❯