251 to 275 of 323 Data Lake Jobs

POSITION OVERVIEW As a data scientist, you'll play a pivotal role in developing and enhancing our innovative supply chain solutions. You'll collaborate closely with a talented team of passionate engineers and industry experts, applying data engineering and data science techniques to optimize supply chain processes. Your expertise will directly contribute to providing … machine learning models to improve the accuracy of supply chain ETA s. Analyze large, complex datasets to extract meaningful insights and identify trends. Design, build, and maintain scalable data pipelines and data lakes to ensure efficient data flow and storage for analytics purposes. Collaborate with cross-functional teams to integrate analytics solutions into our … products. Design and build data visualization tools to communicate findings to stakeholders. Continuously research and apply the latest techniques in AI and machine learning to supply chain problems. Contribute to the development of our analytics product suite, ensuring scalability and efficiency. Communicate complex data science concepts to non-technical stakeholders. Key Responsibilities 1. Advanced Predictive Models More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus … on designing and implementing end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion … pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc.). Strong scripting and Linux/cloud environment familiarity. Desirable: Exposure to big data More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus … on designing and implementing end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion … pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc.). Strong scripting and Linux/cloud environment familiarity. Desirable: Exposure to big data More ❯

The Control-M product line is BMC's orchestration and automation platform. It helps the world's largest companies to automate time-sensitive, business-critical workflows. We orchestrate data and machine learning pipelines, supply chains, production lines, financial transactions, and other processes in complex IT environments worldwide. We continuously grow by adding and implementing the most cutting-edge … AWS serverless services and enables powerful querying and analytics through Amazon Athena. In this role, you'll work on a system that combines streaming ingestion (Firehose), data lake technologies (Parquet, Apache Iceberg), scalable storage (S3), event-driven processing (Lambda, EventBridge), fast access databases (DynamoDB), and robust APIs (Spring Boot microservices on EC2). Your role will involve … AWS. 5+ years of Java backend development experience. 3+ years of Python development. Strong hands-on experience with AWS services: Lambda, S3, K8S. Deep understanding of data lake architectures and formats such as Parquet and Iceberg. Proficiency in Spring Boot and working experience with microservices. Experience with high-scale, event-driven systems and serverless patterns. Nice to More ❯

We are looking for a Junior Data Engineer to support our internal teams by extracting, transforming, and analysing data, and building the tools and repeatable processes that power our strategic insights. In this role, you will play a pivotal part in the technical execution that supports our Architect 360 offering and helps our client-facing teams … to succeed. As a Junior Data Engineer, you will work in the Retail Strategy team, reporting to the Business Data Analytics Lead. You will work closely with your lead and collaborate with the wider teams, such as Product and Engineering and Customer Success, to provide the accurate data and insights needed to support our … of communicating with the business and team on deliverables, timeframes managing their expectations around delivery. You are keen to learn to extract data from other sources like DataLakes and Datawarehouse, working with structured and unstructured data. 30 days holiday + 1 day on your birthday (plus bank holidays) Health Insurance (Bupa) Mental Health Support (Spill, Calm) Cycle to More ❯

world. You are a software engineer passionate about solving problems and building solutions. You will collaborate with scientists, research engineers, and platform engineers to build and deploy scalable data pipelines for machine learning. Your expertise spans data processing and distributed systems, with a focus on software engineering. You will work at the intersection of research and … projects with a diverse, global team of researchers and engineers. Develop scalable distributed systems for processing, filtering, and deploying datasets for machine learning. Process large, unstructured, multi-modal data sources (text, images, 3D models, code, metadata) into ML-ready formats. Conduct experiments on data to derive insights. Create visualizations and summaries to communicate data … to analyze data using tools like Pandas, Matplotlib, Seaborn, Plotly, R. Familiarity with Autodesk or similar CAD/CAE/CAM products. Knowledge of data lake architectures, data provenance, and lineage. Understanding of computational geometry and industry-specific applications. The Ideal Candidate Proactive in providing solutions and eager to learn new technologies. Enjoys More ❯

Senior Data Project Manager page is loaded Senior Data Project Manager Apply locations London time type Full time posted on Posted Yesterday time left to apply End Date: July 31, 2025 (30+ days left to apply) job requisition id R Who are we? Howden is a collective - a group of talented and passionate people all around … work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. About the Role: We are seeking an experienced and strategic Data Project Manager to lead complex projects within our Group Data Function . You will manage high-priority initiatives across global business units, ensuring the successful delivery of … data-driven and technology projects . A strong background in data lakes, analytics, and cloud platforms is highly preferred. You will drive best practices, provide leadership, and influence stakeholders at all levels. Key Responsibilities: Strategic Project Leadership: Oversee the end-to-end execution of high-impact, multi-regional data technology projects. Stakeholder & Executive Engagement More ❯

Job Description The Data Program Manager required to have 15-20 years of experience in managing Data related projects, including at least 2 large transformation projects. The candidate should have a deep awareness of the data management life cycle, exceptional project management skills, and a solid grasp of benefits management are essential for … effectively managing and executing large/complex data-centric programs. Experience: Data Platform Modernization: Move legacy/on-premises applications, workloads, data lakes, lake houses, data warehouses, and data marts to cloud platforms Building platforms/applications that rely on the consolidation of disparate types of data from multiple source systems that need harmonization across dimension Data lifecycle management projects Key Responsibilities: Lead the delivery of complex data transformation initiatives, engaging directly with business leadership. Manage programme governance, stakeholder communication, risk management, and delivery oversight. Translate business needs into structured delivery plans, ensuring data initiatives drive real business value. More ❯

trading platforms, and/or IBA systems). Architecting solutions with Microsoft Azure technologies, Sales force (including Force.com) technologies and modern data platforms (e.g. Data lake house architecture) and Business Intelligence (e.g. Microsoft Power BI) technologies Knowledge of Enterprise Architecture tools (experience in BizzDesign) Good knowledge and awareness of enterprise-grade CRM, HR and Finance More ❯

trading platforms, and/or IBA systems). Architecting solutions with Microsoft Azure technologies, Sales force (including Force.com) technologies and modern data platforms (e.g. Data lake house architecture) and Business Intelligence (e.g. Microsoft Power BI) technologies Knowledge of Enterprise Architecture tools (experience in BizzDesign) Good knowledge and awareness of enterprise-grade CRM, HR and Finance More ❯

trading platforms, and/or IBA systems). Architecting solutions with Microsoft Azure technologies, Sales force (including Force.com) technologies and modern data platforms (e.g. Data lake house architecture) and Business Intelligence (e.g. Microsoft Power BI) technologies Knowledge of Enterprise Architecture tools (experience in BizzDesign) Good knowledge and awareness of enterprise-grade CRM, HR and Finance More ❯

and Global Markets to engineer scalable solutions for our global trading desks. Our team applies specialist methods from mathematics, science, and engineering to generate revenue. We focus on data, models, and algorithms for derivative valuation, risk management, automated trading, and data-driven decision-making. At Macquarie, our advantage is bringing together diverse people and empowering them … always seeking the best tools to tackle each challenge, whether that means embracing new technologies or revisiting familiar ones. You will deliver solutions for large-scale software and data engineering challenges. Working closely with business teams, you will have the autonomy to innovate and build solutions from scratch, bringing your ideas to life. With full ownership of your … and pragmatic solutions with immediate impact Ability to work independently with exceptional proficiency, collaborating with diverse stakeholders to deliver comprehensive solutions from evolving requirements Experience with cloud and data/ML technologies such as AWS, Kubernetes, data lakes, and data pipeline orchestrators is advantageous We welcome applications from anyone inspired to build a better More ❯

align AWS solutions with their desired outcomes. You will educate customers on "art of the possible" success stories and AWS enablers including Amazon Redshift, a managed petabyte-scale data warehouse for fast SQL analytics; Amazon Athena, for serverless SQL queries directly on S3 data … Amazon EMR, a managed big data platform for Spark, Hive, and Presto workloads; AWS Glue, a managed ETL service for data preparation and transformation; AWS Lake Formation, for simplified data lake creation and management; AWS SageMaker Studio, a unified IDE for end-to-end machine learning workflows; Amazon Kinesis and MSK for … real-time data streaming and processing. You'll help customers understand how this analytics foundation enables them to build and deploy AI/ML solutions using Amazon Bedrock, Amazon SageMaker, and other AWS AI services to drive business transformation. You will work with a specialized Solution Architect to craft a solution spanning these solutions as well as selected More ❯

by partnering with AWS. You will educate customers on "art of the possible" success stories and AWS enablers including our data warehousing (Amazon Redshift), data lake (Amazon Lake Formation), BigData processing (Amazon EMR), search (Amazon Open Search Service), ETL (Amazon Glue), streaming (Amazon Kinesis and Amazon Managed Kafka), and Sagemaker Unified Studio brining these … key deals, supporting partners, as well as providing key insights and analysis for their analytics business all up to key stakeholders in EMEA and Corp. Our EU North Data and GenAI team are passionate about our customers, passionate about our domain and foster a supportive, work hard & play hard team culture, all with a big heart. BASIC QUALIFICATIONS … development, sales or alliances management experience PREFERRED QUALIFICATIONS PREFERRED QUALIFICATIONS - 5+ years of building profitable partner ecosystems experience - Experience developing detailed go to market plans - Experience across the Data and Analytics specialty Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your More ❯

Hypercube Consulting is a rapidly growing data and AI consultancy dedicated to transforming the energy sector through cutting-edge technology. Specialising in advanced AI systems, including Agentic AI workflows and large language models (LLMs), we help clients unlock profound value from their data assets. Join our expert team in shaping the future of AI-driven energy … here: We are looking for a Senior AI Engineer with experience in Agentic AI and LLM technologies to design and develop impactful AI solutions. You'll work alongside data engineers, data scientists, and cloud specialists, directly contributing to client success. In this role, you will: Engage with client challenges, developing practical and innovative Agentic AI and … AI expertise. Key responsibilities Technical contribution Develop and deploy reliable AI and LLM solutions, collaborating with senior team members. Contribute to the implementation and maintenance of AI pipelines (data ingestion, model training, deployment, and monitoring). Work within multidisciplinary teams to deliver client-focused solutions. Effectively communicate AI concepts and methodologies to peers and clients. Continuous learning & development More ❯

About Onehouse Onehouse is a mission-driven company dedicated to freeing data from data platform lock-in. We deliver the industry's most interoperable data lakehouse through a cloud-native managed service built on Apache Hudi. Onehouse enables organizations to ingest data at scale with minute-level freshness, centrally store it, and … use case (from traditional analytics to real-time AI/ML). We are a team of self-driven, inspired, and seasoned builders that have created large-scale data systems and globally distributed platforms that sit at the heart of some of the largest enterprises out there including Uber, Snowflake, AWS, Linkedin, Confluent and many more. Riding off … rising talent to grow with us and become future leaders of the team. Come help us build the world's best fully managed and self-optimizing data lake platform! The Community You Will Join When you join Onehouse, you're joining a team of passionate professionals tackling the deeply technical challenges of building a 2-sided engineering More ❯

power user of AI development tools and have a mindset for building AI-augmented workflows Desirable Experience building tools for technical users (ML, robotics, infrastructure) Experience with scientific data visualisation or complex data interfaces Experience … with large-scale job orchestration frameworks such as Flyte, Spark or similar. Knowledge of GraphQL, Prisma, Kafka, or modern cloud infrastructure (Azure, GCP, or AWS) Experiencing Data lake tools (e.g. Databricks) Exposure to AI/ML model development workflows and data tooling This is a full-time role based in our office in London. At More ❯

environment. While Microsoft technologies (Microsoft 365, Azure, Exchange Online) form a core part of the infrastructure, the role also encompasses broader enterprise IT systems, multi layered networking, security, data management, and third-party platforms that support global business operations and the associated applications estate. The role requires a proactive leader who can drive IT operational excellence, manage security … cloud-based services are robust, cost-effective, and aligned with business needs and the Strategic IT vision. They will also play a key role in enhancing cybersecurity, protecting data and systems, driving transformative operational change, enhancing IT processes and ensuring compliance with governance bodies and industry regulations. Due to the nature of the role, complexity of the estate … Azure, CheckPoint and Cloudflare), DNS, VPN, WIFI and Local Area Network design & administration experience Software Defined Networking (Cisco, Meraki, Versa) Key Responsibilities: API Management Datawarehouse (Azure Storage Accounts and DataLake concepts) Virtualisation (Azure Virtual Machines) On prem and cloud backup technology experience (Veeam or other) IT Business process documentation (HLD, LLD, Principles, Policies, Procedures) Key Skills and Experience: Technical Expertise More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

teams. Ideal candidates will have 5+ years of data science experience, proficiency in Python and streaming data (e.g., Kafka), and familiarity with data lake environments. Onsite Required (Ft. Belvoir & Reston, VA). Security Clearance: TS/SCI required (must be active in DISS). Minimum Requirements: • 5+ years of experience in applied data … end-to-end ML workflows (data prep to deployment and evaluation). • Ability to rapidly learn infrastructure concepts, particularly data pipelines and data lake interactions. • Skilled in developing ML models for document classification, extraction, summarization, and search. • Proven ability to manage high-throughput, production-level ML systems. • Bachelor's degree. Key Responsibilities: • Lead … and improve models for performance and accuracy. • Support data science operations tied to millions of streaming documents weekly. Skills and Proficiencies: • Strong understanding of data lake architectures and streaming data environments. • Familiarity with distributed storage systems (e.g., Cloudera) and compute frameworks (e.g., Spark, Hadoop). • Experience with MLOps processes and tools for model More ❯

Job Number: 260 Job Category: GovTech Job Title: DATA ENGINEER (260) - MARYLAND -URGENT Job Type: Full-time Clearance Level: Top Secret/SCI - Full Scope Polygraph Work Arrangement: On-site Job Location: Annapolis Junction MD Salary: 129K-155K Background Collaborate closely with a team of developers to fulfill data integration requirement Write and maintain code using … an ETL platform to ensure data is transformed into suitable formats as defined by IC ITE initiatives Interface with external teams and systems, employing various protocols including HTML and SFTP to collect data efficiently Enhance the ETL platform by adding features aimed at shortening timelines for future data integration effort Develop and maintain software … ensuring seamless integration into a fully functional system Collaboration with external teams will be necessary to validate data ingest processes Responsible for providing comprehensive documentation covering system architecture, development, and any enhancements made throughout the process Requirements Bachelor's degree with 9+ years of professional experience Master's degree with 7+ years of professional experience PhD with 5+ More ❯

and Intelligence challenges through IT solutions. We emphasize teamwork and focus on achieving goals to complete deliverables efficiently, on-time, and under budget. We are currently seeking a Data Engineer/Data Architecct to join our team to support our Government Partner. Primary Job Duties and Required Work Experience: Design, build, and maintain data pipelines that efficiently ingest, process, and transform data from various sources for analysis Collaborate with data scientists and analysts to understand data requirements and ensure data quality and accessibility. Develop and implement data governance policies and procedures to ensure data integrity and security. Stay current on … processing and analysis. Data Visualization: Proficiency in creating interactive dashboards and visual representations of data, potentially using tools like Tableau. Experience with data lake and data lake technologies and best practices Job Requirements • Active TS/SCI + Full Scope Poly U.S. Government Security is required. • Education and Years of More ❯

Software/Data Engineer Who We Are : Veson Nautical is a well-established and rapidly growing software company working to provide end-to-end logistical, operational, and … analytical solutions to propel the efficiency and effectiveness of Maritime Commerce. The Opportunity: In this role, you'll contribute to the development and maintenance of our Data Lake (Snowflake) product, supporting best practices across teams. As a Software/Data Engineer, you'll help design and implement software components, working with others to balance new … is preferred. A Closer Look at the Role This role will provide opportunities to get your hands on various tasks/technologies such as: Develop and support scalable data storage solutions using Snowflake under the guidance of senior engineers. Write and optimize SQL queries within the Snowflake environment, identifying and resolving performance issues with support when needed. Contribute More ❯