26 to 50 of 282 Data Lake Jobs

Job Description We are seeking a skilled Data Engineer with strong experience inMicrosoft Fabric, Data Lake, Data Warehouse, SQL, and ETL development. The ideal candidate will have hands-on expertise in designing and building scalabledata pipelines to support enterprise analytics and reporting needs. Responsibilities Design, develop, and maintain data pipelines and … ETL processes to ingest, transform, and deliver data across the enterprise. Work with Microsoft Fabric, Data Lake , and Data Warehouse solutions to manage structured and unstructured data. Build efficient and scalable SQL queries, stored procedures, and data models for analytics and reporting. Ensure data quality, security, and governance across … in data engineering. Requirements 10+ years of experience as a Data Engineer (or similar role Strong hands-on experience with Microsoft Fabric Data Lake andData Warehouse technologies. Proficiency in SQL (query optimization, stored procedures, performance tuning Strong experience in ETL development and building data pipelines. Knowledge of data modeling More ❯

Data Architect Location: Hybrid working (minimum 2 days a week in Staffordshire Head Office) Type: Full-time Salary: Up to £70,000 Are you a visionary Data Architect ready to shape the future of enterprise data and AI ? I have an amazing opportunity to join my national market leading client to lead the design … and delivery of scalable, secure, and high-performing data solutions that power transformation across a complex, data-rich organisation. What you'll be doing As a Data Architect, you'll be at the heart of enterprise-wide change programmes, working closely with the Lead Data Architect to: Design and deliver enterprise Data … A passion for innovation and continuous improvement in the data space. Tech you'll work with Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines Architecture & Governance: Enterprise data models, data catalogues, metadata More ❯

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … unusual data profiles and establish recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions … implementing ETL processes. Experience in using SQL to query and manipulate data. Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory. Understanding of data extraction from vendor REST APIs. Spark/Pyspark or Python skills a bonus More ❯

Intermediate Strategic Data Specialist LOCATION: Pentagon - Washington, DC JOB STATUS: Full Time CLEARANCE: Top Secret TRAVEL: As Needed Astrion has an exciting opportunity for an Intermediate Strategic Data Specialist, supporting the Air Force. In this role, the Data Specialist supports strategic data initiatives at Headquarters Air Force (HAF) A2/A6 to … the Intelligence Community (IC). The selected candidate will assist with governance, strategic planning, enterprise architecture, capability PfM, solutions analysis & implementation planning, performance and risk management, project management, data and analytics, program analysis, policy analysis, information technology analysis, and administrative technical support. The candidate will also support existing, ongoing, and expanding programs, projects, technologies, processes, and workforce innovations … cloud platforms (AWS, Azure, GCP) and their data services, including storage, compute, analytics, and security offerings. Familiarity with cloud-based data warehousing, data lake solutions, and cloud migration strategies • Understanding of the IC: Knowledge of IC data standards, policies, and practices would be highly valuable • Data Integration/ELT More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits … like S3/GCS, Glue, BigQuery, Pub/Sub, SQS/SNS, MWAA/Composer, and more to create a seamless data experience. (Required) Data Lake , Data Zone, Data Governance: Design, build, and manage data lakes and data zones within our cloud environment, ensuring data … Infrastructure Automation Cloud Expertise: Proven hands-on experience with AWS and/or GCP, including a deep understanding of their data analytics service offerings. Data Lake/Zone/Governance Experience: Demonstrable experience designing, building, and managing data lakes and data zones. Familiarity with data governance tools and frameworks. More ❯

Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI Developers and Data Analysts is required for a well-established company based in Bedford, Bedfordshire. IS THIS YOU? Can you lead the companys data … be based in either UK or Portugal Local Salary Ranges Will Apply JOB TYPE: Full-Time, Permanent JOB OVERVIEW We have a fantastic new job opportunity for a Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI … approach. Experience in SaaS or platform-based businesses is a plus Experience in data roles (data engineering, BI, analytics or architecture). Data lake storage, SQL database, NoSQL Sound understanding of database architecture and relevant underpinning concepts, including relational data modelling, frameworks, warehouse and data lake design, performance More ❯

Data Architect – Data & AILocation: Hybrid – Burton on Trent Salary: £70,000 REED Technology are working with a client who are looking for a hands-on Data Architect with a passion for building scalable data solutions? This is a fantastic opportunity to join a data-first business with major investment in … its data function, working on modern platforms and with cutting-edge AI and ML initiatives. Key Responsibilities Design and deliver enterprise data models and data architectures Support roadmaps for data platforms, integration, and data processing Work with engineers, data scientists, and stakeholders to deliver trusted, high-quality data … into robust data solutions Collaborative communicator with a passion for data and innovation Technology Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines Architecture & Governance: Enterprise data models, data catalogues, metadata More ❯

Data Architect - Data & AI Location: Hybrid - Burton on Trent Salary: £70,000 REED Technology are working with a client who are looking for a hands-on Data Architect with a passion for building scalable data solutions? This is a fantastic opportunity to join a data-first business with major investment … in its data function, working on modern platforms and with cutting-edge AI and ML initiatives. Key Responsibilities Design and deliver enterprise data models and data architectures Support roadmaps for data platforms, integration, and data processing Work with engineers, data scientists, and stakeholders to deliver trusted, high-quality … into robust data solutions Collaborative communicator with a passion for data and innovation Technology Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines Architecture & Governance: Enterprise data models, data catalogues, metadata More ❯

JOB TITLE: AWS DATA ENGINEER JOB LOCATION: SEATTLE, WA (REMOTE) WAGE RANGE : 56.00-60.00 JOB NUMBER: SAIJP REQUIRED EXPERIENCE: 5+ years of experience in data engineering roles Proficiency in SQL, Python, or Scala for data transformation and processing. Experience in the utility industry data Strong understanding of utility data domains … The ideal candidate will have strong expertise in cloud-based data engineering, hands-on experience with AWS native services, and a solid understanding of data lake, data warehouse, and real-time streaming architectures. Location: This position is remote. Responsibilities: Design, build, and optimize ETL/ELT workflows to ingest data from … multiple sources. (e.g., S3, Redshift, Lake Formation, Glue, lambda). Implement data cleansing, enrichment, and standardization processes. Automate batch and streaming data pipelines for real-time analytics. Build solutions for both streaming (Kinesis, MSK, Lambda) and batch processing (Glue, EMR, Step Functions). Ensure pipelines are optimized for scalability, performance, and fault tolerance. Optimize SQL More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to … a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … approaches and can apply data security and privacy strategy to solve business problems. You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). Professional Skills You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to … a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … approaches and can apply data security and privacy strategy to solve business problems. You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). Professional Skills You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy More ❯

full ownership of the data architecture. You’ll be designing scalable, secure solutions using the Azure stack—think Azure SQL, Data Factory, Data Lake, Cosmos DB, and more. You’ll be the go-to person for shaping how data is used across the business, working closely with developers, architects, and stakeholders … are backed by solid data. Key Responsibilities: Design and implement data solutions using Azure services such as Azure SQL Database, Data Factory, Data Lake, Cosmos DB, and more Define the strategic roadmap for cloud platforms and DevOps methodologies Build scalable data models, metadata systems, and data catalogues aligned with … a similar role Strong understanding of database structure and design principles Hands-on experience with Azure data technologies (Azure SQL, Data Factory, Data Lake, Cosmos DB, Power BI) Degree in Computer Science, IT, or a related field Benefits: Salary of £70,000 Bonus - Up to 10% 16% Pesnion Generous holiday allowance plus bank More ❯

region. Because we know that by continually driving up our standards today, well build a better tomorrow for our communities. We currently have an opportunity for an Azure Data Architect to join our team based in Redhill. Joining us on a Permanent Full time basis , you will receive a competitive salary of £70,000 plus excellent benefits. About … What Youll Be Doing Design and implement data solutions on Azure, using a range of services like Azure SQL Database, Data Factory, Data Lake Store, Data Lake Analytics, Stream Analytics, Azure Storage, Cosmos DB and more Making informed decisions on the strategic direction and roadmap for the use and implementation … similar role In-depth understanding of database structure principles Experience with Azure data technologies such as Azure SQL, Azure Data Factory, Azure Data Lake, Azure Cosmos DB, Power BI and SQL. BSc in Computer Science, IT or relevant field What's In It For You? We know that the support and commitment of More ❯

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

full ownership of the data architecture. You’ll be designing scalable, secure solutions using the Azure stack—think Azure SQL, Data Factory, Data Lake, Cosmos DB, and more. You’ll be the go-to person for shaping how data is used across the business, working closely with developers, architects, and stakeholders … very important for this role. Key Responsibilities: Design and implement data solutions using Azure services such as Azure SQL Database, Data Factory, Data Lake, Cosmos DB, and more Define the strategic roadmap for cloud platforms and DevOps methodologies Build scalable data models, metadata systems, and data catalogues aligned with … a similar role Strong understanding of database structure and design principles Hands-on experience with Azure data technologies (Azure SQL, Data Factory, Data Lake, Cosmos DB, Power BI) Degree in Computer Science, IT, or a related field Benefits: Salary of £70,000 to £85,000 Bonus - Up to 10% 16% Pension Generous holiday More ❯

in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect … automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to unify data from various sources, supporting BI and analytics needs. Partner with product managers, analysts, software developers, and IT to ensure data integration and reporting capabilities support business goals. Manage and optimise AWS data warehousing and lake architectures to ensure high quality, accessible data for insights. Enable efficient data processing, transformation, and analysis through best in class AWS technologies and methodologies. Identify opportunities for workflow optimisation and automation to enhance performance. Stay current More ❯

London - Lead Solutions Data Architect, Data Engineering Ekimetrics UK Job Description About Ekimetrics Ekimetrics is a leader in data science and AI, specialising in Marketing Effectiveness, Customer Analytics and business optimisation since 2006. We have pioneered the use of AI to drive sustainable growth, helping companies across industries like retail, banking, luxury fashion, insurance … and many more to maximise their data potential. Our goal: Combine high-impact AI and data science solutions for sustainable business performance. Our approach combines cutting-edge technology with a deep understanding of business challenges, ensuring that our solutions not only meet current needs but also pave the way for future innovations. At Ekimetrics, your work … will directly contribute to shaping the future of data-driven decision-making in a sustainable, ethical manner. About the Role Based in London and reporting to our Head of Data Engineering, you will lead large-scale digital transformations, building bespoke analytics solutions to answer clients' key questions, develop solutions around Geni AI, and consult on the More ❯

professional development and continuous improvement while enjoying a casual work environment and Great Place to Work culture! We're seeking a Principal Software Engineer with a focus on data modeling and governance within the data engineering organization. In this role, you'll take a hands on approach in championing data modeling and governance at … level, while role modeling how engineers should think and work. As a principal engineer, you'll be responsible for leading the technical vision, architecture, and implementation strategy for data modeling and governance across the data ecosystem. You will be collaborating both within the data team and outside to ensure data success along … model Extensive experience in data modeling cross structured/unstructured data, schema vs schema less, batch vs real time, expert understanding of data lake technologies, SQL/No-SQL, streaming, data storage formats (Parquet, ORC, Avro), query engines (e.g. Spark, Presto, SQL) Solid experience with architecting and implementing metadata management including More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

Job Title: Data Engineer (Microsoft Fabric & Synapse) Job Summary We are seeking a skilled and experienced Data Engineer to join our team, focusing on the Microsoft data platform. The ideal candidate will have extensive hands-on experience in designing, building, and maintaining robust and scalable data pipelines using Microsoft Fabric, Azure Synapse … Analytics, and Python. You will be responsible for orchestrating the flow of data from diverse sources into our analytical platform, enabling data-driven decision-making across the organization. Key Responsibilities Pipeline Development: Design, develop, and maintain efficient ETL/ELT data pipelines using Microsoft Fabric and its components, including Fabric Pipelines and Spark jobs. … complex data ingestion, cleansing, and transformation tasks. Data Warehouse and Lakehouse Management: Implement and manage data storage solutions, leveraging Azure Data Lake and Fabric's OneLake for a modern lakehouse architecture. Data Integration: Integrate data from a wide variety of sources, including transactional databases, APIs, and streaming More ❯

Job Summary: GridIron IT is looking for a Data Management Technical Lead to support a large U.S. Department of Justice (DOJ) program. The Antitrust Division of the U.S. Department of Justice (DOJ) is responsible for enforcing federal antitrust laws and promoting fair competition in the marketplace. The Data Management Technical Lead will be responsible for overseeing … DC area. Key Responsibilities: • Lead the configuration, deployment, and administration of Azure cloud resources and services, ensuring optimal performance, scalability, and security. • Manage Azure Storage, Azure Data Lake, and Azure SQL Database for data storage and analysis needs. • Oversee Azure Active Directory and other Azure services to manage user access, security, and compliance. • Implement automation … management, with at least 3+ years in a technical leadership or SME role. • Expertise in Azure Administration and management, including Azure SQL Database, Azure Data Lake, and Azure Storage. • Deep understanding of SQL Server/Database Administration, including performance tuning, backup strategies, and migrations. • Hands-on experience with Apache Tomcat for web application and service More ❯

improvement while enjoying a casual work environment and Great Place to Work culture! We're seeking a Principal Software Engineer to provide technical and architectural leadership within the data engineering organization. In this role, you'll take a hands on approach in championing technology and architecture decisions at the ecosystem level, while role modeling how engineers should think … and work. As a principal engineer, you'll be responsible for leading the technical vision, architecture, and implementation strategy across the data ecosystem, collaborating both within the data team and outside to ensure successful deliveries in production, representing the data team in various technical forums across engineering to apply a data lens … data acquisition, data ingestion, data transformation, data aggregation, data governance, business intelligence, data warehouse, data lake, NoSQL, object storage, streaming etc. Extensive experience with building and driving adoption of software engineering best practices Strong understanding of distributed systems, cloud computing, and microservices architectures Extensive experience More ❯

This newly created Data Engineer Managers position is an excellent opportunity for a hands-on Senior Data Engineer/Technical Lead/Engineering Team Lead etc looking to move into a management position. The postholder will lead and mentor a team of 3 Data Engineers whilst overseeing data platform development and optimisation. … Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. The Data Engineer Manager will play a pivotal role at the heart of our clients data & analytics operation. Having implemented a new MS Fabric based Data platform, the need is now to scale up and meet … the demand to deliver data driven insights and strategies right across the business globally. Therell be a hands-on element to the role as you'll be troubleshooting, doing code reviews, steering the team through deployments and acting as the escalation point for data engineering. This is a hybrid role based in Central/West London More ❯