101 to 125 of 553 Data Lake Jobs

My FTSE 100 Client is urgently recruiting for a Data Solutions Architect, the chosen Candidate will be at the forefront of shaping end-to-end data architectures that support analytics, AI, and enterprise reporting across the organisation. You will lead solution design, champion best practices, and … robust, scalable, and secure data platforms. Key Responsibilities Design and implement modern data architectures using Azure Synapse , Data Lake , Data Factory , Databricks , and Microsoft Fabric . Lead the development of integrated data solutions supporting BI, advanced analytics, and real … time data processing. Define data governance, security, and compliance standards across the data lifecycle. Collaborate with cross-functional teams to translate business requirements into technical blueprints. Stay ahead of emerging trends in cloud, data, and AI, bringing innovative thinking into the organisation. More ❯

Databricks Data Engineer - Contract Day Rate: £550 - £650 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST … Key expertise and experience we're looking for: Data Engineering in Databricks - Spark programming with Scala, Python, SQL Ideally experience with Delta Lake Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks Data Governance experience - Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator - if not then experience with a similar Catalog/Data More ❯

My client is seeking to recruit Senior Data Engineers to join its expanding IT operation To be considered for these positions you will need to have experience in the following areas - Good … Data Engineering/ETL development experience - Data design experience in an MI/BI/Analytics environment (for example Kimball, lake house, data lake) - Good experience working in a structured Change Management project lifecycle - Excellent Data Warehouse skills - A strong … knowledge of business intelligence solutions and an ability to translate this into data solutions for the broader business is essential. - Strong demonstrable knowledge of data warehouse methodologies - Robust understanding of high-level business processes - Understanding of data migration, including reconciliation, data cleanse More ❯

eligibility: No Job Summary Strong experience in Databricks Expertise implementing batch and real time data process solutions using Azure Data Lake storage, Azure Data Factor and Databricks. Experience in built ETL pipelines for ingesting, transforming and loading data from multiple sources … into Cloud data ware houses Proficient in Docker for containerization, utilizing REST API in Python for seamless system integration, and applying containerization concepts to improve deployment efficiency and scalability. Experience in data extraction, data acquisition, transformation, data manipulation, performance tuning and data analysis. Experience in Python libraries to build efficient data processing workflows and streamline ETL operations across large data sets and similar distributed systems. Expertise in automating data quality checks, reducing data errors by 40% and ensuring more reliable reporting and More ❯

Immuta enables organizations to unlock value from their cloud data by protecting it and providing secure access. The Immuta Data Security Platform provides sensitive data discovery, security and access control, data activity monitoring, and has deep integrations with the leading cloud data … continuously improve and promote Immuta. Assist our strategic alliance partners in joint opportunity pursuits, helping establish Immuta in reference architectures and leaders in Data Security and Access. WHAT YOU'LL BRING 4+ years experience in a technical sales role, working with an … enterprise software or data product. Deep understanding of database and data warehouse technology, to include SQL experience. Data Lake Architectures, Data Products, Data Analytics, and Programming experiences desired. Excellent communication skills: interpersonal, written, visual (presentations), and verbal. Comfort with More ❯

as we possibly can. If this sounds good to you, then we're thrilled you're considering joining our team! Role Overview The Data Engineer will play a critical role in implementing and maintaining Lumon's technical data infrastructure. Reporting to the Head of Data, you will focus on building and optimising the Azure Synapse data warehouse, developing robust data pipelines, and delivering high-quality datasets for reporting and analytics. This role is ideal for a technically skilled professional who thrives on designing scalable data solutions and … financial services or a related field. Hands-on experience with Azure Synapse, Pipeline creations, Azure Data Factory, and Azure Data Lake Storage. Strong proficiency in SQL, including database management, query optimisation, and troubleshooting. Experience building and maintaining ETL pipelines for large-scale data More ❯

agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Data Lake Engineer at JPMorgan Chase within the Corporate Technology, Chief Data and Analytics Office Development Team, you will play a pivotal role in … discipline (e.g. data ingestion, data storage, data serving, APIs, etc.). Hands-on experience in data lake or data warehouse and related technologies (e.g. Spark, ETL, Databricks). Hands-on applied experience delivering system design, application development, testing, and More ❯

ALTA IT Services is in search of a Data Management Specialist to support U.S. Department of Justice (DOJ) is responsible for enforcing federal antitrust laws and promoting fair competition in the marketplace. The Data Management Specialist will support the management, administration, and optimization of the company … s data infrastructure, with a focus on cloud services, database management, data analysis, and reporting solutions. This role involves hands-on work with Azure, SQL Server, Power BI, and Apache Tomcat as well as utilizing R Studio and Data Bricks for data … data-related projects. Key Responsibilities: Administer and support Azure cloud resources, including Azure SQL Database, Blob Storage, and Azure Data Lake, ensuring optimal functionality and performance. Manage and configure Azure-based solutions for data storage, security, and access control. Implement automation scripts for More ❯

Data Analytics Developer Location: London (Hybrid) Type: Permanent | Full-Time My client is seeking a talented and driven Data Analytics Developer to join our fast-paced and evolving data team. This is a reporting-first technical role , ideal for someone with a passion for … building insightful dashboards, collaborating with senior stakeholders, and working at the forefront of cloud-based data platforms. We're looking for someone who thrives in a dynamic, start-up-style environment - adaptable, switched-on, and ready to take ownership of their work while contributing to the development of … DAX Solid experience in SQL/T-SQL for data extraction and transformation Hands-on experience with Azure technologies (Data Lake, Data Factory, Synapse, etc.) Data modelling experience (star/snowflake schemas, normalization, etc.) Familiarity with ETL processes and working alongside More ❯

Azure data engineering solutions (Ingestion & Curation) Create and maintain Azure data solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Utilizing Azure … Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations Use Azure Data Factory and Databricks to assemble large, complex data sets Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Ensure … data quality/security and compliance. Optimize Azure SQL databases for efficient query performance. Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures. Participate in all scrum ceremonies. Experience And Knowledge Required Including More ❯

What you'll be doing: NTT DATA are looking for a Lead Data Solutions Architect to work within a dynamic, remote-first data architectural capability to deliver cloud based data solutions using best-in-class RDBMS, ETL/ELT, and Cloud platforms … for blue-chip customers across a range of sectors. You will lead cross-functional teams of Data Engineers, Architects, Business Analysts and Quality Assurance Analysts to provision data processing, storage, and visualisation capabilities in an Agile environment. You will be comfortable with stakeholder engagement and take … the technical delivery of your team and the solution they are building. What experience you'll bring: Experience and Leadership: Proven experience in data architecture, with a recent role as a Lead Data Solutions Architect, or a similar senior position in the field. Proven experience in More ❯

Role Title: Data Modeler Duration: contract to run until 31/12/2025 Location: London, Hybrid 2-3 days per week onsite Rate: up to £644 p/d Umbrella inside IR35 Role purpose/summary We are seeking an experienced Data Modeller with proven … expertise in the London Market insurance sector. The successful candidate will play a key role in designing and validating data models that support enterprise data initiatives. This includes working closely with data engineers, architects, and business stakeholders to ensure data structures are … concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of More ❯

Role: Data Lead Location: Knutsford Contract Role Job Description: AWS Services: Glue, Lambda, IAM, Service Catalogue, Cloud Formation, Lake Formation, SNS, SQS, Event Bridge Language & Scripting: Python and Spark ETL: DBT Good to Have: Airflow, Snowflake, Big Data (Hadoop), and Teradata Responsibilities: Serve as the … primary point of contact for all AWS related data initiatives and projects. Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform. Gather and analyze business requirements to develop scalable and efficient data solutions on AWS. Design and implement data pipelines using various AWS services such as EMR, Glue, Kinesis, and Redshift. Develop data models and ETL processes to efficiently transform and load data into AWS data lakes and data warehouses. More ❯

DATA ENGINEER LONDON BASED £55,000-65,000 PER ANNUM This UK-based Music company are searching for a … new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in AWS. You will also be responsible for building new data pipelines in python. THE COMPANY The company is one of the … the team and will be using Python to code. Work collaboratively with the data science team, to create a data lake using AWS. Build and maintain Data Pipelines using Python. Develop real-time streaming features using big data tools such as More ❯

.video-wrapper svg top:40%; U.S. - What we do matters By playing this video you consent to Google/YouTube processing your data and using cookies Learn more . Position Description: CGI has an immediate need for a Cloud and Data Architect to join our team. … 5k+ loyal Clients who are leveraging our end-to-end services across the globe. Your future duties and responsibilities: As a Cloud and Data Architect, you will be responsible for leading architectural decisions for the Cloud, and Data Enterprise Portfolios. You must have a deep understanding … is a MUST - CISSP or any other security certification is a plus - Expertise in managing Enterprise Data platforms including Data Lake, Data Warehouse, and Data marts is required - Experience with SAS and R technologies is a major plus - Experience with real More ❯

Senior Data Engineer Quant Hegde Fund - London Our client, a leading quantitative hedge fund, is searching for its next Senior Data Engineer to join its London-based team. This is a fantastic opportunity to leverage a range of systems, including data libraries in Python … the most complex financial challenges and deliver high-quality returns for investors. Your day-to-day work will involve building and scaling global data lakes, optimising performance, and ensuring data completeness and quality. You will also be responsible for modelling large volumes of data … pipelines in Python using data libraries and cloud SDKs. Data modelling within the scope of Data Lake and OLAP - large volumes and highly concurrent data access. Optimising the performance of the data lake as well as More ❯

Role Title: Data Modeler Duration: contract to run until 31/12/2025 Location: London, Hybrid 2-3 days per week onsite Rate: up to £644 p/d Umbrella inside IR35 Role purpose/summary We are seeking an experienced Data Modeller with proven … expertise in the London Market insurance sector. The successful candidate will play a key role in designing and validating data models that support enterprise data initiatives. This includes working closely with data engineers, architects, and business stakeholders to ensure data structures are … concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of More ❯

on business needs. An average day: As Database Architect III, you will lead the strategic design, optimization, and governance of an organization's data architecture. This position will drive solutions to ensure seamless data delivery, support AI/ML and automation initiatives, and enforce standards for … security, performance, and data quality across diverse environments. In this position you will: Architect, develop, and maintain large-scale data infrastructures spanning bronze, silver, and gold layers Establish best practices for performance optimization, indexing, and high availability Develop and refine advanced schema designs to address complex … sprint planning, task tracking, and collaboration using Jira (or similar agile tool), ensuring timely and high-quality deliverables. Strong background in data lake and data warehouse design, including data modeling and partitioning strategies Advanced proficiency in ETL tools (e.g., Talend, Informatica, Apache Airflow More ❯

our focus on growth in the UK and Europe, now is the perfect time to join us on this high-speed journey. Introducing Data Engineering at Trainline At the heart of our Data Team, Data Engineers play a pivotal role by creating pipelines and … opportunities with Data Camp! As a Data Engineer at Trainline, you will Be key to making our data lake more accessible and insightful breaking down the barriers to access by working on new data marts and designing data models … Orchestrate your pipelines with DAGs on Airflow Participate in SCRUM ceremonies (standups, backlogs, demos, retros, planning) Secure data with IAM and AWS Lake formation Deploy your changes with Jenkins and GitHub actions We'd love to hear from you if you have Proven experience as a Data More ❯

We are looking for Data Engineer for our client's project based at London, UK - Hybrid Role Description: We are seeking an experienced Data Modeller with proven expertise in the London Market insurance sector. The successful candidate will play a key role in designing and validating … data models that support enterprise data initiatives. This includes working closely with data engineers, architects, and business stakeholders to ensure data structures are scalable, accurate, and aligned with business needs. Key Responsibilities: Design and maintain conceptual, logical, and physical data … concepts to non-technical stakeholders. Preferred Skills Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of More ❯

are seeking a Technical Trainer to lead impactful training programs across cutting-edge technologies, with a strong focus on Starburst, Dell Data Lake solutions, and Data Warehousing frameworks. Responsibilities: Design and develop high-quality training programs focused on Starburst, Dell Data Lakes, and … Data Warehousing architectures. Create engaging, hands-on materials such as labs, case studies, presentations, learning content that support enterprise data analytics adoption. Ensure training material is tailored to a wide range of audiences, from data engineers to business analysts. Deliver live, virtual, and hybrid training sessions that promote hands-on exploration of Starburst and Data Lake environments. Tailor instructional methods to suit technical and non-technical audiences; apply real-world scenarios from data warehouse modernization and lakehouse integration. More ❯

are seeking a Technical Trainer to lead impactful training programs across cutting-edge technologies, with a strong focus on Starburst, Dell Data Lake solutions, and Data Warehousing frameworks. Responsibilities: Design and develop high-quality training programs focused on Starburst, Dell Data Lakes, and … Data Warehousing architectures. Create engaging, hands-on materials such as labs, case studies, presentations, learning content that support enterprise data analytics adoption. Ensure training material is tailored to a wide range of audiences, from data engineers to business analysts. Deliver live, virtual, and hybrid training sessions that promote hands-on exploration of Starburst and Data Lake environments. Tailor instructional methods to suit technical and non-technical audiences; apply real-world scenarios from data warehouse modernization and lakehouse integration. More ❯

For one of our large scale clients based in Brussels, we are searching for a Freelance Azure Data Engineer that will be responsible for building and developing their internal platforms. Key Responsibilities: Design and implement robust data pipelines using Azure Data Factory, Azure Synapse … and related services. Develop and manage data integration solutions across structured and unstructured data sources. Optimize performance of large-scale data workloads and ensure data quality, integrity, and security. Collaborate with data architects, analysts, and business teams to enable data … initiatives on Azure. Your Profile: Strong hands-on experience with core Azure data services (Data Factory, Synapse, Data Lake, Databricks, etc.). Proficient in writing complex SQL queries and performance tuning. Solid understanding of ETL/ELT frameworks and data architecture More ❯

Company Insight This is the opportunity for an exceptional Senior Data Engineer to join one of Europe's best performing systematic quant trading businesses. Since its inception, this firm has cemented a formidable reputation within the systematic trading space, having been recognised as one of 2024's top … performing funds. This is an organisation that prides itself on it's innovative data and tech driven investment approach implemented within their trading strategies. Such an unparalleled scientific approach has allowed the firm to build next-generation, scalable and fault-tolerant multi-asset trading and backend systems, generating … data pipelines in Python using data libraries and cloud SDKs. Data modelling within scope of Data Lake and OLAP - large volumes and highly concurrent data access. Optimizing performance of the data lake as well as OLAP More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is … work with cutting-edge technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of … a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding More ❯