276 to 300 of 544 Data Lake Jobs

Overview: The Manual Data QA will be responsible for executing comprehensive manual tests to ensure the quality of data flows across various Chambers products and platforms, with a primary focus on the Databricks environment. This role plays a critical part in maintaining the integrity and reliability … of our data services. Main Duties and Responsibilities: Collaborate with cross-functional teams to understand data migration requirements and ensure smooth data transition to the cloud platform. Develop and execute comprehensive test plans for data migrations, database implementations, and ETL processes. Perform … assess system scalability and identify potential bottlenecks. Skills and Experience: Proven experience in testing data migrations, database implementations, and Data Lake environments. Familiarity with cloud environments, especially Azure, is highly desirable. Strong knowledge of SQL and experience in writing complex queries for data More ❯

Junior-Mid Level Data Engineer – Financial Services – London/Hybrid (2 days per week) – Up to £70K (DOE) My client, a fast-growing and innovative Financial Services organisation, is looking for a talented Junior to Mid-Level Data Engineer to join their expanding technology team. This … is an exciting opportunity for someone looking to take the next step in their data engineering career while contributing to a company undergoing substantial digital and data transformation. The successful candidate will be a proactive self-starter with the ability to work independently or collaboratively within … a high-performing team. You'll play a crucial role as the bridge between the Data Science function and the core Data Engineering team, helping to translate analytical needs into robust, scalable data infrastructure. The company fosters a culture of autonomy, innovation, and trust. More ❯

in how we mobilise others and support them to organise within their own communities. About You Do you have expertise in information management, data governance, and GDPR compliance? Do you have experience developing and delivering data services that support organisational goals and compliance? We are looking … to recruit an experienced Information Management and GDPR Lead to drive best practices in data governance, privacy, and compliance across The Wildlife Trusts federation. This role will develop and manage a data protection service that provides guidance, tools, and resources to help Trusts handle personal and … the governance of artificial intelligence for the RSWT and federation. You will also support shared data services, including the data lake, and help align CRM systems and third-party platforms with compliance requirements. Additionally you will monitor RSWTs risk exposure and compliance. We expect around More ❯

Principal Data Engineer Consulting Leeds, UK £90,000 £100,000 Hybrid A leading consultancy is seeking a Principal Data Engineer to take ownership of delivering scalable, cloud-first data solutions across greenfield and transformation programmes. This is a hands-on role where you'll … design, build, and deploy enterprise-grade platforms and pipelines using AWS and modern ETL tools. As Principal Data Engineer, youll work directly with clients to understand complex requirements, shape the solution architecture, and lead end-to-end technical deliveryalways with a focus on quality, performance, and value. Your … Your previous experience as Principal Data Engineer will include: Strong background across AWS data stack and modern data lake architectures Experience delivering complex ETL pipelines and cloud warehouse solutions Proven business development exposure within a consulting or pre-sales context Familiarity with RDBMS More ❯

Principal Data Engineer Consulting Bristol, UK £90,000 £100,000 Hybrid A leading consultancy is seeking a Principal Data Engineer to take ownership of delivering scalable, cloud-first data solutions across greenfield and transformation programmes. This is a hands-on role where you'll … design, build, and deploy enterprise-grade platforms and pipelines using AWS and modern ETL tools. As Principal Data Engineer, youll work directly with clients to understand complex requirements, shape the solution architecture, and lead end-to-end technical deliveryalways with a focus on quality, performance, and value. Your … Your previous experience as Principal Data Engineer will include: Strong background across AWS data stack and modern data lake architectures Experience delivering complex ETL pipelines and cloud warehouse solutions Proven business development exposure within a consulting or pre-sales context Familiarity with RDBMS More ❯

an impact that matters, through challenging projects which demand ambitious innovation and thought leadership. Are you looking to take on a role in Data? We have an exciting role for you – ETL/ELT Engineering SME. Careers at TCS: It means more TCS is a purpose-led transformation … to bring products to life. The Role As a ETL/ELT Engineering SME , you will be working on designing, developing, and supporting data applications and infrastructure using ETL tools such as IDMC and Informatica Power Center. This position offers a chance to work with cutting-edge data … profiling skills using Informatica and Excel. Strong experience in infrastructure architecture, such as designing, hardware sizing, effort estimation and security. Experience with DataLake and Data Warehouse. Previous experience with data analysis activities. Working experience in developing application integration using SOAP/REST APIs, APIs More ❯

technology services, and we provide large-scale technologic solutions to big companies. What are we looking for? We are looking for a Senior Data Engineer working close to one of our main clients in financial sector. Main tasks and accountabilities will be: Work with stakeholders within business and … technology to understand the business needs and help to design and implement optimal solutions fostering data-driven culture in the organisation Lead strategic prototyping workshops to better understand objectives through quick feedback loops and collaborate effectively across Global Technology Shared Services (InfoSec, Infrastructure, Production Support, etc) to productionise … solutions Understand differences in the approach for building self-service BI (business or IT managed) vs Corporate BI solutions including the choice of data sources and ETL approach Drive reporting efficiencies by categorizing internal practices for streamlined reporting and define a vehicle for sharing with others, including trainings More ❯

Data Manager Location: Watford (Hybrid – 3 days office based and 2 days working from home) Salary: Competitive + Benefits About Us Corona Energy is a leading independent energy supplier with over 20 years’ experience in servicing UK businesses. We currently supply 14% of the industrial and commercial gas … it’ people, champions growth, collaboration, and innovation, we’d love to hear from you! About the role: We are looking for an experienced Data Manager to define, lead, and implement our enterprise data strategy. This role is pivotal in ensuring strong data governance, consistent … standards, and the optimal use of data assets across the business. You will build and manage a network of data professionals, oversee platform and architecture development, and champion a culture of data-driven decision-making across the organisation. Key role and responsibilities: Data More ❯

Description We use innovation to shape data, so it works for everyone and we're planning to re-platform and improve the existing (commercial, operational and customer) data assets and develop new ones, as well as transform how we work with the business to use our … data better. As part of a centralised data function, you will work closely with Data Engineers in a multi-disciplinary team. You will need to understand complex data flows and both business and technical requirements to develop ETL/ELT reconciliation scenarios … rules/requirements. Skilled in using querying tools such as SQL Developer and PostgreSQL/DBeaver Proficient in using Snowflake for data lake testing Experience of working with and using ETL tools such as ODI Proficient with reporting tools such as Power BI and OAS Understanding of More ❯

Description We use innovation to shape data, so it works for everyone and we're planning to re-platform and improve the existing (commercial, operational and customer) data assets and develop new ones, as well as transform how we work with the business to use our … data better. As part of a centralised data function, you will work closely with Data Engineers in a multi-disciplinary team. You will need to understand complex data flows and both business and technical requirements to develop ETL/ELT reconciliation scenarios … rules/requirements. Skilled in using querying tools such as SQL Developer and PostgreSQL/DBeaver Proficient in using Snowflake for data lake testing Experience of working with and using ETL tools such as ODI Proficient with reporting tools such as Power BI and OAS Understanding of More ❯

About The Role Innovation to shape data, so it works for everyone and we're planning to re-platform and improve the existing (commercial, operational and customer) data assets and develop new ones, as well as transform how we work with the business to use our … data better. As part of a centralised data function, you will work closely with Data Engineers in a multi-disciplinary team. You will need to understand complex data flows and both business and technical requirements to develop ETL/ELT reconciliation scenarios … rules/requirements. Skilled in using querying tools such as SQL Developer and PostgreSQL/DBeaver. Proficient in using Snowflake for data lake testing. Experience of working with and using ETL tools such as ODI. Proficient with reporting tools such as Power BI and OAS. Understanding of More ❯

Salary: 50.000 - 60.000 € per year Requirements: • 3+ years of hands-on experience as a Data Engineer working with Databricks and Apache Spark • Strong programming skills in Python, with experience in data manipulation libraries (e.g., PySpark, Spark SQL) • Experience with core components of the Databricks ecosystem: Databricks … Workflows, Unity Catalog, and Delta Live Tables • Solid understanding of data warehousing principles, ETL/ELT processes, data modeling and techniques, and database systems • Proven experience with at least one major cloud platform (Azure, AWS, or GCP) • Excellent SQL skills for data querying, transformation … from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses • Leveraging the Databricks ecosystem (SQL, Delta Lake, Workflows, Unity Catalog) to deliver reliable and performant data workflows • Integrating with cloud services such as Azure, AWS, or GCP to enable More ❯

Roles: Azure Data Engineer (Databricks) Location: London Key Skills: 8 plus years of experience in building/architecting data … analytic solutions. 3 years of experience in building data platform using Azure services including Azure Databricks, Azure Data Factory, Delta Lake, Azure Data Lake (ADLS), Power BI. Solid hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have. … Very good knowledge of data warehousing skills including dimensional modeling, slowly changing dimension patterns, and time travel. Experience in delivering Agile projects with implementation knowledge on CI/CD pipelines, preferably on Azure DevOps. Experience in delivering data analytical platform for insurance customers. Experience in Lloyd More ❯

Data Engineering Manager, London Contract Type: Permanent, Full Time Salary: £80,000-£90,000 + 20% Individual performance bonus + £5,000 corporate bonus About Ekimetrics Founded in 2006, Ekimetrics is a European leader in data science consultancy with 400+ Data Science and Engineering … Operational Excellence Powered by our in-house R&D and proprietary solutions , our mission is to create measurable, sustainable performance for clients through data innovation. About the Role We're hiring a Data Engineering Manager to join our growing London office and lead our UK data engineering presence. You'll join our global Data Engineering & Architecture (DE&A) team and work at the intersection of consulting, strategy, and technology , combining technical delivery with deep business understanding. You'll partner with leading brands to build scalable data platforms, leveraging cloud technologies More ❯

Responsibilities: Develop, optimize, and maintain data ingest flows using Apache Kafka, Apache Nifi and MySQL/PostGreSQL Develop within the components in the AWS cloud platform using services such as RedShift, SageMaker, API Gateway, QuickSight, and Athena Communicate with data owners to set up and ensure … configuration parameters Document SOP related to streaming configuration, batch configuration or API management depending on role requirement Document details of each data ingest activity to ensure they can be understood by the rest of the team Develop and maintain best practices in data engineering and data … in traditional database and data warehouse products such as Oracle, MySQL, etc. Experience in modern data management technologies such as Datalake, data fabric, and data mesh Experience with creating DevSecOps pipeline using CI CD CT tools and GitLab Excellent written and oral More ❯

Job Description BAE Systems, a top-ten prime contractor to the U.S. Department of Defense, enables the U.S. government to transform data into intelligence and provides engineering, integration and sustainment support for critical military platforms and systems. Intelligence & Security provides services and products to the Department of Defense … Be a part of a company that is part of the community; driven to improve our future and protect our freedom. As a Data Engineer, you are responsible for designing data models, building data warehouses and data lakes, automating data pipelines and working with datasets of all sizes. You will optimize overall data/information flow by reducing redundancy and enabling accessibility within security boundaries. You apply data extraction, transformation and loading techniques in order to connect large data sets from a More ❯

Data & AI Technologies - Technical Trainer Salary: Up to £60,000 (Based on candidate experience) Hybrid Model: Mostly remote (ad-hoc travel to London expected) Job Type: Permanent About you: You will have a hands-on technical training session covering Data-focused our AI & Data Practice, specializing in Starburst, Dell Data Lakes, and Data Warehousing solutions. You'll design and deliver training that enables clients to maximize value from modern data architectures and be adept at teaching complex concepts to a variety of learners while ensuring training … and virtual sessions, guiding hands-on workshops and offering immediate feedback Design and develop content, including creating hands-on training for Starburst, Dell Data Lakes, and Data Warehouse Develop practical labs, case studies, and learning materials Adapt teaching methods to different technical levels Stay current with More ❯

We are seeking a skilled senior data engineer to join a dynamic team in London responsible for building a global and scalable data lakehouse which will be used by multiple trading desks at the fund. This role offers the opportunity to work with cutting-edge technologies … and collaborate with multiple trading teams to drive data-driven decision-making. Key Responsibilities: Design, develop, and maintain a robust data lakehouse solution for use by multiple trading desks. Collaborate with trading teams to understand their data needs and provide tailored solutions. Implement data … cloud software development kits (APIs). Optimise performance, data storage and retrieval processes for efficiency and scalability. Ensure the data lake and Online Analytical Processing DB (OLAP - Redshift or similar) is able to handle large volumes and highly concurrent data acess. Ensure data More ❯

Senior Data Manager About Scalian Join our team of industry leaders at Scalian , where for over 30 years innovation and expertise come together. As a leading multinational engineering consultancy firm, we have over 6000 highly skilled specialists. Our focus on OT and IT , including software and systems engineering … management, sets us apart in the industry. Project Description Scalian is supporting the digital transformation of a major industrial player by implementing smart data architectures that connect manufacturing systems with advanced analytics and AI. As part of this initiative, we are building a data-driven ecosystem … engineering, or architecture roles Master's or PhD in Computer Science, Data Engineering, or Information Systems Strong experience with data lake architectures and cloud-based warehousing (e.g., Snowflake, Redshift, BigQuery ) Solid understanding of data governance , security, and system scalability Experience working with MES More ❯

sensor and data fusion, unconventional/asymmetric warfare, situational awareness, cyberspace and spectrum warfare, large data analytics, data lake, jamming technologies, sensor technologies, geo-registration to deliver a cutting-edge approach. As a Software Engineer Chief on the AF TENCAP HOPE 2.0 project … maintain technical documentation. Mentor and manage junior engineers, providing guidance and support. Lead technical discussions and contribute to system-level design decisions. Integrate data engineering and data science techniques to enhance software capabilities. Support AI/ML initiatives to drive innovative solutions. Qualifications REQUIRED EDUCATION AND … equivalent in Information Assurance and Cybersecurity (e.g., Security+ or higher). DESIRED EXPERIENCE: Strong understanding of software design patterns and principles. Experience with data engineering, data science, and AI/ML technologies. Ability to effectively communicate with technical and non-technical stakeholders. Target salary range More ❯

sensor and data fusion, unconventional/asymmetric warfare, situational awareness, cyberspace and spectrum warfare, large data analytics, data lake, jamming technologies, sensor technologies, geo-registration to deliver a cutting-edge approach. As a Software Engineer Chief on the AF TENCAP HOPE 2.0 project … maintain technical documentation. Mentor and manage junior engineers, providing guidance and support. Lead technical discussions and contribute to system-level design decisions. Integrate data engineering and data science techniques to enhance software capabilities. Support AI/ML initiatives to drive innovative solutions. Qualifications REQUIRED EDUCATION AND … equivalent in Information Assurance and Cybersecurity (e.g., Security+ or higher). DESIRED EXPERIENCE: Strong understanding of software design patterns and principles. Experience with data engineering, data science, and AI/ML technologies. Ability to effectively communicate with technical and non-technical stakeholders. Target salary range More ❯

SARL (UK Branch) Locations considered: London, Paris, Madrid, Milan, Munich, Berlin Are you interested in building data warehouse and data lake solutions to shape the analytical backbone of the EU Heavy Bulky & Services team? We are hiring a Business Intelligence Engineer to scale up our … data projects to the next level. This position requires experience in building Business Intelligence solutions, paired with bringing a hands-on data engineering mentality. We seek individuals that enjoy to collaborate across stakeholders and that bring excellent statistical and analytical abilities to the team. Heavy Bulky … evolution of their team's analytical practices. Experience of developing automated analytical solutions is preferred. Key job responsibilities - Design, develop and implement scalable data solutions, automate processes and accelerate analytics. - Collaborate with other Business Intelligence Engineers on a WW scope and implement data pipelines to automate More ❯

Description We use innovation to shape data so it works for everyone and we're planning to re-platform and improve the existing (commercial, operational and customer) data assets and develop new ones, as well as transform how we work with the business to use our … data better. As our Digital Data Analyst, you will play a key role in supporting the charge in digital innovation and management across our diverse range of products and services. In this role, you will support our Digital teams, encompassing both Organic Performance (SEO) and Performance … MO provides tools and methods for the wider business to garner insights and analysis from our Data Warehouse and Data Lake, playing a key role in providing support to the business in their Data Science, AI, and ML initiatives. Our Data More ❯

Description We use innovation to shape data so it works for everyone and we're planning to re-platform and improve the existing (commercial, operational and customer) data assets and develop new ones, as well as transform how we work with the business to use our … data better. As our Digital Data Analyst, you will play a key role in supporting the charge in digital innovation and management across our diverse range of products and services. In this role, you will support our Digital teams, encompassing both Organic Performance (SEO) and Performance … MO provides tools and methods for the wider business to garner insights and analysis from our Data Warehouse and Data Lake, playing a key role in providing support to the business in their Data Science, AI, and ML initiatives. Our Data More ❯

Job Description BAE Systems, a top-ten prime contractor to the U.S. Department of Defense, enables the U.S. government to transform data into intelligence and provides engineering, integration and sustainment support for critical military platforms and systems. Intelligence & Security provides services and products to the Department of Defense … Be a part of a company that is part of the community; driven to improve our future and protect our freedom. As a Data Architect, you are responsible for leading the design of data models, building data warehouses and data lakes, automating … data pipelines and working with datasets of all sizes. You will optimize overall data/information flow by reducing redundancy and enabling accessibility within security boundaries. You apply data extraction, transformation and loading techniques in order to connect large data sets from More ❯