1 to 25 of 215 Data Lake Jobs

Job Title: Lead Data & Analytics Engineer Location: Central London Contract Perm/FTC: Permanent Salary: Up to £80,000 depending on experience Work type Place - Hybrid : 3 days in the office and 2 working from home About us Cynergy Bank is the UK’s human digital bank serving … Services Compensation Scheme. For more information on Cynergy Bank visit www.cynergybank.co.uk The role As part of Cynergy Bank’s digital transformation, the lead data engineer will perform a pivotal role in helping to build the company’s new data and analytics architecture. Working closely with data … such as Apache Beam, Google Dataflow or dbt. Proven experience of building & maintaining data platform elements. (ingestion layers, data lakes, data warehouses etc) Proven experience of building & maintaining Business Intelligence & reporting environments – especially Power BI. Hands-on abilities with data modelling and more »

to £80,000 Location; Remote, for UK-based professionals Skills required; AWS (Aurora, S3, Athena, Redshift, Kinesis), Data Warehouse, Data Lake Design, Python, SQL Company Overview: We are a dynamic and innovative technology company at the forefront of data-driven solutions, committed to … a team of skilled professionals. Key Responsibilities: Design, develop, and maintain data architecture, including data warehousing and data lake solutions. Implement and optimize ETL processes for efficient data extraction, transformation, and loading. Collaborate with cross-functional teams to understand business requirements … and pipelines. Requirements: Proven experience as a Data Engineer with a focus on AWS, Python, Data Warehousing, Data Lake Design, and MLOps. Strong expertise in designing, implementing, and optimizing ETL processes. Proficiency in cloud services, particularly AWS (Amazon Redshift, S3, Glue, etc.). more »

Data Engineer, AWS, Python. LOCATION : Based at client locations or working remotely JOB TYPE : PERMANENT SALARY: £50,000 - £65,000 Frustrated that your bright ideas arent being listened to? Feeling like you arent being given the platform to make the difference you crave? A career at Triad could … with the support of my peers. Triad is an IT consultancy company, and we are looking to complement our team with an experienced Data Engineer. This is an exciting time to join Triad, as we embark on the next phase of our journey to becoming the UKs favourite … and maintain data pipelines to efficiently extract, transform, and load (ETL) data from various sources into our data lake or data warehouse on AWS. Data Modeling: Create and manage data models that facilitate efficient storage and retrieval more »

pipelines/ETL processes using A Data Factory Assemble large, complex data sets using Azure Data lake that meet functional/non-functional business requirements. Architect and extend data models for data visualisation, analytics and data … greater functionality in our data systems. Support in data governance within the data platform (Azure Data Lake & other Data Platform services) The skills & experience that youll need Essential Strong proficiency with SQL with knowledge of best practices including debugging … including data structure optimisation through to visualisation and dashboard creation. Experience using modern data platforms and services (Data Lake, Azure Data Factory, SQL (On-prem/Cloud, Data Bricks) to build conformed and derived data models for more »

Service Advisory Industry/Sector Technology Specialism Technology Strategy Management Level Manager Job Description & Summary General skills 5+ years relevant work experience in data architecture and data modeling as part of complex solution design, delivery and migration for major companies on leading technologies Proven experience as … data architect within wider architecture team in complex transformation from Strategy through to execution, operating across: Data strategy inc. Data landscape analysis and As Is and To Be gap assessment Data architecture and Data model design Agile/iterative delivery … related technologies (MySQL, MongoDb, Oracle, NoSQL, etc) Experienced on data architecture and design pattern Master Data management Data lake and Data Warehouse Data management frameworks Data sharing as part of ecosystem and integration/data more »

SZC Data Engineer will understand and bring together the differing information streams available through its access to the SZC Data lake, Enterprise software tools and other systems used to collect and manage data and delivery on the SZC programme Advising and supporting implementation … responsibilities of a data engineer include working closely with IT to aid data availability through the SZC Data lake, using ETL techniques through Databricks to manipulate data for use in Power BI by data analysts and BI developers within … the team. Ensuring quality and efficiency of data architecture within the SZC Data lake environment Knowledge sharing across the business. Liaison with other functions and supply chain partners for license management and support. Implementation of Power Apps where data capture and interaction is more »

Data Architect (Data, Architecture, Architect, Azure, DataLakes, Data Warehouse, PMO, Data Strategy, Data Cleansing, Stakeholder Management) Permanent Oxford Charles Simon Associates are currently looking for a Data Architect on a permanent basis for our prestigious national client based … Candidates must be certified within MS Azure PowerBi understanding Any previous experience of creating a Datawarehouse from scratch is highly desirable Experience of Azure Datalakes is highly desirable Migration from on prem to cloud using Azure Start date is ASAP for the Data Architect The Data … date copy of your CV to be considered for the Data Architect Data Architect (Data, Architecture, Architect, Azure, DataLakes, Data Warehouse, PMO, Data Strategy, Data Cleansing, Stakeholder Management) Permanent Oxford more »

Data Architect (Data, Architecture, Architect, Azure, DataLakes, Data Warehouse, PMO, Data Strategy, Data Cleansing, Stakeholder Management) Permanent Lincoln Charles Simon Associates are currently looking for a Data Architect on a permanent basis for our prestigious national client based … Candidates must be certified within MS Azure PowerBi understanding Any previous experience of creating a Datawarehouse from scratch is highly desirable Experience of Azure Datalakes is highly desirable Migration from on prem to cloud using Azure Start date is ASAP for the Data Architect The Data … date copy of your CV to be considered for the Data Architect Data Architect (Data, Architecture, Architect, Azure, DataLakes, Data Warehouse, PMO, Data Strategy, Data Cleansing, Stakeholder Management) Permanent Lincoln more »

relevant work experience in integration architecture and delivery as part of complex transformation for major companies on key technologies Proven experience as lead data architect from strategy through to execution, operating across: Data strategy inc. Data landscape analysis and As Is and To Be … gap assessment Data architecture and Data model design Agile/iterative delivery of solution data model across multiple platforms and components Data migration architecture and ETL processes Proven track record to shape and lead large multidisciplinary teams Proven experience to manage senior … related technologies (MySQL, MongoDb, Oracle, NoSQL, etc) Expertise on data architecture and design pattern Master Data management Data lake and Data Warehouse Data management frameworks Data sharing as part of ecosystem and integration/data more »

Engineer, ETL/ELT, Azure, Azure SQL, Azure Data Factory, Azure Data Storage, Azure Synapse, Azure Data Lake, DevOps, CI/CD, Apache Spark, PySpark, SQL and Data Engineer) We have several fantastic new roles for Data Engineer … ETL/ELT, Azure, Azure SQL, Azure Data Factory, Azure Data Storage, Azure Synapse, Azure Data Lake, DevOps, CI/CD, Apache Spark, PySpark, SQL) to join an ambitious and award-winning Microsoft consultancy. They specialise in delivering innovative technology-based business solutions … the following: ETL/ELT, Azure, Azure SQL, Azure Data Factory, Azure Data Storage, Azure Synapse, Azure Data Lake, DevOps, CI/CD, Apache Spark, PySpark and SQL. Knowledge of software development methodologies is of interest (Agile, Scrum). My client will provide more »

70k Responsibilities: Design and implement scalable and secure Azure-based data platforms to manage large and intricate datasets Craft Data Lake and Data Warehouse solutions to effectively store and organize data for analytical purposes Utilize Data Vault and Dimensional … other streaming technologies (Synapse streaming or Event hubs) for real-time data ingestion and processing Proven expertise in Azure Data Lake (ADLS Gen2) and its capabilities for storing and managing large datasets Proficiency in Synapse Dedicated SQL Pool and SQL Data Warehouse, including … with Azure Databricks for batch and streaming data processing, with the ability to develop metadata-driven pipelines Knowledge of Data Lake storage formats such as Parquet and Delta Lake to efficiently store and manage data Experience in handling complex data more »

an Azure Data Engineer you will construct and manage a sophisticated data platform on Azure utilising Azure Data Lake Services (Gen2)/Delta Lake, Azure Data Factory, Azure Synapse and Azure Databricks, tailored to manage extensive and intricate data … both batch and streaming data pipelines that are automated, efficient, and responsive. Develop solutions for Data/Delta Lakes and Data Warehouses. Utilize Data Vault and Dimensional modeling techniques for data model construction. Coordinate with teams focused on Reporting and … or SQL. Skilled in using Azure Synapse/Databricks for both batch and streaming data processing. Proficiency with Azure Data Lake Storage Familiarity with Azure Data Factory, including the creation and management of metadata-driven pipelines. Experience with Synapse Dedicated SQL Pool, including more »

Engineer – £60,000 – £70,000 – Middlesbrough/Hybrid Sustainability | Renewable Energy | Power BI | Azure | ADF | Azure Data Factory | Data Lake | SQL | Data Bricks | Power Query | SSRS | SSIS | SSAS Do you want the chance to work on some of the biggest projects in … and undertake ETL integrations. What they are after – SQL Management server ( SSRS,SSIS ) Experience with Microsoft Azure stack ( ADF, Logic Apps, Data Lake, Data Bricks ) What is in it for you – Hybrid working Private healthcare Half day Friday Access to award winning e-learning platform … you need to be in commutable distance to Middlesbrough. Sustainability | Renewable Energy | Power BI | Azure | ADF | Azure Data Factory | Data Lake | SQL | Data Bricks | Power Query | SSRS | SSIS | SSAS more »

My client is a dynamic and innovative consulting firm at the forefront of leveraging data to drive business success. They are seeking a highly skilled and experienced Senior Data Architect to join their growing team and play a pivotal role in shaping and optimizing the enterprise … data storage, processing, and analytics. • Data Storage Mastery: • Showcase expertise in data storage, encompassing data lakes, data marts, and data warehouses (e.g., Amazon Redshift). • Data Security: • Implement and uphold data security protocols, encryption … strategies. • Proficiency in cloud-based data platforms, especially AWS and Azure. • Knowledge of data storage, including data lakes, data marts, and data warehouses. • Understanding of data security protocols, encryption methods, and best practices. • (Nice to have) Familiarity with more »

https://www.youtube.com/watch?v=gN4nmkp855Y Join the GSK Industrial Placement UK Programme in Data Analytics: Help us get ahead of disease together. Education required: Undergraduate degree from an accredited university, in Science, Technology, Engineering, and Mathematics (STEM), Data Science, Life Science, or computer … developing your skills and gaining valuable experience for wherever the future takes you. Inspired to help us get ahead together? Apply for a Data Analytics Industrial Placement at GSK today! As a part of your placement year in the Data Analytics, you will be embedded in … analytics and automation agenda. You will have support embedding advanced DDA (Digital, Data and Analytics) capabilities developed through a data lake platform, data science capability and leading edge digital analytical tools. This role will appeal to someone who wants to combine skills in more »

Data Architect Salary Range: Negotiable Dependent on Experience Location: Eastleigh - Hybrid Working Hours: 37 ½ per week, Monday - Friday Contract: Full Time, Permanent Do you have a deep passion for data and analytics? Have you honed your skills in crafting and executing data solutions for … If your response is a resounding "yes" to these questions, then an exciting opportunity awaits you Our client is in search of a Data Architect to join their dedicated Enterprise Data Services team based in Eastleigh. As part of your regular workday, you will engage in … knowledge, skills and experience: Insurance/financial services domain knowledge. Expertise in at least two of these key technologies: Azure, Azure Data Lake, Databricks, Matillion, Snowflake and PowerBI. Event-driven architecture, including Lambda. Analytical system data architecture and ETL design experience. Sound understanding of dimensional more »

Data Architect London/Hybrid up to £90,000 per annum + 15% bonus & generous benefits package An exciting opportunity has arisen to join a global organisation within the insurance industry, famed for their diverse workforce and superb office culture. As the new Data Architect you … level integrated designs to meet those requirements, and align with enterprise strategy and related business architecture. Main duties include: Overseeing the production of Data Architecture project deliverables, including logical data diagrams, data flow diagrams, data dissemination diagrams, data migration, data … between systems to provide a comprehensive data architecture Knowledge of Cloud based big data frameworks such as data lake, relational, graph and other no-SQL databases Able to articulate a vision and build support for that vision in the wider team and organization. more »

We are partnered with one of the UK’s most admired companies on their search for an experienced Data Integration Architect in the London area. They are looking for a Data integration Architect to join their team as an SME & will assist in ensuring that integration … as service-oriented architectures, APIs, event-driven architectures/event hub/event grid, batch data integration, ETL, data lakes, data mesh, data warehousing, data management etc. What is required to be the next Data integration Architect … and operations of NoSQL data storage technologies such as SQL Server, Azure SQL, Azure SQL DW, PostgreSQL, RedisCache, Azure Data Lake An expert understanding of data integration strategies and the technology platforms that underpin them. Experience in Design and configuration of data more »

We are partnered with one of the UK’s most admired companies on their search for an experienced Data Integration Architect in the London area. They are looking for a Data integration Architect to join their team as an SME & will assist in ensuring that integration … as service-oriented architectures, APIs, event-driven architectures/event hub/event grid, batch data integration, ETL, data lakes, data mesh, data warehousing, data management etc. What is required to be the next Data integration Architect … and operations of NoSQL data storage technologies such as SQL Server, Azure SQL, Azure SQL DW, PostgreSQL, RedisCache, Azure Data Lake An expert understanding of data integration strategies and the technology platforms that underpin them. Experience in Design and configuration of data more »

As a Data & Reporting Lead, you will be responsible for overseeing and managing the data-related activities within the company programme organisation. Your main objective will be to ensure effective data integration, data migration and reporting setup activities. You will collaborate with … cross-functional teams to identify data requirements, design data acquisition and integration processes, and implement them. You will also lead a data & reporting team and provide guidance and support in their daily tasks. Your role will be crucial to implement and support the integration … and data readiness projects Experience in a range of modern data migration approaches and tools. Experience in data lake setup in the organizations. Strong knowledge of database technologies, data warehousing, data lake integration and ETL processes. Experience in more »

Senior GCP Data Engineer Remote - must be UK based with valid R2W Up to £95,000 I'm currently looking for a Senior Data Engineer to join an established SaaS organisation, who believe in using the latest cutting edge technology to aid business growth. The Senior … is essential, particularly with a good understanding of how to build views, materialisations and data flow scripts within a Data Lake/Data Warehouse environment against business requirements. Strong SQL development background, with at least 5 years’ experience in any SQL syntax etc. … Integration, and ETL experience of Data Warehouse & Data Lake platforms either by scripting or ETL tools. Programming experience - any language, ideally Golang or Python Demonstrable experience delivering clean well tested code Analysis & design Strong analytical skills and ability to undertake large data designs more »

Senior GCP Data Engineer Remote - must be UK based with valid R2W Up to £95,000 I'm currently looking for a Senior Data Engineer to join an established SaaS organisation, who believe in using the latest cutting edge technology to aid business growth. The Senior … is essential, particularly with a good understanding of how to build views, materialisations and data flow scripts within a Data Lake/Data Warehouse environment against business requirements. Strong SQL development background, with at least 5 years’ experience in any SQL syntax etc. … Integration, and ETL experience of Data Warehouse & Data Lake platforms either by scripting or ETL tools. Programming experience - any language, ideally Golang or Python Demonstrable experience delivering clean well tested code Analysis & design Strong analytical skills and ability to undertake large data designs more »

Lead Azure Data Engineer - £70k - £85k + Benefits Hybrid - UK Do you want the autonomy to take charge of your career and deliver the most innovative solutions in the Microsoft market? We're supporting a well-established and reputable Microsoft Partner who are actively investing in their Data … Architects where you'll be utilising cutting-edge Microsoft technologies to deliver innovative data solutions within Azure Synapse, Azure Data Lake, Azure Data Bricks, Azure Data Warehouse, Fabric and Data Modelling techniques. You will be leading end-to-end … through to Director Level What experience will you have? End to end implementations of Microsoft Azure Data Solutions (Azure Data Lake, Azure Data Warehouse, Azure Synapse, Azure Data Bricks, Azure Data Factory) Ability to translate business requirements into innovative more »

I am working with a new telecommunication start-up who are on the hunt for an experienced Data Integration Architect, to join their growing Engineering function in London. This company recognises the importance of collaboration and growth at a personal level. You will be at the forefront of …/Integration architectures, such as service-oriented architectures, APIs, event-driven architectures, batch data integration, ETL, data lakes, data mesh, data warehousing, data management, etc. Requirements: 3-5 years+ experience in Integration and data architecture and … and operations of NoSQL data storage technologies such as SQL Server, Azure SQL, Azure SQL DW, PostgreSQL, RedisCache, Azure Data Lake An expert understanding of data integration strategies and the technology platforms that underpin them. Experience in Design and configuration of data more »

Description Due to continued growth within our professional services, we are looking for a Solution Architect to join our data practice - working with some of the best data professionals in the country. You will play an integral part in taking our data services to … market - providing technical and strategic thought across the whole lifecycle of data projects from presales through to sign-off and support. A day in the life of an Aiimi Solution Architect: Taking on technical ownership of data projects and transitioning them from presales to delivery Translating … and/or GCP would be of added benefit) Experience of using technologies such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Analysis Services, Databricks and Power BI (or equivalent technologies within AWS or GCP stack) Experience of implementing centralised data more »