1 to 25 of 215 Permanent Data Lake Jobs in the UK

Product Manager (Product Owner Business Analysis Data Lake Data Mesh Datamesh SQL Architecture Big Data AWS Python Dremio Apache Iceburg Iceberg Arrow DBT Tableau PowerBI Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund … London. You MUST have the following: Advanced ability as a Product Owner/Product Manager/Business Aanlyst Extensive exposure to data lake environments Some exposure to data mesh architecture projects Some SQL querying Agile The following is DESIRABLE, not essential: Trading, Front Office finance … of data into the company from external financial data providers. The data is fed into an AWS based datalake and then distributed across the Front Office. This data lake will be migrated to a data mesh architecture using Dremio more »

Previous experience working in a Data Engineering role * Experience working with Azure Technologies - Azure Data Factory, Synapse, Data Lake, Data Bricks * Experience working with SQL and Python * Experience designing and implementing ETL solutions This is a unique opportunity for a data … to d.moore1@nigelfrank.com or alternatively, give me a call on 0191 338 7577 Key Skills:Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLJob SummaryUp to … GBPDeveloper/Programmer RoleSkills: Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLLevel: Senior more »

working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits Purpose of Job Advise on and ensure the maximum return of value from the company's … Engineers. Providing Technical guidance to Data Engineers Knowledge, Experience and qualifications Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation more »

Data Scientist (Pharma) Fully remote (UK/Ireland/Europe) Salary up to £75k depending on experience MBN Solutions are delighted to have been retained by their client, a powerhouse in the Pharmaceuticals industry, to onboard a talented and innovative Data Scientist to join the team. … This Data Scientist will help rocket the business into the future, masterfully crafting, launching, and fine-tuning cutting-edge Advanced Analytics Models. You will be the person behind transforming raw data into actionable insights, ensuring the organisation makes decisions that are not just informed but inspired. … & modelling lifecycles (ML Ops). Seek to improve model efficiency, performance, and scalability Microsoft Technology Stack experience sought (Azure Data Lake, Databricks, Azure ML, Power BI), and capabilities of programming in and understanding R & Python. You will also likely have: A passion for problem-solving more »

D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client … with Microsoft Dynamics 365 Finance Operations and Project Operations 4+ years' experience working with Microsoft Power BI 4+ years' experience working with enterprise data warehouse/BI projects. … 4+ years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake, Lake House, and Delta Lake Experience Responsibilities: Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics and more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … Technical Skills – Deep hands on experience with the following data technologies: Stack including, Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, primarily power BI Data Lake & Data Mesh implementation The rewards more »

Product Manager (Product Owner Business Analysis Data Lake Data Mesh Datamesh SQL Architecture Big Data AWS Python Dremio Apache Iceburg Iceberg Arrow DBT Tableau PowerBI Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund … London. You MUST have the following: Advanced ability as a Product Owner/Product Manager/Business Aanlyst Extensive exposure to data lake environments Some exposure to data mesh architecture projects Some SQL querying Agile The following is DESIRABLE, not essential: Trading, Front Office finance … of data into the company from external financial data providers. The data is fed into an AWS based datalake and then distributed across the Front Office. This dat... more »

LEAD DATA ARCHITECT All candidates must be located in the UK Are you looking for a company where YOUR VOICE is heard? Where you can MAKE A DIFFERENCE ? Do you THRIVE in a FAST-PACED work environment? Do you wake every morning EXCITED to work with GREAT PEOPLE … teamwork and transparency. We hold each other accountable and always have each other’s back! About the role: We are seeking a Lead Data Architect to oversee the design and implementation of our organization's data architecture. The ideal candidate will have a strong understanding of … governance Experience leading teams of data architects and engineers Strong understanding of data warehousing and data lake principles and technologies Experience with data governance frameworks and tools Excellent communication and collaboration skills Strong problem-solving and analytical skills Diversity more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future! With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … data solutions aligned with business requirements. Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services. Develop, optimize, and maintain data pipelines for automated data integration from … and/or BI Developer. Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake. Strong data engineering and data modeling skills, with the ability to craft complex data models. more »

Senior Data Architect About Mars Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL … Associates into taking action every day towards creating the world we want tomorrow. Job Description: We are searching for an experienced Senior Data Architect to join our team and lead our data architecture initiatives. The ideal candidate will possess a deep understanding of data … techniques, database normalization, and denormalization strategies. Strong understanding of data integration patterns, ETL processes, data warehousing, and data lake architectures. Experience with a variety of database systems, such as relational databases (e.g., SQL Server, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity more »

mission by providing a hugely diverse set of technical solutions and platforms. From supporting critical systems which underpin the UK economy, to evolving data analytics, reinventing our online presence, and introducing a fully digital workplace. Be part of a team that’s constantly evolving, just like our industry.We … deliver services to both the Bank and external users. These include critical systems and services that underpin the UK economy, financial supervision, evolving data analytics, collaboration and research.This role sits within the Technology Strategy and Architecture (TSA) division in the Technology Directorate who are accountable for technical strategy … and experience in architecture modelling toolsDeep domain expertise in cloud scale analytics and experience in one or more technologies e.g. Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Machine Learning, Azure Synapse, Azure ML, Azure Cognitive Services, PowerBIKnowledge and exposure of financial regulation is more »

tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. … their team. In this role, you will have the opportunity to work with cutting-edge technologies such as Bitbucket and AWS Data Lake while collaborating with a team of innovative individuals. As a Data Engineer, your main responsibility will be developing and maintaining data pipelines on Bitbucket using Bitbucket Pipelines. You will also use your knowledge of AWS data lake approaches to optimize performance by implementing Apache Iceberg tables. This is an exciting chance to gain experience in visualisation development using Power BI and working with MS SQL Server more »

This is an exciting opportunity for a Data Architect to join a growing Data & AI team. The successful applicant will work alongside architects and consultants to deliver high-quality data solutions to help customers become more successful in becoming a data-guided … platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage Building conceptual, logical and physical data models … in Data Warehouse methodologies Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI Strong experience in SQL Good understanding of Azure infrastructure more »

This is an exciting opportunity for a Data Architect to join a growing Data & AI team. The successful applicant will work alongside architects and consultants to deliver high-quality data solutions to help customers become more successful in becoming a data-guided … platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage Building conceptual, logical and physical data models … in Data Warehouse methodologies Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI Strong experience in SQL Good understanding of Azure infrastructure more »

will be invaluable. Main Responsibilities: Design and implement effective database solutions and models to store and retrieve data including Data Lake and Data Warehousing Assess database implementation procedures to ensure they comply with GDPR and data compliance Design conceptual and logical … the benefits, pros and cons of solution options. Skills & experience required: Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around Azure Extensive experience in implementing solutions around DataBricks, Azure Data Factory, Azure SQL, CosmosDB, Cognite Services, Storage Accounts, Azure … of working with structured and unstructured datasets Able to design a range of architectural solutions Data models and ETL Data lake and data warehouse end to end architecture Experience within media, publishing, research, or a similar consumer focused industry is highly desirable, but more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global … when needed, accurate and understood. Key Technical Skills required: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server … . Metadata management/Data quality Profile Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server more »

Requirements At least two years of professional experience as a data engineer with a proven ability to provide effective data solutions in a production setting. Knowledge of developing real-time data stream systems (ideally Kafka). Proven track record in developing data systems using PySpark and Apache Spark for batch processing. Capable of managing data intake from various sources, including data streams, unstructured data, relational databases, and NoSQL databases. Extensive knowledge in distributed systems, cloud architecture, and data pipelines. Proficiency in Python … making and client visibility. Play a major role in the development and optimisation of data systems to support our Data Lake/Data Mesh architecture and data processing needs, ensuring the provision of scalable, high-performance data products for more »

the opportunity to share in the success of our business. Job description: Department: RUTM - Corporate Location: London Contract Type: Permanent Reporting to: Business Data Manager Purpose Asset management domain specialist data analyst responsible for building out data workflows to support automation of foundational data domains, RAM business processes and reporting. There will be particular focus on leveraging tools such as Alteryx (low code data science platform), and PowerBI as part of the RAM data strategy to turn RAM into a data driven business. The Role Help … practices advantageous Ability to write SQL code and join data tables. Ability to leverage data from internal data lake and build data models in data tools Experience working with APIs The ability to work autonomously and as part of more »

Job Description Summary The Senior Data Architect is accountable for enabling the technical vision and strategy for the organisations use of data. You will be accountable for defining and maintaining the technical data architecture roadmap offering advise and guidance to business stakeholders. You will ensure that … data architect solutions align with business requirements and data policies and regulations. You will be accountable for the choice of the toolsets required to design, build, manage and maintain the data storage facility within an agreed budget. You will lead a team of people … to deliver a simplified data solution ensuring that data is secure, available, and accurate to business stakeholders. Job Description You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … Informatica or similar ETL/ELT platforms, as well as knowledge of data warehousing, data mart, and data lake concepts and processes Work within the team as directed to automate and improve existing data designs and data models, including more »

Lead Database & ETL Developer looking for an exciting opportunity? Our Technology team at Southern Housing is searching for someone who can expertly manage data across our technology estate, optimising and developing source data systems to the highest quality standards. In this role, you'll take full … ownership of data management, ensuring its consistency throughout our ecosystem. Collaboration is key, as you will work alongside the data community of practice/guild to uphold consistent data practices and set the bar for organisational best practice and lead fellow Data … used to develop new functionality. What youll need Experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management Experience in working with large, heterogeneous datasets in more »

provide data and analytics to the business.They work on a modern Delta Lakehouse tech stack built on Databricks, Azure Data Lake, SQL and Python. This role is very much a hands-on role, and the leadership team are all still very hands-on.The ideal candidate … reporting. * Plus more...Main Skill-Set We are looking for a good mix of the below skills, (not necessarily all of the below): * Azure Delta Lake * Databricks * Azure Data Lake * SQL * PythonMust HavesTo be successful, it is essential you have the following: * 3+ years' experience in a … to successful background checks including a DBS and Credit Check.Job Summary65,000 to 90,000 GBPOther RoleSkills: Delta Lakehouse, Databricks, Azure Data Lake, SQL, Python, Data WarehouseLevel: Senior more »

decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders.Are you passionate about Data and Analytics and excited about how it can completely transform the way an enterprise works … Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal candidate for the role of Solution Architect Data Foundations, in the Enterprise … Architecture function for Global Pet Nutrition (PN) at Mars.The Solution Architect Data Foundations is a strategic leadership role that oversees delivery of cross product transversal data capabilities that is foundational to our success. This role is accountable for the architecture and design andoptimization of data more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £65,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Job Title: Azure Data Engineer (Contract) Duration: 3 months Rate: £400 per day Location: Remote Skills: Databricks/Azure Data Lake/Kubernetes IR35 Determination: Outside IR35 Company Overview: We are seeking a skilled and experienced Azure Data Engineer to join our team … on a contract basis. This is an exciting opportunity to contribute to our data infrastructure and play a key role in ensuring the reliability, efficiency, and performance of our data solutions on the Azure platform. Responsibilities: Design, develop, and implement data solutions using Azure … services, including Azure Databricks, Azure Data Lakes, and other cloud-native technologies. Work closely with cross-functional teams to understand data requirements and translate them into technical specifications. Build and maintain data pipelines, ETL processes, and data warehouses on Azure, leveraging technologies more »