Data Lake Jobs

1 to 25 of 119 Data Lake Jobs

Data Platform Manager

London, England, United Kingdom
dmg media
Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically … many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … Required Demonstrable experience of working with Databricks Demonstrable experience with and knowledge of Azure components - Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure Synapse etc. Demonstrable experience in Azure Devops/any relevant tools. Experience in any IAC tools. Bachelor's degree in more »
Posted:

Data Architect

London, United Kingdom
Confidential
Technologies: Enterprise Data Architect Data Engineer Financial Services Insurance Our client, one of the worlds largest commercial insurance companies with operations in 54 countries and territories has a need for a skilled Data Architect/Data Engineer to join its London based … team. The role is 3 days onsite and 2 days remote. The role: Do you have data engineering or architecture experience within the financial services industry? If you are interested in growing your skills and career within one of the largest commercial insurers in the world, then we … functional data management solutions Hands-on experience architecting and implementing large scale multi field master data management, data lake, business intelligence, data warehouse, and data quality solutions are a must have. Experience in architecting enterprise knowledge graph capability from more »
Posted:

Senior Data Engineer

Penrith, Cumbria, United Kingdom
Hybrid / WFH Options
Computer Futures
working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £66,000 + Great Benefits Purpose of Job Advise on and ensure the maximum return of value from the company's … Engineers. Providing Technical guidance to Data Engineers Knowledge, Experience and qualifications Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation more »
Employment Type: Permanent
Salary: £45000 - £66000/annum Great Benefits
Posted:

Data Engineer

London, United Kingdom
Confidential
for designing, developing, and maintaining data pipelines and systems in Azure Cloud environments, with a strong emphasis on Azure Data Lake, Azure Data Factory, and Microservices architecture. Key Responsibilities: Develop and maintain data pipelines in Azure Cloud environments, leveraging Azure Data Lake, Azure Data Factory, and Microservices architecture. Design and implement scalable and efficient data processing solutions using technologies such as ServiceBus, REST API, App Service, SQL Data Warehouse, and Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch … engineering. Bachelor s Degree or higher in Computer Science or a related field. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL more »
Posted:

Azure Data Engineer

London, United Kingdom
Confidential
Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … data solutions aligned with business requirements. Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services. Develop, optimize, and maintain data pipelines for automated data integration from … and/or BI Developer. Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake. Strong data engineering and data modeling skills, with the ability to craft complex data models. more »
Posted:

Data Engineer

Manchester, North West, United Kingdom
Hybrid / WFH Options
Adria Solutions
tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. … their team. In this role, you will have the opportunity to work with cutting-edge technologies such as Bitbucket and AWS Data Lake while collaborating with a team of innovative individuals. As a Data Engineer, your main responsibility will be developing and maintaining data pipelines on Bitbucket using Bitbucket Pipelines. You will also use your knowledge of AWS data lake approaches to optimize performance by implementing Apache Iceberg tables. This is an exciting chance to gain experience in visualisation development using Power BI and working with MS SQL Server more »
Employment Type: Permanent, Work From Home
Salary: £60,000
Posted:

Senior Data Architect

London, United Kingdom
Hybrid / WFH Options
Confidential
will be invaluable. Main Responsibilities: Design and implement effective database solutions and models to store and retrieve data including Data Lake and Data Warehousing Assess database implementation procedures to ensure they comply with GDPR and data compliance Design conceptual and logical … the benefits, pros and cons of solution options. Skills & experience required: Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around Azure Extensive experience in implementing solutions around DataBricks, Azure Data Factory, Azure SQL, CosmosDB, Cognite Services, Storage Accounts, Azure … of working with structured and unstructured datasets Able to design a range of architectural solutions Data models and ETL Data lake and data warehouse end to end architecture Experience within media, publishing, research, or a similar consumer focused industry is highly desirable, but more »
Posted:

Data Engineer

London, United Kingdom
Confidential
ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … Purview or another governance tool experience. Familiar with building Catalogs and lineage Lead Azure Data Engineer PySpark (Python), Synapse, Data Lake Tech for Good/Charity more »
Posted:

Principal Data Engineer

Preston, Lancashire, United Kingdom
Hybrid / WFH Options
Uniting Ambition
Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their … team and be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data … role 3+ years GCP experience Data Ingestion & Transformation BigQuery experience advantageous but not essential. Extensive experience with SQL and Data Lake/Warehouse solutions Strong proficiency in languages such as SQL, Python, Java or Scala In-depth knowledge of query optimization techniques and experience in more »
Employment Type: Contract
Rate: £85000/annum
Posted:

Data Architect

London, United Kingdom
Confidential
Data Architect We are searching for an experienced Data Architect About RSM Consulting brings together multiple teams across Transactions, Risk & Consulting, ABA, and Outsourcing to provide client-centric solutions for RSM s current and future clients within the middle market. Our Consulting team has a major … empower our people to make an impact and develop their own unique career path. About the team and your role Our Digital and Data Advisory practice, as part of our broader Business Transformation client offering, consists of three teams: Digital Finance team working with clients to understand how … Data Tools (SSDT), SQL Server Reporting Services (SSRS), Azure Data Resources, Azure Data Factory, Azure Data Lake, Azure Data Bricks and Azure Analysis Services. Able to support clients and prospects in their evaluation of Business Intelligence solutions providing information more »
Posted:

Data Engineer

Washington, Tyne and Wear, North East, United Kingdom
Baltic Recruitment Services Ltd
Are you an experienced Data Engineer, looking for a new and exciting challenge? Baltic Recruitment are currently recruiting for a Permanent Data Engineer, for a client located in Washington. The Data Engineer will provide vital assistance to the Senior Business and Data Analyst, as part of the overall digital transformation and data analysis team within the business. Data Engineer Duties & Responsibilities: Supporting in the business wide digital transformation process Develop and maintain Microsoft Azure infrastructure in line with business needs Assist in mapping the data … as covered by your contract of employment Data Engineer Applicants: Essential: Microsoft Azure Stack (specifically Data Factory, Data Lake, Databricks) Python (Pandas, NumPy) SQL Microsoft Power Platform Knowledge and experience of a formal project management methodology A high degree of computer literacy Project more »
Employment Type: Permanent
Salary: £40,000
Posted:

Data Lead/Architect

Manchester, North West, United Kingdom
INFUSED SOLUTIONS LIMITED
Data Lead/Architect, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … an approval process in ADO for all schema changes Octopus Deploy and Azure ADO experience Azure experience - designing/implementing a data lake Data modelling - keeping ERD's up to date and assisting the Architecture team with database design Scripting tools such as PowerShell, Experience more »
Employment Type: Permanent
Salary: £75,000
Posted:

AWS Data Architect

London, United Kingdom
Confidential
Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »
Posted:

Data Modeler

London, United Kingdom
Hybrid / WFH Options
Confidential
Role: Data Modelling Job Type: Permanent Location: London (Hybrid) Ready to utilize your Data analysis and Investigatory skills ? Are you passionate about RDBMS systems and converting data requirements into logical models and physical solutions? We have an exciting role for you as a Data … the future of technology. with some of the brightest global minds in the industry. access to endless learning opportunities. The Role As a Data Modeler, you will utilise your analytical skills to design, implement and create conceptual, logical, and physical data models. Key responsibilities: modelling standards … to convert data requirements into logical models and physical solutions. with data warehousing solutions (e.g. Snowflake) and data lake architecture, Azure Databricks/Pyspark & ADF. retail data model standards - ADRM. communication skills, organisational and time management skills. to innovate, support change more »
Posted:

Data Engineer

Newcastle upon Tyne, Northumberland, United Kingdom
Confidential
do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as: Azure SQL Data Warehouse, Azure Data Lake, AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e. Hadoop Hive, Pig, Impala or … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »
Posted:

Data Engineer

Manchester, Lancashire, United Kingdom
Confidential
do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »
Posted:

Data Warehouse Architect (JR100692)

London, United Kingdom
Confidential
a successful, dynamic, and creative global business then we want to hear from you. The Opportunity: We have an exciting opportunity for a Data Warehouse Architect to join a rapidly growing data team in Clarion. The role will report into the Senior Architect, with responsibility to … overcome complex challenges, and grow your design through developing skills with the new initiatives we are looking to explore. Key Responsibilities: Analyse existing data design and suggest improvements that promote performance, stability, and interoperability. Work with product management and business subject matter experts to translate business requirements into … Analytics platform including Azure Synaps Azure Logic Apps, Azure Functions, Azure Storage Azure SQL Data Warehouse, Azure Data Lake, Azure Databricks Azure Cosmos DB, Azure Data Factory, Azure Search, Azure Stream Analytics Delta Lake and Data Lakes Apache more »
Posted:

Senior Engineer, Data Engineering

London, United Kingdom
Confidential
html Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? Position: Lead Data Engineer Lead Data Management and Architecture: Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust data … efficiency, and quality. Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »
Posted:

Azure AI Solutions Architect

London, United Kingdom
Hybrid / WFH Options
Confidential
or Contract Pay Range: Based on experience level GENERAL DESCRIPTION & RESPONSIBILITIES The Azure AI Solution Architect will lead the creation of high-value data driven solutions leveraging Cyclotron s proven implementation methodology and solutions for enterprise projects, as well as contributing to technical pre-sales activities as required. … and implementing Retrieval Augmented Generation (RAG) Information Architecture Data Modeling principles for relational and dimensional data structures Data Lake design principles, Data Virtualization Strong knowledge of data warehouse concepts and T-SQL relational/non-relational databases for data … SQL/SQL Server 2016+ (SQL, Structure, Stored Procs, Tuning) ETL/ELT, (ADF, SSIS) Data governance (Purview, Unity Catalogue) Databricks Delta Lake Storage Azure Dev OPS DESIRED SKILLS Advanced Analytics Data Technologies Databricks, Delta Lake, Synapse Spark SQL, Pyspark Azure Data more »
Posted:

Data Architect

Bristol, United Kingdom
Hybrid / WFH Options
Fusion People Ltd
Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data lifecycle are adequately provisioned. They will also be expected to … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »
Employment Type: Permanent
Salary: £85000/annum company benefits
Posted:

Data Architect

London, United Kingdom
Hybrid / WFH Options
Fusion People Ltd
Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data lifecycle are adequately provisioned. They will also be expected to … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »
Employment Type: Permanent
Salary: £85000/annum company benefits
Posted:

Data Architect

Nationwide, United Kingdom
Hybrid / WFH Options
Fusion People Ltd
Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data life-cycle are adequately provisioned. They will also be expected … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »
Employment Type: Permanent
Salary: £85000/annum Company benefits
Posted:

Data Engineer

Manchester, Lancashire, United Kingdom
Hybrid / WFH Options
Confidential
Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data … tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. more »
Posted:

Principal Data Architect, Consulting

London, United Kingdom
Cognizant
elevate the unique abilities and business aspirations of customers and employees and build relationships based on trust and value. Role Overview The Principal Data Architect will have following responsibilities: Transformational Leadership: Lead and guide the development of cloud data platforms, leveraging your extensive experience to drive … innovation and change. Effective Communication: Collaborate seamlessly with C-suite executives, translating business vision into actionable data initiatives that deliver tangible value. Data Strategy Expertise: Shape robust data strategies that align with organizational goals, emphasizing business intelligence (BI) and AI/ML capabilities. Team … Building: Assemble and nurture high-performing data teams, fostering a culture of excellence and driving multi-million-pound benefits. Solution Implementation: Successfully drive complex, large-scale data solutions from concept to execution. Continuous Learning: Demonstrate a commitment to personal and team growth, staying abreast of industry more »
Employment Type: Permanent
Posted:

Data Migration Developer

Central London, United Kingdom
Hybrid / WFH Options
Syntax Consultancy Ltd
Data Migration Developer (SC Cleared) London (Hybrid) Permanent £7 0,000 - £90,000 (DOE) + Benefits An experienced Data Migration Developer wanted with active SC clearance. This fantastic opportunity will involve playing a dual role as a Migration Specialist and Developer. Hybrid working with the expectation … to write high-quality, maintainable code using languages such as Python, SQL Server. PC, PowerShell, Sharepoint, Azure, Desktop Support , Snowflake, Azure Data Lake services (ALA) Gen 2. Expertise in development, testing Proof of Concepts (PoCs), delivering Minimum Viable Products (MVPs) is essential for achieving project success. Develop … Plan, design, and execute PoCs to validate new technologies, frameworks, or solutions. Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2. Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Familiarity with data more »
Employment Type: Permanent
Salary: £70000 - £90000/annum £70,000 - £90,000 (DOE) + Benefits
Posted:
Data Lake
10th Percentile
£43,750
25th Percentile
£62,500
Median
£90,000
75th Percentile
£129,375
90th Percentile
£148,750