26 to 50 of 102 Data Lake Jobs with Hybrid or WFH Options

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … Informatica or similar ETL/ELT platforms, as well as knowledge of data warehousing, data mart, and data lake concepts and processes Work within the team as directed to automate and improve existing data designs and data models, including more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data … tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. more »

Data Architect £80k + Excellent Benefits | Remote: UK Are you a personable and talented Data Architect? Do you thrive on providing vision and hands-on expertise to improve the quality and architecture of company data? If so, we have an exciting opportunity for you … The Company Well-established and award-winning Microsoft partner, committed to excellence in data management. As a Data Architect, you’ll play a crucial role in shaping the future of clients’ data landscape. Your Role As the successful Data Architect, you’ll … bring your expertise to the table: Proven Experience: You have a track record in Data Architecture and Data Engineering. Azure Proficiency: You’re proficient across Azure Data Factory, Synapse/Databricks, and Azure Data Lake. Azure Analytics: You possess good knowledge of more »

and growth of our bespoke development capabilities. Leading design phases on Business IT programmes, validating requirements and ensuring that all aspects of UX, data and solution design are within scope, complete, and deliverable. Having responsibility for the architecture of data and solutions delivered to the business … premise application to the cloud Azure Cloud development, Blazor, NServiceBus, CQRS and Domain-driven design, Scrum/Agile, API Design and management skills Data Engineering projects using Data Lakes, Data factories, ETL techniques, Synapse and PowerBI … MS Logic and Power Apps Azure DevOps Experience with the following would be beneficial: AI + Machine Learning Analytics: Analysis Services, Data Lake Analytics, Data Catalog DevOps: Application Insights Key Competencies Will use a coaching and influencing style to achieve outcomes rather than taking a more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer … Educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an additional Snr Data Engineer to join a well established team, this could possibly suit a mid weight Data Engineer who has mentored others. Salary is circa 75K with a 5% bonus There is no sponsorship for this role, sorry. Responsibilities: Guiding a team of developers in the creation, optimization … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. Understanding more »

Data Analyst | 100% Remote |£35,000-£45,000 KDR is excited to be partnering with a leading Commodities Data Analytics company who are on the lookout for their next Data Analyst. The Company Our client, a global software company providing innovative solutions in data management, data analysis, and business automation within the energy/commodity trading space. Due to ongoing success, they’re seeking a talented Data Analyst to join their dynamic Consulting team focusing on their bluechip clients within energy/commodity trade or risk management operations. … The Role As a Data Analyst you will play a pivotal role in driving the successful delivery of high-quality data projects. Here's what you'll be doing: Become an expert in our client’s data management/analytics platform, in support of more »

Title: Azure Data Engineer Rate: Up to £800 P/D Length: 12 month rolling Location: London (Hybrid) Description (Full spec avail): To work with an established team on developing a new strategic big data platform for our customer, we are searching for a Senior Azure … Engineer. The current Oracle and Java stack will be replaced with a new platform that is an Azure-based data lake with APIs and events to enable data consumption by analytics teams. The needs for this multi-year migration project include engineering to … facilitate the transfer of data masters from the old platform to the new one. Key requirements : CompSci or equivalent degree from a top global university Awareness of and comprehension of Agile approaches, including TDD and BDD knowledge. familiarity with working in agile development teams Excellent written and verbal more »

Unit Testing. Experience with PostgresSQL and NoSQL databases like MongoDB. Knowledge of Powershell. Linux experience is a plus. Familiarity with Azure data lake and data pipelines. Experience with Java or Kotlin (JVM 11+). Knowledge of the Spring Framework, including Spring Boot, Spring Cloud, and more »

Job Title: Data Analyst Location: Devon (2 days per week in the office - this is not fully remote role) Salary: up to £40k About Us: If you are passionate about data, this is an incredibly exciting time to join our team. We are in a period … of transformation as we build our all-new Azure data lake. Leveraging the vast amounts of data captured from our tech, we deliver cutting-edge analytics that drive change across the businesses we serve. We are seeking a dynamic Data Analyst/Scientist to … join our team and help shape the future of our data capabilities. Role Overview: As a Data Analyst/Scientist, you will work as part of our data team, reporting to our Lead Data Analyst/Scientist. You will be responsible for more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data lake. Lead by example, always aiming to work towards software engineering best practice and disaster prevention (rather than recovery). Maintain and optimise the infrastructure across the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years more »

Innovative music client now requires a Data Administrator to join their team and support the day-to-day management of their data processes. This role will support critical functions, ensuring the accuracy and efficiency of our client’s data operations. Key Responsibilities: Oversee the … management of data ensuring daily files are delivered and processed. Monitoring the availability of data within our client’s data lake. Timely analysis and reporting in reference to our client’s data processes. Maintenance of data tables, ensuring they are … ad hoc basis. Identify and analyse where processes can be improved/additional checks could be made. Key Requirements: Strong experience as a Data Administrator working with complex data lakes. Solid SQL experience. (Tableau experience is desirable). Experience with Cloud technologies is desirable (AWS/ more »

looking for someone to help lead the team in this transition. The right person will be both technically capable of working within a Data environment as well as leading a team of BI Developers. The role is suited for a creative and driven individual who can effectively take … making process Work with management to develop the reporting system Develop ETL processes using Kimball methodology Key skills Microsoft Azure, Synapse, Data lake SQL PowerBI Proven experience of leading a team What’s on Offer Up to £60k Salary + Pension Hybrid working -3 days on site more »

team. Job title: Head of Integrations Job type : Full time, Permanent Location: London - Hybrid Qualifications Significant experience of implementing an Enterprise Service Bus, Data lakes and design patterns. Experience with Azure Experience managing a team Experience of automating tasks using Azure Dev-Ops, Terraform, PowerShell, Puppet, C# or more »

A global leader in the design, marketing and distribution of premium lifestyle products is seeking a customer data platform product manager, to join their global customer insights team. You will be responsible for leading the development of their customer data platform. The ideal candidate will understand … customer facing businesses, have ROI-driven digital marketing acumen, be data fluent, and play a pivotal role to bridge the gap between business and technical teams. Responsibilities: Bridge the gap between the business and IT; ensure all requirements are documented, understood, and delivered. Own customer data platform development and product roadmap, promoting its value proposition and communicating new features to internal stakeholders. Manage customer data platform implementation process Partner and collaborate with regional customer insight teams in US and EMEA, managing best practice communication and guidelines. Serve as the first point of more »

My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based … in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels. You'll be responsible for managing a remote engineering team of …/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »

The Data Engineer is an expert in SQL development, supporting data and analytics IT experts in database design, data flow, and data analysis activities. This role is crucial in developing and deploying innovative big data platforms for advanced analytics and … data processing. The Data Engineer defines and builds the data pipelines that enable faster, better, data-informed decision-making within the business. They have deep experience in developing enterprise data management strategies, including operational data stores, data … with data blending technology (eg, Alteryx). Experience with Microsoft or AWS data stack (eg, Microsoft Azure Data Lake, Hadoop with Spark, Cosmos DB, HDInsight/HBase, MongoDB, Redis, Azure Table/Blob stores). Preferred Skills Experience with Databricks, Azure Data more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Role: Data Modelling Job Type: Permanent Location: London (Hybrid) Ready to utilize your Data analysis and Investigatory skills ? Are you passionate about RDBMS systems and converting data requirements into logical models and physical solutions? We have an exciting role for you as a Data … the future of technology. with some of the brightest global minds in the industry. access to endless learning opportunities. The Role As a Data Modeler, you will utilise your analytical skills to design, implement and create conceptual, logical, and physical data models. Key responsibilities: modelling standards … to convert data requirements into logical models and physical solutions. with data warehousing solutions (e.g. Snowflake) and data lake architecture, Azure Databricks/Pyspark & ADF. retail data model standards - ADRM. communication skills, organisational and time management skills. to innovate, support change more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Data Integration Manager A brand new and exciting opportunity has recently arisen for a Data Integration Manager with excellent knowledge in Azure and Salesforce SQL to join one of the UK's most notorious Charities. We're in search of an … experienced Data Integration Manager to lead the smooth integration of data from diverse sources into our Azure Data Lake and Salesforce NFP Cloud. The ideal candidate will oversee the entire data flow process, including cleansing, harmonization, and integration into Salesforce NFP … Cloud and Marketing Cloud. Proficiency in data management technologies, especially Azure Data Lake, Salesforce NFP, and Azure Data Factory, is essential for this role. Skills that are required for a Data Integration Manager are: Expert in Azure Experience working with data more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as more »