1 to 25 of 224 Data Lake Jobs in England

Data Architect SQL, PowerBI, Azure synapse data warehouse, ETL Leading data transformation & strategy within the business Southampton based 2-3 days per week Spectrum IT has partnered with a leading green energy consultancy who supports and empowers companies with the journey to net zero. … having impacts across the education sector, parts of the NHS and within private sector companies across the UK. As part of a large Data transformation within the business they are building a new Azure synapse data warehouse and consolidating multiple forms and streams of data into 1 centralised platform. The Data architect will be a crucial part of this project helping to analyse the current data estate, identify opportunities and weaknesses then build a roadmap for the data strategy. Key Skills: Highly advanced level of SQL querying more »

Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits Up to 10% matched pension scheme with Standard Life Death in Service: 4 x salary Annual Car Parking permit Purchase monthly during … Children under the age of 24 can be covered free of charge. Skills Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences Experienced in working Microsoft Cloud Data and Automation technologies Experienced working with Tableau and or Power BI Experienced in data more »

have been supporting professionals from the entertainment space for the past century. Lead a team of internal and 3rd party Application, Integration and Data Engineers to deliver world-class solutions for the organisation to manage its business activities, through understanding the business requirements and translating into technical solutions. … you will excel in this role: Integration Application architecture and design Azure cloud-based infrastructure solutions Azure Integration services, Azure API management Azure Data Lakes, Azure Synapse Networking, security and storage technologies Delivering a microservices architecture Developing and implementing RESTful APIs, microservices and UIs XML, JSON, Web APIs more »

AWS Data Architect/Enterprise Architect | Contract | Initial 6 months London - 3x a week Length: Initial 6 months Contract, Inside IR35 Delivery of AWS-based data & analytics capabilities, built on foundational services such as EMR, Glue, MWAA, Dynamo, Kinesis, Kafka and Sagemaker AWS Cloud Data Platforms Architecture and AWS Cloud Security & Infrastructure Insurance or Regulated Financial Services Industries Solutioning within a modern data architecture context such as data fabric or data mesh, and of cornerstone data & analytics capabilities (including data lakes, data more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »

Job DescriptionAre you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future!With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that … scalable data solutions aligned with business requirements.Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services.Develop, optimize, and maintain data pipelines for automated data integration from various … Engineer and/or BI Developer.Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake.Strong data engineering and data modeling skills, with the ability to craft complex data models.In-depth more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future! With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … data solutions aligned with business requirements. Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services. Develop, optimize, and maintain data pipelines for automated data integration from … and/or BI Developer. Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake. Strong data engineering and data modeling skills, with the ability to craft complex data models. more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as: Azure SQL Data Warehouse, Azure Data Lake, AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e. Hadoop Hive, Pig, Impala or … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as: Azure SQL Data Warehouse, Azure Data Lake, AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e. Hadoop Hive, Pig, Impala or … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

Job DescriptionLead Data Engineer:We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experience Job description:Building new data pipelines and optimizing data flows using the Azure cloud stack.Building data products … from scratch.Support Business Analysts and Data Architects with discovery and best practices.Self-directed and comfortable supporting the data needs of multiple teams, systems and products.What’s required ?Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.Experience building and … Analytics in Azure Synapse Analytics, Azure Analysis ServicesData Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream AnalyticsExperience with Object-oriented/object function scripting languages: Python preferred more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … more consecutive yearsHave practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similarHave experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similarHave experience … function scripting languages such as Python, Java or similarHave expertise in data modelling, data warehouse design and data lake concepts and practices.Additional InformationThis role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester, or Newcastle more »

What can you expect as a Senior Azure Data Engineer... Working for a respected Microsoft Solutions Partner that will help you gain Microsoft certifications; Joining a rapidly expanding and innovative organisation with exciting plans for 2024, that will give you the freedom to grow as an Azure Data … Working with clients across various industries on exciting projects that will see you utilising the latest products within the Microsoft Azure and SQL Data analytics stack; A flat hierarchy and no-door policy. You won’t have a “manager” but a mentor who will help you grow from … experience working with one or more of the following Azure data services (ADS): Azure Data Factory, Azure Data Lake Store and Azure Data Lake Analytics with uSQL, Azure Databricks, Azure SQL DB and Azure SQL DW/Azure Synapse Analytics more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 15 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »

Azure Developer (C#, DevOps, Data Lake, Logic Apps) Havant, Portsmouth (1-2 days per week in the office). £45000 - £62000 + Benefits Your new company I’m working with an energy provider with a focus on modern DevOps practices that have considerably grown their Development team … Azure Developer strong fundamental C#. Deep knowledge of Azure is essential – Azure DevOps (Functions, Redis, Service Bus etc), plus knowledge of Data Lake, Logic Apps, Power BI etc. Working here you’ll use the latest versions of .Net daily to build complex applications. You should have good more »

Job DescriptionData Integration ManagerA brand new and exciting opportunity has recently arisen for a Data Integration Manager with excellent knowledge in Azure and Salesforce SQL to join one of the UK's most notorious Charities.We're in search of an … experienced Data Integration Manager to lead the smooth integration of data from diverse sources into our Azure Data Lake and Salesforce NFP Cloud. The ideal candidate will oversee the entire data flow process, including cleansing, harmonization, and integration into Salesforce NFP … Cloud and Marketing Cloud.Proficiency in data management technologies, especially Azure Data Lake, Salesforce NFP, and Azure Data Factory, is essential for this role.Skills that are required for a Data Integration Manager are:Expert in AzureExperience working with data flowsGreat more »

Job DescriptionSenior Data Engineer- Fast growing SaaS Scale up 🚀West Midlands- hybrid working Up to £86K base with bonus and benefitsThe clientSaaS Software business platform which is revolutionising financial management for their customers.Responsibility:Working to ensure a high-quality data platform.Design, develop, test … and deploy data pipelines and integrations using IPaaS technologyCollaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystemWillingness and an enthusiastic attitude to work within existing processes/methodologies.Collaborate with the DevOps … Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. ExperienceData Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores.Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory, Apache Airflow, Logic more »

Job DescriptionLead Data Engineer - Azure/Spark/DatabricksRole: Lead Data EngineerLocation: London (3 days a week)Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In this … engineering stack. Key Responsibilities:Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks.Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices.Lead and mentor a team of … effectively with remote teams, leveraging your experience in leading distributed teams to drive success.Requirements:Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks.Proficiency in coding with Spark and a strong understanding of design aspects.Deep understanding of engineering best practices and the ability to implement more »

design a comprehensive plan for implementation.Responsibilities: Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform.Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis … of large-scale data.Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform.Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness.Provide guidance … platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or Google Cloud Platform (e.g., Cloud Storage, BigQuery).Deep understanding of cloud computing concepts, including infrastructure as code, serverless computing, and containerization.Expertise in more »

Job DescriptionI am searching for a talented Data Architect to join my client, a leading Fintech company in London.In this exciting role, you'll be responsible for designing, developing, and implementing the data architecture that forms the backbone of their data-driven strategy. You … ll work closely with stakeholders across the business to understand their needs and translate them into robust, scalable data solutions.Job Title: Data Architect Location: London (Hybrid)Salary: £95,000 - £100,000Industry: FintechStart: ASAPWhat you'll be doing:Design and develop enterprise-level data architectures … and solutions.Select and implement appropriate data management tools and technologies.Ensure data quality, consistency, and security across the organization.Collaborate with data engineers and analysts to deliver successful data projects.Stay up-to-date on the latest trends and technologies in data architecture.Requirements more »

Databricks - £70-75,000 - London/HybridScalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function.They are looking for a Data Engineer to join them to work on … building a brand new data platform which is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer and more consistent. This role would suit someone who … years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etcExperience with SQL is a must, some Python is a bonusExperience of working with a number of different data sources would be more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an a mid -weight Data … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. (You more »

Job DescriptionRole - Azure Data EngineerRate - £600 per day insideHybrid working - 1 day a week onsite (Centre of London)Duration - Initial 6 monthsMy client is a large Financial services organisation based out of London and they are going through a huge data transformation that is expected to … run for at least 18 months.My client is seeking experienced Azure Data Engineers for a stakeholder-facing project. This role will have particular emphasis on Azure, Databricks and DevOps. Our client is in the consultancy sector but does not have a preference for previous experience within a consultancy … project. There is a massive emphasis on Pyspark and Databricks for this particular role.Technical Skills Required:Azure (ADF, Functions, Blob Storage, Data Lake Storage, Azure Data Bricks)DatabricksSparkDelta LakeSQLPythonPySparkADLSDay To Day Responsibilities:Extensive experience in designing, developing, and managing end-to-end data more »

in the UK and abroad. This will be s a great opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real … be up to?:Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse.Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed.Modern tech stack … several teams, this is key as you will be reporting directly to the CTO.2 + years of programming language experience (e.g. Python, SQL)Data modeling/ETL tool experience A startup/greenfield mentalityWhat's in it for you?:Hybrid workingPrivate healthcare and wellness supportEmployee Discount: 75% discount more »