26 to 50 of 237 Permanent Data Lake Jobs in England

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Deltalake, BigQuery, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, Azure ML is a plus Experience with Azure more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … Informatica or similar ETL/ELT platforms, as well as knowledge of data warehousing, data mart, and data lake concepts and processes Work within the team as directed to automate and improve existing data designs and data models, including more »

Role: Senior Data Engineer Job Type: Permanent Location: London (Hybrid) Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing? Are you passionate about Azure Cloud and Python? Are you keen to build your career with a dynamic global IT Consultancy implementing cutting … data transformations, aggregations, and analysis on large datasets. Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with cross-functional teams including data scientists, analysts, and software engineers … Data Engineering, Solution designing and Cloud Computing. in Azure cloud services, particularly Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage. programming skills in Python, with experience developing data processing applications using PySpark. Solid understanding of SQL for data manipulation more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision … to provide specialist services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You … will work closely with various teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision … to provide specialist services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You … will work closely with various teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using more »

Join Ascent and help us do extraordinary things with data for our customers! About Us We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to … create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as … integration solutions Good knowledge of the Azure data engineering stack - Azure Data Factory, Azure Synapse, Azure Data Lake, Azure Blob, Cosmos DB Capability in using Databricks and Informatica Good experience in a general programming – ideally Python Prior experience with Lloyds of London more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »

part of the Top Employer Institute annual listings. We were assessed on several key HR practices including Diversity and Inclusion. Role : Data Lake Engineer Key Responsibilities Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR … and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration of … Computer Science, Engineering, Mathematics or a related field Experience of IT platform implementation in a technical and analytical role Experience of Data Lake/Hadoop platform implementation Hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop ecosystem Experience more »

detriment and business impact through swift and accurate analysis. Additionally, you'll assist the Incident Manager in building and overseeing the reporting and data infrastructure for the Next Customer Service Online Operations across our contact centres. What you’ll be doing: Take ownership of report implementation from understanding … through to development and implementation. Support project with expertise and knowledge of reporting systems advising of best practices and optimum set up of data structures. Create, analyse and then provide accurate management information/reporting and forecasting as required by the department/business on a daily/… Experience of working with Contact Centre Metrics. Experience of change management. Experience in working with Microsoft Azure Platform eco-system ( Azure data lake , Azure data factory, Azure Synapse Analytics , Data bricks , Power BI etc) would be highly desirable. Experience in Data more »

detriment and business impact through swift and accurate analysis. Additionally, you'll assist the Incident Manager in building and overseeing the reporting and data infrastructure for the Next Customer Service Online Operations across our contact centres. What you’ll be doing: Take ownership of report implementation from understanding … through to development and implementation. Support project with expertise and knowledge of reporting systems advising of best practices and optimum set up of data structures. Create, analyse and then provide accurate management information/reporting and forecasting as required by the department/business on a daily/… Experience of working with Contact Centre Metrics. Experience of change management. Experience in working with Microsoft Azure Platform eco-system ( Azure data lake , Azure data factory, Azure Synapse Analytics , Data bricks , Power BI etc) would be highly desirable. Experience in Data more »

on delivering quality services and solutions. Able to distill complex technical challenges to actionable and explainable decisions. Having in-depth knowledge on Azure data components with this feature to provide solutions and necessary recommendations on the architecture. Inspire teams by building consensus and mediating compromises when necessary. Demonstrate … as a new product within a platform & product landscape. Having knowledge on the data components such as Azure datafactory, data lake, Azure SQL DB, Synapse and visualization with expertise skills in terms of performance tuning and advanced troubleshooting. 8+ years of experience in data architecture, analytics, design and development Good working knowledge in trouble shooting data warehouse/analytical systems using Azure Synapse. Strong, in-depth experience in data modelling and experience with business intelligence Design and develop batch and real-time streaming of data loads more »

on delivering quality services and solutions. Able to distill complex technical challenges to actionable and explainable decisions. Having in-depth knowledge on Azure data components with this feature to provide solutions and necessary recommendations on the architecture. Inspire teams by building consensus and mediating compromises when necessary. Demonstrate … as a new product within a platform & product landscape. Having knowledge on the data components such as Azure datafactory, data lake, Azure SQL DB, Synapse and visualization with expertise skills in terms of performance tuning and advanced troubleshooting. 8+ years of experience in data architecture, analytics, design and development Good working knowledge in trouble shooting data warehouse/analytical systems using Azure Synapse. Strong, in-depth experience in data modelling and experience with business intelligence Design and develop batch and real-time streaming of data loads more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology experience. more »

Senior Data Engineer 💰 £80,000-£100,000 🖥️ AWS, Python, Docker 🌍 London, 3 days a week in office We are exclusively partnered with a high growth, early stage startup operating in the beauty and wellness industry (in the UK and now US!) and supporting them on their search for … a Senior Data Engineer. The role... As the company's 1st Data Engineer, you’ll be the central player in building the integrated data architecture from the ground up. You'll gather data from diverse sources, build and maintain data … What you'll be doing... You will gather data from various departments and tools, integrating it into a central data lake or warehouse. You will design and construct data pipelines to automate data flow, involving ETL processes as needed. You will more »

they are always looking to adapt to technological changes to stay at the forefront of the industry About the Role: As a Principal Data Engineer, you’ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across the … organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes. Whilst this is a data engineer role, the focus is on data analytics and migrating … from Tableau to Power BI. Experience/skills required: Proficient in data analysis, data modelling and designing ETL processes. Familiar with Data Mesh architecture and Data Products Highly skilled in T-SQL with experience in performance tuning and dealing with large data more »

term objectives. As an Automation Specialist, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … deploy, particularly focusing on .NET changes and code deployment. Eliminating internal delays in software releases, streamlining processes, and enhancing overall efficiency within the data and architecture function. To be successful in this role, you should have the following skills and experience: Experience automating SQL Deployment into multiple environments more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an additional Snr Data Engineer to join a well established team, this could possibly suit a mid weight Data Engineer who has mentored others. Salary is circa 75K with a 5% bonus There is no sponsorship for this role, sorry. Responsibilities: Guiding a team of developers in the creation, optimization … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. Understanding more »

SME underwriting decisions per month. Responsibilities include: To perform data extraction , manipulation and cleansing techniques within a data lake environment. Support the delivery of strategic initiatives into Credit SME to build scale, reduce manual touchpoints and enhance the controls environment. Providing Portfolio analysis through the … use of analytical methods. Implementation and design of risk management & changes within 3rd party tools i.e. CRM/UD portal etc Utilise customer data to build risk segmentation and mitigation strategies Lead role for supporting SME commercial strategy and input into key working groups across pricing, system development … you have experience in, or comfortable with: Experience in the extraction and cleansing techniques of data held within a data lake environment Develop Credit Risk Strategies supported by Decision Engine Rules, and Scorecards (Nice to have) Working knowledge of other automating solutions (implementation and maintenance more »

Database, Azure App Services, Azure virtual networks, Exchange Online, and Intune Azure security best practices, and Microsoft Defender products and services Protect sensitive data and ensure compliance with data governance standards Work closely with … Data and AI teams to ensure their Azure-based solutions are designed, implemented, and maintained correctly and securely Azure Data Lake, Azure Data Factory and Azure OpenAI Participate in joint projects to integrate Data and AI solutions On Prem Infrastructure Experience more »

Database, Azure App Services, Azure virtual networks, Exchange Online, and Intune Azure security best practices, and Microsoft Defender products and services Protect sensitive data and ensure compliance with data governance standards Work closely with … Data and AI teams to ensure their Azure-based solutions are designed, implemented, and maintained correctly and securely Azure Data Lake, Azure Data Factory and Azure OpenAI Participate in joint projects to integrate Data and AI solutions On Prem Infrastructure Experience more »

Pricing Manager at AXA UK, you'll play a pivotal role in shaping our clear strategic vision, leveraging our current future technologies and data resources. You'll have the opportunity to contribute and manage technical pricing analysts to establish greater pricing sophistication, making our commercial lines of business … more customer centric and data driven. In this influential position, you'll also be collaborating with key stakeholders at all levels to encourage greater adoption of technical and statistical approaches to derive, track, and monitor price and drive forward the right decisions for a range of commercial products. … learning and open source coding languages, to support the increased use of external data and enhanced insights from the data lake, actively sharing best practices. Provide scope for individuals to develop and expand their formal people management skills, as well as coaching and mentoring skills more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

on a 12 month FTC (up to £95K) or day rate (Up to £350) contract. You will be responsible for developing software and data strcuture. Including application production, on budget, timely and compliant. Key responsibilities: Analyse, recommend, develop and maintain new solutions. Continuous improvement of existing solutions and … change recommendation. Security assessments. Review all data and deliver data mapping for use cases. Create … technical requirements and documentation, models for data and ERD review and sign off with HQ. Use CDP to automate data lake and profile design within sandbox environments. Setup BI connections and manage through develop for exports. Your background: Demonstrated experience creating and implementing corporate level more »