101 to 125 of 196 Data Lake Jobs in England

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

the future of Azure solutions with Ascent? If so, we are looking for you. We are looking for Cloud Solution Architects with a Data and AI specialism who are eager to be a part of the team—you'll be instrumental in our mission to leverage technology accelerators … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data … experience in Azure data and AI technologies, like Fabric, Synapse, Databricks, Spark, Python, GitHub, Data Factory, Azure Data Lake, Power BI, Cognitive Services, Purview, etc. Strong data analysis and modeling skills. High-level understanding of Azure infrastructure. Experience with CI/ more »

Database, Azure App Services, Azure virtual networks, Exchange Online, and Intune Azure security best practices, and Microsoft Defender products and services Protect sensitive data and ensure compliance with data governance standards Work closely with … Data and AI teams to ensure their Azure-based solutions are designed, implemented, and maintained correctly and securely Azure Data Lake, Azure Data Factory and Azure Open AI Participate in joint projects to integrate Data and AI solutions On Prem Infrastructure more »

About The Role We are recruiting for a Senior Technical Data Analyst to join our team. Our Technical Data Analysts work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Technical Data Analysts are involved in creating data-specific solutions to ensure we have the right information and data to make informed decisions. Stakeholder engagement is key, and collaborating within your technical squad and alongside colleagues from other professions is fundamental. Your role in a nutshell … Draw actionable insights from multiple, large sources of data and communicate these effectively through reports, dashboards, and presentations. Engage with client stakeholders to understand their business and organizational needs and translate these into clear requirements for your analysis. Identify opportunities for the use of advanced analytics techniques (e.g. more »

A leading Energy & Commodities client is seeking a Senior Data Engineer to join their growing IT team on an initial 6 month contract basis with high chance of extension thereafter to over 12 months. The role requires the individual to work with Solution and Data Architects … to design the next generation Big Data platform to support the digital marketing platform. The role, therefore, doesn't necessarily require Energy or Trading experience. The role is Inside IR35 and will be a couple of days per month onsite in London. Skills Required: Essential experience in Databricks … design and coding skills (e.g. Python, Scala, JavaScript). Experience with Microsoft or AWS data stack e.g. Microsoft Azure Data Lake, Hadoop (preferably with Spark), Cosmos DB, HDInsight/HBase, MongoDB, Redis, Azure Table/Blob stores etc. Exposure to tools like SAP technologies and more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

Chief Information and Data Officer (CIDO/CDIO) - Australia based, will sponsor. Summary: We are proud to offer an exceptional opportunity for a Chief Information and Data Officer, CIDO within an esteemed and well-recognized Education Services provider known globally for enhancing the mobility of learners. … This transformational role is crucial for steering the technology strategy to empower digital and data enablement as the organization advances through a period of dynamic growth and scaling. Basen in Australia, and directly reporting to an innovative CEO, the role involves a significant leadership presence, managing a technology … team of c.40, and driving the digital transformation, data optimisation, product digitisation, and expansion into new international markets. You will join a profitable business that is not only established but experiencing exponential growth with the aim to double its revenue in the next three to five years. This more »

Title: Azure Data Engineer Rate: Up to £800 P/D Length: 12 month rolling Location: London (Hybrid) Description (Full spec avail): To work with an established team on developing a new strategic big data platform for our customer, we are searching for a Senior Azure … Engineer. The current Oracle and Java stack will be replaced with a new platform that is an Azure-based data lake with APIs and events to enable data consumption by analytics teams. The needs for this multi-year migration project include engineering to … facilitate the transfer of data masters from the old platform to the new one. Key requirements : CompSci or equivalent degree from a top global university Awareness of and comprehension of Agile approaches, including TDD and BDD knowledge. familiarity with working in agile development teams Excellent written and verbal more »

Job Title: Data Analyst Location: Devon (2 days per week in the office - this is not fully remote role) Salary: up to £40k About Us: If you are passionate about data, this is an incredibly exciting time to join our team. We are in a period … of transformation as we build our all-new Azure data lake. Leveraging the vast amounts of data captured from our tech, we deliver cutting-edge analytics that drive change across the businesses we serve. We are seeking a dynamic Data Analyst/Scientist to … join our team and help shape the future of our data capabilities. Role Overview: As a Data Analyst/Scientist, you will work as part of our data team, reporting to our Lead Data Analyst/Scientist. You will be responsible for more »

Lead Data Engineer A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. As … the Lead Data Engineer you will be implementing a new CRM (Salesforce) and also leading the migration to Azure. This is an excellent opportunity for an Lead Data Engineer who is looking to work for the Largest UK Charity who are working on exciting projects and … this is the perfect opportunity for you! Skills that are required for a Lead Data Engineer are: Experience in Azure (ADF and Datalake) Experience working with ETL pipelines Previous experience Managing or Mentoring Engineers CRM Implementation experience Lead Data Engineer/Senior Data Engineer more »

time to join this ambitious team!! WHAT YOU'LL BE DOING As Senior Machine Learning Engineer, you will sit within the company's Data Science team and report to the Director of Engineering. Their Machine Learning stack runs on on-demand containerised infrastructure – ranging from sub-second latency … TECH STACK: Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; Azure Synapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES Lead the productionisation of Monolith’s ML models and data processing pipelines, both mid-low-level system and … design and exemplary hands-on implementations using Spark and other tech stacks Shape the ML engineering culture and practices around model & data versioning, scalability, model benchmarking, ML-specific branching & release strategy Concisely break down complex high-level ML requirements into smaller deliverables (epic à task) Proactively identify blockers more »

CENTRAL LONDON – HYBRID (3 DAYS A WEEK) £50,000 - £70,000 A great opportunity for a BI Engineer to bridge the gap between Data Engineering and BI reporting at an asset management firm expanding their data and analytics team. THE COMPANY Join a forward-thinking asset … returns. With a focus on secured loans, high-yield bonds, and structured credit, they operate at the forefront of the financial markets, leveraging data and analytics to drive informed decision-making. THE ROLE AND RESPONSIBILITIES As a BI Engineer, you will be responsible for supporting data … fast-paced environment, working with cutting-edge technologies such as Alteryx, Tableau, SQL, and Python. Responsibilities: Contribute to the setup and maintenance of data infrastructure, including data lakes, warehouses, and SQL Server databases. Utilize your technical expertise in SQL and Python to extract, transform, and analyse more »

AWS, Azure). o Experience with microservices architecture, APIs, and integration patterns. o Proficiency in security architecture and best practices. o Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. o Full Stack Development: Strong background in both more »

of cloud platforms (AWS, Azure). Experience with microservices architecture, APIs, and integration patterns. Proficiency in security architecture and best practices. Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. Full Stack Development: Strong background in both front more »

looking for someone to help lead the team in this transition. The right person will be both technically capable of working within a Data environment as well as leading a team of BI Developers. The role is suited for a creative and driven individual who can effectively take … making process Work with management to develop the reporting system Develop ETL processes using Kimball methodology Key skills Microsoft Azure, Synapse, Data lake SQL PowerBI Proven experience of leading a team What’s on Offer Up to £60k Salary + Pension Hybrid working -3 days on site more »

Senior Azure Data Engineer (Consultancy) £70,000-£80,000 salary Hybrid (London) Immediate start One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out with an urgent … hire for a Senior Azure Data Engineer to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** They have a new project starting in mid-February, so are looking ideally for … interviews next week, and they are looking to have this position filled by next Friday . Essentials: Experience in a consultancy . Azure Data Engineer certification . Experience working with Dynamics 365 Experience with Azure Synapse , Data Factory , Data Lakes 4+ years as a more »

that a truly decentralized future is the best option for our species as we advance. Our core product, the risk rating protocol, uses data found on blockchains, primarily token balances and transactions, to assess the risk of a crypto asset. The purpose of such risk rating is to … enable your immigration to the UK. Job Description : Xerberus is a risk rating protocol; a crucial part of this protocol is to collect data from validators. The protocol combines various technologies but is fundamentally built on the substrate framework. This is no easy undertaking, and you must have … responsibility will be building the on-chain presence of Xerberus. Qualifications and Skills Must haves: Extensive experience with Google Cloud Profound understanding of data lakes Profound understanding of large data sets and data transformation Additionally plus points: Experience with Agile, DevOps, and CICD frameworks more »

team. Job title: Head of Integrations Job type : Full time, Permanent Location: London - Hybrid Qualifications Significant experience of implementing an Enterprise Service Bus, Data lakes and design patterns. Experience with Azure Experience managing a team Experience of automating tasks using Azure Dev-Ops, Terraform, PowerShell, Puppet, C# or more »

A global leader in the design, marketing and distribution of premium lifestyle products is seeking a customer data platform product manager, to join their global customer insights team. You will be responsible for leading the development of their customer data platform. The ideal candidate will understand … customer facing businesses, have ROI-driven digital marketing acumen, be data fluent, and play a pivotal role to bridge the gap between business and technical teams. Responsibilities: Bridge the gap between the business and IT; ensure all requirements are documented, understood, and delivered. Own customer data platform development and product roadmap, promoting its value proposition and communicating new features to internal stakeholders. Manage customer data platform implementation process Partner and collaborate with regional customer insight teams in US and EMEA, managing best practice communication and guidelines. Serve as the first point of more »

the team guiding and leading the python competency within LGIM The increased popularity in Python, creating technical solutions and automating financial processes and data flows has become essential to teams across the business. This multi-faceted role will involve building financial products, advising teams on technical decisions across … technical stakeholders Passionate about continuous development and learning Experience working with front-end languages (e.g. JavaScript, React, HTML, CSS) Experience working with big data and/or data lakes Whatever your role, we reward performance and behaviour with a package that looks after all the things more »

My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based … in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels. You'll be responsible for managing a remote engineering team of …/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »

consulting services elevate the unique abilities and business aspirations of customers and employees and build relationships based on trust and value. The Lead Data Architect will design and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis … Quicksight. We also widely use other tech such as Snowflake, DBT, Databricks, Informatica, Matillion, Airflow, Tableau, Power BI etc. The Lead Data Architect will liaise with clients to define requirements, refine solutions and ultimately hand over to our own Managed Service Teams or to our clients own technical … learn new things and share our ideas, so that clients get the best return on their investments. Essential experience: Shaping & designing solutions (notably data analytics, data integration, data platform) Driving the performance of assurance activity to delivery appropriate quality Leading the production of solutions more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »