Data Lake Jobs in England

76 to 100 of 218 Data Lake Jobs in England

Senior Azure Data Engineer

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Senior Data Engineer - Azure & Snowflake

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Senior Data Engineer - Azure

City of London, London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »
Employment Type: Permanent
Salary: £70000 - £85000/annum
Posted:

Java Solutions Architect Engineering Trading Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Solutions Architect Engineering Trading Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Team Lead Software Engineer Developer Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … asset classes such as Fixed Income, equities, FX or commodities Role: Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Site Reliability Engineer SRE AWS Big Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial Services Hedge Fund) required by our asset management client … Good Python, JavaScript, Java or Go Terraform SRE experience in an enterprise scale environment The following is DESIRABLE, not essential: SRE for big data Glue, Athena, Dremio, Iceberg, Snowflake … DBT, Arrow, gRPC, protobuf, Airflow, Ignite Graffana, Prometheus Role: Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

REMOTE Site Reliability Engineer SRE AWS Big Data London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
REMOTE Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial Services Hedge Fund DevOps) required by our asset … Good Python, JavaScript, Java or Go Terraform SRE experience in an enterprise scale environment The following is DESIRABLE, not essential: SRE for big data Glue, Athena, Dremio, Iceberg, Snowflake, DBT … Arrow, gRPC, protobuf, Airflow, Ignite Graffana, Prometheus Role: REMOTE Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

AWS Data Architect

London, United Kingdom
Stott & May Professional Search Limited
Stott and May are looking for an experienced Data Architect that specialises in AWS. CONTRACT HYBRID - 3 days per week in London Start: ASAP Duration: 6-months (extensions) Your role: - Define the portfolio of enterprise data products being delivered on AWS - Deliver and maintain logical and … architectural patterns composing their data products. Technical experience required: - AWS- based data: EMR, Quicksight, Glue, MWAA, Dynamo, Kinesis, Kafka - Azure Datalake - AWS cloud data platform security and infrastructure Non-Technical skills required: - Stakeholder management, you'll be in direct contact with end client - Communication more »
Employment Type: Contract
Rate: £640 - £700 per day
Posted:

Application Manager

Central London, London, United Kingdom
Hybrid / WFH Options
Franklin Bates Limited
have been supporting professionals from the entertainment space for the past century. Lead a team of internal and 3rd party Application, Integration and Data Engineers to deliver world-class solutions for the organisation to manage its business activities, through understanding the business requirements and translating into technical solutions. … you will excel in this role: Integration Application architecture and design Azure cloud-based infrastructure solutions Azure Integration services, Azure API management Azure Data Lakes, Azure Synapse Networking, security and storage technologies Delivering a microservices architecture Developing and implementing RESTful APIs, microservices and UIs XML, JSON, Web APIs more »
Employment Type: Permanent, Work From Home
Salary: £65,000
Posted:

Senior Data Engineer

London Area, United Kingdom
Lorien
Our client within the Education sector are looking for a Senior Data Engineer to join them on a contract basis. Inside IR35 … month contract Hybrid 1 – 2 days per week onsite Technical Skills: In depth knowledge of relevant Azure services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Stream Analytics, etc. Strong Python or Scala with Spark … and analytics. Apache Spark: Deep understanding of Apache Spark for large-scale data processing. Azure Blob Storage and Azure Data Lake Storage: Expertise in setting up and optimizing Azure Data Lake Storage for storing and managing large volumes of data. Cloud Experience more »
Posted:

Senior Data Architect

Manchester Area, United Kingdom
TalkTalk
Job Description Summary The Senior Data Architect is accountable for enabling the technical vision and strategy for the organisations use of data. You will be accountable for defining and maintaining the technical data architecture roadmap offering advise and guidance to business stakeholders. You will ensure that … data architect solutions align with business requirements and data policies and regulations. You will be accountable for the choice of the toolsets required to design, build, manage and maintain the data storage facility within an agreed budget. You will lead a team of people … to deliver a simplified data solution ensuring that data is secure, available, and accurate to business stakeholders. Job Description You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across more »
Posted:

Azure Data Engineer

Manchester Area, United Kingdom
CODA Technology Services
We are currently looking for an Azure Data Platforms Engineer on a contract basis (OSIR35) for a global retail organisation. The project will to deliver a foundational data platform to enhance data-driven decision-making and performance analytics.They will play an important role in … and data integration processes using Azure services such as Azure Data Factory, Azure Synapse Analytics and Azure Data Lake Storage. Responsibilities: Collaborate with solution/data architect to design and implement scalable, secure data infrastructure using Azure services. Develop … and support. Skills/Experience required: Proficiency in Azure services, particularly Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage. Strong understanding of data integration processes and tools. Knowledge of data security measures, including Azure Active Directory integration and more »
Posted:

Senior Data Analyst

Brighton, England, United Kingdom
Hybrid / WFH Options
Study Group
non-technical deliverables. As an integral team member, you will play a key role in advancing Study Group's transition to a more data-driven culture, all while supporting data governance initiatives. ABOUT THE ROLE Undertake simple and complex statistical analysis of a variety of different … establishing and maintaining automated data processes. This will involve working with the Data Architecture Team around the data lake by identifying and revising reporting requirements. Will need to develop and maintain MI/data reports and dashboards. Reports often must be … initiative to manage competing priorities and requirements, whilst ensuring the delivery of key objectives. Ideally, experience using SQL servers, Microsoft Azure Data Lake, or Oracle databases and data warehouses. Highly desirable if there is experience with Alteryx. Highly desirable if there is experience with R more »
Posted:

Data Analyst

London Area, United Kingdom
Hybrid / WFH Options
Brown & Brown Europe
Data Analyst Location: Hybrid - London Package: Negotiable + Benefits The Data Analyst for Data Operations will be responsible for gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality, whilst ensuring delivery deadlines meet business requirements. Working closely with the data operations team, business stakeholders and the wider data team in resolving operational and data issues. The day to day: You will be an experienced analyst who … communication and collaboration skills Experience with data warehousing Experience in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d expect (Holiday, company more »
Posted:

Data Engineer

London Area, United Kingdom
Durlston Partners
𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫 - 𝐌𝐚𝐜𝐫𝐨 𝐇𝐞𝐝𝐠𝐞 𝐅𝐮𝐧𝐝 - 𝐋𝐨𝐧𝐝𝐨𝐧 - 𝐔𝐩 𝐭𝐨 £𝟏𝟓𝟎𝐤 + 𝐁𝐨𝐧𝐮𝐬 Note: I have a plethora of live Data Engineering opportunities. Therefore, even if you don't feel your profile is relevant for the role mentioned below, we encourage you to apply anyway to discuss one of the … other positions. A well established Quant Fund we are working with is looking to develop a new high frequency data platform to support the development and deployment of new strategies. The sort of work you would get exposure to includes … building greenfield market data processing systems that will handle very large amounts of market/exchange data, data lake development using AWS Glue, Apache Kafka/Airflow and dbt, and more traditional end-to-end Data Pipeline development. Lastly, part of more »
Posted:

Data Architect

Coleshill, England, United Kingdom
Hybrid / WFH Options
Mercury
what role you come in and do, we will have a plan targeted to help you advance. What you’ll do As a Data Architect will be required to analyse an array of product offerings and business requirements within Mercury, to create and own the overall data architecture spanning the Mercury product suite. You will work with the product development teams (e.g. Core, Web, Integration, Data Practice and product owners) to evaluate and identify solutions that meet the needs of the business and customers, utilising industry standard best practices, patterns and creative design … support of Microsoft cloud-based services and products including (but not limited to): Azure Fabric Azure Data Factory Azure Data Lake Store Azure Data Lake Analytics Azure Storage Azure AI Search Azure Cosmos DB Azure SQL, Azure DW, Synapse and Azure Analytics more »
Posted:

Data Platform Product Manager | Research & Insights Scale-up | London

London Area, United Kingdom
Harmonic Finance™ | Certified B Corp
About the job Role: Data Platform Product Manager Location: Central London (2 days per week in office) Harmonic is delighted to partner with a high-growth research and insights scale-up, undergoing a phase of rapid expansion. They have grown 20% YoY for the past 5 years, and … following recent investment are continuing to scale. Being a data-led organisation carrying out some extremely interesting work, the data team has a significant role to play in aiding the growth and success of the organisation and offers the opportunity to work on cutting-edge technologies … such as AI and ML. The Data Platform team currently sits at a headcount of 4 but will double to 8 before the end of the year, offering amazing progression opportunities! Job Responsibilities: Directly lead and manage a team of 2 Data Analysts Embrace a visionary more »
Posted:

Python & Power BI Developer

London Area, United Kingdom
Hybrid / WFH Options
Sterlings
BI Developer that has a strong background in Python and Power BI to join the Software Delivery team to strengthen the power of data within the business. The company is moving its data from legacy stores to a strategic data warehouse and data … coding standards, and tools, while also working collaboratively with the team by utilising communication and problem solving skills. Key responsibilities: Ability to build data pipelines that will allow optimal extraction, transformation, and incorporation of data from various data sources. Be able to utilise Power … BI to build dashboards and reports. Understand the Data Virtualisation layer and partner with the Business for continued deployment and Business enhancements. Improve solutions and be able to anticipate where the demand is for the business. Build analytics tools that utilise the data pipeline to provide more »
Posted:

Lead Data Engineer

London, United Kingdom
Hybrid / WFH Options
Methods Consulting
safe, and designed for the future.Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and … public-sector, Methods is now building a significant private sector client portfolio.Methods was acquired by the Alten Group in early 2022.As a Lead Data Engineer at Methods you will be expected to get involved with projects from conception to delivery - leading and supervising other engineers to meet requirements … JSON, Parquet, XML etc.Experience with or developed understanding of the application of ETL/ELT tools.Experience with NoSQL type environments, Data Lakes, Lake-Houses (Cassandra, MongoDB or Neptune).Experience with distributed storage, processing engines such as Apache Hadoop and Apache Spark.Experience with message brokering/stream processing more »
Salary: £ 70 K
Posted:

Lead Data Engineer

London Area, United Kingdom
Talent
Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In … engineering stack. Key Responsibilities: Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices. Lead and mentor a … with remote teams, leveraging your experience in leading distributed teams to drive success. Requirements: Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks. Proficiency in coding with Spark and a strong understanding of design aspects. Deep understanding of engineering best practices and the ability more »
Posted:

Data Architect

London Area, United Kingdom
Talent
Data Architect - Azure/Spark/Databricks Role: Data Architect Location: London (3 days a week) Salary: £100k - £110k A leading technology firm, renowned for connecting people globally, is looking for a skilled Data Architect to join their expanding team. You will be spearheading … Azure-based data solutions and helping them further the development of their award winning data platform. In this pivotal role, you'll be responsible for leading the design and implementation of cutting-edge data solutions. Key Responsibilities: Lead the design and implementation of Azure … data design documents to articulate architecture decisions and implementation plans clearly. Requirements: Strong proficiency in Azure services, including Spark, Data Lake, Synapse, and Databricks. Exceptional stakeholder management skills with the ability to communicate effectively with both technical and non-technical audiences. Experienced and knowledgeable of more »
Posted:

Lead Data Engineer

London, United Kingdom
LinuxRecruit
Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You’d drive out the cloud transformation, taking a lead on all things data related in a Google Premier Partner. You will actively engage with … clients, gathering requirements, creating the appropriate structure for data in ERA data warehouses and develop … robust ETL processes - thus ensuring the integrity of the data. Your role will be instrumental in the creation of a new data lake/warehouse/hub built in GCP. You are confident using the full suite of Google data products, IAC, CI/CD more »
Salary: £ 80 K
Posted:

Client Director

England, United Kingdom
Hybrid / WFH Options
Ice Recruitment Limited
an experienced Business Development Manager with a passion for driving sales and fostering growth? Are you well-versed in any of the following? Data, data warehousing, data lakes,, data engineering, Business Intelligence solutions? A legacy of potential clients waiting to be re … ignited!!! Then, I have an exciting opportunity for you! My client is a leading IT solutions provider specialising in Data, BI and ERP solutions, serving a diverse clientele ranging from FTSE 100 companies. Retail, manufacturing, FTSE500, NHS, Blue Light, and Local Authorities. The mission is to unlock insights … in data, drive performance, and create value by leveraging cutting-edge technology and expertise. As a Senior Business Development Manager, you will play a pivotal role in driving sales and expanding the solutions portfolio. Your responsibilities will include identifying new clients, nurturing relationships with key stakeholders, conducting market more »
Posted:

Solution Architect

England, United Kingdom
Hybrid / WFH Options
Parser
subject matter experts, solving interesting problems, and building the products of tomorrow, this opportunity is for you. On our mission to revolutionize the Data Strategy & Management space, we are seeking a dynamic and seasoned Solution Architect with a stellar track record in Data Products. As our … client navigates the complexities of a legacy IT landscape, we need someone who can not only conceptualize, design and build robust data platforms but also provide strategic guidance and stakeholder management expertise. Leveraging your software engineering expertise, you'll play a pivotal role in ensuring the integrity, efficiency … innovative solutions in challenging environments. Bachelor’s degree in computer science, computer engineering, or a relevant field. Responsibilities: Design and implement scalable database and datalake solutions tailored to client requirements. Evaluate client operations, applications, and programming to identify database structural necessities and ensure alignment with organizational goals. Create robust data more »
Posted:
Data Lake
England
10th Percentile
£42,250
25th Percentile
£57,500
Median
£81,500
75th Percentile
£118,750
90th Percentile
£148,750