251 to 275 of 338 Data Lake Jobs in England

I am representing a global tech company driven by innovation, who are looking for a talented Data Engineer to join their cutting-edge team. This is a FULLY REMOTE role but will require you to be available to travel occasionally to their London office. You will work on … a very exciting and innovate list of projects for the business and really spearhead a new data platform being built. They are looking for intelligent, self motivated & resourceful problem solvers! Someome who can figure out a problem and work through the best solution. What We're Looking For … including version control (GitHub). A proactive approach to problem-solving, with the ability to identify optimization opportunities and drive continuous improvement. PowerBI Azure Datalakes Github/Version Control What You'll Do: Design, develop, and optimize scalable ELT pipelines, ensuring reliable data delivery from diverse sources such More ❯

I am representing a global tech company driven by innovation, who are looking for a talented Data Engineer to join their cutting-edge team. This is a FULLY REMOTE role but will require you to be available to travel occasionally to their London office. You will work on … a very exciting and innovate list of projects for the business and really spearhead a new data platform being built. They are looking for intelligent, self motivated & resourceful problem solvers! Someome who can figure out a problem and work through the best solution. What We're Looking For … including version control (GitHub). A proactive approach to problem-solving, with the ability to identify optimization opportunities and drive continuous improvement. PowerBI Azure Datalakes Github/Version Control What You'll Do: Design, develop, and optimize scalable ELT pipelines, ensuring reliable data delivery from diverse sources such More ❯

is seeking a software engineer to join their team in Mayfair, London. We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions. Hybrid working is in play, with … days at home. Software Engineer - About the role: My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications … API development RabbitMQ/Message queue PostgreSQL Databricks Containerisation: Docker, Kubernetes CI/CD: Azure DevOps, GitHub Actions Relational databases and data lake architecture Model and data pipeline integration (e.g. MLflow) Microsoft Azure (Functions, Storage, Compute) Monitoring tools (Grafana, Prometheus, etc.) Mentoring and knowledge sharing More ❯

Senior Data Engineer – Snowflake Platform Build Location: London (2 days a week on site) Contract: 6 month sign on (18–24 month project) We’re building the next version of our data platform, with Snowflake at the core. The PoC is in place — now we need … before to lead the implementation and help scale the platform across the business. The project involves migrating our current on-prem Data Lake to Snowflake, while keeping storage on a private cloud . You’ll be setting the foundations: building out ETL pipelines, establishing best practices, and … in Python , PySpark , and Spark Hands-on with platform setup – ideally with a DevOps-first approach Exposure to AWS environments Experience working with data from trading platforms or within commodities, banking, or financial services Tech environment: Primary Platform: Snowflake Other Tech: DBT, Databricks, Spark, PySpark, Python Cloud: AWS More ❯

Senior Data Engineer – Snowflake Platform Build Location: London (2 days a week on site) Contract: 6 month sign on (18–24 month project) We’re building the next version of our data platform, with Snowflake at the core. The PoC is in place — now we need … before to lead the implementation and help scale the platform across the business. The project involves migrating our current on-prem Data Lake to Snowflake, while keeping storage on a private cloud . You’ll be setting the foundations: building out ETL pipelines, establishing best practices, and … in Python , PySpark , and Spark Hands-on with platform setup – ideally with a DevOps-first approach Exposure to AWS environments Experience working with data from trading platforms or within commodities, banking, or financial services Tech environment: Primary Platform: Snowflake Other Tech: DBT, Databricks, Spark, PySpark, Python Cloud: AWS More ❯

having fun in a collaborative environment. Yelp is seeking an entry-level Software Engineer who is excited to work at the intersection of data and backend engineering. In this role, you'll help design and develop systems that power Yelp's advertising platform-from building SDKs for large … scale event ingestion to designing data pipelines that process and analyze those events. You'll be joining the Product Monetization Platform team, which is responsible for collecting and processing ad-related events. Our work supports critical business functions, including billing, analytics, machine learning, and ad serving. This is … for projects, feature enhancements, and bug fixes. Work with large-scale data storage solutions, including Apache Cassandra and various data lake systems. Collaborate with cross-functional teams, including engineers, product managers and data scientists, to understand business requirements and translate them into effective More ❯

be a self-starter who is passionate about discovering and solving complicated problems, learning complex systems, working with numbers, and organizing and communicating data and reports. You will be detail-oriented and organized, capable of handling multiple projects at once, and capable of dealing with ambiguity and rapidly … Information Technology, or a related field Proficiency in automation using Python Excellent oral and written communication skills Experience with SQL, ETL processes, or data transformation Preferred Qualifications Experience with scripting and automation tools Familiarity with Infrastructure as Code (IaC) tools such as AWS CDK Knowledge of AWS services … Business Intelligence Engineer in the team, you will collaborate closely with business partners, architect, design, implement, and BI projects & Automations to build scalable data solutions and analytical insight. You will work with a team of highly motivated business intelligence engineers, Business Analysts and: Contribute to the design, implementation More ❯

Principal Data Engineer – Consulting Location: Leeds, Bristol or London (hybrid) Salary: £90,000 – £105,000 (depending on experience) + bonus + benefits NOTE: Candidates for this role must be eligible for UK Security Clearance. Are you passionate about designing modern data solutions that drive real business … value? We're looking for an experienced, hands-on Principal Data Engineer to join our growing consulting practice. This is a fantastic opportunity to work across greenfield projects, collaborating closely with clients to deliver scalable, cloud-native data platforms and pipelines. About the Role You’ll … lead the design and implementation of cutting-edge data architectures using AWS technologies such as Redshift, S3, Lambda, Glue, Step Functions, and Matillion. Your role will include liaising with stakeholders to shape technical solutions, driving delivery excellence, and ultimately empowering clients to take ownership of their platforms. We More ❯

The Apprentice will be involved with analysing financial data, identifying trends and creating models that present results in an informative and visual way. You will develop database skills to be able to interpret and relay data confidently and clearly to others. You will become an expert … cloud-based financial software and applications in our portfolio, in order to build some basic reports that look for trends and present key data to be shared with clients. Observe and participate with database management in data warehouses and data lakes for consolidation of … client systems and data. Handle client support queries on their data issues and participate in scoping meetings with clients to ascertain their needs. Observe and support with software launches and integrations and learn the process of moving data from source to warehouse via middleware and API. More ❯

of the Master Systems Integration service. This might involve ensuring that projects contribute to the development and implementation of ontologies, technical submittal reviews, data migration processes, and program development. Compliance with Security Standards: The Project Manager is responsible for ensuring that data migration processes are conducted … Good understanding of networking principles. Knowledge of working in AWS, GCP and migration of data from building outputs to data lake an advantage. Must have excellent verbal and written communication skills. Strong interpersonal skills and an ability to deal with both internal and external customers. … project budgets effectively and efficiently allocate resources. Technical Proficiency: Understanding of MSI Concepts: Familiarity with Master Systems Integration concepts and practices, including ontologies, data migration, and technical submittal review. Technical Background: A background in a technical field related to systems integration, information technology, or a relevant domain. Security More ❯

Lead BI Developer Lead BI Developer - Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps, SQL Development, Power BI, ETL/ELT, Data Pipelines - Hybrid (Warrington) - £60-70k + excellent bonus + bens An experienced More ❯

TrueNorth are working with a growing e-commerce company that are looking for I'm currently a Staff Data Engineer to join them on an initial 6-month contract (with strong potential to … extend). This is a fully remote role and sits outside IR35. Key Requirements: Significant experience designing and scaling cloud-based data lake architectures (ideally Delta Lake on Databricks or similar) Deep expertise in workflow orchestration using Airflow, with production-grade DAGs and solid dependency management … is preferable Strong background in building reliable, scalable batch and streaming pipelines using Spark (ideally Scala) Python and SQL Hands-on experience implementing data quality, observability, and lineage systems across distributed environments Proven leadership in technical design, platform adoption, and mentoring engineers on best practices The role can More ❯

Senior Data Engineer - Contract - London A Senior Data Engineer is required by a Reinsurance broker to design, implement, and maintain data solutions in their Azure cloud platforms. You will need extensive experience in SQL, NoSQL, Data Lakes, Data Mining, DML … DQL, Data Modelling, and Scripting. This is a hybrid contract role. Sound like a bit of you? Then get involved. More ❯

Senior Data Engineer - Contract - London A Senior Data Engineer is required by a Reinsurance broker to design, implement, and maintain data solutions in their Azure cloud platforms. You will need extensive experience in SQL, NoSQL, Data Lakes, Data Mining, DML … DQL, Data Modelling, and Scripting. This is a hybrid contract role. Sound like a bit of you? Then get involved. More ❯

should have expertise in designing and developing with various Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure, integration, and data management. Experience in industries such as pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Knowledge of healthcare industry regulations, data … GitHub, MS Teams, etc. Experience with Azure integration tools like Data Factory, Logic Apps, and utilizing Azure SQL Server, Data Lake, etc. Proficiency in Visual Studio and programming languages such as C#, Java, JavaScript, Python, and PowerShell. Understanding of the architecture of cloud and on More ❯

of security controls to Business Risk Owners. The Lead Cybersecurity Analytics Cloud Infrastructure & Site Reliability Engineer will be part of the CSA Platform & Data Engineering … Team, joining a global team of data technology professionals to deliver critical analytics engineering requirements for the strategic cybersecurity data lake and analytics platform. As an HSBC employee in the UK, you will have access to tailored professional development opportunities and a competitive pay and … and object-oriented programming. Expertise in cloud technologies, with a focus on Azure. Deep knowledge of Azure Cloud services, including IAM, Active Directory, Data Factory, Databricks, Functions, Kubernetes, Azure Monitor, and more. Familiarity with PowerBI, Synapse Analytics, and S3 is a plus. This role is based in Sheffield. More ❯

systems, recognizing the ongoing need for hybrid solutions. Centralized Cloud Solutions: Develop centralized solutions for firewalls and DNS management within the Azure environment. Data Warehouse Implementation: Utilize Azure Synapse for data warehousing solutions to support analytics and reporting needs. Migration Strategy: Plan and execute the migration … Experience in designing and implementing cloud networks, including VPNs and hybrid solutions. Familiarity with data management solutions, particularly Azure Data Lake and Azure Synapse. Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment. Excellent communication skills to liaise with More ❯

systems, recognizing the ongoing need for hybrid solutions. Centralized Cloud Solutions: Develop centralized solutions for firewalls and DNS management within the Azure environment. Data Warehouse Implementation: Utilize Azure Synapse for data warehousing solutions to support analytics and reporting needs. Migration Strategy: Plan and execute the migration … Experience in designing and implementing cloud networks, including VPNs and hybrid solutions. Familiarity with data management solutions, particularly Azure Data Lake and Azure Synapse. Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment. Excellent communication skills to liaise with More ❯

digital analytics, technologies and tools to integrate, digitalise and analyse fragmented, complex processes - turning them into simplified, actionable information. And as a result, data is transformed into intelligence for the right people, in the right place, at the right time. By bringing clarity to risks, we empower teams … mitigate risks across the entire organisation. We do this by helping them to: Transform current business processes into fully digitalised applications to collect data efficiently. Bring data to life by integrating operational processes with culture, risks, and incidents throughArtificial Intelligence (AI) and Machine Learning (ML). … feedback from leadership, project teams, and clients based on project delivery. Channel feedback and market requirements for continuous improvement. Leverage dss+ data lake to derive thought leadership content. Collaborate with dss+ Marketing team to manage internal and external marketing efforts across various channels. Who you are With More ❯

Senior GCP Data Engineer Start: ASAP Duration: initial 12-month contract Pay: inside IR35, negotiable Location: central London (3-days per week in office) We are looking for a Senior GCP Data Engineer to join its Cyber Security team on a contract basis. You'll be … responsible for delivering high-quality data engineering solutions using Google Cloud Platform, supporting large-scale data ingestion, transformation, and integration projects. Key Responsibilities: - Build and maintain APIs and backend systems - Develop and optimise GCP-based data pipelines (BigQuery, DataFlow, Composer) - Design scalable data models and cloud data lakes - Integrate data from cloud and on-prem sources - Automate infrastructure with Terraform and CI/CD tools - Collaborate with product teams to deliver business value Requirements: - 8+ years in data engineering, with strong GCP expertise - Proficient in More ❯

and data. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data security and compliance standards (e.g. GDPR), and EDI standards (e.g. FHIR, HL7) is very valuable. Developer certifications of Azure and/or Microsoft suite … development experience using Azure integration tools like Data Factory, Logic Apps, along with knowledge of utilizing Azure SQL Server, Data Lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages: C#/Java/JavaScript/Python, and PowerShell. Thorough … Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data Verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology More ❯

Strong knowledge of Python frameworks (e.g. Flask, Django), data libraries (Pandas, NumPy) Cloud-native experience, especially Microsoft Azure (Functions, Data Lake, etc.) Familiarity with DevOps practices (Git, CI/CD, testing frameworks) Experience with SQL/NoSQL databases and API integration Proven experience working in More ❯

Strong knowledge of Python frameworks (e.g. Flask, Django), data libraries (Pandas, NumPy) Cloud-native experience, especially Microsoft Azure (Functions, Data Lake, etc.) Familiarity with DevOps practices (Git, CI/CD, testing frameworks) Experience with SQL/NoSQL databases and API integration Proven experience working in More ❯

We are currently recruiting for a Data Engineer with hands-on experience of Azure and Insurance experience to join one of our Global Insurance Clients on a 6-month contract. Please note, this role is Inside IR35 with travel to London 1 day a week (Mondays). Key … Responsibilities: Design, build, and maintain robust data pipelines to curate and ingest data efficiently. Work with Azure cloud services to deploy and manage scalable data solutions. Implement and maintain CI/CD pipelines for seamless data workflows. Collaborate with cross-functional teams … to ensure data integrity, security, and accessibility. Key Skills & Experience: Strong programming skills in Python (PySpark). Hands-on experience with Azure Data Services (Azure Data Factory, Databricks, Synapse, Data Lakes, etc.). Experience with CI/CD pipelines for release management. More ❯

will be responsible for a range of backend systems such as Software applications that include areas such as: Payment Gateway, Settlement, Transaction Fraud Monitoring, Datalake Service and the Core Banking System. You will oversee their deployment, development, enhancements and production operations. You should have extensive experience and skills in Software More ❯