301 to 325 of 385 Data Lake Jobs in England

of security controls to Business Risk Owners. The Lead Cybersecurity Analytics Cloud Infrastructure & Site Reliability Engineer will be part of the CSA Platform & Data Engineering … Team, joining a global team of data technology professionals to deliver critical analytics engineering requirements for the strategic cybersecurity data lake and analytics platform. As an HSBC employee in the UK, you will have access to tailored professional development opportunities and a competitive pay and … and object-oriented programming. Expertise in cloud technologies, with a focus on Azure. Deep knowledge of Azure Cloud services, including IAM, Active Directory, Data Factory, Databricks, Functions, Kubernetes, Azure Monitor, and more. Familiarity with PowerBI, Synapse Analytics, and S3 is a plus. This role is based in Sheffield. More ❯

systems, recognizing the ongoing need for hybrid solutions. Centralized Cloud Solutions: Develop centralized solutions for firewalls and DNS management within the Azure environment. Data Warehouse Implementation: Utilize Azure Synapse for data warehousing solutions to support analytics and reporting needs. Migration Strategy: Plan and execute the migration … Experience in designing and implementing cloud networks, including VPNs and hybrid solutions. Familiarity with data management solutions, particularly Azure Data Lake and Azure Synapse. Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment. Excellent communication skills to liaise with More ❯

systems, recognizing the ongoing need for hybrid solutions. Centralized Cloud Solutions: Develop centralized solutions for firewalls and DNS management within the Azure environment. Data Warehouse Implementation: Utilize Azure Synapse for data warehousing solutions to support analytics and reporting needs. Migration Strategy: Plan and execute the migration … Experience in designing and implementing cloud networks, including VPNs and hybrid solutions. Familiarity with data management solutions, particularly Azure Data Lake and Azure Synapse. Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment. Excellent communication skills to liaise with More ❯

Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over … the growth of our business. Responsibilities Guide a team of engineers in developing applications that empower our clients to optimize marketing campaigns through data-driven insights and automated actions, with a specific focus on leveraging LLMs and AI. Own the technical roadmap for your team, aligning it with … and asynchronous APIs. Deep understanding of cloud infrastructure (AWS, GCP) and experience deploying and managing applications at scale. Strong understanding of data lake architectures, including experience with data ingestion, storage, processing, and retrieval of large volumes of structured and unstructured data. Familiarity with containerization technologies More ❯

include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … experience using Azure integration tools like Data factory, Logic Apps, etc. Along with knowledge of utilizing Azure SQL Server, Data lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages: C#/Java/JavaScript/Python, and PowerShell. Thorough … Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology More ❯

Imagine being part of a team where your data analysis skills can impact millions of consumers worldwide. In Fulfillment by Amazon (FBA), you will help third-party businesses (our Selling Partners) leverage the robust data and analytics capabilities that Amazon has built over the last … using FBA, generating over 3 billion units served in the EU last year alone. In this role, you will use your expertise in data engineering, business analytics, and problem-solving to provide critical insights that drive the success of the FBA program and our selling partners. Are you … Key job responsibilities In a typical day, as a Support Engineer, you will: Trace Seller specific defects across upstream systems and data lake to detect, investigate, and fix the root causes (e.g., algorithmic bottlenecks, data quality issues, software flaws). Develop the tools for the More ❯

digital analytics, technologies and tools to integrate, digitalise and analyse fragmented, complex processes - turning them into simplified, actionable information. And as a result, data is transformed into intelligence for the right people, in the right place, at the right time. By bringing clarity to risks, we empower teams … mitigate risks across the entire organisation. We do this by helping them to: Transform current business processes into fully digitalised applications to collect data efficiently. Bring data to life by integrating operational processes with culture, risks, and incidents throughArtificial Intelligence (AI) and Machine Learning (ML). … feedback from leadership, project teams, and clients based on project delivery. Channel feedback and market requirements for continuous improvement. Leverage dss+ data lake to derive thought leadership content. Collaborate with dss+ Marketing team to manage internal and external marketing efforts across various channels. Who you are With More ❯

Senior GCP Data Engineer Start: ASAP Duration: initial 12-month contract Pay: inside IR35, negotiable Location: central London (3-days per week in office) We are looking for a Senior GCP Data Engineer to join its Cyber Security team on a contract basis. You'll be … responsible for delivering high-quality data engineering solutions using Google Cloud Platform, supporting large-scale data ingestion, transformation, and integration projects. Key Responsibilities: - Build and maintain APIs and backend systems - Develop and optimise GCP-based data pipelines (BigQuery, DataFlow, Composer) - Design scalable data models and cloud data lakes - Integrate data from cloud and on-prem sources - Automate infrastructure with Terraform and CI/CD tools - Collaborate with product teams to deliver business value Requirements: - 8+ years in data engineering, with strong GCP expertise - Proficient in More ❯

Senior Data Engineer | Music Industry | Up to £85K | AWS, Python, SQL Are you passionate about music and data ? We're looking for a Senior Data Engineer to build and scale a cutting-edge data platform in the music industry. What You’ll … Do: 🎵 Design & develop robust data pipelines (ETL/ELT) ensuring accuracy & reliability. ☁️ Own & evolve our AWS-powered data platform , integrating multiple sources (databases, APIs, external datasets). 🚀 Optimise performance —tune queries, enhance scalability & streamline infrastructure. 🔍 Work with data modelling & integration , collaborating closely with analysts … stakeholders. 🛠 Tech stack: AWS, Python, SQL, Data Lakes/Warehouses, APIs. What We’re Looking For: ✅ Strong expertise in Python & SQL for data processing. ✅ Experience with AWS services (Lambda, S3, Glue, Redshift, etc.). ✅ Background in building & optimising scalable data platforms . ✅ Knowledge of More ❯

Strong knowledge of Python frameworks (e.g. Flask, Django), data libraries (Pandas, NumPy) Cloud-native experience, especially Microsoft Azure (Functions, Data Lake, etc.) Familiarity with DevOps practices (Git, CI/CD, testing frameworks) Experience with SQL/NoSQL databases and API integration Proven experience working in More ❯

Strong knowledge of Python frameworks (e.g. Flask, Django), data libraries (Pandas, NumPy) Cloud-native experience, especially Microsoft Azure (Functions, Data Lake, etc.) Familiarity with DevOps practices (Git, CI/CD, testing frameworks) Experience with SQL/NoSQL databases and API integration Proven experience working in More ❯

will be responsible for a range of backend systems such as Software applications that include areas such as: Payment Gateway, Settlement, Transaction Fraud Monitoring, Datalake Service and the Core Banking System. You will oversee their deployment, development, enhancements and production operations. You should have extensive experience and skills in Software More ❯

will be responsible for a range of backend systems such as Software applications that include areas such as: Payment Gateway, Settlement, Transaction Fraud Monitoring, Datalake Service and the Core Banking System. You will oversee their deployment, development, enhancements and production operations. You should have extensive experience and skills in Software More ❯

Overview: 3 contract data engineers to supplement existing team during implementation phase of new data platform. Main Duties and Responsibilities: Write clean and testable code using PySpark and SparkSQL scripting languages, to enable our customer data products and business applications. Build and manage data … a structured, trackable and safe manner. Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain. Data Analyse, profile and plan work, aligned with project priorities. Perform reviews of code, refactoring where necessary. Deploy code in a structured, trackable and safe … manner. Document your data developments and operational procedures. Ensure adherence to data/software delivery standards and effective delivery. Help monitor, troubleshoot and resolve production data issues when they occur. Contribute to the continuous improvement of the team. Contribute to the team's ability More ❯

This fantastic institution located in SW London is seeking a dynamic and versatile Data Engineer/Analytics Engineer to contribute to the development, enhancement, and management of their data systems, pipelines, and reporting infrastructure. This role will focus on designing and maintaining efficient data pipelines while building a scalable data warehouse architecture. A major aspect of this position will involve integrating new data sources to create a unified Single Customer View. Additionally, collaboration with the Analytics and Insights teams is essential to ensure they have seamless access to … evolve the Single Customer View to consolidate data from various sources. Demonstrate hands-on experience with Microsoft Azure technologies (including Synapse Analytics, Datalake, Azure SQL), as well as familiarity with DevOps and GitHub practices. Contract Details: Initially a Fixed Term Contract, likely transitioning to Permanent. 1-2 days More ❯

ability to design, develop, and deploy cutting-edge artificial intelligence and machine learning solutions on cloud platforms. You will be familiar with big data tools and technologies for handling large datasets and have hands-on experience with cloud providers like Google Cloud Platform (GCP) . Responsibilities: Utilise cloud … e.g. ) to build and deploy scalable AI solutions. Process and analyse large datasets to train and evaluate AI/ML models. Collaborate with data scientists to optimise model performance and accuracy. Develop and maintain AI/ML pipelines for data ingestion, processing, and model training. Integrate … advancements in AI/ML and cloud technologies. Contribute to the development of AI/ML strategy and best practices. Requirements: Knowledge of data structures, algorithms, and software design principles. Experience with machine learning frameworks: Preferably hands-on experience with cloud platforms (GCP) and their AI/ML More ❯

A prestigious organization based in London is seeking a dynamic and versatile Data Engineer/Analytics Engineer to contribute to the development, enhancement, and management of their data systems, pipelines, and reporting infrastructure. This role will focus on designing and maintaining efficient data pipelines … while building a scalable data warehouse architecture. A major aspect of this position will involve integrating new data sources to create a unified Single Customer View. Additionally, collaboration with the Analytics and Insights teams is essential to ensure they have seamless access to the necessary data … evolve the Single Customer View to consolidate data from various sources. Demonstrate hands-on experience with Microsoft Azure technologies (including Synapse Analytics, Datalake, Azure SQL), as well as familiarity with DevOps and GitHub practices. This role could accommodate 1 visit a month/fully remote for the right More ❯

bottom , and Apollo GraphQL sits in the middle. We keep our data in DynamoDB , Postgres and snowflake for our data-lake using one or the other as best suits a particular workload. You can learn more about our tech stack at While we're looking More ❯

business" with Ramsay - for patients, clinicians, and partners. Working alongside colleagues in our "Digital & Technology" function, along with trusted partners in the infrastructure, data, integration, and AI spaces, you will have great opportunities to lead and shape the future of Ramsay. The role As Cloud Architect, you will … Storage Account, Application Insights Data Factory, Databricks (Unity Catalog, SCIM Provisioning, Permissions, Delta Sharing, multi-workspace management), Storage Account (Data Lake), Power BI Virtual Machines, Bastion, Flow Logging, Log Analytics Workspaces, Event Hub, Diagnostic settings, Backup, Azure Site Recovery, Private Endpoints Benefits 25 Days Leave More ❯

Other Skills/Technologies that you will use and develop in the role: Managing and optimizing Azure Synapse Analytics and Azure Data Lake for large-scale data processing. Overseeing Dynamics 365 (D365) applications and integrating them with other Azure services. Facilitating connectivity between Azure, Azure More ❯

Pro currently has an exciting opportunity for a motivated and detail-orientated individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims … using data ingestion/analysis tools such as Intrali, Quantemplate or Matillion. The project centres on the extraction, transformation and loading (ETL) of data from various sources into data warehouses and data lakes. This is the perfect role for an aspiring Data … Liverpool office. This vacancy however is suitable for an individual who is fully remote and we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing and preparing datasets for analysis. Creation and management of both Risk and More ❯

DATA ENGINEER/£85,000 PACKAGE/LEEDS This Tech For Good business is looking for an experienced data engineer to join their growing, international team. This isn't your normal analyst role, and no 2 days will be the same . The role will be … What do you need: Experience leading a small agile team (SCRUM and Kanban methodologies) Strong experience with AWS services Experience with Snowflake for data warehousing solutions Data Lakes/Big Data Sound like you? No CV is needed at this stage - we can cross More ❯

promise of AI. GX has built specialised knowledge AI assistants for the banking and insurance industry. Our assistants are fed by sector-specific data and knowledge and easily adaptable through ontology layers to reflect institution-specific rules. GX AI assistants are designed for Individual Investors, Credit and Claims … professionals and delivering 10x improvements by supporting them in their day-to-day tasks. Responsibilities: Helping to architect, design, implement, and optimise our data ingestion, transformation, and spreading pipelines and processes. Developing data models, processing pipelines, and back-end services supporting the data science … building integrations, and analytics. Desired skills: A university degree in Mathematics, Computer Science, Engineering, Physics or similar. 5+ years of relevant experience in Data Engineering, warehousing, ETL, automation, cloud technologies, or Software Engineering in data related areas. Ability to write clean, scalable, maintainable code in Python More ❯

key applications such as Rydoo, Unit4, Cash Up App and Anaplan. ABP also builds and maintains integrations between these applications, our data lake and pipelines for processing financial and property data. With Finance, our continued mission is to transform and modernise their financial processes, be that via More ❯

a collaborative, forward-thinking setup. Why it’s worth your time: Join a product-led company that’s doubling down on innovation – AI, data lakes, and more are incoming Remote-first culture, with the chance to travel to meet-ups and team events when it makes sense You More ❯