326 to 350 of 465 Data Lake Jobs in the UK

manage model lifecycle, versioning and observability. Leverage Azure Machine Learning, OpenAI APIs and multi-agentic frameworks (LangChain, AutoGen, CrewAI) to build intelligent, data-driven experiences. Champion the use of modern AI development tooling (Cursor, GitHub Copilot, Claude) across the engineering team. Voice AI: STT, TTS and Telephony Lead … pipelines, containerisation (Docker, Kubernetes), secrets management and deployment automation. Maintain and optimise MySQL and cloud data services (CosmosDB, Firebase, Data Lake). Ensure query performance and cost efficiency at scale. Establish infrastructure-as-code practices (Terraform, Bicep or equivalent) and enforce security best practices. Implement ...

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Data Analyst to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Senior Data Analyst , you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

skills necessary to help us meet future business challenges. Position not right for you? Share it with someone you know. Business Intelligence Data Architect Reference: MAY20257722 Expiry date: 2025-05-27 22:59:00.000 Location: Ipswich Benefits: BUPA medical, Life Assurance, discounted holidays and cruises plus retail discounts … about making lasting memories for our guests. As we continue to grow, we are strengthening our IT department with a Business Intelligence Data Architect in our Ipswich Head Office. This is an exciting and varied position responsible for designing, developing, and maintaining the data architecture that ...

Barclays in London is seeking a Senior Risk Data Modeller to design and deliver risk data solutions that are scalable, accurate, and governed for regulatory calculations, reporting, and strategic decision-making. You will build and maintain data pipelines, data warehouses and data lakes, ensuring secure, durable data and integrating with analytics teams to model complex risk data and support stress testing, FRTB and other regulatory initiatives. #J-18808-Ljbffr ...

journal articles, extracting entities, classifications, claim tuples, and summaries optimized for use by downstream agentic applications. We're looking for a senior data scientist to own domain‐specific content modeling work end to end, from the eval set through the pipeline stage that ships it. You'll join … Nice to have Experience working with scientific or scholarly text. Familiarity with AWS (S3, Batch, Lambda, SageMaker) and Parquet or Iceberg data lake patterns. Experience running LLMs under real cost and latency budgets in production. Some exposure to agentic AI applications: tool use, multi‐step reasoning, guardrails ...

London, Manchester, Newcastle Bank HouseApply for this job* Permanent* Experienced Professionals* Architecture* ID 488759-en\_GB## **Who You'll Be Working With**The Data Powered Industries and Domains (DPID) team, part of Capgemini’s Insights and Data practice in the UK, is growing its Architecture capability. … Join a team that sits at the heart of our most important client relationships, advising on complex data, AI and analytics challenges with deep expertise across the entire delivery lifecycle. We build trusted partnerships with senior stakeholders by translating business needs into technology solutions and measurable outcomes. ...

your technical skills to design, develop, test, monitor and support the infrastructure that forms the foundations of our vital big data platform. You’ll be working on the whole platform stack, up from the bare metal up to customer facing applications. Automation and monitoring will be key requirements … customers to understand their technical needs Set the choices of software and hardware for our big data platform and data lake Design, build and deploy core infrastructure ensuring the system is scalable and resilient Ensure systems are automated, including system build and common maintenance functions ...

your technical skills to design, develop, test, monitor and support the infrastructure that forms the foundations of our vital big data platform. You’ll be working on the whole platform stack, up from the bare metal up to customer facing applications. Automation and monitoring will be key requirements … customers to understand their technical needs Set the choices of software and hardware for our big data platform and data lake Design, build and deploy core infrastructure ensuring the system is scalable and resilient Ensure systems are automated, including system build and common maintenance functions ...

your technical skills to design, develop, test, monitor and support the infrastructure that forms the foundations of our vital big data platform. You’ll be working on the whole platform stack, up from the bare metal up to customer facing applications. Automation and monitoring will be key requirements … customers to understand their technical needs Set the choices of software and hardware for our big data platform and data lake Design, build and deploy core infrastructure ensuring the system is scalable and resilient Ensure systems are automated, including system build and common maintenance functions ...

large number of recruitment projects we undertake for our partners, we are currently looking for: Tech Lead (AWS) Responsibilities: Design and develop data architecture based on AWS Redshift and AWS Glue Design the Semantic Data Spine and a semantic layer consistent across multiple products and clients … Data modeling (Star Schema, Snowflake, Data Vault) with a focus on performance and scalability Define governance, data quality, and security standards (including GDPR compliance) Optimize query performance and manage Redshift resources (distribution styles, sort keys, WLM) Design and oversee ETL/ELT pipelines ...

About this opportunity Join cross‐functional product engineering teams to play a key role in delivering high‐quality data capabilities. This opportunity sits within the Personalised Experiences and Communications Platform, where we are focused on building innovative, data‐driven solutions that enhance customer experiences. … Data Engineering Lead, you will bring deep technical expertise and a passion for engineering excellence. You will lead by example, champion best practices and explore the possibilities offered by modern cloud technologies. We understand that no one is an expert in every aspect of data ...

diversified trading firm that builds data engineering solutions to support trading activities. We own data products from concept through production and emphasize scalable batch and real-time streaming systems with robust APIs for fast data access. We seek engineers … with multi-language skills and deep experience in Linux-based high-throughput environments, plus exposure to streaming platforms like Kafka and data lake technologies such as Delta Lake or Apache Iceberg. #J-18808-Ljbffr ...

adjacent domains is a strong plus and will be valued in candidate evaluation, since it enables broader solution ownership across engagements. Networking and data center design (routing/switching, fabric architectures).Storage architecture (all-flash arrays, software-defined storage, parallel file systems).Cybersecurity architecture, particularly zero trust … tuning (LoRA/QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel).Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & ObservabilityInfrastructure-as-code: Terraform ...

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data … platforms and pipelines, while applying best practices for automation and source control. The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering #J-18808-Ljbffr ...

Solution Architecture team and work collaboratively with clients, executive stakeholders, delivery leaders, and technical teams across Application Innovation, Cloud Platform, and Data & AI. You will provide strategic architectural leadership throughout the solution lifecycle, from early-stage pursuits and roadmap development through delivery and transformation. In this role … using Terraform, Bicep, or ARM templates. Knowledge of Azure Data & AI services including Azure Synapse Analytics, Azure Databricks, Azure Data Lake, machine learning, and applied AI solutions. Experience delivering hybrid and multi-cloud architectures in large enterprise environments. We're excited to meet people ...

Senior Data Engineer (Azure Databricks) London/WFH to 95kAre you a technologist Data Engineer with experience of working in regulated financial environments You could be progressing your career at a specialist FinTech and Investment technology business.As a Senior Data Engineer/Architect … take a hands-on lead role in shaping and developing the company's data platform. You'll design and build robust Databricks pipelines, develop reusable data products and medallion architecture and help modernise the data estate, migrating legacy data stores, stored procedures ...

Xelix in London is hiring a Data Engineer to join …/Data team. You will build the data platform from the ground up: pipelines, data lake and Snowflake warehouse, enabling analytics and AI-driven insights. You will work closely with the Platform Team to bring data together for analytics, reporting ...

focus on MLOps (Machine Learning Operations), NLP (Natural Language Processing), knowledge graphs, and Azure services. This role involves designing, developing, and deploying Data Science & AI/ML (Artificial Intelligence/Machine Learning) solutions, products, and engineering infrastructure as part of a multi-functional team, working as a self … Proficiency in programming languages such as Python, R, Java, C# Familiarity with cloud-based data storage technologies like Azure Data Lake and Azure SQL Database Excellent relationship building skills with the ability to gain trust and influence at senior level. Experience of coaching/mentoring ...

Senior Data Engineer (Azure Databricks) London/WFH to £95k Are you a technologist Data Engineer with experience of working in regulated financial environments? You could be progressing your career at a specialist FinTech and Investment technology business. As a Senior Data Engineer/… Architect, you'll take a hands-on lead role in shaping and developing the company's data platform. You'll design and build robust Databricks pipelines, develop reusable data products and medallion architecture and help modernise the data estate, migrating legacy data ...

Join our Data Fabric Services team in our Information Systems department as a Senior Data Engineer working across all directorates: Engineering, Simulation, Test, Production, Quality, Supply Chain, MRO, and Corporate Functions. Salary: Circa £55,000 depending on experience Dynamic (hybrid) working: 2 days per week … Facilities: Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity In this role you will design enterprise-wide data and BI solutions brought together from varied sources — business data, simulators, missile test systems, shop-floor machines — and then turning them into ...

Software Engineer - Data (Java/Kotlin/Python) Do not apply if you do not have experience within Financial services, working with Java data pipelines as you will not be considered. 6-month initial contract | Onsite (potential for hybrid) An elite quantitative research and trading firm … looking for a Data focused Software Engineer to join a Reference Data team supporting critical research and trading use cases. This team owns complex financial market datasets that describe how markets are structured and behave, and plays a key role in ensuring high-quality, reliable data ...

Data & Insight Manager Up to £70,000 Hybrid - Taunton, Somerset x3 days/week This is a rare opportunity to step into a leadership role at the intersection of data strategy and real-world impact. You’ll shape how an organisation thinks, decides, and grows - turning … complex data into clear direction for executive and board-level stakeholders. Reporting into the Head of IT, you’ll lead the Data & Insights function - owning the strategy, the team, and the output. You’ll partner closely with Finance, Operations, Marketing, HR, and the Executive Leadership Team ...

Puzzel is seeking a Data & Platform Analytics Lead to unify our data lake, define standard metrics, and enable accurate reporting across the business. You’ll own Snowflake ingestion, structure, access, and cost, while ensuring alignment with finance and other functions. You’ll lead … transformation by providing solid data foundations for AI tools and dashboards. You will report to the CFO and collaborate with data owners across the company, building a governed data model and reliable #J-18808-Ljbffr ...

Technopals Pte.Ltd. is seeking an experienced project professional to coordinate technical solutions and translate business requirements into data initiatives aligned with the bank's strategic objectives. You will … primary contact for stakeholders and drive progress updates. The role involves risk identification and mitigation, resource allocation, and leading enterprise-scale Data Lake and Data Warehouse initiatives, collaborating with business stakeholders to convert requirements #J-18808-Ljbffr ...

Join us and shape the future of risk technology with your expertise in data engineering and software development. You will have the opportunity to push boundaries, innovate, and make a meaningful impact on our business. We value diversity, inclusion, and respect, fostering a collaborative environment where your ideas … C# Practical experience delivering system design, application development, testing, and operational stability Working knowledge of relational and NoSQL databases and data lake architectures Experience developing, debugging, and maintaining code with modern programming languages and database querying languages Experience in large‐scale data processing, microservices ...