401 to 425 of 601 Data Lake Jobs in the UK

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

trading workflows across the business. The firm operates in a sophisticated investment environment with large and diverse datasets. Задачи Develop and maintain data pipelines supporting investment research and business-critical processes; Automate the onboarding and processing of new datasets to improve efficiency and scalability; Contribute to the design … collaborative software development practices; Strong communication skills and the ability to understand end-user requirements; Nice to have: exposure to databases, data lake technologies, or financial datasets. Условия Competitive base salary, annual bonus and benefits package; Specific compensation and benefits details are available on request. #J ...

Data Architect Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle to Work Scheme 25 days holiday, increasing with length of service Employee Assistance Program I am working with a client in the West Midlands … looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being brought back in house, so you should be experienced enough to take over responsibility ...

Data Architect needed in Lincoln Paying £30.29 per hr ref 376142 Full time hours on a temporarybasis Key Responsibilities Data Architecture & Strategy Develop, implement, and maintain the organisation's data architecture strategy. Design scalable data models, data warehouses, data ...

specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements … efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake and other data storage solutions. Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. ...

across the company or shared with the broader software community. Involving identifying common challenges and developing solutions that can be widely adopted. Being Data-Driven: Use data analytics to make informed decision-making processes. This involves gathering and analysing data to understand trends, measure …/CD The Atlassian Suite (JIRA, Confluence, Bitbucket, Bamboo) Azure Services Machine learning algorithms Big Data (Hadoop, Azure Data Lake, S3, Apache Spark) Additional programming languages – Python, Scala, Typescript, CSS 3/SASS (or other pre-processors) Other Information The successful candidate will be rewarded ...

Principal Software Engineer at JPMorgan Chase within the Corporate Sector, you provide expertise and engineering excellence as an integral part of an agile data engineering team. To enhance, build, and deliver a trusted market leading Global Know Your Customer (KYC) and Risk Assessment Data Platform … MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure, or GCP) Ability to present and effectively communicate with senior leaders ...

Your role will be to extend and maintain the data backbone of the UK Digital Twin Centre's projects and programmes. You'll transform complex, real-world data from sensors, devices and industrial systems into reliable, scalable data platforms that enable impactful digital twin … solutions. Working across a range of digital twin initiatives, you'll help shape data architectures, pipelines and services from initial concept through to delivery. WHAT YOU’LL DO (Duties) Design, build, and maintain ETL pipelines that bring data from sensors, devices and other sources into digital ...

Essential Employment in Lincoln is seeking a Data Architect to design and manage the organisation's data architecture. The role focuses on building scalable data models, data warehouses, data lakes, and integration solutions to align with business goals. Responsibilities include … leading data projects, establishing governance and security standards, and guiding data engineers and BI teams. The position is a full-time, temporary role based in Lincoln. #J-18808-Ljbffr ...

Photon Group in London, UK is seeking an experienced Data Engineer to contribute to a major ledger migration and data cleanup initiative within a financial services environment. The role requires hands-on data extraction, transformation, and rigorous reconciliation to ensure data integrity. … team emphasizes data validation, regression testing, and migration readiness in a dynamic setting. UK right-to-work is preferred, with a competitive salary of £48,478.22. #J-18808-Ljbffr ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

RoleWe are seeking a talented Senior Software Engineer to help build and run the data services and platform behind Datalex's dynamic pricing and offer optimisation. This is a Python-first, backend and infrastructure-focused role: you will work on end-to-end solutions — from robust application code … optimise data pipelines on AWS to collect, transform, and serve large datasets. Work extensively with S3 (Hive-partitioned Parquet data lake), Athena for SQL querying and analysis, DynamoDB for low-latency caching, and Kinesis/SQS for streaming and queue-based integration — including customer-facing ...

## Principal Data Scientist (NLP + Applied AI)Apply: Remote: Remote, GBR: Full time: Posted Today: R2601250**Job Description:** We believe in bold ideas, diverse perspectives, and the drive to transform knowledge into impact. Here, your curiosity fuels progress, your voice shapes innovation, and your ambition helps redefine … Nice to have*** Experience working with scientific or scholarly text.* Familiarity with AWS (S3, Batch, Lambda, SageMaker) and Parquet or Iceberg data lake patterns.* Experience running LLMs under real cost and latency budgets in production.* Some exposure to agentic AI applications: tool use, multi-step reasoning, guardrails ...

Keka Technologies Private Limited is seeking an experienced Data Engineer to architect scalable data solutions and data pipelines is the focus. This role emphasizes data integrity, security, and performance across the data lifecycle. Location: Remote. The ideal candidate has 7+ … years in data engineering, strong SQL and Python/Java skills, and experience with data lakes, ETL, and Power BI to deliver insightful visualizations for stakeholders. #J-18808-Ljbffr ...

analytics platforms across on-premises and AWS environmentsDesigning and implementing new platform features that enhance usability, scalability and the developer experienceCollaborating with research, data and engineering teams to accelerate time-to-insight through modern analytics solutionsDriving improvements in automation, observability and resilience across analytics servicesEvaluating and adopting emerging … approach to diagnosing and resolving issuesHighly desirable skillsExperience with streaming frameworks such as Flink, Kafka Streams and Kafka ConnectKnowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data CatalogExposure to DataOps practices and collaboration with Data Engineering teamsFamiliarity with ...

Barclays is seeking a Data Engineer within our Markets Post trade technology division in London to deliver a set of enterprise data strategy outcomes across the end-to-end lifecycle. You will build and maintain data pipelines, data warehouses and data lakes to ensure data is durable, complete and secure, while collaborating with data scientists to deploy machine learning models and influence data-driven decisions. #J-18808-Ljbffr ...

Capital One UK is seeking a Senior Manager Architect in Data to shape the architecture of a cloud-based data ecosystem. You will lead cross-functional teams, influence senior stakeholders, and define standards for distributed data processing, data lakes, and data products. You will collaborate with engineers, data scientists, and governance teams to drive real-time data capabilities, ML/AI readiness, and scalable data platforms across the organization. #J-18808-Ljbffr ...

across on‐premises and AWS environments Designing and implementing new platform features that enhance usability, scalability and the developer experience Collaborating with research, data and engineering teams to accelerate time‐to‐insight through modern analytics solutions Driving improvements in automation, observability and resilience across analytics services Evaluating … resolving issues Highly Desirable Skills Experience with streaming frameworks such as Flink, Kafka Streams and Kafka Connect Knowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data Catalog Exposure to DataOps practices and collaboration with Data Engineering teams Familiarity ...

team you'll be working with: We are seeking an accomplished and highly skilled Snowflake Solution Architect to join our Data & AI practice. The successful candidate will bring deep expertise in designing and implementing Snowflake-based cloud data platforms that are scalable, secure, and business-aligned. … This individual will play a pivotal role in guiding enterprise clients through their data platform modernisation journey, leveraging Snowflake's capabilities to enable data democratisation, advanced analytics, and AI-driven insights. As a trusted advisor, you will collaborate with client partners, business stakeholders, and technology teams ...

London/Bristol About the Role The Principal Software Engineer (Full-Stack, Backend-leaning) is a senior engineer responsible for the backend architecture, data pipelines, and API layer of a new sports technology product, while remaining capable of contributing to frontend development as needed. This role sits within … Lambda for lightweight processing tasks. Data transformation and aggregation layers that normalise tracking outputs, store them in a data lake, and make them available to downstream consumers via clean API contracts. REST and WebSocket APIs that serve both a live data product ...

London/Bristol About the Role The Principal Software Engineer (Full-Stack, Backend-leaning) is a senior engineer responsible for the backend architecture, data pipelines, and API layer of a new sports technology product, while remaining capable of contributing to frontend development as needed. This role sits within … Lambda for lightweight processing tasks. Data transformation and aggregation layers that normalise tracking outputs, store them in a data lake, and make them available to downstream consumers via clean API contracts. REST and WebSocket APIs that serve both a live data product ...

London/Bristol About the Role The Principal Software Engineer (Full-Stack, Backend-leaning) is a senior engineer responsible for the backend architecture, data pipelines, and API layer of a new sports technology product, while remaining capable of contributing to frontend development as needed. This role sits within … Lambda for lightweight processing tasks. Data transformation and aggregation layers that normalise tracking outputs, store them in a data lake, and make them available to downstream consumers via clean API contracts. REST and WebSocket APIs that serve both a live data product ...

Anaplan’s forecasting solutions. The team is responsible for the production execution of forecasting and predictive models, the MLOps infrastructure supporting our data scientists, and the data processing services that deliver insights to enterprise customers. This role reports to the Director of Engineering for Predictive Intelligence … models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi‐cloud experience across AWS, GCP, and Azure. Background in forecasting ...

company Pre-Sales Solution Architects are responsible for guiding our customers and users to design and build reliable, scalable systems using our data platform. Our team is made up of seasoned technical sales professionals, software architects, entrepreneurs, and developers who take direct responsibility for customer success, including … company's core database Atlas and Advanced Services: Gain expertise in Atlas (fully managed cloud database service), Atlas Stream Processing, Atlas Data Lake, Atlas Full-Text Search, Atlas Vector Search, and Charts Relational Migrator: Learn to migrate from relational databases seamlessly Market-Relevant Technologies: Hyperscaler Ecosystem: Gain ...