1 to 25 of 38 Data Architecture Jobs in East London

Databricks Architect (Contract) - Greenfield Data Platform Location: Hybrid working (London) Duration: 12-month initial contract Are you a visionary Databricks Architect with a passion for building cutting-edge data platforms from the ground up? Do you thrive on shaping strategy and driving technical excellence in a greenfield environment? Our client is embarking on a pivotal journey to establish … a brand-new, enterprise-grade data platform using the full power of Databricks. This is a unique opportunity to lead the architectural design and implementation of a truly greenfield data ecosystem that will underpin all future data-driven initiatives, from advanced analytics to AI/ML. We are looking for a hands-on architect who can translate … business needs into robust, scalable, and secure Databricks solutions. The Role: As our Databricks Architect, you will be instrumental in defining and delivering our new data strategy and architecture. This is a greenfield project, meaning you'll have the exciting challenge of building the entire Databricks Lakehouse Platform from scratch. You will provide critical technical leadership, guidance, and hands More ❯

The Opportunity A leading global consultancy organisation is seeking a skilled Data Architect to design and deliver robust, scalable data platforms on Google Cloud Platform (GCP). The ideal candidate will bring extensive experience in building and maintaining large-scale data warehouses, ensuring high standards of data quality, and adhering to best practices in data architecture. Key Responsibilities Define and develop the overall data strategy in line with client requirements and compliance standards. Lead and mentor a team of data engineers to implement scalable and efficient data solutions. Translate business needs into technical solutions by collaborating with both technical and non-technical stakeholders. Ensure the design and deployment of data platforms follow GCP best practices for performance, reliability, and security. Required Skills and Experience Proven background in designing data warehouse and data lake architectures. Demonstrable experience in building and operating large-scale data platforms on Google Cloud Platform, with a focus on data quality at scale. Hands-on expertise in core GCP data services More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical functions. This is a … collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with users to resolve data queries. Manage and maintain ETL processes and troubleshoot data issues, including More ❯

Job Title: Principal Data Engineer Location: London, UK – Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital … assets. As they continue to scale their data infrastructure , they’re seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the ability … to communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and More ❯

This is a pivotal role in shaping our data landscape, ensuring alignment with business objectives, and driving innovation through effective data management practices. You will lead a team of skilled data architects, collaborate with cross-functional stakeholders, and define the strategic direction for data initiatives. What you will do: Data Strategy Development: Develop and articulate … a comprehensive data strategy that aligns with the organizations vision, mission, and long-term goals. Collaborate with senior leadership, including the Chief Data Officer (CDO), to define data-related priorities and roadmaps. Understands disruptive forces and the businesss economic & financial levers that affect transformation, to effectively guide technology investment decisions. Facilitates business and IT alignment through a … and the technology industry to determine their potential impact on the enterprises business strategy, direction and architecture. Provides perspective on the readiness of the organization to change and innovate. Data Architecture Leadership: Own and drive the future state data architecture, ensuring scalability, flexibility, and adherence to industry best practices. Establish and maintain data architecture More ❯

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯

Responsibilities : 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam … response. Ability to be a SPOC for all technical discussions across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients. Excellent ETL skills, Data Modeling Skills. Excellent communication skills. Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working … evaluating client operations, applications, and programming. Ability to articulate and write POVs on new and old technologies. Ability to recommend solutions to improve new and existing database systems. Assess data implementation procedures to ensure they comply with internal and external regulations. Install and organize information systems to guarantee functionality. Prepare accurate database design and architecture reports for management More ❯

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements Previous experience with the preparation of high-quality engaging customer presentations … offer solution team, solution definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP), Cloudera, No-sql databases (Cassandra, Mongo DB … ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization solutions: Microstrategy, Qlik, PowerBI, Tableau, Looker,... Background in Data Governance and Data Catalog solutions More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally … you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components More ❯

Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Architect within the in-house digital product and services department of a groundbreaking public sector entity that is reshaping the way public services are delivered. The Role: Data Architect The … Data Architect will be responsible for designing and implementing a scalable, secure, and efficient data architecture that supports the organisation’s strategic goals. This role will focus on data integration, governance, and platform design, ensuring that data systems are aligned with business needs and operational efficiency. The successful candidate will have expertise in data modeling, Master Data Management (MDM), data governance, and cloud-based architectures, ensuring data consistency, accessibility, and security across the organisation. Responsibilities Strategic: Lead the design and implementation of a modern data architecture, ensuring scalability, flexibility, and efficiency. Define and manage data integration strategies, enabling seamless flow and access to critical business information. Drive More ❯

. Develop web applications including SharePoint sitesand web parts in accordance with processes and standards. Analyse business requirements by collaborating with business users and IT Management, studying systems flow, data usage and work processes and translating them into Power Platform/SharePoint solutions. Identify areas and processes where Microsoft Power Platforms and Frameworks can be better leveraged and facilitate … helping with the wider digital transformation. Engage in project scoping activities to turn initial proof of concept engagements into fully delivered Portal solutions. Develop and deliver Business Intelligence reports, data visualisation and data analysis solutions to identify and communicate insights which meet business requirement. Collaborate with stakeholders to gather and interpret data requirements. Profile and analyse raw … data to identify, interpret and summarise patterns, outliers and data quality issues. Perform software design using software development fundamentals and processes, debug, test, and deploy software solutions.Completing impact assessments for any changes to production instances. Document technical designs, processes and user guides. Implement best practices for app and report design and usability. Deploying applications through CI/CD More ❯

Job Title: Solutions Architect (Data) Terms: Permanent, full-time Salary: c.£75,000 Employee Benefits: Local Government pension scheme, 31 days annual leave (plus Bank Holidays) Allen Lane is delighted to be supporting a London-based Local Authority in their search for a Solutions Architect . This is a new role in the structure, with a particular focus on … data architecture and data platforms . The postholder will own end-to-end solution designs, working closely with senior stakeholders cross the Council. We are looking for applicants that can demonstrate outstanding collaboration and engagement skills, communicating effectively will a diverse range of stakeholders up to and including Director level and with external partners. You will play … a critical role in leading the definition, design and delivery of modern data solutions and products. You will have excellent Cloud knowledge, either with Azure or AWS . Applicants are expected to demonstrate the following skills and experience against the following essential criteria: Relevant certifications (e.g. Azure Solutions Architect, Azure Data Scientist, Azure AI, Power Platform Solution Architect More ❯

Role: Cloud Data Architect Location: London, UK Duration: Contract Job Description: Key Responsibilities Provide technical leadership and strategic direction for enterprise-scale data migration and modernization initiatives. Architect end-to-end data platforms using Dataproc, Dataflow, Pub/Sub, BigQuery, Cloud Spanner, and Bigtable. Define and implement real-time and batch processing pipelines for complex use cases … involving streaming analytics, ML feature engineering, and automation. Act as a trusted advisor to senior technical and business stakeholders across industries (e.g., telecom, retail, financial services). Drive data quality, governance, lineage, and security standards across enterprise data pipelines. Mentor engineering teams and lead best practice adoption across data architecture, orchestration, and DevOps tooling. Participate in … technical workshops, executive briefings, and architecture reviews to evangelize GCP data capabilities. Required Qualifications Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related technical field. 12+ years of experience in data architecture and data engineering with proven skills and leadership in large-scale cloud data programs. 5+ years of More ❯

Data Analyst Are you passionate about turning data into clear, actionable insights? Do you enjoy working with a variety of tools to solve business challenges? Ready to join a leading retailer where your work will make a tangible impact? MacGregor Black is partnering with a Leading Retailer on the search for a Data Analyst . This is … a hybrid role based in the London area. As Data Analyst , you will be responsible for delivering data-driven insights across a wide range of datasets. Using tools such as Databricks, Tableau, Looker Studio, Amplitude, and DBT, you will extract, transform, and analyse data to support key business functions. You will collaborate closely with stakeholders to understand … their data needs, generate reports, and provide actionable insights that influence business decisions. Your remit will include analysing sales, customer, marketing, and operational data, as well as supporting digital analytics when required. Key Responsibilities: Data Extraction & Analysis Write SQL queries in Databricks. Support stakeholders with key business questions. Handle ad-hoc and recurring data requests. Validate More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation and excellence … making it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate data management technologies and software tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. As the selected Data Engineer, your background will include: 3+ years industry experience in a Data Engineer role and More ❯

twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse group of engineers … and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and machine learning efforts across the … business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business teams in an agile environment to deliver data More ❯

client is on the lookout for a dynamic and experienced Senior Solutions Architect to join their team! This is a fantastic opportunity to shape the future of Surveillance solutions architecture while working with cutting-edge technologies in a vibrant, agile environment. Role: Senior Solutions Architect Duration: 12 Months (extension options) Location: London (Hybrid 2 days in office) Rate … per day (umbrella) Key Responsibilities: Design and create Surveillance solutions architecture and evolution roadmaps tailored to meet our business needs. Collaborate with enterprise architects, delivery leads, and engineers to define scopes and low-level designs, driving the delivery of new features in an agile manner. Manage architectural and technical debt, ensuring solutions align with Lloyds Banking Group’s standards … A proven track record of delivering technical solutions in Agile environments with expertise in JIRA and Confluence. Proven Solution Architect Experience: Deep technical expertise in various solution architectures, especially data platforms and complex data pipelines on public cloud platforms, with a focus on GCP. Robust Application Design Skills: Experience in designing scalable, low-latency solutions that meet diverse More ❯

Data Engineer - Python, SQL, DBT, DWH, Airflow, Kafka, Snowflake - Challenger Digital Bank Location: London (Hybrid, 2 days per week in office) Type: Permanent Salary: Competitive + 20% bonus + excellent benefits Are you a Data Engineer ready to shape the future of a digital-first banking experience? Join a fast-growing start-up challenger bank where data is at the core of every decision. You’ll play a key role in building the bank’s next-generation data infrastructure and enable insight-led growth from the ground up. What you will be doing: Build and optimise robust data pipelines using Python , Kafka , Airflow , and DBT Design and manage Snowflake data warehouse objects to … support scalable analytics Write clean and efficient SQL to support reporting, dashboards and data products Collaborate across engineering, analytics and product teams to enable data-driven decisions Drive data quality, performance and governance through best practice and documentation Support A/B testing, automation, and analytics innovation projects What we are looking for: Strong hands-on experience More ❯

SQL Server Database Developer – London Markets Insurance A specialist London Markets insurer is building out a brand-new, modern data platform and is looking for an experienced SQL Server Database Developer to join their growing data team. With strong executive support and significant investment, this is a rare greenfield opportunity to help define and build core data infrastructure from the ground up. The business is deeply committed to becoming a more data-driven organisation, and this role offers both stability and progression in a collaborative, high-impact environment. Why apply: Greenfield platform build with real architectural influence Strong backing and long-term investment in data initiatives Excellent career development opportunities within a growing team … and optimise SQL Server databases to support analytics and operational workloads Write high-quality, efficient T-SQL procedures, views, and functions Develop ETL processes and support the integration of data from core insurance systems Work closely with BI, data architecture, and business teams to shape data structures and pipelines Support performance tuning, indexing, and optimisation across More ❯

Solutions Architect – Remote – Data, Integration, Digital Architecture 🌳 🧠 Role: Solutions Architect 💡 Area of Expertise: Order & Information Systems 🏠 Work Style: Remote Working 💼 Employment Type: Full-Time. 💰 Salary: £85,000 - £95,000, based on experience and subject matter expertise. 🎁 Benefits: A robust and competitive benefits package is available, please reach out for full details. Areti is seeking a Solution Architect with … strong expertise in Data, Integration, and Digital Architecture. We welcome candidates from a broad range of industries, including, Telecommunications, Financial Services & Banking, Healthcare & Insurance, Utilities (Electricity, Water, Gas), SaaS & Cloud Services, E-Commerce & Retail, and Government & Public Sector. Core Competencies – Experience is integral to success in this role: Technical Documentation & Communication. Proven ability to produce high-quality technical documentation … including High-Level Designs (HLDs), Low-Level Designs (LLDs), reports, and presentations. Clear communication with both technical and non-technical stakeholders is essential. End-to-end solution Architecture experience with information systems and order architecture. Data - Data Architecture, Data Warehousing & Lakes, ETL/ELT Pipelines, Customer Data Platforms (CDPs), Data Governance & Compliance, or More ❯

Solutions Architect – Remote – Data, Integration, Digital Architecture Role: Solutions Architect Area of Expertise: Order & Information Systems Work Style: Remote Working Employment Type: Full-Time. Salary: £85,000 - £95,000, based on experience and subject matter expertise. Benefits: A robust and competitive benefits package is available, please reach out for full details. Areti is seeking a Solution Architect with … strong expertise in Data, Integration, and Digital Architecture. We welcome candidates from a broad range of industries, including, Telecommunications, Financial Services & Banking, Healthcare & Insurance, Utilities (Electricity, Water, Gas), SaaS & Cloud Services, E-Commerce & Retail, and Government & Public Sector. Core Competencies – Experience is integral to success in this role: Technical Documentation & Communication. Proven ability to produce high-quality technical documentation … including High-Level Designs (HLDs), Low-Level Designs (LLDs), reports, and presentations. Clear communication with both technical and non-technical stakeholders is essential. End-to-end solution Architecture experience with information systems and order architecture. Data - Data Architecture, Data Warehousing & Lakes, ETL/ELT Pipelines, Customer Data Platforms (CDPs), Data Governance & Compliance, or More ❯

Director — Enterprise Data Architecture & Governance Base c. £140-175k + bonus and LTIP (flexible for the right hire) 35 days leave │ 14 % pension │ full family healthcare Purpose Establish and scale a single enterprise data backbone for a global retail-investing and pensions platform (~£400 bn AUA), enabling regulatory-grade lineage, real-time analytics, and API-driven … product innovation. You will be tasked with the front, middle and back-office solution, defining the interactions, integration and data model transformation. Candidate with no Investment or Asset Management experience are not being considered for this role at this time. 12-Month Success Metrics Publish an enterprise-wide canonical data model covering custody, wrappers, trading, and digital touchpoints. … up policy-as-code controls delivering automated Consumer Duty & CASS MI. Migrate 60 % of legacy ETL into an event-stream/Snowflake lakehouse pattern, cutting report latency to Embed data-product operating model across UK & India hubs; uplift data-literacy score by 25 %. Core Accountabilities Architecture & Design Authority : Define reference architectures, patterns, and guardrails for data More ❯

Lead Data Platform Engineer | Energy Trading | Python, Snowflake, Dagster, & AWS | Up to £140,000 + Benefits | Hybrid – London A Lead Data Platform Engineer is required to join a fast-growing Commodities Trading firm at the forefront of the global Oil & Gas markets. As part of their continued investment in data and analytics, they're scaling their Enterprise … Data Platform to drive smarter, faster trading decisions—and they need an experienced leader to guide this transformation. In this high-impact role, you'll lead a team of 5 data engineers within the central data architecture function, setting the technical direction and ensuring best practices across the business. You'll be hands-on with modern … data technologies, while also mentoring, coaching, and guiding the team in delivering scalable, high-performance solutions. Key Tech Stack: Python, Snowflake, Dagster, Kafka Terraform, CI/CD, AWS (and some on-prem) Key Responsibilities: Lead, mentor, and manage a team of 5 Data Engineers, fostering a high-performing and collaborative culture. Design and build enterprise-grade data More ❯

We are looking for a highly skilled and strategic Senior Data Advisory Lead with deep expertise in financial services. Your Profile: 15+ years of experience in data advisory, data strategy, or data management roles. 8-10 years of experience working within consulting for financial services institutions. Deep understanding of financial services business models, regulatory landscape, and … data challenges. Proven track record of delivering data transformation programs in complex environments. Strong knowledge of data governance, data architecture, and analytics platforms. Excellent stakeholder management, communication, and presentation skills. Experience working in or with consulting firms, Big 4, or boutique advisory practices. More ❯

Metris Energy At Metris, we're on a mission to accelerate the energy transition by helping solar owners manage their asset(s) autonomously. Today, our platform delivers real-time data on 100s of solar projects across the UK and automates time-consuming tasks involved in solar management such as monitoring, fault detection, reporting and billing. Next, Metris is building … proprietary AI to deliver autonomous operation of small-scale renewables. The Role We’re looking for a Senior Software Engineer with strong experience in data-intensive systems to join our team. You’ll bring a solid grounding in data processing and architecture, and will play a key role in maintaining data integrity across the Metris platform … . This role will define and own our data architecture, connecting to hundreds of renewable energy assets — storing, transforming and aggregating millions of rows of data — we also expect that over time you will also contribute to other parts of the Metris product as the business continues to grow and evolve into new products and markets. This More ❯