23 of 23 Data Lake Jobs in Berkshire

Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and … or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. To be considered for this role you MUST have in-depth experience … Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

We are searching for a remote working Senior Data Engineer to join our clients high-performing Data Engineering team. This role is ideal for an experienced, hands-on professional Senior Data Engineer who thrives on technical leadership, innovation, and delivery. You can be based anywhere in the UK to be considered for the role … on-prem (coding, configuration, automation, delivery, monitoring, security). Extensive Big Data hands-on experience - Cloudera or similar. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Azure - hands-on experience including coding, configuration, automation and delivery. Advanced Database and SQL skills. Certifications: Cloudera, Azure or FME certifications … Java, Python, PySpark, Scala, ETL Tools, Azure Data Fabric (ADF), Databricks, HDFS, Hadoop, Big Data, Cloudera, Data Lakes, Azure Data, Delta Lake, Data Lake, Databricks Lakehouse, Data Analytics, SQL, Geospatial Data, FME, QGIS, PostGIS. Please note that due to a high level of applications More ❯

models, performance dashboards). Engineering & Implementation Build robust batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming. Implement secure, scalable storage using Delta Lake formats, Azure Data Lake Gen2, and time-series solutions (e.g. Azure Data Explorer). Deliver data validation, schema evolution, metadata management, and … can own and evolve the platform post-delivery. Required Skills & Experience Extensive experience delivering enterprise-scale data platforms in cloud environments(preferably Azure). Deep expertise in lake house architectures, real-time/batch processing, and telemetry/IoT pipelines. Proven ability to lead complex delivery across technical and non-technical teams. Strong hands-on experience with … Azure Event Hubs, IoT Hub, Data Factory, Data Lake Gen2, Synapse, Databricks Spark, Structured Streaming, Delta Lake, Parquet SQL, Python Time-series DBs (Azure Data Explorer, InfluxDB, TimescaleDB) Familiarity with Medallion architecture, schema evolution, cost optimisation, and system observability. Track record of mentoring internal teams and embedding best practices in technical delivery. More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Azure Data Engineer Up to £72,000 + Benefits International Law Firm – London (Hybrid) I’m working with a highly respected international law firm that’s looking for a skilled and proactive Azure Data Engineer to join their forward-thinking Data team. This role is a great fit for someone who thrives on solving … complex data challenges and wants to directly influence how a global legal business uses its data to make smarter decisions. As part of the Strategy, Transformation & Project Delivery function, you’ll be instrumental in designing, developing, and optimising the firm’s Azure-based data infrastructure, from building scalable data pipelines to ensuring … data integrity, security, and compliance. The Role Data Infrastructure Development – Build and maintain scalable Azure data pipelines (following Senior Data Architect designs) using tools such as Azure Data Factory and Tray.io. Implement and manage data lakes and warehouses (Azure Synapse, Azure Data Fabric, etc.). Integration More ❯

of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For … leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development More ❯

Data Architect London Area, United Kingdom (Hybrid) Salary: £110,000 basic Summary We’re seeking a highly skilled Data Architect to take ownership of the organisation’s enterprise data strategy and architecture. This is a senior role responsible for designing scalable, secure, and future-ready data solutions that enable business growth, innovation … and data-driven decision-making. Objectives Define and deliver an enterprise-wide data architecture roadmap . Collaborate with senior stakeholders to align data strategy with business objectives. Ensure data platforms and solutions are resilient, secure, and compliant . Promote best practices in data modelling, governance, and integration across the organisation. … Responsibilities Design and optimise the enterprise data landscape , including data models, storage, and integration layers. Implement and oversee data governance frameworks , covering quality, security, and compliance. Partner with analytics, BI, and data science teams to enable scalable and consistent access to data . Provide guidance on data ingestion More ❯

About the Opportunity This is a rare opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere to … data scientists, analysts, and performance experts to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL More ❯

Title: Data Transformation leader Work Location: London Work from Office : 3 days per week (Hybrid model) Experience: 12-18 Years We at Coforge are hiring Data Solution Architect professional for London. About the Role We are seeking an accomplished Senior Data Leader to spearhead a high-impact data transformation programme for a … leading UK insurance client . This is a critical role that requires strong leadership, deep expertise in enterprise data strategy, and proven delivery of large-scale data initiatives in complex, regulated environments. The successful candidate will be accountable for shaping, governing, and delivering data capabilities that drive business value, regulatory compliance, and digital transformation … outcomes. Key Responsibilities Data Strategy & Governance: Define and implement a robust enterprise data strategy , aligned with client’s insurance business priorities. Establish data governance frameworks , policies, and operating models ensuring data quality, lineage, and compliance with UK/EU regulations (FCA, PRA, GDPR, Solvency II). Data Transformation & Architecture: Lead More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯

to work with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Role Overview We are currently seeking a Data Analyst to come join our Cyber team here at Albany Beck. As a Data Analyst, you will play a critical role in designing and embedding our client … s data mesh, plugging in and managing multiple source data streams, and developing meaningful dashboards that bring clarity to over 400+ risk metrics. You’ll combine strong technical expertise with stakeholder engagement skills to ensure data is not just cleansed, but truly understood, contextualised, and actionable. Key Responsibilities Plug in and manage multiple source … ensuring data integrity and governance. Review, manage, and improve 400–500 Cyber & Risk metrics, positioning them effectively for senior leadership. Support the transition from data lake to data mesh, enabling data to be materialised, accessed, and visualised with ease. Develop and maintain Power BI dashboards, ensuring metrics are clearly presented and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Job Title: Data Engineer Location: London (Hybrid) Salary: Open upto GBP £60,000 - £100,000 Per annum - DOE Employment Type: Full time, Permanent About the Role: We are seeking a skilled Data Engineer to join our Digital & Data team. You will work alongside product, design, and cross-disciplinary experts to deliver innovative software solutions … and scalable data architectures. This is an exciting opportunity to develop your career in a collaborative, inclusive, and technology-driven environment. Key Responsibilities: Design, build, and maintain production data pipelines from ingestion to consumption in big data architectures. Develop ETL processes and manage data warehouses, data lakes, and data movement across multiple sources. Work with structured and unstructured data, integrating from multiple systems using AWS or open-source tools. Collaborate with multiple stakeholders in an agile environment to solve complex business challenges. Participate in live problem-solving sessions, whiteboarding, and asynchronous collaboration to deliver high-quality solutions. Contribute to the technical growth of the team More ❯

Job Title: Data Analytics Manager Location: London (3 Days in the office) Job Type: Full Time Company Overview Operating quietly at the intersection of community and commerce, this UK-based real estate investment trust specialises in essential-led retail that remains relevant through changing market cycles. Focused on underappreciated assets in resilient locations, the company balances disciplined asset … local needs. It offers employees the chance to work behind the scenes on places that genuinely matter. Role Summary We’re looking for a proactive and technically capable Data & Reporting Analyst to join the Strategy & Investment team at a pivotal moment in the company’s data journey. This newly created role is part of a broader … performance, credit risk, and strategic KPIs. Standardise and manage data inputs from systems such as Yardi , OnePower , and other internal platforms into a central data lake . Produce structured outputs and data matrices used for Board reports, investor updates, and ExCo presentations. Collaboration & Integration Work closely with the Finance , Asset Management , and Strategy More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯

a fraction of the cost. From customised front end mobile apps and online banking portals, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“Bank-in-a-Box”) or in part, as required. Our technology stack has gained positive attention from multiple players globally and over More ❯

high growth tech company. Job Description As Engineering Lead for Backend you will be responsible for a range of backend systems such as Payment Gateway, Settlement, Transaction Fraud Monitoring, Datalake Service and the Core Banking System. You will oversee their deployment, development, and enhancements, while also being responsible for their reliability, performance, and stability in production. This hybrid role merges More ❯

We are a global name in digital transformation, undertaking exciting work that strives to genuinely change the world. We are currently looking for an experienced Data Architect to help expand our business, using our advanced portfolio of solutions to deliver exceptional results to potential clients. The Ideal Data Architect will have; Demonstrable experience in architecting and … implementing data lakes & Lakehouse platforms, including Databricks & Unity catalogue. Strong experience with data architecture on public cloud platforms such as AWS, Azure or GCP. Knowledge of programming languages such as Python, R, or Java. Exposure to ETL/ELT Processes, SQL, NOSQL databases. End to end delivery experience on consulting engagements. Data Architect key … details: Up to £140k salary Performance bonus. Car allowance. Flexible hybrid working, London office. If you would like to join us as an experienced Data Architect, make sure to click apply now. If you'd like to discuss the Data Architect role further, make sure to get in contact with Zachary Phillips at Anson McCade for More ❯

workflows. Ensure reliability, scalability, observability, and security of production systems and ML infrastructure. Automate deployment, orchestration, and environment management using modern DevOps tooling. Collaborate closely with software engineers, data scientists, and product teams to bring ML-powered features to production. Proactively detect, troubleshoot, and resolve infrastructure and model performance issues. Stay up to date with industry best practices … tools (Docker, Kubernetes). Solid understanding of CI/CD systems (e.g., GitHub Actions, GitLab CI, ArgoCD) and infrastructure-as-code tools (e.g., Terraform, Helm). Familiarity with data engineering concepts such as ETL pipelines, data lakes, and large-scale batch/stream processing. Ability to design scalable, secure, and observable systems in fast-moving environments. More ❯