51 to 75 of 157 Data Lake Jobs

Data Platform Consultant A fast-growing, forward-thinking technology Microsoft partnered consultancy is looking for a Data Platform Consultant to join their expanding Data & Analytics practice. This is an exciting opportunity to work on diverse, high-impact data transformation programmes across both … data modelling and data engineering Expertise with: Azure Data Services (Data Factory, Data Lake, Synapse, SQL, Analysis Services) Microsoft Fabric & Power BI On-prem equivalents (SSIS, SSAS, SSRS) welcome Highly proficient in T-SQL; experience with M, DAX, Python ...

Data Engineer/Architect This organisation builds and manages critical healthcare infrastructure used by communities across the UK. As data becomes central to decision-making and innovation, they’re investing heavily in modern platforms and AI-led solutions. This role sits at the heart of that … pipelines Advanced Python and SQL skills Solid hands-on experience with Azure data services (Data Factory, Synapse, Data Lake, Functions, Logic Apps) Power BI data modelling and dashboard development expertise Practical experience using OpenAI APIs or similar AI/ML services ...

tailored to finance and retail business needs. Extract and transform financial and transactional data from Dynamics 365 via Azure Data Lake/Synapse/Data Factory (as applicable). Collaborate with finance and IT teams to understand data requirements and reporting … Dynamics 365 Finance and Operations data structures. Experience with Azure tools such as Data Factory, Synapse Analytics, Data Lake, or SQL Databases . Solid knowledge of data warehousing concepts and financial reporting. Ability to work independently in a contract capacity with ...

Permanent Job Summary: AWS Support Engineer/Data Engineer Telecom Domain (JD) Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/… Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort ...

Data Architect Edinburgh 6-Month contract Paying up to 69p/h (Inside IR35) Please note - due to the nature of the work, you will need to hold or be eligible to obtain a high level of UK Security clearance - please only apply if suitable Key Responsibilities: Design … implement enterprise-level data architecture solutions, including databases, data warehouses, and data lakes. Develop and maintain logical, physical, and conceptual data models. Define data management standards, policies, and best practices. Work with data engineers to design and optimize ...

Details Role/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration: Lead and provide expertise on Integrate data from various sources, ensuring data consistency, integrity, and quality across the entire data lifecycle. Infrastructure Management: Provide guidance for the junior & Mid Data Engineers on the best practices when building and managing ...

Interim Principal Azure Data Architect Location: North London (hybrid) Contract: Interim Rate:£900 per day outside IR 35 A complex organisation based in North London is seeking an Interim Principal Azure Data Architect to reset, review, and re-implement its data architecture . This … architecture Deep, practical experience across the Azure data stack (for example Azure Data Factory, Synapse, Fabric, Databricks, Data Lake, SQL) Strong background in data modelling , analytics architecture, and large-scale data platforms Experience leading data architecture resets ...

Details Role/Job Title: Data Engineer Work Location: Manchester, UK Mode of Working: Hybrid Office Requirement (Hybrid): Tuesday/Wednesday/Thursday The Role Seeking a Data Engineer profile with deep technical expertise and thought leadership, provides advanced data solutions by using software … process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract ...

Azure Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Azure Data Engineer. This role sits within a growing Data practice delivering Azure … based data platforms for a wide range of clients. The Azure Data Engineer will focus on building modern, scalable data solutions using Microsoft Fabric and the wider Azure data stack, working closely with customers throughout the full delivery lifecycle. This ...

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms … data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known ...

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role … scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, this role … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, this role … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

Title: Senior Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Senior Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Senior Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

Title: Lead Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Lead Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Lead Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

hands-on work. What you’ll do: Own the Group BI roadmap and align it with business goals Build on existing data lake work, integrating multiple entities Develop and maintain ETL pipelines, dashboards, and reports Translate business questions into actionable technical solutions Integrate BI with … similar and dashboard design Knowledge of ETL, data lakes, and data pipelines (Python, DuckDB, Azure Data Lake) ERP integration experience Confident communicator with a consultative approach Experience in manufacturing, engineering, or distribution is a plus Why join? Build a group-wide BI function ...

Automation Leadership Lead and support the selection, design, and transition from fragmented security tooling to a unified SIEM platform and security data lake . Drive a fundamental shift from incident-focused, task-based workflows to preventative security activities and platform optimisation . Proactive Threat Focus Guide … high-availability environments. End-to-End Programme Ownership Full lifecycle ownership of major initiatives including MDR consolidation, SIEM, SOAR, and security data lake deployments , delivering measurable business outcomes. Formal RFP & Vendor Management Expertise Proven experience authoring RFPs, evaluating vendors, and overseeing complex onboarding and integration. Battle-Tested ...

Power BI Data Analyst (12-month FTC) Location: Remote (UK-based) Salary: £40,000 – £45,000 Sponsorship: No sponsorship available VIQU have partnered with a large, values-driven organisation operating at national scale within the education sector. Supporting a wide and diverse network of institutions, they … modelling Partner with stakeholders to translate business needs into actionable insight Support the evolution of the data platform and data lake Promote data literacy through guidance, training, and support Ensure strong data governance, access control, and reporting quality Key Skills & Experience ...

client, a speciality insurance broker, are looking for a Data Analyst to join our Data Analytics team, helping transform data into actionable insights … that drive smarter decision-making across our business.What You'll Be Doing: * Extracting, transforming, and presenting data from our data lake and data marts to support business performance * Designing and delivering visually engaging reports and dashboards using Power BI * Monitoring data ...

/paternity pay – Life assurance – HolidayPlus – Cycle2work Scheme & more REQ5381 The Senior Systems Analyst is a senior technical specialist responsible for keeping HR data accurate, well-governed, and ready for migration to next-generation HR systems like Oracle Fusion Cloud HCM. The role leads complex data … projects, change control, and regression testing cycles. Collaborate with key stakeholders to define requirements and integration points between core HCM platforms, Data Lake, payroll, and reporting environments. Build advanced executive ready Power BI dashboards, data models, and self-service data sets, and scheduled ...

architectures , covering data ingestion, identity resolution, segmentation, and activation Define how the CDP integrates with, Data lake/lakehouse platforms (e.g. Databricks), CRM and sales platforms (e.g. Salesforce), Marketing automation and engagement tools (e.g. Braze) Apply strong understanding of batch vs real-time data … martech and data architectures , spanning CDP and identity resolution, Marketing automation and engagement platforms, CRM and customer-facing systems, Data lake/lakehouse platforms (e.g. Databricks). Proven track record of leading discovery, requirements definition, and solution shaping in complex or ambiguous environments Previous exposure ...

Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification … Doing Managing and maintaining large-scale Hadoop clusters across on-prem environments Supporting and optimising our HDFS-based Data Lake and adjacent platform components Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie , and related tooling Partnering with engineering teams to deliver scalable, high-quality data ...

Technical Data Analyst | Contract | Azure | 6 months | Hybrid | Outside IR35 | £350 - £400 |We’re supporting a major data transformation programme and looking for a Technical Data Analyst to help migrate legacy systems into a modern Azure data platform . This … Strong SQL skills and experience working with Azure-hosted datasets Power BI reporting/dashboards creation Python experience Exposure to Azure Data Lake, Databricks, or Data Factory is beneficial If this is a role that suits your skill set, you are immediatley available ...

years. Help us transform our workforce of the future, today. We are seeking an experienced Senior Databricks Solution Architect to join our data architecture team, focusing on architecting cloud solutions in Databricks. This role involves architecting state-of-the-art data integration and analytics solutions … enable business objectives. Technical Experience and Qualifications: Databricks proficiency: In-depth, hands-on experience using the Databricks platform and its tools like Delta Lake, Delta Live Tables, Databricks SQL, etc. Cloud platform expertise: Proven experience with Google Cloud Platform (GCP) or another major provider like AWS or Azure Data ...

Senior Manager: Data Officer - Sought by leading bank - London - Permanent Role Overview: We are looking for a Data Officer to lead the data governance, strategy and quality across its London Branch. This is a newly created role within the Risk function, working closely with … senior stakeholders to embed a strong, enterprise-wide data governance framework. Key focus areas: Data strategy & governance, policy and standards, data ownership & stewardship, data quality management, and regulatory compliance (GDPR, risk & audit). Ideal background: 6-8+ years in data ...