8 of 8 Data Lake Jobs in Lancashire

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and … communicating enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience … advise clients on reference architectures Design and develop scalable Databricks solutions on both Azure and AWS environments Lead the architecture and deployment of data solutions using Databricks Requirements: Expert in capturing end-user requirements and aligning technical solutions to the business objectives Experience in leading, designing, and implementing More ❯

Are you an experienced Data Engineer looking to join a leading B Corp organisation in the financial services industry? Keen to join accompany offering a hybrid 3-day office working week? You will be joining a company who work very hard to enable long term financial well-being … by providing tailor made lending solutions. Data is key to our success, and that’s where you come in! You will be working hard to enable effective data driven decisions using your experience of data warehousing and Business intelligence. As a Data … industry, however this is not essential. Experience working in an Azure Data environment with storage tech such as Azure Data Lake, Data warehouse and traditional MSSQL. You will have great experience of MS SQL Server including working with T-SQL. Previous experience working More ❯

Based (Hybrid working model, 2 days a week office based, 3 days remote) Competitive Salary plus performance related bonus The Role: As a Data Ops Engineer, you will be responsible for enhancing the efficiency and reliability of our data management processes, supporting our advanced analytics, machine … learning, and AI initiatives. You will harness your engineering skills to develop and automate data pipelines, ensuring data is seamlessly integrated, processed, and available across our analytics platforms. Your role will include automating data workflows, improving data quality, and ensuring efficient delivery … pipelines. You will work alongside teams across the organization to address their data needs, craft agile solutions, and continuously improve the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data More ❯

Delivery Consultant - Data Analytics, Professional Services Global Competency Center The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS … Engineering, related field, or equivalent experience Experience with data analytics IT platform implementation with hands-on implementation experience with data lake and data warehouse. Hands-on experience developing software code in one or more programming languages/frameworks such as Python, Spark, SQL … etc. Hands-on experience leading large-scale full-cycle MPP enterprise data warehousing (EDW), data lake and analytics projects PREFERRED QUALIFICATIONS AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation) AWS Professional level certifications More ❯

Pro currently has an exciting opportunity for a motivated and detail-orientated individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims … using data ingestion/analysis tools such as Intrali, Quantemplate or Matillion. The project centres on the extraction, transformation and loading (ETL) of data from various sources into data warehouses and data lakes. This is the perfect role for an aspiring Data … Liverpool office. This vacancy however is suitable for an individual who is fully remote and we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing and preparing datasets for analysis. Creation and management of both Risk and More ❯

Services, Functions Application Gateways and API Management services. SQL Services - MI, PaaS, IaaS, ADF, SSIS, etc. Storage services - files and blob. Data Lake Services, PowerBI and ETL technologies. More ❯

Software Development. In this senior leadership position, you will oversee the end-to-end delivery of software engineering across our key platforms, including data, integrations, portals, mobile, and core applications. You'll take ownership of the software development roadmap, providing direction, mentorship, and support to a high-performing … pivotal role in driving architectural strategy, development best practices, and governance. What you'll be doing: Lead and develop the internal software and data engineering teams across cloud data, integration, and application development. Own and prioritise the software development backlog in partnership with project managers and … business stakeholders. Oversee delivery of Synapse pipelines, data interfaces, API platforms, and front-end portals across mobile and desktop. Manage BAU support for core pipelines and ensure service reliability, issue resolution, and continuous improvement. Drive agile delivery practices, sprint planning, and DevOps automation including CI/CD and More ❯