2 of 2 Data Lake Jobs in Bedford

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … unusual data profiles and establish recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions … implementing ETL processes. Experience in using SQL to query and manipulate data. Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory. Understanding of data extraction from vendor REST APIs. Spark/Pyspark or Python skills a bonus More ❯

Data Lead This role can be based in either UK or Portugal Who we are? Verifile is an award-winning leading provider of CV verification and background screening services using innovative technology and methodology. We carry out background checks on candidates to enable our clients to make informed and long-term rewarding recruitment decisions. As Data Lead, youll be the driving force behind ensuring our data is accurate, secure, and fully leveraged. Youll create a single source of truth, turning information into actionable insights and uncovering opportunities that give us a competitive edge. Youll design and evolve Verifiles data infrastructure, adopting emerging technologies to boost performance and efficiency. Partnering with … approach. Experience in SaaS or platform-based businesses is a plus. Experience in data roles (data engineering, BI, analytics or architecture). Data lake storage, SQL database, NoSQL Sound understanding of database architecture and relevant underpinning concepts, including relational data modelling, frameworks, warehouse and data lake design, performance More ❯