2 Data Ingestion Jobs in Yorkshire

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload more »

The successful candidate will work closely with the BI Manager to to deliver and maintain end-to-end business intelligence solutions for Keepmoat., from data ingestion to analysis and visualisation through reports and dashboards that drive insights and improve decision-making across the organisation. Duties will include working … the hands-on development of metrics, reports, and dashboards. Responsibilities will also include the maintenance and optimisation of the Power BI service and championing data quality throughout the business. The ideal candidate will have 2-3+ years of proven professional experience in Business Intelligence/Analytics (Power BI … . They will have experience with Microsoft BI stack, relational database and SQL experience alongside experience working with ETL and/or data integration tools (preferably Informatica). Experience working in an agile environment (preferably with Azure DevOps) is also essential. Experience within the housebuilding industry, as well as more »