6 Data Ingestion Jobs in the North of England

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload more »

to £100,000 dependent on experience, plus bonus and other benefits. An overview of the role: We're seeking talented individuals to join a Data & AI Strategy team of a consultancy that we're supporting, where you'll design and build strategies and operating models to transform organizations across … all industries through data & AI. All Managers and Senior Managers work as trusted advisors with senior clients, leading teams of consultants and technical specialists on large and complex projects. We're looking for candidates with consulting experience in sectors such as Transport, Energy, Utilities, Government, Defence, Consumer Products & Retail … the opportunity to take on leadership roles within the consultancy practice, honing your skills before taking them to clients. Why this role? As a Data & AI Operating Model Manager, you will play a leadership role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage more »

Title: Snowflake Data Engineer - 6-Month Contract (Inside IR35) Remote Pay rate: (Apply online only) per day dependent on skill set Position Overview: As a Snowflake Data Engineer, you will play a pivotal role in designing, developing, and maintaining our Snowflake data platform. Your expertise will be … critical in ensuring efficient data ingestion, transformation, and storage, enabling seamless data access and analytics across the organization. This position offers an excellent opportunity to work with cutting-edge technology and make a significant impact in a fast-paced environment. Responsibilities: Collaborate with stakeholders to understand data requirements and translate them into technical solutions within Snowflake. Design and implement scalable data pipelines for ingestion, transformation, and loading of data into Snowflake. Optimize performance and efficiency of Snowflake data warehouse through tuning, indexing, and partitioning strategies. Develop and maintain documentation, including data more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

The successful candidate will work closely with the BI Manager to to deliver and maintain end-to-end business intelligence solutions for Keepmoat., from data ingestion to analysis and visualisation through reports and dashboards that drive insights and improve decision-making across the organisation. Duties will include working … the hands-on development of metrics, reports, and dashboards. Responsibilities will also include the maintenance and optimisation of the Power BI service and championing data quality throughout the business. The ideal candidate will have 2-3+ years of proven professional experience in Business Intelligence/Analytics (Power BI … . They will have experience with Microsoft BI stack, relational database and SQL experience alongside experience working with ETL and/or data integration tools (preferably Informatica). Experience working in an agile environment (preferably with Azure DevOps) is also essential. Experience within the housebuilding industry, as well as more »

Job Description: Software Developer - Data Science & AI Programme We are a globally renowned research-intensive university committed to delivering the highest quality teaching and learning experiences. Positioned at the forefront of economic, social, and cultural development in the North East of England, we prioritize attracting and retaining exceptional talent … to drive our ongoing success. Role Overview: Join the Data Science & AI Programme at one of the Norths leading higher education institutions. Supported by £27M of NIHR funding, the IO integrates horizon scanning analysts, evidence synthesis researchers, and data scientists into a cohesive hub focused on observing and … on health innovation. Key Responsibilities: As a Software Developer, you will contribute significantly to enhancing and maintaining OpenScan, our in-house developed, cloud-based data science engine. Your role involves refining the data ingestion pipeline, responsible for aggregating, standardizing, and analyzing health data from diverse sources more »