1 to 25 of 32 Data Ingestion Jobs in the UK excluding London

Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their team and … be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data Flow, and more. … The Data Team: The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining their data platform, they extract data from source, transform it into a usable format, load it into consumer models & marts as well more »

Job Title: Data Warehouse Developer Location: Rotherham Salary: Up to £40,000 Hours: Monday to Friday 9 am - 5.30 pm Benefits: 25-day annual leave entitlement, plus bank holidays. A Continuous Learning Program to keep you in the loop with relevant progression within the business and changes to economic … because we may consider covering the cost of your annual subscription/membership. Workplace Pension is provided by Scottish Widows About the position of Data Warehouse Developer Working for a leading home improvements lender driving positive market change, we have a newly created vacancy available for a Data Warehouse Developer, reporting to the Head of IT. You will be responsible for the design, development, and maintenance of the company's data warehouse. This role involves working closely with business stakeholders, data analysts, and the IT team to ensure the data warehouse meets business needs more »

week. Key Responsibilities : As a Azure Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements: Deliver … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

days a week. As a Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements of the … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

and support of BTs Strategic SIEM development. We are seeking a skilled Software Engineer with expertise in Elasticsearch (or other SIEM and/or Data platforms) to join our dynamic team. As a Software Engineer you will play a critical role in designing, developing, and maintaining our security information … focus will be on leveraging Elasticsearch and related technologies to enhance threat detection, incident response, and overall security posture. What you’ll be doing • Data Ingestion and Enrichment: o Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka o Enhance data enrichment … Team Lead for the year and work towards achieving these. You'll have the following experience • ETL Processes with Logstash Design, develop, and maintain data pipelines using Logstash, part of the Elastic Stack. Automate data ingestion, transformation, and loading tasks. • Beats for Data Collection Configure and more »

benefits Please note: you need to have the right to work in the UK no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with business … activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the use of data to improve business performance. The role will require playing a highly collaborative role by overseeing cross-functional data governance while ensuring the adoption and adherence to data quality are understood by stakeholders. Key Responsibilities Responsible for designing effective, efficient data models to support various types of more »

benefits Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with business … activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the use of data to improve business performance. The role will require playing a highly collaborative role by overseeing cross-functional data governance while ensuring the adoption and adherence to data quality are understood by stakeholders. Key Responsibilities Responsible for designing effective, efficient data models to support various types of more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role … requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal Data Engineer will: Identify opportunities for … automation and process improvement. Mentor and guide data engineers. Establish coding standards and best practices. Implement and document data integrity and quality checks. Optimize queries. Facilitate collaboration within the data engineering team. This role involves close collaboration with the Principal Cloud Engineer and the Data Architect more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role … requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal Data Engineer will: l Identify opportunities … for automation and process improvement. l Mentor and guide data engineers. l Establish coding standards and best practices. l Implement and document data integrity and quality checks. l Optimize queries. l Facilitate collaboration within the data engineering team. l This role involves close collaboration with the Principal more »

Principal Data Engineer Northwest Up to £76,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team across numerous … specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data Architect, as it is key more »

Principal GCP Data Engineer Remote Up to £85,000 VIQU are seeking Principal GCP Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team … across numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal GCP Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will include … data ingestion, quality, modelling, transformation, security, and monitoring. The Principal GCP Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data Architect more »

Data Engineer – Azure A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment. Based in either Derby or London, the … to the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward. Key Responsibilities As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented team … the candidate will oversee the management and maintenance of existing data pipelines, monitor workloads, conduct root cause analysis, ensure data quality, and escalate technical issues as necessary. What you’ll be getting up to: Monitoring and recovery of Azure Data Factory and Databricks jobs Proactive monitoring of more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

Rivington Rd, Preston Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … quality products and services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting … visualisation, analysis, and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data more »

Junior Data Architect- £50,000- £58,000 + Fantastic Pension & Benefits Bath- Hybrid working with 5 days per month working onsite This is an exciting time to join as leading business is embarking on the next stage of its digital transformation journey. They are transforming the way data & technology services are delivered and are looking to bring in a Data Architect to design, build, and optimise the data architecture to support the evolving business needs. My client would consider someone who is looking to step up and develop their career within data architecture and … offer excellent support, Role: You will collaborate closely with the business to understand our existing data landscape, identify opportunities for improvement, and develop strategic plans for managing and integrating data across the organisation. Design and implement scalable data architectures that support data ingestion, storage, processing more »

Data Engineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data is … department to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained … Working with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using Azure services more »

I am partnered with an innovation & transformation consultancy that are on the lookout for an SC Cleared Data Engineer in their Bristol office. Join one of the UK's largest innovation & transformation consultancies dedicated to shaping the future of public sector engagements. We pride ourselves on delivering cutting-edge … solutions that drive impactful change and foster growth in the community. Key Responsibilities: Utilize your expertise in Azure to design, develop, and maintain data solutions tailored to the unique requirements of public sector projects. Engage in end-to-end data engineering processes, including data ingestion, transformation … Requirements: SC clearance is essential for this role. Bachelor's degree in Computer Science, Engineering, or related field. Minimum of 4 years' experience in data engineering roles, preferably within a consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks more »

experience in delivering a cloud-based solution to a problem based in the physical world. This work will support research, development and learning in data science (incl. machine learning), earth observation and digital twins. The key aim of the Front End is to expose (show) insights extracted from combining … a Front End on a cloud-based system (most likely AWS), in a reproducible, scalable and reusable way. The Front End will take in data from various sources (eg the land-surface physical model JULES, climate datasets, ecosystem-service models) produced with Python code by the TWINE scientists, and … the work will be to understand the scientific requirements, to document and test the Front End, and to adapt to continuous developments of the data to be exposed to users (more data, more geographical areas, etc.). Responsibilities Gather requirements for the Front End of the prototype digital more »