1 to 25 of 31 Permanent Data Ingestion Jobs in the UK

Job Title: Data Warehouse Developer Location: Rotherham Salary: Up to £40,000 Hours: Monday to Friday 9 am - 5.30 pm Benefits: 25-day annual leave entitlement, plus bank holidays. A Continuous Learning Program to keep you in the loop with relevant progression within the business and changes to economic … because we may consider covering the cost of your annual subscription/membership. Workplace Pension is provided by Scottish Widows About the position of Data Warehouse Developer Working for a leading home improvements lender driving positive market change, we have a newly created vacancy available for a Data Warehouse Developer, reporting to the Head of IT. You will be responsible for the design, development, and maintenance of the company's data warehouse. This role involves working closely with business stakeholders, data analysts, and the IT team to ensure the data warehouse meets business needs more »

week. Key Responsibilities : As a Azure Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements: Deliver … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

days a week. As a Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements of the … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

we do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

market. They are a dynamic financial service business that provides innovative solutions in credit risk assessment and sustainable finance. This newly created role of Data Warehouse Developer reports to the Head of IT and is responsible for the design, development, and maintenance of the company s data warehouse. … This role involves working closely with business stakeholders, data analysts, and the IT team to ensure the data warehouse meets business needs and performance standards. Responsibilities: Design and develop data models and schemas for the data warehouse. Build and maintain ETL (Extract, Transform, Load) processes to … integrate data from various sources. Develop complex SQL queries and scripts to ensure efficient data retrieval and manipulation. Responsible for the build and deployment of data warehouse capabilities. Ensure data quality and integrity through validation and cleansing processes. Implement data warehousing best practices for data more »

of a successful, dynamic, and creative global business then we want to hear from you. The Opportunity: We have an exciting opportunity for a Data Warehouse Architect to join a rapidly growing data team in Clarion. The role will report into the Senior Architect, with responsibility to analyse … to overcome complex challenges, and grow your design through developing skills with the new initiatives we are looking to explore. Key Responsibilities: Analyse existing data design and suggest improvements that promote performance, stability, and interoperability. Work with product management and business subject matter experts to translate business requirements into … good database design. Work with internal and external resources to develop robust Extract/Transform/Load (ETL) processes for disparate data sources. Strong knowledge of setting up and maintaining synapse pipelines within Azure. Good knowledge of acquiring data from various Rest, Soap, SFTP, Landing Zones and obtaining more »

benefits Please note: you need to have the right to work in the UK no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with business … activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the use of data to improve business performance. The role will require playing a highly collaborative role by overseeing cross-functional data governance while ensuring the adoption and adherence to data quality are understood by stakeholders. Key Responsibilities Responsible for designing effective, efficient data models to support various types of more »

Lead Data Engineer Salary: Up to £50,000 National/Up to £60,000 London Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for a highly skilled data engineer with significant experience of snowflake. As … well as being an expert in the snowflake cloud platform, you’ll have a strong background in data ingestion and integration, designing and implementing data pipelines on various technologies, data modelling, and a rounded understanding of data warehousing. Aviva believes strongly in experimentation leading to … industrialisation and we are searching for passionate, energetic data engineers who are focussed on using their skills to drive out real business value for our customers. A bit about the job: An exciting opportunity within one of our data engineering teams for a highly skilled individual to work more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

high aspirations for strategic expansion and growth to be achieved through both organic and acquisitive means. The Role: We are currently hiring for a Data Architect, who will be accountable for architecting, enhancing, managing, and supporting a highly available, distributed, cloud data platform for Sysco International business units … and enterprise data. The Architect will collaborate with the International business units, US architecture team and Sysco 3rd party Vendors to create data solution andl ensure alignment between the international businesses in the deployment of initiatives. The role will also be the point of escalation for the International technology … will form part of the International Business Technology Team and will work closely with all the International business units and 3rd party contractors. The Data Architect will play a key role in Data Platform projects, the implementation of which is critical to the business operations and business-wide more »

Solution Architect, Microsoft Azure, Data Warehousing, Technical Integration Architect, API, ERP, Cloud Technology Operations, TOGAF, Logic Apps, Function Apps, Azure Message Bus, Remote Solution Architect, Technical Integrations Architect (within Data, API, ERP) required towork for a fast growing Enterprise business based in Central London. However, this will be … hands on and technology driven role where we need this person to be a solid Solution Architect within Cloud Technology Operations. You MUST have Data Architect/Data Ingestion/Data Warehousing experience within the likes of API and ERP. This is strictly a Microsoft Stack … Experience of designing, reviewing, improving Cloud Technology Operations Understanding of various integration patterns such as point-to-point, hub-and-spoke, publish-subscribe, etc. Data Ingestion and Data Warehousing experience Knowledge of middleware and messaging technologies like enterprise service buses (ESBs), message queues, and event-driven architecture. more »

About the role: My client is seeking an experienced Senior Data Engineer with a specialisation in Snowflake and DBT to own and evolve the company's data stack. The ideal candidate for this role will be a self-starter with a knack for problem-solving and a strong … ability to learn new skills quickly. Key responsibilities include designing and developing scalable data models and warehouses, creating and maintaining database objects, and ETL processes for loading data into Snowflake. Proven proficiency in SQL, database optimisation, and effective database security implementation is a must (working closely with Data … Snowflake best practices and new features. This role is perfect for someone who enjoys the challenge of working with Snowflake and is passionate about data engineering. Key responsibilities: Design and build data pipelines in Snowflake. Collaborate with stakeholders, including the Data Science Team, to define data more »

ideally with experience in the media industry, we re looking for an experienced engineer who is a real team individual to join our core data platform team, As a key member of our team, you will be responsible for developing systems for the ingest, processing, and summarization of audience … data, while also contributing to the future development of the BBC data platform. Over the next 12 months, we are transforming the platform proposition to enable data professionals to self-service their data needs from the platform in order to meet the huge demand for data across the organisation. This encompasses a wide data toolset, spanning data ingestion, transformation, developing systems for ingest, processing, and in summarization of audience data. Key Skills and Responsibilities You will: Testing: TDD, BDD, end-to-end, load testing, Stress Testing Database experience Have experience in cloud more »

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a brand new … Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data and work within an … organisation who are providing significant investment into all of their data teams. The teams itself are growing in size but the company are also investing in the technology that they use with an emphasis on Microsoft tech such as Azure Synapse, Databricks and Data Factory. As part of more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

Rivington Rd, Preston Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … quality products and services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting … visualisation, analysis, and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data more »

Data Engineer (6-Month Contract) - £450 per day inside IR35 Birmingham/Hybrid We are recruiting on behalf of a leading company dedicated to innovative solutions in waste management. As part of our ongoing commitment to excellence, we are currently seeking a skilled Data Engineer to join our … Commercial Waste programme on a 6-month contract basis. Role Overview We are looking for a talented Data Engineer to support enterprise data platforms and warehouses in Azure. You will play a crucial role in gathering detailed requirements from business sponsors/owners and executing data ingestion … reports is desirable but not essential. Key Responsibilities Collaborate with business sponsors/owners to understand and document detailed requirements. Design, develop, and maintain data pipelines using Azure Data Factory and Azure Databricks. Implement and manage SQL databases and queries. Develop and maintain data models to support more »

Senior Data Engineer £90,000 - £100,000 London - Hybrid - 2 day per week We are representing a market leading, international FMCG business who are looking for a Senior Data Engineer to join their organisation. This Data & Analytics team currently sits at 9 but is growing rapidly. You … will work closely with the Head of Data Management and will be the 2nd Data Engineering hire in the area. This is a real opportunity to shape and build-on their strong foundations to expand the Data capability. Our client has some well-running Data infrastructure … new Snowflake platform at its centre. The successful candidate will help add to this platform both in features and robustness. Expect to work on Data Ingestion as a big part of the first 6-months. As the Senior Data Engineer you will work with the UK arm more »

Data Platform Architect €110k-€135k + Health + Pension + more Remote working (Two days per month in Dublin Office) We are looking for an experienced Data Architect to join a collaborative team of experts focused on creating a world-class data platform. As a subject matter … expert, you will serve as a technical thought leader in data management, database systems, and information processes across the company. You will have the freedom to design innovative solutions to unique challenges, using data to improve workplace experiences. This opportunity will allow you to really put your stamp … to the table. The role: Acting as an SME on how information is collected, organized, and used within the company. Shape and lead our data strategy and architectural vision. Create design patterns and blueprints for data ingestion, processing, and transformation. Develop a multi-year data platform more »

Senior Azure/Databricks Data Engineer/Architect c£90k - (1-2 days in the office a month) - London We're working with a global organisation who have grown rapidly over the last few years and are expecting to double in size, mainly through M&A over the next … to recruit a Senior Azure/Databricks Engineer who is looking to move up into an Architecture role. Reporting to the Group Director of Data and Architecture you'll play a key role in the Azure Databricks platform capability build-out and operation. You will pay a key role … in designing, developing and managing data ingestion processes and transformation pipelines within Azure and Databricks environments and you'll create well-defined and governed data consumption models, adopting a data-as-a-product mindset. Candidates will need to have a Bachelor's degree in Computer Science more »

Junior Data Architect- £50,000- £58,000 + Fantastic Pension & Benefits Bath- Hybrid working with 5 days per month working onsite This is an exciting time to join as leading business is embarking on the next stage of its digital transformation journey. They are transforming the way data & technology services are delivered and are looking to bring in a Data Architect to design, build, and optimise the data architecture to support the evolving business needs. My client would consider someone who is looking to step up and develop their career within data architecture and … offer excellent support, Role: You will collaborate closely with the business to understand our existing data landscape, identify opportunities for improvement, and develop strategic plans for managing and integrating data across the organisation. Design and implement scalable data architectures that support data ingestion, storage, processing more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure … Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Data Scientist - London (Hybrid) - 200k+ Company We are working with a global energy trading organisation who are committed to building a best-in-class Data Science platform, as being at the forefront of data management and analytics is the foundation to their investment strategy. Role We are … looking for a Data Scientist with expertise in power, gas, or petroleum market analytics, time series forecasting, and machine learning model development to join the London team Your Responsibilities Collaborate with desk heads, traders, and analysts to understand data requirements and perform time series forecasting for European Power … Natural Gas, and Petroleum markets. Develop machine learning models and deliver end-to-end data science solutions using advanced analytics and custom coding. Apply mathematical and statistical fundamentals to enhance existing applications, create new data ingestion pipelines, and source new data sets. Communicate insights to stakeholders more »

The Role - Senior Software Engineer At Ophelos, we are revolutionising how data flows between us and our clients. Our small but dynamic I/O Squad plays a critical role in bridging this gap, ensuring seamless integration and information exchange. As we expand across Europe, we are looking for … role, you ll get to: Design, implement and deliver software features such as our developer dashboard to help external teams manage and debug the data integration process Collaborate as part of a close & multi-disciplinary team. Your work will have meaningful and measurable impact on our organisation and products … Build and maintain APIs capable of handling high-volume data ingestion from clients Own and deliver key projects such as batch file handling and transitioning existing integrations to our new API platform Mentor other members of the team to ensure technical excellence and continuously raise the bar when more »