1 to 25 of 59 Data Ingestion Jobs in England

Data Engineer Tech for good - up to £52,000 1 day a week - London My Client is in the tech for good space working to protect children globally. They are looking for a Data Engineer who will report directly to the Head of Data and is responsible … for building and maintaining of the Enterprise Data Platform, including data ingestion pipelines and data models. Responsibilities/skills required: Experience working the entire data lifecycle, building relevant data models and pipelines that meet business requirements Minimum of 3 years experience in a Data Engineering role Must have strong experience with Snowflake and SQL Implement data solutions making sure the data is accessible, accurate and up-to-date Strong experience with data management, data migration, data ingestion, data transformation, data storage, data quality, data more »

Data Scientist/Engineer - Hybrid/Bristol Job Title : Data Scientist/Engineer Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Role will be based with the modelling team. 25% Data Submission and Cleansing (Data Engineer), 75% Process Improvement (Data Science). Ideally, seeking someone with strong Data Science exposure but Data Engineering skills. Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate advanced machine learning elements into data pipelines to elevate … data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile development setting to meet project objectives and deadlines. Harness modern more »

Data Scientist/Data Engineer - Mid Level - Hybrid in Bristol (2-3 days) £50,000 - £60,000 About Based in Bristol, our client is at the forefront of cyber risk assessment and management. Their innovative approach and proprietary models are revolutionising the way cyber risk is understood and … excellence and innovation, making them leaders in their field. Position Overview Our client is on the lookout for a talented and experienced Mid-Level Data Scientist/Data Engineer to play a crucial role in the development and operations of their automated ingestion system. This role is … ideal for someone passionate about crafting sophisticated data ingestion pipelines that incorporate advanced ML components and thrives in a dynamic, agile environment. Key Responsibilities - Automated Ingestion System Development: Be a key player in the design, development, and maintenance of sophisticated data ingestion pipelines, ensuring they more »

Job Specification: Mid-Level Data Scientist/Data Engineer About Us Based in Bristol, we are at the forefront of cyber risk assessment and management. Our innovative approach and proprietary models are revolutionizing the way cyber risk is understood and mitigated in the reinsurance domain. We are committed … to excellence and innovation, making us leaders in our field. Position Overview We are on the lookout for a talented and experienced Mid-Level Data Scientist/Data Engineer to play a crucial role in the development and operations of our automated ingestion system. This role is … ideal for someone passionate about crafting sophisticated data ingestion pipelines that incorporate advanced ML components, and who thrives in a dynamic, agile environment. Key Responsibilities Automated Ingestion System Development: Design, develop, and maintain efficient, scalable, and reliable data ingestion pipelines. ML Component Integration: Integrate advanced more »

Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their team and … be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data Flow, and more. … The Data Team: The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining their data platform, they extract data from source, transform it into a usable format, load it into consumer models & marts as well more »

Job Title: Data Warehouse Developer Location: Rotherham Salary: Up to £40,000 Hours: Monday to Friday 9 am - 5.30 pm Benefits: 25-day annual leave entitlement, plus bank holidays. A Continuous Learning Program to keep you in the loop with relevant progression within the business and changes to economic … because we may consider covering the cost of your annual subscription/membership. Workplace Pension is provided by Scottish Widows About the position of Data Warehouse Developer Working for a leading home improvements lender driving positive market change, we have a newly created vacancy available for a Data Warehouse Developer, reporting to the Head of IT. You will be responsible for the design, development, and maintenance of the company's data warehouse. This role involves working closely with business stakeholders, data analysts, and the IT team to ensure the data warehouse meets business needs more »

week. Key Responsibilities : As a Azure Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements: Deliver … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

days a week. As a Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements of the … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

Working with a top tier Digital Asset Management firm who are looking for an adept and experienced Data Engineer to play a critical role in shaping and managing their data engineering platform. This role demands strong technical skills and a proven ability to work closely with quantitative researchers … ensuring seamless integration of data engineering processes to support our quantitative investment strategies. Key Responsibilities: Collaborate closely with quantitative researchers to understand their data needs, offer technical solutions, and effectively integrate data engineering with quantitative strategies. Design, develop, and optimize robust data pipelines, facilitating ETL processes … that support quantitative research, analysis, alpha forecasting, and execution. Implement stringent data quality assurance measures to ensure the accuracy, reliability, and consistency of data inputs and outputs. Evaluate, select, and manage appropriate data engineering tools, technologies, and infrastructure, with a focus on scalability and automation. Work with more »

and support of BTs Strategic SIEM development. We are seeking a skilled Software Engineer with expertise in Elasticsearch (or other SIEM and/or Data platforms) to join our dynamic team. As a Software Engineer you will play a critical role in designing, developing, and maintaining our security information … focus will be on leveraging Elasticsearch and related technologies to enhance threat detection, incident response, and overall security posture. What you’ll be doing • Data Ingestion and Enrichment: o Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka o Enhance data enrichment … Team Lead for the year and work towards achieving these. You'll have the following experience • ETL Processes with Logstash Design, develop, and maintain data pipelines using Logstash, part of the Elastic Stack. Automate data ingestion, transformation, and loading tasks. • Beats for Data Collection Configure and more »

market. They are a dynamic financial service business that provides innovative solutions in credit risk assessment and sustainable finance. This newly created role of Data Warehouse Developer reports to the Head of IT and is responsible for the design, development, and maintenance of the company’s data warehouse. … This role involves working closely with business stakeholders, data analysts, and the IT team to ensure the data warehouse meets business needs and performance standards. Responsibilities: Design and develop data models and schemas for the data warehouse. Build and maintain ETL (Extract, Transform, Load) processes to … integrate data from various sources. Develop complex SQL queries and scripts to ensure efficient data retrieval and manipulation. Responsible for the build and deployment of data warehouse capabilities. Ensure data quality and integrity through validation and cleansing processes. Implement data warehousing best practices for data more »

benefits Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with business … activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the use of data to improve business performance. The role will require playing a highly collaborative role by overseeing cross-functional data governance while ensuring the adoption and adherence to data quality are understood by stakeholders. Key Responsibilities Responsible for designing effective, efficient data models to support various types of more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role … requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal Data Engineer will: Identify opportunities for … automation and process improvement. Mentor and guide data engineers. Establish coding standards and best practices. Implement and document data integrity and quality checks. Optimize queries. Facilitate collaboration within the data engineering team. This role involves close collaboration with the Principal Cloud Engineer and the Data Architect more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role … requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal Data Engineer will: l Identify opportunities … for automation and process improvement. l Mentor and guide data engineers. l Establish coding standards and best practices. l Implement and document data integrity and quality checks. l Optimize queries. l Facilitate collaboration within the data engineering team. l This role involves close collaboration with the Principal more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. This consultancy … the office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 15 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial services client is required Desirable: Data more »

Principal Data Engineer Northwest Up to £76,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team across numerous … specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data Architect, as it is key more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to realise consistent … trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you'll also … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Senior Principal Consultant, Data Architect/Data Engineer! In this role, you will … play a pivotal role in designing and implementing robust data solutions. Your technical expertise and leadership will drive the success of our big data initiatives. Good level of experience is required. Responsibilities: Build robust, high-performance, and adaptable solutions for modern platforms (GCP Big Query,Relational, OLAP) Finance … data modelling extensive experience desired as the data lead. Talend/Informatica transformation logic experience is required Technical thought leadership on architecture, data modeling, and Big Data strategy Expertise in technical principles, vision, and standards for data warehouse. Scalability to handle increasing data demands more »

Data Engineer – Azure A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment. Based in either Derby or London, the … to the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward. Key Responsibilities As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented team … the candidate will oversee the management and maintenance of existing data pipelines, monitor workloads, conduct root cause analysis, ensure data quality, and escalate technical issues as necessary. What you’ll be getting up to: Monitoring and recovery of Azure Data Factory and Databricks jobs Proactive monitoring of more »

Solution Architect, Microsoft Azure, Data Warehousing, Technical Integration Architect, API, ERP, Cloud Technology Operations, TOGAF, Logic Apps, Function Apps, Azure Message Bus, Remote Solution Architect, Technical Integrations Architect (within Data, API, ERP) required towork for a fast growing Enterprise business based in Central London. However, this will be … hands on and technology driven role where we need this person to be a solid Solution Architect within Cloud Technology Operations. You MUST have Data Architect/Data Ingestion/Data Warehousing experience within the likes of API and ERP. This is strictly a Microsoft Stack … Experience of designing, reviewing, improving Cloud Technology Operations Understanding of various integration patterns such as point-to-point, hub-and-spoke, publish-subscribe, etc. Data Ingestion and Data Warehousing experience Knowledge of middleware and messaging technologies like enterprise service buses (ESBs), message queues, and event-driven architecture. more »