26 to 50 of 59 Data Ingestion Jobs in England

Data Engineer – Azure A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment. Based in either Derby or London, the … to the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward. Key Responsibilities As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented team … the candidate will oversee the management and maintenance of existing data pipelines, monitor workloads, conduct root cause analysis, ensure data quality, and escalate technical issues as necessary. What you’ll be getting up to: Monitoring and recovery of Azure Data Factory and Databricks jobs Proactive monitoring of more »

Solution Architect, Microsoft Azure, Data Warehousing, Technical Integration Architect, API, ERP, Cloud Technology Operations, TOGAF, Logic Apps, Function Apps, Azure Message Bus, Remote Solution Architect, Technical Integrations Architect (within Data, API, ERP) required towork for a fast growing Enterprise business based in Central London. However, this will be … hands on and technology driven role where we need this person to be a solid Solution Architect within Cloud Technology Operations. You MUST have Data Architect/Data Ingestion/Data Warehousing experience within the likes of API and ERP. This is strictly a Microsoft Stack … Experience of designing, reviewing, improving Cloud Technology Operations Understanding of various integration patterns such as point-to-point, hub-and-spoke, publish-subscribe, etc. Data Ingestion and Data Warehousing experience Knowledge of middleware and messaging technologies like enterprise service buses (ESBs), message queues, and event-driven architecture. more »

to £100,000 dependent on experience, plus bonus and other benefits. An overview of the role: We're seeking talented individuals to join a Data & AI Strategy team of a consultancy that we're supporting, where you'll design and build strategies and operating models to transform organizations across … all industries through data & AI. All Managers and Senior Managers work as trusted advisors with senior clients, leading teams of consultants and technical specialists on large and complex projects. We're looking for candidates with consulting experience in sectors such as Transport, Energy, Utilities, Government, Defence, Consumer Products & Retail … the opportunity to take on leadership roles within the consultancy practice, honing your skills before taking them to clients. Why this role? As a Data & AI Operating Model Manager, you will play a leadership role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage more »

Azure Data Engineer. Contract. Remote Python/PyTest/Azure/Databricks Notebooks Our client, a leading consultancy are looking to bring in an Azure Data Engineer to support their data transformation and wondered if you could be open to a chat? If so, please find more … contract, Location: Remote with very occasional travel to any of their offices across the UK (Scotland, Manchester, Midlands, London, Bristol + others) Experience required: Data inventory and data familiarisation Efficient data ingestion and ingestion pipelines Data cleaning and transformation Databricks (ideally with Unity Catalog more »

Data Engineer £80,000-£95,000 London, Hybrid Permanent I am seeking an experienced Data Engineer who is passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines across diverse sources, enhancing the quality … of data for our systems, and readiness to meet the challenges of scale. Responsibilities: Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices. Design robust data processing and indexing pipelines handling large amounts of data across several … modalities, ensuring robustness and timeliness. Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability. Requirements: Strong programming more »

We are excited to be working with a Direct-to-Consumer VC-backed startup looking to hire an exceptional Head of Data into their London office. Having raised a substantial Series B funding round from top investors, they’re now keen to bring in an experienced Head of Data to lead and develop their growing data team. You will report directly to the VP Engineering, playing a key role in introducing structure and rigour to how the company uses its data and creating a data-driven culture throughout the organisation. You will inherit a small … but-mighty team of 5 including data engineers, analytics engineers and a software engineer, and mentoring and developing your direct reports will be a key aspect of this role. You will tackle a broad range of problems, from developing cutting edge data product solutions to maintaining and building more »

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a brand new … Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data and work within an … organisation who are providing significant investment into all of their data teams. The teams itself are growing in size but the company are also investing in the technology that they use with an emphasis on Microsoft tech such as Azure Synapse, Databricks and Data Factory. As part of more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve … their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions … like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse business more »

Rivington Rd, Preston Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … quality products and services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting … visualisation, analysis, and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data more »

Junior Data Architect- £50,000- £58,000 + Fantastic Pension & Benefits Bath- Hybrid working with 5 days per month working onsite This is an exciting time to join as leading business is embarking on the next stage of its digital transformation journey. They are transforming the way data & technology services are delivered and are looking to bring in a Data Architect to design, build, and optimise the data architecture to support the evolving business needs. My client would consider someone who is looking to step up and develop their career within data architecture and … offer excellent support, Role: You will collaborate closely with the business to understand our existing data landscape, identify opportunities for improvement, and develop strategic plans for managing and integrating data across the organisation. Design and implement scalable data architectures that support data ingestion, storage, processing more »

Data Engineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data is … department to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained … Working with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using Azure services more »

I am partnered with an innovation & transformation consultancy that are on the lookout for an SC Cleared Data Engineer in their Bristol office. Join one of the UK's largest innovation & transformation consultancies dedicated to shaping the future of public sector engagements. We pride ourselves on delivering cutting-edge … solutions that drive impactful change and foster growth in the community. Key Responsibilities: Utilize your expertise in Azure to design, develop, and maintain data solutions tailored to the unique requirements of public sector projects. Engage in end-to-end data engineering processes, including data ingestion, transformation … Requirements: SC clearance is essential for this role. Bachelor's degree in Computer Science, Engineering, or related field. Minimum of 4 years' experience in data engineering roles, preferably within a consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure … Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

who shares this vision. What the role will be doing: Designing, developing, and maintaining high-performance databases Collaborate with cross-functional teams to understand data requirements Optimize and enhance database performance Troubleshoot and resolve database issues Stay updated on the latest trends and technologies in database development Experience needed … Strong experience within Azure database development Experience of designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server Data ingestion into the data warehouse using SSIS & databricks. Transformation of data Azure Synapse Configuring source ingestion more »

Senior Data Engineer 💰 £85,000-£100,000 🖥️ Snowflake, AWS, dbt, Terraform 🌍 London, 2-3 days a week in London office We are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for a … Senior Data Engineer. The role... As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to enhance understanding … of customer behaviors, market trends, and operational efficiencies. What you'll be doing... You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality. You will be architecting and building the next generation Data Platform. You will construct data models, pipelines, and stores to more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. To … help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its next phase … of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless data operations and more »

Data Scientist London (hybrid working model) £60,000 - £90,000 + bonus My Client is one of the leading private equity firms in Europe. They are looking for a Data Scientist to join a growing team where you will be designing end-to-end solutions; from data ingestion and processing, to running predictive ML models, and serving outputs for consumption by the business. RESPONSIBILITIES Designing Machine learning models to be applied to financial market products. Working within a team of Data Scientists, Machine Learning Engineers, and Investment Analysts to add value to key stakeholders. … Be a key part of the strategy for multi-million pound decisions! REQUIREMENTS Masters/PhD degree in Computer Science or STEM subject Commercial Data Science experience Knowledge of statistics and common supervised machine learning algorithms. Time Series & probabilistic modelling experience is preferred. Experience in delivery of end-to more »

Head of, Machine Learning and Data Science Center of Excellence Salary: £105,000 - £130,000 dependant on skills and experience Location: Remote, United Kingdom Contract: Permanent Hours: 37.5 Williams Lea, a leading global business process outsourcing (BPO) firm, seeks a visionary and hands-on Senior Manager to spearhead the … establishment and oversight of a Machine Learning and Data Science Center of Excellence. This strategic role will be instrumental in driving AI and tech enablement initiatives across the company's diverse service offerings, creating market differentiation, increasing profit margins, and delivering superior service to clients. Williams Lea serves clients … in 20 countries across four continents and has 7,000 employees worldwide. Key responsibilities Develop and execute a comprehensive strategy for the ML and Data Science Center of Excellence, aligning with the company's overall business objectives and tech enablement goals. - Build and lead a high-performing, cross-functional more »

as a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. - Extensive ETL … and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyse, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application ) - Understand and provide inputs for STT documents. - Design and develop the data pipelines using GoLang programming. - Able more »

as a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. - Extensive ETL … and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application) - Understand and provide inputs for STT documents. - Design and develop the data pipelines using GoLang programming. - Able more »

Golang Developer - £500 per day - London/remote - 12 months Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. Duties Assess … analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD pipelines built. Essential … Skills: Extensive ETL and Data warehousing experience Strong experience in GoLang programming Google Cloud Services and BigQuery more »

days pweek) iR35 determination - Inisde iR35 Duration - 6 months Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud Key Responsibilities Assess … analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application ) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD pipelines built. Essential … Skills Extensive ETL and Data warehousing experience Strong experience in GoLang programming Google Cloud Services and BigQuery more »

Developer will need as much of the following as possible. Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. Assess, analyse … data ingestion, transformation & storage layers (RAW, Exploratory, Curated application) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD pipelines built. more »

Role Purpose: In this role you will use your expertise in battery systems and data analysis to work at the interface between our powerful software products and our customers. You will support our customers in turning battery data into longer lasting, safer, and higher performing batteries. You will … This starts with onboarding – getting customers online with both the internal Cloud and Embedded platforms. You will then support through expert monitoring of the data, interpretation of insights, and if necessary, deep diving into the data to identify all-new insights, be it an opportunity to unlock performance … of Concepts and Demos. Drive and take ownership of end-to-end technical delivery for customer onboarding; identify and resolve issues and risks. Conduct data quality reviews and validate customer datasets through existing algorithms and analytics functions. Identify gaps in data quality and either develop workarounds to enable more »