26 to 49 of 49 Permanent Data Ingestion Jobs in England

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a brand new … Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data and work within an … organisation who are providing significant investment into all of their data teams. The teams itself are growing in size but the company are also investing in the technology that they use with an emphasis on Microsoft tech such as Azure Synapse, Databricks and Data Factory. As part of more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve … their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions … like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse business more »

Rivington Rd, Preston Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … quality products and services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting … visualisation, analysis, and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data more »

Junior Data Architect- £50,000- £58,000 + Fantastic Pension & Benefits Bath- Hybrid working with 5 days per month working onsite This is an exciting time to join as leading business is embarking on the next stage of its digital transformation journey. They are transforming the way data & technology services are delivered and are looking to bring in a Data Architect to design, build, and optimise the data architecture to support the evolving business needs. My client would consider someone who is looking to step up and develop their career within data architecture and … offer excellent support, Role: You will collaborate closely with the business to understand our existing data landscape, identify opportunities for improvement, and develop strategic plans for managing and integrating data across the organisation. Design and implement scalable data architectures that support data ingestion, storage, processing more »

Data Engineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data is … department to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained … Working with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using Azure services more »

I am partnered with an innovation & transformation consultancy that are on the lookout for an SC Cleared Data Engineer in their Bristol office. Join one of the UK's largest innovation & transformation consultancies dedicated to shaping the future of public sector engagements. We pride ourselves on delivering cutting-edge … solutions that drive impactful change and foster growth in the community. Key Responsibilities: Utilize your expertise in Azure to design, develop, and maintain data solutions tailored to the unique requirements of public sector projects. Engage in end-to-end data engineering processes, including data ingestion, transformation … Requirements: SC clearance is essential for this role. Bachelor's degree in Computer Science, Engineering, or related field. Minimum of 4 years' experience in data engineering roles, preferably within a consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure … Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Senior Data Engineer 💰 £85,000-£100,000 🖥️ Snowflake, AWS, dbt, Terraform 🌍 London, 2-3 days a week in London office We are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for a … Senior Data Engineer. The role... As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to enhance understanding … of customer behaviors, market trends, and operational efficiencies. What you'll be doing... You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality. You will be architecting and building the next generation Data Platform. You will construct data models, pipelines, and stores to more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. To … help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its next phase … of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless data operations and more »

Principal GCP Data Engineer Remote Up to £85,000 VIQU are seeking Principal GCP Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team … across numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal GCP Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will include … data ingestion, quality, modelling, transformation, security, and monitoring. The Principal GCP Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data Architect more »

Data Scientist London (hybrid working model) £60,000 - £90,000 + bonus My Client is one of the leading private equity firms in Europe. They are looking for a Data Scientist to join a growing team where you will be designing end-to-end solutions; from data ingestion and processing, to running predictive ML models, and serving outputs for consumption by the business. RESPONSIBILITIES Designing Machine learning models to be applied to financial market products. Working within a team of Data Scientists, Machine Learning Engineers, and Investment Analysts to add value to key stakeholders. … Be a key part of the strategy for multi-million pound decisions! REQUIREMENTS Masters/PhD degree in Computer Science or STEM subject Commercial Data Science experience Knowledge of statistics and common supervised machine learning algorithms. Time Series & probabilistic modelling experience is preferred. Experience in delivery of end-to more »

Head of, Machine Learning and Data Science Center of Excellence Salary: £105,000 - £130,000 dependant on skills and experience Location: Remote, United Kingdom Contract: Permanent Hours: 37.5 Williams Lea, a leading global business process outsourcing (BPO) firm, seeks a visionary and hands-on Senior Manager to spearhead the … establishment and oversight of a Machine Learning and Data Science Center of Excellence. This strategic role will be instrumental in driving AI and tech enablement initiatives across the company's diverse service offerings, creating market differentiation, increasing profit margins, and delivering superior service to clients. Williams Lea serves clients … in 20 countries across four continents and has 7,000 employees worldwide. Key responsibilities Develop and execute a comprehensive strategy for the ML and Data Science Center of Excellence, aligning with the company's overall business objectives and tech enablement goals. - Build and lead a high-performing, cross-functional more »

Developer will need as much of the following as possible. Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. Assess, analyse … data ingestion, transformation & storage layers (RAW, Exploratory, Curated application) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD pipelines built. ... more »

Role Purpose: In this role you will use your expertise in battery systems and data analysis to work at the interface between our powerful software products and our customers. You will support our customers in turning battery data into longer lasting, safer, and higher performing batteries. You will … This starts with onboarding – getting customers online with both the internal Cloud and Embedded platforms. You will then support through expert monitoring of the data, interpretation of insights, and if necessary, deep diving into the data to identify all-new insights, be it an opportunity to unlock performance … of Concepts and Demos. Drive and take ownership of end-to-end technical delivery for customer onboarding; identify and resolve issues and risks. Conduct data quality reviews and validate customer datasets through existing algorithms and analytics functions. Identify gaps in data quality and either develop workarounds to enable more »

their field for over two decades. Building upon their continued success, they are launching the search for an Analytics Engineer within a 10-strong Data team to help support the development of their BI reporting and Data Platform. This will be a business-facing role, with a …/50 split between BI reporting/analysis and data ingestion, and would suit someone with a couple years experience across Python , ETL, (AWS, Azure or GCP) and any BI tool (PowerBI, Tableau, Qlik, QuickSight, or GoodData - it's more about the transferable skills!). This is an more »

assessment) with a focus on NER. Leverage CI/CD & containers for seamless integration & scalability. Automate ML Workflows: Build robust MLOps pipelines to automate data ingestion, pre-processing, model training & serving for efficient NLP workflows. Champion NLP Expertise: Collaborate with data science teams, translate model requirements into more »

We're representing a dynamic business dedicated to extending healthy lifespans and cutting unnecessary medical costs. They're seeking a Senior Data Engineer to propel their Data team forward. Key Responsibilities: Lead Cloud Data Warehouse Project: Oversee the next development phase, ensuring top-notch scalability, reliability, and … performance. Data Management Ownership: Be the go-to expert for data management, ensuring smooth operations and accessibility. Support BAU Workloads: Assist in prioritising and managing day-to-day tasks for efficiency and alignment with goals. Set Technical Direction: Define the systems and tools' technical direction, advancing towards ML … and AI integration. Required Experience: Snowflake: Proficiency in setup, configuration, and optimisation. DBT (Data Build Tool): Strong skills in managing transformations and data pipelines. Python: Expertise in scripting, automation, and data manipulation. Beneficial Experience: Dagster/Airflow: Managing complex workflows. Qlik Sense Cloud/Tableau: Data more »

knowledge of Docker Experience working with a modern JavaScript framework such as React JS, Vue or Angular Experience with management and analysis of large data sets What you'll need to do: You will be working as part of a team of skilled software developers, building and delivering our … diverse client base, Integrates a wide range of digital services across the Cavendish team. The platform offers a wide range of features including, API data ingestion, aggregation and analytics, insight generation and dashboarding, reporting and notification, AI Data processing, social media integrations and much more. Write clean more »

are high-performing and scalable Leverage Azure services to create and manage cloud-based applications (SQL DB, App Services, Azure FrontDoor, SignalR) Create efficient data ingestion and indexing pipelines using Elasticsearch Design, develop, and maintain efficient, reusable, and reliable C# code Implement necessary infrastructural changes for successful application more »

travel to London). Please see the desired skill-set below: SAS VIYA expertise and relevant experience. Ability to develop ETL solutions to surface data in SAS Troubleshooting SAS on Cloud functional and data ingestion problems. SAS 9.4 + expertise and relevant experience. Understand user/project more »

based technologies. Key Responsibilities: Design and implementation of Automation products, IT tooling, scanning solutions, CI/CD etc. Automation based Architecture/Engineering Enhancing data ingestion and processing Providing core input for Ansible technologies Design, implement, and manage CI/CD pipelines for continuous integration and deployment. Applying … Expertise of Automation and CI/CD technology and tools Extensive knowledge of Automation products: Ansible/Ansible tower, Chef Inspec Strong understanding of data and related principles and environments Strong experience with SNOW/JIRA Deep expertise in Infrastructure As Code (IaC) Expertise on either Windows and/ more »

and have huge influence on the strategic and technical direction of the system moving forward. Responsibilities Design, build, and maintain software for real-time data ingestion, processing, and presentation. Collaborate with quants, traders, and developers to understand needs and deliver effective solutions. Ensure data accuracy and clarity more »

a Senior Backend Software Engineer (Node/Typescript), you will work on a range of upcoming exciting projects including a new AI product, developing data ingestion pipelines, services backing cutting-edge features in a SaaS web application and many more. The Senior Backend Software Engineer (Node/Typescript more »