76 to 100 of 442 Data Engineering Jobs in England

means that we’ve got one of the widest, most diverse, and most exciting datasets to work within the UK.The role responsibilities The Principal Data Engineer is a new role that will support the newly created Product Data Domain teams. You will help to build ETL pipelines to … ingest and transform data to develop the data products that will power key value use cases across the BBC. You will work in an agile multi-disciplinary team alongside product analytics developers, product data managers, data modelers and data operations managers, ensuring that all work … delivers maximum value to the BBC.Role and responsibilities will comprise of:· Leads and architects on developing robust and scalable complex data pipelines to ingest, transform, and analyse large volumes of structured and unstructured data from diverse data sources. Pipelines must be optimised for performance, reliability, and scalability more »

Senior Data Engineer Python – SQL – Azure 5 days a week in the office Up to £130,000 Are you a Senior Data Engineer ready to make a significant impact in the insurance industry? We have an exciting opportunity for you to join our esteemed client, a global insurance … solutions and exceptional service to clients worldwide. With a dedicated team of 90 underwriters, they are at the forefront of driving business success through data-driven insights. Role Overview: As a Senior Data Engineer, you will play a crucial role in empowering our underwriting team with robust data infrastructure. You will be responsible for designing, building, and optimizing ETL pipelines using SQL and Python. Leveraging the Azure Data Engineering stack, including Azure Data Factory (ADF) and Azure Synapse Analytics, you will ensure our data processes are efficient, scalable, and reliable. The Senior Data more »

a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python, AWS and web scraping is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global Pharmaceutical Services … provider Description This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. You will work … on designing and developing their company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers. Key Responsibilities: Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business. Explore solutions for optimising more »

Senior Data Scientist Mobysoft is one of the fastest growing SaaS providers in the UK and has been shortlisted in the "Top 50 fastest growing technology companies in the North" for four successive years. Mobysoft provides predictive analytical software that has helped our customers deliver tens of millions of … years and as a result we’re looking for great people to join our exciting team. Role overview We are an ambitious, customer-centric Data & Insights team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with … a focused product lens, driven by curiosity and a commitment to technical excellence. Data Science is pivotal to this mission. As a Senior Data Scientist you will take a leading role in researching, building, deploying and monitoring machine learning (ML) models, in close collaboration with cross-functional teams. more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our clients Data Platform. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. Ensure data integrity, monitoring, and alerting are integrated into all solutions. Create more »

Data Architect - UK Wide - Need to be DV Security Cleared Data Architect with experience in data modelling, data integration, and data architecture is required by a leading global consultancy. You must already hold DV (Developed Vetting) Security clearance to apply for this role Working with … some high-profile clients such as the MoD & government, you will be working on some of the most interesting data architecture projects going on at the moment. They offer remote working when needed with offices all over the UK for when you need to be in the office. There … will be the odd visit to the client side, but that will be project-dependent. Experience needed: Data Modelling; Data Integration & Processing; Data Storage; Information Consumption - ideally gained across E2E data deliveries. Experience in data toolsets and platforms supporting the architectural knowledge above. Experience in more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You … will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and implement scalable and secure data pipelines … that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams Share expertise by mentoring and showing best practices in data more »

develop scalable, cost-effective, and secure distributed architectures and solutions, utilizing appropriate GCP and AWS services and technologies.Lead, manage & mentor a small team of data engineers to design, develop, and implement data platforms, pipelines, and infrastructure for our multi-cloud product across GCP and AWS.Develop data pipelines … Design, implement, and maintain data pipelines that efficiently collect, process, and store large volumes of data from various sources, ensuring data quality and integrity.Continuously monitor, analyze, and optimize data pipelines to improve performance, reduce costs, and ensure reliability and scalability.Ensure that data solutions comply with … relevant data security and privacy regulations, and implement best practices for securing data at rest and in transit.Establish & govern a project wide data catalogue where we maintain the list of all data sets across the platform with the appropriate description of the data itemsRequired qualifications more »

Head of Data Engineering London £90k - £110k Hybrid Company Digitech are partnered with a scale-up SAAS business looking to bolster their Data team. The business are a data driven and AI focussed technology firm partnering with well known brands Globally, using cutting edge technology to … improve customer journeys and provide the firms with exceptional and real time data. Required 5 years of commercial data engineering or data architecture experience Hands on experience of developing solutions within public cloud Experience of greenfield Data Warehouse implementations, including Data Architecture principles Knowledge of … data science concepts and ability to promote solutions to production via machine learning engineering Hands-on knowledge of NoSQL and relational Databases, alongside relevant data modelling techniques ETL/ELT tooling Knowledge of DBT, Luigi or similar orchestration tooling of managing and developing a team in an more »

Data Scientist/Engineer - Hybrid/Bristol Job Title : Data Scientist/Engineer Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Role will be based with the modelling team. 25% Data Submission and Cleansing (Data Engineer), 75% Process Improvement (Data Science). Ideally, seeking someone with strong Data Science exposure but Data Engineering skills. Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate advanced machine learning elements into data pipelines to elevate … data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile development setting to meet project objectives and deadlines. Harness modern more »

Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's insurer whose size offers … agility and allows you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be designed … implemented from scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real Time … data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such … as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data with minimal more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead thier team! You'll play a pivotal role in bridging engineering best practices with thier data domain. Thier team is committed to transforming … data into actionable insights, aiding decision-making processes and enhancing our products. Your expertise will drive advancements in our data engineering practices, leading the development of new data products with a focus on data backends, infrastructure, and DataOps. If you thrive on enhancing infrastructure scalability … and designing sophisticated data architectures, then this role is perfect for you! Responsibilities Design Data Architecture: Spearhead the development of an event-driven operational data architecture. Optimize Infrastructure: Ensure the scalability and reliability of our data pipelines and infrastructure. Advance Data Privacy: Strengthen our data more »

Head of Data Engineering, to lead and grow a team in a mid market Financial Services business. Success will be developing a real time cloud based Data Platform that will offer valuable insights to numerous stakeholder across the business. To enable effective development of that platform a … of this leaders role will be consulting with and building great relationships with heads of various departments in the company. Ideal Candidate : Has led Data Engineering teams Worked in Real Time Data & Cloud Environment extensively Ideally experience working in Banking or Credit Demonstrable experience of developing a … Data Platform for business users and results In depth understanding of modern cloud based Data Technologies & Systems If you are currently leading a Data Engineering team, feeling a bit stale, and interested in taking on a mission to build a valuable Data Analytics platform within more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be involved … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data capabilities … maintain an effective professional community. Defining, updating and implementing Career Pathways to enhance capability development, talent management and reduce attrition. Defining and implementing the Data Engineering standards and Best Practices for DWP. Understanding the demands and development of the profession in the wider industry and feed this into more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be involved … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data capabilities … maintain an effective professional community. Defining, updating and implementing Career Pathways to enhance capability development, talent management and reduce attrition. Defining and implementing the Data Engineering standards and Best Practices for DWP. Understanding the demands and development of the profession in the wider industry and feed this into more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be involved … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data capabilities … maintain an effective professional community. Defining, updating and implementing Career Pathways to enhance capability development, talent management and reduce attrition. Defining and implementing the Data Engineering standards and Best Practices for DWP. Understanding the demands and development of the profession in the wider industry and feed this into more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be involved … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data capabilities … maintain an effective professional community. Defining, updating and implementing Career Pathways to enhance capability development, talent management and reduce attrition. Defining and implementing the Data Engineering standards and Best Practices for DWP. Understanding the demands and development of the profession in the wider industry and feed this into more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be involved … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data capabilities … maintain an effective professional community. Defining, updating and implementing Career Pathways to enhance capability development, talent management and reduce attrition. Defining and implementing the Data Engineering standards and Best Practices for DWP. Understanding the demands and development of the profession in the wider industry and feed this into more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be involved … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data capabilities … maintain an effective professional community. Defining, updating and implementing Career Pathways to enhance capability development, talent management and reduce attrition. Defining and implementing the Data Engineering standards and Best Practices for DWP. Understanding the demands and development of the profession in the wider industry and feed this into more »

Job summary Join a passionate NHS team helping to shape the future of healthcare. The Health Economics Unit is looking for a Senior Data Engineer to provide vital data and insights, as we support health and care providers in making impactful decisions to improve population health. As a … passionate member of our outstanding team, you will have a range of responsibilities, including: Data extraction and integration Data workflow management Data processing and transformation Data storage and management Quality assurance and governance Data analysis Collaboration and development The Senior Data Engineer will sit … within the Data and Analytics team, led by the Chief Analyst and reporting to the Lead Data Engineer, and working closely across HEU team, with data scientists, analysts, project managers, and health economists. You will also engage with our clients, partners and stakeholders throughout projects, understanding their more »

Job Role: Senior Data Analyst Location: Stockport Salary: £60,000 DOE The successful applicant will be responsible for developing and maintaining the data analysis strategy. This is a very exciting opportunity for someone to trailblaze Data and Data Engineering within this company. Responsibilities: Work closely … with C-Suite and Managers to map out the roadmap Develop and maintain the data analysis strategy for the organisation Provide data analysis expertise to the organisation Establish and maintain data flows and processes Analyse large data sets to identify trends and anomalies Develop data models to support decision making Monitor and analyse data to identify opportunities for improvement Develop reports and visualisations to support decision making Design and develop databases and data warehouses You will eventually manage a team of Data Specialists Required Skills: The succesful Senior Data Analyst more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the design … and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust … data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration more »

Job summary This is an exciting new opportunity to join the Health Foundation funded Networked Data Lab (NDL) embedded within the Health & Care Hub at the Leeds Office of the West Yorkshire Integrated Care Board (ICB in Leeds). This team spans across the ICB in Leeds and Leeds … to influence national policy. Main duties of the job If successful, the candidate will be responsible for aiding development of the ICB in Leeds data warehouse, developing the Leeds Data Model (LDM) - a health and social care data set linked on a person-level covering the population … of Leeds across primary care services, secondary care services, mental health services, community services, and social care services. Key work will include simplifying existing data sets within the LDM and bringing new data into the LDM for use by the NDL data scientists for research projects. As more »