101 to 125 of 415 Data Engineering Jobs in the UK

Data Engineer (Azure) Up to £80,000 North London office x1 day per week OVERVIEW A successful & established B2C Insurance giant are hiring for a Data Engineer to join a strong, cross-functional Data team in the UK. You will be spearheading some of their key Data Engineering projects, working on an Azure tech stack. Proven experience using Azure Cloud Technology is essential for this role. Your responsibilities as a Data Engineer will include, but not be limited to: Spearhead Data Engineering work within the team, including ETL pipelines, CI/CD … platform engineering. Help guide and mentor junior team members on key Data Engineering projects for the business. Engage with senior business stakeholders and communicate technical concepts and projects to non-technical audiences. YOUR SKILLS & EXPERIENCE A successful Data Engineer (Azure) will have the following. Strong proficiency with more »

Founding Data Engineer Role update - this role is now contract only. And really a mix of data science and engineering... Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams or … they have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for someone … that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. more »

better informed and clearer financial decisions to create better financial well-being. The company has created a new role in the company in there data team. It's an existing time to join this scale-up. About the Senior Product Manager role We are looking for a very data-centric Senior Product Manager for the company's data engineering mission. Data is at the heart of everything this company does. It is an exciting time to join them as they have recently overhauled the global data platform and built new foundations. The Senior Product … with prior experience is advantageous or someone who is looking for that next step in their career will suit this role well. Accountable for: Data engineering roadmap Collaboration with stakeholders globally across multiple functions eg engineering, and commercial. Develop a data platform strategy to keep the more »

Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve … their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions … like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse business units more »

GOAT Interactive is looking for a Junior Data Engineer to join our Data Engineering team, this role will be responsible for the development, testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be working with technologies … such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so the scale of our data, we are currently working on several … initiatives to improve our data solution and you would become an integral part of this. Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity and quality. Manage ETL and ELT pipelines across many data more »

DATA ENGINEER £60,000 - £75,000 HYBRID - LONDON This new position is with a global consultancy who have recently expanded into supporting niche but data-driven companies in growing their data capabilities. This is a great position if you are looking to not only expand your knowledge … in data engineering but also in data science, BI, and Software Engineering, given the versatile nature of the role. THE COMPANY As mentioned, this consultancy operates on a global scale. Some of the clients you would therefore be working with are based overseas, not necessarily just … improve their capabilities, and you will become a big part of this. THE ROLE The team looking to tackle the various projects is very Data Science heavy, and you would be working closely with the Software Engineering team also. You are therefore going to be the first Data more »

Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such as automating manual tasks … and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes within a medallion architecture. Proficient in Data more »

I am working with a hugely successful, global organisation who are looking to add a Senior BI Developer to their growing London based data team. This organisation have recently implemented a brand new data platform encompassing the full Microsoft Azure Stack including leveraging Databricks in order to deliver … on its goal of becoming truly data driven. In this role you will be responsible for the BI and data engineering lifecycle across the business supporting the global data needs of various business functions. This role is a split between data engineering and data … will be joining a business that values its people at the centre of everything they do. They are looking to expand their close-knit data team where everyone will work collaboratively and share expertise and experiences. This a great time to join a well established organisation, at a time more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around 2 times … per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team! As a … Senior Data Engineer, you will support the Lead Data Engineer to mentor and lead the Data Engineering team, undertaking a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in Databricks, coding in PySpark, and more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around 2 times … per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team! As a … Senior Data Engineer, you will support the Lead Data Engineer to mentor and lead the Data Engineering team, undertaking a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in Databricks, coding in PySpark, and more »

I have partnered with a cutting-edge software business who are looking to hire a Head of Data Engineering, As the Head of Data Engineering, you will be responsible for designing, developing, and maintaining our data infrastructure on GCP. You will work closely with cross … functional teams to ensure that our data pipelines are robust, scalable and efficient. The best-matched Head of Data Engineering will have the following experience and abilities: Led a team of data engineers in designing, building, and maintaining data pipelines on the Google Cloud Platform. … Evaluate and recommend new technologies and tools to improve our data infrastructure and processes. Monitor and optimize the performance of data pipelines to ensure reliability, scalability, and cost-effectiveness. Hybrid working in London, 2 days a week in the office If this looks like it could be of more »

is fragile and career outlook right now is very uncertain. What about working at a hedge fund where their growth is almost certain? This data engineering team hired multiple people last year – most from big-tech – and plan to do the same this year. A large portion of … your work will technically be non-finance, with the main finance focused work completed by other teams. The real-world, complex data engineering problems are all yours. You’ll be joining a team that builds and has built thousands of ingestion pipelines, with data coming from every … single potential avenue it possibly can. To get the best understanding of an investment, all data points are considered. You’ll bring the data into the business, build the data infrastructure around it and deliver the data to the right person in the business to build more »

Data Science/Data Analytics Team Lead, working with senior management to lead the evolution of data infrastructure and analytics as they build and develop next generation of self-service data tools for customers and transition to new Azure Cloud platform. You will lead a small … providing coaching and mentorship to upskill the team. We are looking for a critical thinker who has experience in building and developing new analytical data structures, to extract the most insight from our data. Strong experience in Dimensional Data modelling, data warehousing, data processing (Map Reduce … Sense). Key responsibilities Manage a small team of skilled analysts. Be a key decision maker in the development of new Azure cloud based data warehouse and analytics tools Lead in the development of new data structures. Lead in the creation of new analytical insights, vision for data more »

Role: Data Analyst Permanent role Location: Birmingham, Midlands Style: Hybrid Salary: £42,000-57,000 One of our leading clients is looking for ambitious Data Analyst to join their Data Team and work closely with Business Partners and Enterprise Architects and support the Data Manager to … understand the business challenges and provide data and analytics solutions. As a Data Analyst you will be responsible for: Data Engineering – assisting with the design, development and implementation of ETL User Experience Analysis – understanding the data and identifying user experience requirements and designing goals Business … Intelligence – assisting in the development, production and delivery of data insights and taking part in informed decision making Continuous Improvement - providing support to the Data Manager to make sure that data analytics processes are robust, efficient and fit for purpose. Reviewing areas for automation and data more »

Title: Principal Consultant Data Engineer - AWS & ETL Location: Belfast Are you a visionary Data Engineer with a passion for innovation and transformation? Our leading innovation & transformation consulting firm is seeking a Principal Consultant Data Engineer to lead strategic data initiatives and drive meaningful change for our … clients. Key Responsibilities: Setting the technical direction and vision for data engineering projects, guiding the team in implementing best practices and innovative solutions. Architecting scalable and efficient ETL pipelines on AWS, leveraging advanced features and services to optimize performance and cost. Collaborating with senior stakeholders to understand business … objectives and develop data strategies aligned with organizational goals. Providing thought leadership in data engineering, staying abreast of emerging technologies and trends. Requirements: Master's or Ph.D. degree in Computer Science, Engineering, or related field. Extensive experience in designing and implementing complex ETL pipelines on AWS more »

environment where achievement is rewarded. The Role: Aspen’s vision is to be the global reference point for quality in all its markets. Regarding data, Aspen has a common principle to ensure that its data is accurate and fit for purpose to support business decision-making, promote trust … in reporting and provide client intimacy. The role of the Head of Data Insights is to establish a strong analytics and AI capability in support of the business needs to become a data led company. As the Head of Data Insights, your primary responsibility is to oversee … the strategic utilization of data to drive informed decision making across all departments. You will be the lead of a team of data analysts and scientists, setting the strategy and delivering actionable insights from our single version of truth Lakehouse architecture. You will co-develop our data more »

Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation … s data processing needs and facilitate BI reporting and analytics delivery. Responsibilities for the Senior Data Engineer Design, develop, and maintain scalable data pipelines and workflows using Azure Data Factory and Databricks Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency … of data. Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing. Key Skills & Experience for the Senior Data Engineer Essential Hands-on Experience with Azure Data Factory: Proven experience in designing, developing, and managing data pipelines using Azure Data Factory. Good knowledge more »

Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation … s data processing needs and facilitate BI reporting and analytics delivery. Responsibilities for the Senior Data Engineer Design, develop, and maintain scalable data pipelines and workflows using Azure Data Factory and Databricks Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency … of data. Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing. Key Skills & Experience for the Senior Data Engineer Essential Hands-on Experience with Azure Data Factory: Proven experience in designing, developing, and managing data pipelines using Azure Data Factory. Good knowledge more »

Principal Data Engineer Northwest Up to £76,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team across numerous … specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will include data ingestion … quality, modelling, transformation, security, and monitoring. The Principal Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data Architect, as it is key to more »

Senior Data Engineer 6 month fixed term contract – 2 x a week in London £80,000 - £90,000 per annum + excellent benefits I am very excited to be partnering with a well-known fintech company! We're seeking a talented Senior Data Engineer to join the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. Role Overview: As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse. You'll collaborate closely with various … stakeholders to gather business requirements and translate them into scalable data pipelines. Your expertise in Azure will be crucial in building robust infrastructure to support our data-driven initiatives. Key Responsibilities: with stakeholders to understand business requirements and translate them into technical solutions. build, and maintain scalable data more »

Graduate Software Engineer - London - Exciting Fin-Tech Scale-Up 🚀 📢 Permanent + Fun Social Team + Share options Are you a 2024 graduate passionate about Data Engineering and working with MLOps? Are you looking for a fantastic environment to start your career in? Here’s your chance to be … social FinTech scale-up and take the first big step in your career! This firm is looking for a Software Engineer to join their Data team and work with developing new data pipelines, helping to deploy new features to their stack, and help build and run their MLOps … have 🖥️: Degree from top Russell Group universities in a related field (i.e. Maths, Physics, Computer Science, etc.) Experience using Python and SQL Experience with data engineering, data cleaning, data pipelines A passion for pushing boundaries in technology Great problem-solving abilities Excellent time management and communication more »

Data Engineer Hybrid, West- Midlands £56k + bonus & great benefits Our client are a fast growing SaaS scale-up, revolutionising supply chain ecosystems and increasing revenue for their customers. You'll contribute to the organisation's high-quality data engineering practices, participating in technical design, implementation, testing … deployment and ongoing support and maintenance of the data platform. By going above and beyond implementing new features, the company focus on customer experience, building a high-quality data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the expertise of your … more experienced colleagues, including: Skill set & Experience: • Data Modelling and Querying - Proficiency in designing and implementing data models, including star schemas and snowflake schemas. Expertise in SQL. • Data Storage Technologies - Experience in SQL, NoSQL, Blob, Delta Lake , and/or other enterprise scale data stores. • Data more »

Job summary Join Our Team: NHS Chief Data Officer Are you passionate about revolutionising service design and delivery through data? The Partnership of statutory organisations within Somerset is seeking a dynamic Chief Data Officer to lead our data-driven transformation. About the Role: Lead the strategic … direction of data management and analytics across the Partnership. Drive innovation through data to personalise care, improve operational efficiency, and drive health outcomes. Collaborate with local professionals, government agencies, and industry partners to harness the power of data. Main duties of the job Key Responsibilities: Work with local … BI leaders to develop and implement data governance policies to ensure data integrity, privacy, and security. Oversee the development of data infrastructure and analytics capabilities to support decision-making at County level that supports organisational level processes. Drive initiatives to leverage artificial intelligence and machine learning for more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Rate: £500-650 per day Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once every two months max) Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. As this is a lead role 50% of your time will be leading and assisting the other data engineers and more »

Data Engineer - Databricks - £70-75,000 - London/Hybrid Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Data Engineer to join them … to work on building a brand new data platform which is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer and more consistent. This role would suit someone who … is currently working as a Data Engineer and who wants a role that can grow into a senior position, as that is the longer term plan for this role. Key Experience Required: In-depth knowledge of and experience with Databricks 3+ years experience in Data Engineering Azure more »