101 to 125 of 206 Permanent Data Engineer Jobs in London

A global company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team based in their London office – this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It’s a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having recently launched a brand-new Azure Data Platform and introduced the use of Databricks. The role is predominantly back-end Data Engineering focused, where you’ll develop various solutions for data collection, integration, transformation and modelling, to support the ongoing development of their global data platform. This will include developing data pipelines, to automate data collection and integration across various sources, with the use of Azure Data Factory and Databricks. You will also do a little more »

Data Engineer Paddington, London (Hybrid) Overview Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on this ambition set by this OGSM we require the very highest level of technical/engineering … expertise within Global Petcare Data & Analytics. There is a need to expand this high performing team of creative, skilled individuals – to help build out new capabilities and bring fresh ideas to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment using a … progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask Ingest and integrate data from a large number of disparate data sources Design and build complex data models for analytical insight Write high quality code contributing to a more »

Data Engineer | Integration | SSIS | SSRS | Azure Logic Apps | Azure API management | DevOps | Azure Data Factory | SQL | Oracle Database | Systems Integration | Integration Architecture We are thrilled to be partnering with a university who is in the market for a Data Engineer who has strong experience working … implementation of an ERP system that will manage their HR and Finance, due to go live in a year. Summary of the role: Role: Data & Integration Architect Employment Type: Permanent - 2-year FTC but one of the team member will be retiring so there will be an extension Location … of working. Essential skills: System integrations experience (rather than BI Analytics) Strong understanding of SQL OR oracle databases Microsoft integration tools (SSIS, SSRS, Azure data factory) Good level of communication Desirable skills: Experience with administration and deployment of Azure Logic Apps, Azure Function, Azure API management, ARM templates in more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The role: Designing … data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the … reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. Excellent more »

SENIOR) DATA ENGINEER ROLE PROFILE Hush is an ambitious and distinctive fashion brand, with plans to double the business over the next few years. Founded 20 years ago, we are now established as one of the UK’s leading online fashion retailers. We employ around 125 staff in … Technology team with a key focus on aiding Hush to develop, maintain and draw insights from business intelligence solutions consisting of Google Big Query (Data warehouse), Domo (Visualisations), Snaplogic (ELT), and DBT (Modelling). Reporting into our Head of Technology, playing a critical role in our small Data … ll have the opportunity to challenge the status quo, preparing ad-hoc analysis, supporting business users in self-serve operations mode and actively championing data-science use and robust data analysis across the organisation. THE RESPONSIBILITIES Collaborate with the business to prioritise and define data requirements into more »

Lead Data Engineer £80,000 - £100,000 DOE Mainly remote, some travel may be required Blue Wolf Digital are partnered with a boutique consulting firm who are looking to grow significantly this year due to some greenfield project wins. I'm looking for an experienced Lead Data Engineer to play a pivotal role in building state-of-the-art Databricks and Snowflake Lakehouse solutions from scratch. If you have experience with Azure, Databricks or Snowflake, SQL, ETL, and a passion for consulting, please get in touch. Key Responsibilities: Design, develop, and maintain cutting-edge Databricks … or Snowflake Lakehouse solutions from scratch Collaborate with cross-functional teams to understand data requirements and translate them into efficient ETL processes. Work with Azure services to ensure data storage, security, and scalability. Develop and optimize SQL queries for data extraction and analysis. Stay updated on industry more »

Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such as automating manual tasks and … optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes within a medallion architecture. Proficient in Data Modelling more »

Principal Data Engineer Location: London based Salary: £90k - 100k A Principal Data Engineer has the opportunity to join one of the United Kingdom’s leading digital innovation and design hubs that are renowned for building digital products and services in the public sector. In this role … databases is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Working in an Agile Environment Test-Driven Development and/or Behaviour Driven more »

across the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions, constructing … new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead the design and … implementation of a modern data platform as a Greenfield Project. Establish and maintain data flows to integrate operational systems, data analytics, and business intelligence (BI) systems. Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven track record in designing and more »

Data Engineer On-Premise/Excel/SQL We have partnered with a leading client based in Central London who are looking to increase their data engineering team. Role: You will be working on a large volume of various financial reporting data sources. The client here … is using on-premise databases including Excel services & SQL. You will be working to gather data from these various sources for reporting, and creating the data pipelines. Experience: Data engineering experience within financial services (Asset Management/Harrington Starr) Experience working to gather data from on more »

Spectrum IT's UK National Client are seeking to recruit a Contract Data Migration Engineer to join them on an initial 6 month contract. The role has been deemed OUTSIDE IR35 and will offer full remote working for a UK based candidate. As the Contract Data Migration … Engineer you will support the project transformation team currently working on the implementation and migration to a new housing management system. You will take a leading role focusing on the data migration, support and design activity on data management and BI systems. Duties will include building high … quality, accessible data models and stores, including full documentation of source and target maps; provide maintenance of an information and data catalogue and metadata repository; Generating information management testing and quality controls in both new and existing projects, and day to day operations. Knowledge and experience in NEC more »

DATA ENGINEER LONDON BASED £75,000-95,000 PER ANNUM This growing e-commerce trading company are searching for a new Data Engineer. You will be responsible for building and maintaining a new AWS serverless platform. You will also be responsible for building and maintaining data pipelines, using Python. THE COMPANY This E-commerce trading company have been growing since their formation. They are expanding their Data and Analytics team as the CEO has realised how important Data and Technology are to the business and is investing further in Machine Learning variables. THE … ROLE You will be joining an expanding Data and Analytics team, which currently has more than 20 employees. You will be responsible for building and maintaining a new AWS serverless data platform. Improve best coding practices within the Business. Stream real-time Data using Kafka. Build and more »

Beyond: Putting Data to Work delivers data-led strategic consulting services globally, bringing cutting-edge data science, engineering, analytics and visualisation expertise by having the highest quality talent, borderless data services and best-in-class creative thinking. We pride ourselves on our ability to swiftly get … We deliberately recruit professionals with diverse experience which makes for a culture of healthy challenge, respect and collaboration. We are seeking a mid-level Data Engineer to join our London based team. As part of the Data Engineering team, you will be working alongside the Technology, Analytics … and Commercial Teams. You will design and create cutting edge data solutions to our clients across various domains. This is a hybrid role where you will be working from our Central London office at least once a week and also on client sites as required. The remainder of your more »

re helping to improve our customers’ lives and contributing to the success of the business every day. Job Description Legal and General’s Group Data and Analytics function is looking to hire a Lead Data Engineer to assume responsibility around the delivery of the infrastructure and data … the internal customers in the Retirement Operations team. This role will see you working closely with the team to improve the current mainframe and data flows, building new rest APIs and removing the click replicate functions which are currently in place while evaluating and making improvements to engineering strategy. … improvement and efficiency Overseeing solution development from design to implementation, ensuring solutions are fit for purpose Identifying and mitigating issues and risks associated with data solutions and projects Engaging stakeholders effectively, providing guidance on data solutions and ensuring productive relationships Engaging stakeholders and undertaking appropriate testing prior to more »

Vertex Search is representing a fast-growing financial services firm that is now looking to make a Senior Data Engineering hire, the first role of its kind into the business with huge scope for impact and influence. The nascent data engineering team will collaborate with internal teams around … the business with a focus on data engineering, pipelines, tooling and services. Key Responsibilities: Data Engineering: Design and develop data services across various business functions Data Pipelines: Design and develop data pipelines for extracting, transforming, and loading data into appropriate storage systems. Data Tools and Services: Develop data tools and services to discover, understand, and utilize data effectively. Best Practice: Advise on and contribute to the development of data governance and management practices. Collaborate across teams to understand requirements and deliver data solutions. Skills and Experience: Required: 7+ more »

Senior Software (Data) Engineer - Up to £150k + bonus - 12m FTC Durlston Partners are working with a large financial institution whose Data Office team is revolutionising financial services, collaborating with engineering and business partners to redefine the investment experience. They're committed to innovation and excellence, ensuring … your career. Innovation-Driven: Be part of a team that fosters creativity and forward-thinking solutions. The Role: As an individual contributor in the Data Enablement team, you'll play a pivotal role in addressing complex data challenges. You'll work closely with business and engineering teams to … deliver scalable and innovative solutions, enhancing their strategic data platform. This role requires a proactive approach to problem-solving and a strong enthusiasm for leveraging technology to create meaningful impacts. Key Responsibilities: Analyse and understand real-world problems, translating them into software-led solutions. Collaborate with business and engineering more »

A high growth global events business are searching for a Senior Data Engineer to join their Data and Analytics division. The successful candidate will have the opportunity to work in a close knit and high performing team that operates at group level. Key Responsibilities Data Platform … Design: Lead the creation and optimization of data platforms for CRM, finance, and marketing, driving informed decision-making. Team Leadership: Head a skilled data team, collaborating with DevOps and System Integration to support Hyve portfolios and ensure alignment with business goals. Architecture Enhancement: Contribute to refining data architecture across portfolios, ensuring consistency and relevance through continuous improvement. Requirements Extensive Experience: Minimum 5 years in data roles, with expertise in designing and implementing complex data platforms. Technical Proficiency: Skilled in handling diverse workloads and integrating real-time and batched data streams, MUST HAVE A more »

driven crypto technology company that specialise in building trading and MEV-related infrastructure and services, based in London. They are looking to add a data engineer to their tech function. Background in or strong understanding of Crypto and/or the Miner Extractable Value (MEV) is needed - please … only apply if you have good knowledge of the space. The team are focusing on designing, building, and optimizing their data infrastructure. Previous experience in low latency systems, algorithmic trading, or MEV-related systems is a plus but not required. Responsibilities: Oversee the complete process of gathering and analyzing … telemetry data to derive insights regarding company performance Support the development team in resolving issues by using data gathered from various sources Designing, developing, and maintaining scalable and reliable data pipelines and ETL processes Building and managing data monitoring tools to ensure data quality and more »

Title: Azure Data Engineer Rate: Up to £800 P/D Length: 12 month rolling Location: London (Hybrid) Description (Full spec avail): To work with an established team on developing a new strategic big data platform for our customer, we are searching for a Senior Azure Data Engineer. The current Oracle and Java stack will be replaced with a new platform that is an Azure-based data lake with APIs and events to enable data consumption by analytics teams. The needs for this multi-year migration project include engineering to facilitate the transfer of … data masters from the old platform to the new one. Key requirements : CompSci or equivalent degree from a top global university Awareness of and comprehension of Agile approaches, including TDD and BDD knowledge. familiarity with working in agile development teams Excellent written and verbal communication The initiative to resolve more »

Role Responsibilities: We are seeking an experienced data engineer to join the Surveillance IT team. The successful candidate will be responsible for developing data ingestion pipelines and frameworks that support trade surveillance analysts in their strategic decision-making. Qualifications and Skills: Educational Background : Bachelor's degree in more »

and infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with stakeholders … Conduct peer reviews and offer technical guidance. Identify process improvements and adhere to IT policies. Essential Technical Skills: 2-3 years' experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting … traditional Data Warehouses. Building Azure data pipelines and data lakes. Agile development experience. Strong problem-solving skills. Awareness of industry trends and stakeholder interaction. Desired Experience: Familiarity with Business Objects Reporting and Power BI. more »

Role: Senior Data Developer Rate : up to £1400 P/D - DoE Length : 6 Month rolling! Location: London - Office based My client is a well-established and successful tech house working in the finance sector who are looking for a Senior Data Engineer/Developer, with outstanding … on some of the most modern, innovative software in finance. you will get the opportunity to build one of the most scalable and performant data platforms, not only in the finance space, but in the world. Working alongside some of the smartest people in Paris, you will get a more »

About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. … development methodology; think strategically and execute methodically. Develop and manage capacity and growth projection forecasts of the environment within budgets. Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements. Drive optimization, testing and tooling to improve quality … 8+ years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills more »

is fragile and career outlook right now is very uncertain. What about working at a hedge fund where their growth is almost certain? This data engineering team hired multiple people last year – most from big-tech – and plan to do the same this year. A large portion of your … work will technically be non-finance, with the main finance focused work completed by other teams. The real-world, complex data engineering problems are all yours. You’ll be joining a team that builds and has built thousands of ingestion pipelines, with data coming from every single potential … avenue it possibly can. To get the best understanding of an investment, all data points are considered. You’ll bring the data into the business, build the data infrastructure around it and deliver the data to the right person in the business to build their investment more »

organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to … respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes. Core Responsibilities build schedules so that pipelines run effectively. up and maintaining health checks on different data pipelines Triage, and debug the data pipeline when broken. code … and writing code changes and/or modifying the monitoring set-up and understanding how to navigate the data pipelines and documentation. Standard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time. outages with the end users of more »