1 to 25 of 202 Permanent Data Engineer Jobs in London

Data Engineer – London - £85,000 Description Are you passionate about data engineering and looking for an exciting opportunity in the retail industry? I am seeking a skilled Data Engineer to join my clients team and play a pivotal role in their data-driven decision … making process. As a Data Engineer, you will work closely with data scientists, analysts, and other stakeholders to design, develop, and maintain data infrastructure. Your expertise will contribute to improving data pipelines, optimizing data flows, and ensuring data quality and consistency. Responsibilities Design … and implement scalable data solutions to collect, process, and analyze large volumes of data Collaborate with cross-functional teams to identify and define data requirements Develop and maintain data pipelines and ETL processes Manage data integration from various sources to ensure data consistency and more »

Passionate for Music & Data Engineering? Have a look at this role! An exciting music licensing company is looking for a Senior Data Engineer to join their team! You will get to work with an amazing team of 5 Data Engineers and drive the design, development, and … optimisation of the company's data infrastructure. You will work with some of the most innovative tools in the market including Snowflake, AWS (Glue, S3), Apache Spark, Apache Airflow and DBT!! The role is hybrid, with 2 days in the office in central London and the company is offering … up to £83,000 with some excellent benefits - including attending the BRITS! Requirements: Extensive experience in Data Engineering Experience developing and maintaining data pipelines from scratch Data modelling, data integration and transformation experience Hands on work with tools such as Snowflake, AWS, Airflow, and DBT Proficiency more »

Senior Data Engineer - Investment Firm - London - Up to £150k base + bonus About Us: We are working with a prominent investment firm based in London, renowned for their innovative approach and commitment to delivering exceptional results for our clients. As part of our continuous growth and evolution, we … are seeking a talented Senior Data Engineer to join our dynamic team. Role Overview: As a Senior Data Engineer, you will play a pivotal role in managing and optimising our data infrastructure, ensuring the reliability, security, and efficiency of our data processes. You will … work closely with various teams to design, implement, and maintain robust data pipelines, leveraging cutting-edge technologies to drive insights and inform strategic decisions. Key Responsibilities: Develop and maintain data pipelines for security and index data, sourced from Bloomberg, Reuters, and other relevant providers. Utilise Python and more »

GOAT Interactive is looking for a Junior Data Engineer to join our Data Engineering team, this role will be responsible for the development, testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be working with technologies … such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so the scale of our data, we are currently working on several … initiatives to improve our data solution and you would become an integral part of this. Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity and quality. Manage ETL and ELT pipelines across many data more »

Push the boundaries of BI, building complex data pipelines and beautiful visualisations for all kinds of business users at this $50bn Hedge Fund. Every business user here understands the power and importance of data for them to do their jobs and for the business to excel. You don … t need to understand what a Hedge Fund does, but you’ll need to be adaptable and eager to learn. You’ll take data requirements direct from the business users and you’ll be given freedom and support to come up with your own ideas to give the best … operate with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a better or newer tool, you’re free to use that too. The key think is that you more »

Senior Data Engineer AWS/Bedrock/Glue/EKS/Redshift Contract - Inside - London Harrington Starr have partnered exclusively with a long-standing client of ours within the commodities trading space who are looking to increase headcount within their Data Engineering team at the start of … the year here with 2024. The role will require you to have: 5+ years data engineering background working on cloud architecture Must have specific experience with AWS Bedrock and other newer technologies Cloud experience (AWS Redshift) would be beneficial Power BI or another similar technology would be an advantage more »

LEAD DATA ENGINEER £100,000 - £120,000 HYBRID - LONDON This new position is great for someone who is excited by companies with a great start-up culture and the opportunity to have a clear business impact. You would be going in to take ownership of this FinTech's … are now looking to take a modern approach to how they use data. THE ROLE You would play a core role in using this data to map out their continued growth. Entering this role you will interact with the C-suite and decipher how best to grow their capabilities. more »

Location : London, Must have SC Clearance Certificate Mode: Hybrid Salary: Competitive Overview: We are seeking a talented Data Engineer with expertise in Azure to join our team. The ideal candidate will be responsible for developing data pipelines, building and maintaining data warehouses and data lakes … implementing data integration and transformation solutions, ensuring data quality and integrity, and optimizing data performance. Responsibilities: Develop data pipelines for ETL/ELT (Extract, Transform, Load) processes using Azure technologies. Build and maintain scalable and efficient data warehouses and data lakes on Azure platforms. … Implement data integration and transformation solutions to enable seamless data flow across systems and applications. Ensure data quality and integrity by implementing data validation and cleansing processes. Perform performance tuning and optimization of data pipelines and storage solutions to enhance efficiency and reduce latency. Requirements more »

Role – Senior Data Engineer Location – Central London Salary – up to £70,000 plus Bonus and excellent benefits package Working Pattern – Hybrid Summary We have a brand-new role for a Senior Data Engineer with a large company, with an office in central London, close to transport … links. In this role you will be responsible for owning and evolving the company’s data stack. It’s an amazing opportunity for a data engineer to focus on exploring solutions to maintain, improve, and scale their use of data. They’re a collaborative business so you … for someone with ambition, problem-solving and communication skills. The Company This is a creative and ambitious company who are looking to grow their data team. It’s a large company with well-established operations across the UK and Europe. They offer all positions on a hybrid basis with more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Contribute to … the organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating more »

A leading professional services business is looking for a Data Engineer to join their team and be responsible for leading and contribute to data engineering projects, designing and implementing efficient and scalable data pipeline. The ideal candidate will be an expert with azure cloud, python and … SQL. Responsibilities: Lead and contribute to data engineering projects, designing and implementing efficient and scalable data pipelines. Demonstrate proficiency in data engineering tools, ETL processes, and database systems, with a strong command of programming languages. Design and optimise data models to ensure efficient storage, retrieval, and … processing of data Requirements: Azure cloud experience is essential (Data Factory, Data Bricks, Azure Synapse) Strong expertise in designing, implementing, and optimising Extract, Transform, Load (ETL) processes for efficient and scalable data movement. In-depth knowledge and hands-on experience with various database technologies, including both more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and … analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams Share expertise by mentoring and showing best practices more »

Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office My client is looking for a Data Lead to take responsibility for the technical design and implementation of data integration projects using Azure and Integration Services. Core duties will include technical … of the team whilst ensuring the overall performance of the solutions utilising the latest technologies, processes and best practice. You will design and build data pipelines, ETL processes and data workflows that enable data to be transferred seamlessly across a variety of platforms Required Skills: - Effective experience … leading, motivating and developing a team - Demonstrable experience in designing and deploying Azure Integration Services solutions - Proven experience of building data solutions and products in Azure - Data pipelines - SQL knowledge - Agile/Scrum Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week more »

days p/w in office Salary: £90,000 - £120,000 Industry: Insurance Tech Stack: Python, SQL, Spark, Azure 👩🏻‍💻 Great opportunity for a talented Engineer (Python, SQL, Spark, Azure) to join a market leading cyber insurance company. The Company 🚀 Tech driven insurance business that are expanding into emerging risk … by over 100,000 business around the world to provide unique, competitive and secure insurance packages. The Role ✨ They are seeking a highly pragmatic Engineer (Python, SQL, Spark, Azure) to help build out their new data platform. You (Python, SQL, Spark, Azure) will work closely with Architects, Data … heart of London with work from home options Opportunity to work in small, diverse and skilled cross-functional teams If you are a skilled engineer (Python, SQL, Spark, Azure) who is interested in this role then please apply below and I will be in touch with more details. more »

Principal Data Engineer – Hybrid (Bristol or London) - £80 – 110k Spinks are working with an established, rapidly growing digital consultancy who are looking to bolster their awesome Data Team with another experienced Principal Data Engineer. As a Principal Data Engineering Consultant, you will be an expert … occur. Be a strong communicator and presenter, presenting prototypes, solutions, and progress to internal/external stakeholders in a clear concise manner. Building reliable Data Pipelines. Promoting Test-Driven Development and/or Behaviour Driven Development. Continuously review and prioritise the delivery team’s workload and anticipate the need more »

building machine learning solutions to facilitate private market investing at BlackRock, and for Aladdin clients. Alts differs from other major asset classes as investment data generally comes in documents in semi or unstructured formats. Our job in the Data Science and Machine Learning group within Private Markets Systems … is to build the systems we need to gather data automatically and at scale and generate investment insights from these documents. Our team was founded four years ago and forms a core component of BlackRock's strategy for expanding into Alts. Our remit covers both building out the foundational more »

Senior Data Engineer – Higher Education – 6 Months (Rolling) - London - £522.50 One of the UK’s leading higher education clients now requires a Senior Data Engineer on an initial six-month contract to improve their learning engagement platform. The Data Engineer will be predominantly responsible … for setting up and configuring a new Azure Data Lake. The ideal Data Engineer will have the following skills/experience: Proven Experience working on Azure Data Factory Previously worked with Python and SQL Previously worked with Power BI Interpersonal and Stakeholder Management Skills This is … hybrid position and would require you onsite 1 – 2 day(s) per week onsite at their office in London. If you’re an experienced Data Engineer looking for an exciting new opportunity with a leading Higher Education client, please apply more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As they … continue to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase carbon neutrality. Role Overview … As a Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of more »

Principal Data Engineer – National Salary Circa £80,000. London Salary Circa £100,000. Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As … well as being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we … individuals who are focussed on using their skills to drive out real business value for our customers. A bit about the job: At Aviva, data serves as the lifeblood that propels our organizations forward, and we are no exception. As a Principal Data Engineer within our esteemed more »

Lead Data Engineer London salary circa £58,000, National salary circa £45,000 Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As … well as being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we … passionate, energetic individuals who are focussed on using their skills to drive out real business value for our customers. A bit about the job: Data is the life blood of any modern organisation and Aviva is no different. Our Data Engineering team sits within Aviva Quantum our global more »

Principal Data Engineer - London This Digital Services Partner revolutionises how people engage with technology. They pride themselves on delivering innovative solutions that enhance user experiences and drive measurable results. People are genuinely at the heart of this business, and they're looking for a Principal Data Engineer to join. This role will provide technical expertise in data engineering practices both internally and to clients, and provides great opportunity to develop and upskill. The role: Act as a technical SME to help produce user centered software Design and manage software deployment and development pipelines, and work … delivery teams to prioritise workload and realign where needed Be a strong communicator, present prototypes and solutions to stakeholders The person: Strong experience in Data Engineering, with python being your primary language Strong cloud exposure - AWS, GCP or Azure Excellent SQL and relational database skills - NoSQL desirable Experienced in more »

across the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions, constructing … new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead the design and … implementation of a modern data platform as a Greenfield Project. Establish and maintain data flows to integrate operational systems, data analytics, and business intelligence (BI) systems. Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Minimum 5 years of experience in more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look after … employees to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so that Aventum … Strategy: Support designing, developing, implementing, managing and supporting enterprise-level ELT/ELT processes and environment Technical and business processes are used to combine data from multiple sources to provide a unified, single view of the data. Be an architect making strategic decisions. Partly responsible for accessing, validating, and more »

TwentyAI are supporting a lead commodity trading house with a hire needed in their London office. They are looking for a talented Data Engineer to work a number of greenfield initiatives as part of a trade monitoring department. This is an exciting opportunity to work within a fast … and strategy of this team and play a leading role in the growth of the team. The role: Work on designing, implementing & continuously evolving data platform's including pipeline & repository Carry out data ingestion, curation, preparation and access required for systematic alpha ideas exploration, analytics & reporting Management and … ongoing development of an enterprise data platform built on Azure Development of new data products and services for commercial and operational teams Tech Stack Python and Pyspark SQL Pipelines, Big Data, Data architectures App Services, Functions, Cosmos DB, Databricks, Synpase and associated tools automation, PyTest If more »

Data Engineer – Machine Learning Hybrid working - London offices We are seeking a talented Data Engineer/Machine Learning Engineer to join an established business who leverage Data and Data Science methods to effectively improve their business decision making and customers product development. The … Data Engineer will be involved in developing, testing, and deploying machine learning and data science models. Experience with relevant technology such as the Python ecosystem, Deep Learning algorithms in Ecommerce or Retail environments is desirable. Responsibilities: The role will remain hands-on, so will develop AI/… ML software products using Python. Collaborate with other teams and Senior level management on the ML/AI and Data Science models and projects. You will help ensure that development best practice (SOLID, TDD) and relevant standards and procedures are met. Work to Agile best practice. Required Experience: 4+ more »