101 to 125 of 211 Data Engineer Jobs in London

Senior Data Engineer 💰 £85,000-£100,000 🖥️ Snowflake, AWS, dbt, Terraform 🌍 London, 2-3 days a week in London office We are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for … a Senior Data Engineer. The role... As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to … enhance understanding of customer behaviors, market trends, and operational efficiencies. What you'll be doing... You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality. You will be architecting and building the next generation Data Platform. You will construct data models, pipelines, and more »

Title: Data Engineer, 40 hours per week, fixed-term contract – DE001. Location: White City, London, UK. Compensation: £45-65,000 plus health insurance and free lunch! Posted date: Monday 6 th , 2024. Closing date: June 7 th , 2024. Start date: July 1 st , 2024, or before. Company: Esox … platform harnesses metagenomics to resolve this biological dark-matter and improve pathogen detection and prevention efforts for global aquaculture. Role: We are hiring a Data Engineer to join our Detect team. Our Detect platform enables clients to identify total microbiomes sampled from livestock and the environment surrounding their … farms. This data is pivotal in advancing our understanding and management of aquatic ecosystems. Our metagenomics pipelines produce significant quantities of DNA data and accompanying sample metadata. You’ll play a central role in supporting the growth of our company by designing and building the infrastructure necessary to more »

Data Engineer Salary: £35-70k (plus very attractive bonus on top) Location: London/Leeds (hybrid working of 1 day a week in either the London or Leeds office, if prefered) We are looking to fill 2 or 3 roles at various seniority levels. PLEASE only apply … are recruiting for a Sports Analytics company - a clear leader in their market with considerable expansion plans. Purpose of role: The purpose of the Data Engineer is to implement and maintain data infrastructure that facilitates data-driven decision making, innovation and operational efficiency while ensuring that … the data pipeline is secure, reliable, and scalable. The role holder will build and maintain high-performance data systems that are foundational to driving business growth and success. Key responsibilities: Implementing scalable data architectures and systems. Developing and maintaining ETL (Extract, Transform, Load) pipelines. Managing data more »

Data Engineer (Snowflake) - Up to £80K + Benefits – Flexible Working - London Overview: We are working with one of the market leaders and most exciting organisations within the retail sector. We’re seeking an experienced Data Engineer who is analytically focused with expertise and proven experience with … and efficient databases to support internal enterprise applications. Collaborate closely with development and infrastructure teams to ensure seamless integration and optimal database performance. Lead data strategy aligned with organizational objectives, including data governance, architecture, quality management, and integration initiatives. Develop and support data warehouse, customer data platform (CDP), and associated data pipelines using Matillion and Snowflake. Gather requirements from the Business Intelligence team and translate them into technical specifications for implementation by the software development team. Define software requirements for data maintenance and dashboard requirements for displaying insights to relevant users. Essential Skills more »

Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In … this role, you will lead a team of talented engineers, leveraging your expertise in the Azure data engineering stack. Key Responsibilities: Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. Code in Spark and oversee the … technical design aspects of projects, ensuring adherence to engineering best practices. Lead and mentor a team of data engineers, providing guidance and support to foster their professional growth and development. Collaborate effectively with remote teams, leveraging your experience in leading distributed teams to drive success. Requirements: Extensive experience with more »

Lead Big Data Engineer - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Senior Big Data Engineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. … design, processes, and implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as a Lead Big Data Engineer with excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent … experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will more »

Stott and May has partnered with a global healthcare organisation within the private sector, to source a senior data engineer to join their growing tech team. Hybrid (3/4 days per month in London or Manchester) Salary: Circa £80k p/annum Key Responsibilities: Lead the consolidation … and migration of legacy data to our new cloud-based data platform. Design and implement master and transactional data models to ensure data integrity and consistency. Develop ETL pipelines and cloud data storage solutions that meet business requirements and non-functional needs. Collaborate closely with … data analysts, visualization engineers, and project managers to deliver data solutions. Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models. What we are looking for: Proficiency with Databricks and building data pipelines on Azure cloud platforms. Strong data more »

Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an exciting … leading market research and analytics company specialising in data analysis on the alcohol and beverages market. They provide data to a range of major multinational beverage corporations, to provide essential market insights. They're looking to strengthen their team with a Data Engineer, with: Experience building … this opportunity matches your ability and expectations, please apply through the job advert above ASAP and I will be in touch. Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL more »

Data Engineer Location: London, 3 days per week in the office Salary range: £50,000-£70,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake … specialist consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing IT … services to the Maritime industry and are looking to provide its Data Insights services to key business partners who require Data Engineering expertise to support data management activities. The Role: The successful candidate will work on all aspects of our client's data architecture, collection, pipelining more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to … start interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If more »

Senior Azure Data Engineering Consultant Home-based with occasional customer travel £65,000 - £85,000 + bonus and benefits I'm working with a leading Microsoft Gold Partner who specialise in data. They are true experts when it comes to data strategy, data platforming, analytics, artificial intelligence … and data managed service. This means they are working on the most interesting and cutting-edge data centric projects in the market today. I’m looking for a Senior Data Engineering Consultant to join the team. This is an excellent opportunity for a Data Engineer, with experience in consulting and customer-facing roles to join a data-centric organisation at an exciting time of change. You will be well supported with the opportunity to gain numerous Microsoft certifications and accreditations to enhance your profile whilst working alongside experienced professionals to boost your learning more »

Geospatial Data Engineer | London (Remote) | £55,000-£65,000 🌍 Peaple Talent have partnered with a fast-growing, FinTech organisation, leading the market in technological innovation. They enable the world’s largest Asset Managers to understand the impacts that their portfolio companies have upon the natural world. My client … capture and process vast riches of environmental data, transforming raw information into actionable insights. From tracking deforestation trends in the Amazon rainforest to monitoring carbon emissions across urban landscapes. As part of this journey, we are looking for a talent Geospatial Data Engineer to join the growing … team who will specialise in Geospatial Data & GCP. What we are looking for: -Proven experience in data engineering role with a focus on geospatial data -Proficiency in programming languages such as Python and SQL. -Experience building ETL pipelines -Working knowledge of Google Cloud Platform What's in more »

role, work together to minimise risk and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. ROLE: Data Engineer LOCATION: Remote (UK) CLEARANCE: SC eligible Job Description: We are seeking a highly skilled Data Engineer to join our team. … the needs of our clients. Key Responsibilities: Consultant needs to be able to programme in Java as the project uses Java to ingest the data into the platform. The Consultant would be helping to build out the Data Lake and Lakehouse on Databricks, working with AWS. Stack: AWS … ECS, KMS, SNS, SQS, Lambda, Python, Databricks, MongoDB, Spring Boot AWS, Java (to support ingestion), Databricks - experience in PowerBi would also be useful. Engineer with past experience with Java, Data, and Infrastructure (DevOps). Java is a key skill Programming: Java, Python, PySpark Storage Mechanisms: MongoDB, Redshift, AWS more »

Intelligence technologies and leading and educating a technical team across two global territories. The client is in the initial stages of deploying the Collibra Data Catalog tool to assist in accurate reporting of IT Asset Management. Collaborate with key stakeholders to understand business requirements and translate them into Collibra … solutions. Lead the implementation of Collibra Data Catalog, including configuration, customisation, and integration with other systems. Design and implement data governance workflows, data dictionaries, and data lineage within Collibra. Develop and maintain Collibra data governance policies, standards, and rules. Provide technical guidance and support to … users on Collibra platform usage and best practices. Develop custom reports and dashboards to monitor data governance metrics and KPIs. Conduct training sessions and workshops for end-users to promote adoption and usage of Collibra. Work closely with the Collibra vendor and internal IT teams to resolve technical issues more »

This innovative Multi-Strategy Hedge Fund, seek an experienced Software Engineer with expertise in Python to work within a dynamic Data Engineering Group building greenfield pipelines, frameworks, APIs and core Data store (Data warehouse and Data Lake) to enable the ingestion and provision (upstream and … Trading teams firmwide (X-Asset - Equities, Rates, Commodities, FX and Crypto). Key Skills required 3+ years of exp. as a Software Developer/Data Engineer with Python as your core language Extensive API and Microservices development experience 3+ years SQL Strong DB skills ideally in both SQL more »

Data Engineer Azure/Snowflake/Power Bi/Airflow London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place … alongside. They want to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

Would you be interested in a data engineering role at a fast-paced AI (LLM) start-up comprised of Meta, Google, AWS, and Microsoft alumni? You can expect to: Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Design robust … data processing and indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices. Manage cloud orchestration and data infrastructure, applying your expertise with various … data processing and indexing tools to ensure scalability and reliability. Work closely with the team to integrate search infrastructure that meets the needs of large language models and retrieval systems. Your first 3 months will include: You have a strong grasp infrastructure, architecture, performance concerns, SDLC and practices. You more »

of the emerging blockchain financial markets. They have launched one of the largest by % block-builders on Ethereum. They are now looking for a Data Engineer to join their growing team. W e are looking for someone with the following: Strong programming skills in Python (2-3+ … years expertise) Experience working with SQL and No SQL Knowledge of Data Management, Data Warehousing concepts and methodologies Comfortable working with Linux, AWS, Git, Docker is a big plus Experience working in (whether professionally or as a side project) and having a passion for crypto, blockchain and MEV more »

Data Engineer – Crypto Infrastructure Hybrid in London - 3/4 days a week Python, SQL, Git, Docker, MongoDB This is your opportunity to join a venture-backed research-driven crypto platform at the forefront of building trading and MEV-related infrastructure, shaping the future of finance. You’ll more »

We have a very important mandate from a leading hedge fund that who are looking for a Senior Data Engineer to join a group formed only 3 months ago. They would be one of the first Data Engineers on the ground with full autonomy. This organization specifically … within the firm. The project itself cannot be disclosed yet as it is in such early stages but in regard to the amount of data you would be dealing with - THE SKY IS THE LIMIT!! Additionally, the firm has a real focus on introducing new technology if it can more »

Data Science & ML Consultant Location : London – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching data more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead the development of … robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new … lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data lineage. The successful candidate will have: A strong background in data engineering using Python Strong understanding of Test Driven Development Experience building Star Schemer Databases Strong experience with SQL design patterns Experience in more »

LEAD AZURE DATA CONSULTANT £76K - £90k + BONUS & BENEFITS HOME-BASED CONTRACT + CUSTOMER TRAVEL I’m working with a leading Microsoft Partner who currently hold 13 specialisations across the Azure tech stack. This is a great opportunity to join an experienced team of Microsoft specialists who can help … to grow your professional and technical skills each day. I am looking for Lead Data Consultants to join the team due to a number of recent project wins which means there is an increased workload. The successful candidate will draw upon their experience with business intelligence tools and techniques … deliver analytics capability on time and to budget. I’m looking for candidates with the following skills and experience: Expert with SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse more »

Be the first hire of this brand-new data engineering team and build it from the ground up. First up, you’re going to need to have done something similar before within finance, ideally algorithmic or systematic trading, with ETFs. You’re going to be given total autonomy to … build the team in the way you want. You’ll work closely with the quant teams to understand their requirements, but data strategy will be down to you. Using the right technologies will be down to you. It’s a hands-on engineering role to begin with, with engineering … leadership responsibilities in future. The focus is on collecting and processing data that’s critical to the business, so you’re not going to be building data ingestion strategies for every piece of data you can find. There’ll be specific data types, looking at things more »