1 to 25 of 205 Permanent Data Engineer Jobs in London

Data Engineer -SQL, Power BI, Analytics - Permanent Data Engineer SQL, Power BI, Data Analytics Insurance City, London/Hybrid (3 in the office) Permanent Competitive Salary A fantastic opportunity has arisen for an experienced Data Engineer ideally with previous Insurance background … years of work experience with Analytical users and a good exposure to Cloud based data/analytics to join a well respected Specialist Insurer in their London office. Reporting to the Head of Data & Cloud, you will be an integral part of building out Cloud solutions and supporting … management information dashboards through the automation and streamlining of data processes. KEY RESPONSIBILITIES The primary role is to provide data and management information expertise, specifically: Build and maintain data warehouses on the Azure Cloud and create one source of truth data sets to drive consistency and more »

Title: Data Engineer, 40 hours per week, fixed-term contract – DE001. Location: White City, London, UK. Compensation: £45-65,000 plus health insurance and free lunch! Posted date: Monday 6 th , 2024. Closing date: June 7 th , 2024. Start date: July 1 st , 2024, or before. Company: Esox … platform harnesses metagenomics to resolve this biological dark-matter and improve pathogen detection and prevention efforts for global aquaculture. Role: We are hiring a Data Engineer to join our Detect team. Our Detect platform enables clients to identify total microbiomes sampled from livestock and the environment surrounding their … farms. This data is pivotal in advancing our understanding and management of aquatic ecosystems. Our metagenomics pipelines produce significant quantities of DNA data and accompanying sample metadata. You’ll play a central role in supporting the growth of our company by designing and building the infrastructure necessary to more »

Data Engineer (Snowflake) - Up to £80K + Benefits – Flexible Working - London Overview: We are working with one of the market leaders and most exciting organisations within the retail sector. We’re seeking an experienced Data Engineer who is analytically focused with expertise and proven experience with … and efficient databases to support internal enterprise applications. Collaborate closely with development and infrastructure teams to ensure seamless integration and optimal database performance. Lead data strategy aligned with organizational objectives, including data governance, architecture, quality management, and integration initiatives. Develop and support data warehouse, customer data platform (CDP), and associated data pipelines using Matillion and Snowflake. Gather requirements from the Business Intelligence team and translate them into technical specifications for implementation by the software development team. Define software requirements for data maintenance and dashboard requirements for displaying insights to relevant users. Essential Skills more »

Senior Azure Data Engineering Consultant Home-based with occasional customer travel £65,000 - £85,000 + bonus and benefits I'm working with a leading Microsoft Gold Partner who specialise in data. They are true experts when it comes to data strategy, data platforming, analytics, artificial intelligence … and data managed service. This means they are working on the most interesting and cutting-edge data centric projects in the market today. I’m looking for a Senior Data Engineering Consultant to join the team. This is an excellent opportunity for a Data Engineer, with experience in consulting and customer-facing roles to join a data-centric organisation at an exciting time of change. You will be well supported with the opportunity to gain numerous Microsoft certifications and accreditations to enhance your profile whilst working alongside experienced professionals to boost your learning more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead the development of … robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new … lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data lineage. The successful candidate will have: A strong background in data engineering using Python Strong understanding of Test Driven Development Experience building Star Schemer Databases Strong experience with SQL design patterns Experience in more »

Data Engineer - Python, Snowflake, Azure Contract hire £700 per day inside IR35 London Job Details: As the data engineer, you will help build a data analytics platform on cloud native Azure using Python and Snowflake. Migrating the current Databrick platforms into our new cloud environment. … Key skills required. Python Scripting 3+ years of commercial use of Snowflake Experience in building data warehouses Cloud Services experience - We use MS Azure Technical strength in working with Azure Data Factory (ADF) Strong API knowledge Ability to perform advanced database queries using SQL, MySQL or similar Good more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to … start interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If more »

This role is to join the quantitative analysis and technology team at one of Europe’s leading financial institutions to help build out the data and visualization tools required to support the business in all parts of the investment lifecycle. As a business data analyst, you will: Develop … and deploy dashboards to provide data-backed insights Interpret key business data sets Deliver insights on potential areas of growth, optimization, and improvements Support business intelligence strategies with quantitative analysis What we would like from you: Proven working experience as a Data Analyst or Business Data more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and a dedication … and commercial decisions are driven by this innovative collection of art market data. Role overview We are seeking a highly skilled and experienced Senior Data Engineer. You would be joining a strong team of roughly 20 people (software and data engineers, data scientists, analysts), in a fast more »

Data Engineer Azure/Snowflake/Power Bi/Airflow London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place … alongside. They want to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite … Fuel your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing, storage … and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them into specific data more »

Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an exciting … leading market research and analytics company specialising in data analysis on the alcohol and beverages market. They provide data to a range of major multinational beverage corporations, to provide essential market insights. They're looking to strengthen their team with a Data Engineer, with: Experience building … this opportunity matches your ability and expectations, please apply through the job advert above ASAP and I will be in touch. Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL more »

LEAD AZURE DATA CONSULTANT £76K - £90k + BONUS & BENEFITS HOME-BASED CONTRACT + CUSTOMER TRAVEL I’m working with a leading Microsoft Partner who currently hold 13 specialisations across the Azure tech stack. This is a great opportunity to join an experienced team of Microsoft specialists who can help … to grow your professional and technical skills each day. I am looking for Lead Data Consultants to join the team due to a number of recent project wins which means there is an increased workload. The successful candidate will draw upon their experience with business intelligence tools and techniques … deliver analytics capability on time and to budget. I’m looking for candidates with the following skills and experience: Expert with SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse more »

role, work together to minimise risk and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. ROLE: Data Engineer LOCATION: Remote (UK) CLEARANCE: SC eligible Job Description: We are seeking a highly skilled Data Engineer to join our team. … the needs of our clients. Key Responsibilities: Consultant needs to be able to programme in Java as the project uses Java to ingest the data into the platform. The Consultant would be helping to build out the Data Lake and Lakehouse on Databricks, working with AWS. Stack: AWS … ECS, KMS, SNS, SQS, Lambda, Python, Databricks, MongoDB, Spring Boot AWS, Java (to support ingestion), Databricks - experience in PowerBi would also be useful. Engineer with past experience with Java, Data, and Infrastructure (DevOps). Java is a key skill Programming: Java, Python, PySpark Storage Mechanisms: MongoDB, Redshift, AWS more »

Intelligence technologies and leading and educating a technical team across two global territories. The client is in the initial stages of deploying the Collibra Data Catalog tool to assist in accurate reporting of IT Asset Management. Collaborate with key stakeholders to understand business requirements and translate them into Collibra … solutions. Lead the implementation of Collibra Data Catalog, including configuration, customisation, and integration with other systems. Design and implement data governance workflows, data dictionaries, and data lineage within Collibra. Develop and maintain Collibra data governance policies, standards, and rules. Provide technical guidance and support to … users on Collibra platform usage and best practices. Develop custom reports and dashboards to monitor data governance metrics and KPIs. Conduct training sessions and workshops for end-users to promote adoption and usage of Collibra. Work closely with the Collibra vendor and internal IT teams to resolve technical issues more »

Data Science & ML Consultant Location : London – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching data more »

Data Engineer – Crypto As a Data Engineer, are you ready to shape the future of finance in a dynamic, research-driven crypto technology company? Do you want to join a fast-paced VC-backed organisation promoting a strong start-up culture as a Data Engineer … Their founders come from backgrounds working in successful start-ups combining experience from Y-Combinator, FAANG and top London Universities. We are seeking a Data Engineer with advanced analytical skills and a profound passion for research and technology. Experience in analytical, research, quantitative roles, or algorithmic trading and … a keen interest in Crypto is essential. Join us in our mission to drive innovation and efficiency within decentralised networks. Your Role as a Data Engineer: Extend and improve internal and external monitoring suites (post-trade/post-block analytics) Close collaboration with the engineering team on deployment more »

Job Title: Data Engineer Job Type: Permanent Location: London or Fully remote Salary: £50,000-£70,000 (Dependant on experience) + Bonus + Benefits Skills: Python, SQL, Posgress SQL, Snowflake, Powershell Roc Search`s client provides real-time decisions and active risk monitoring to enable their customers to … maximize profitability while managing risk. their solutions are continually adapting to changing market conditions. They 20+ years of retail data science expertise and experience. They work with a global base of leading commerce partners, representing a big proportion of all US omnichannel retail sales activity across hundreds of thousands … intelligence to operations, finance, marketing, and loss prevention. Their performance-improvement solutions yield measurable results with significant return on investment. About the role The Data Engineer will be part of a team that follows DataOps best practices and owns the standardized data assets and the processes around more »

of the emerging blockchain financial markets. They have launched one of the largest by % block-builders on Ethereum. They are now looking for a Data Engineer to join their growing team. W e are looking for someone with the following: Strong programming skills in Python (2-3+ … years expertise) Experience working with SQL and No SQL Knowledge of Data Management, Data Warehousing concepts and methodologies Comfortable working with Linux, AWS, Git, Docker is a big plus Experience working in (whether professionally or as a side project) and having a passion for crypto, blockchain and MEV more »

We have a very important mandate from a leading hedge fund that who are looking for a Senior Data Engineer to join a group formed only 3 months ago. They would be one of the first Data Engineers on the ground with full autonomy. This organization specifically … within the firm. The project itself cannot be disclosed yet as it is in such early stages but in regard to the amount of data you would be dealing with - THE SKY IS THE LIMIT!! Additionally, the firm has a real focus on introducing new technology if it can more »

Lead Big Data Engineer - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Senior Big Data Engineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. … design, processes, and implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as a Lead Big Data Engineer with excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent … experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills more »

collaborative culture where your voice is valued. Ready to explore a career path? Start your journey. Job Description As a member of Egencia’s Data Engineering group, you will tackle Egencia’s most sophisticated and impactful challenges using cutting-edge data technologies. Working in an agile development mindset … you will contribute to our cloud-based data platform and make sure it scales dynamically and operates reliably. Internal and external clients will use the products you develop to gain in-depth insights into travel programs, financials, and operations. Every day, data scientists will leverage the platform you … code – lots of it. We use Python, Java, Scala, Spark, and SQL. We welcome programmers of all backgrounds as long as you focus on data engineering solutions and attention to quality. Foster and strengthen a deep understanding of vast data sources in the cloud and know precisely how more »

of our new solutions for the future. We are currently made up of 4 key areas: Marketer & Media Owner, Sustainability, Enterprises Business Applications and Data Intelligence. The Data Intelligence team helps our clients and their partners better understand their customers and how to serve them, by equipping them … decisions. We currently serve clients predominantly in such industries as retail, leisure and hospitality, real estate and smart cities. Our team of industry experts, data and insights consultants, data scientists, data engineers and machine learning engineers use advanced analytics to uncover the rich profile of customers’ current … and future behaviours to inform how clients can better serve and communicate with their customers. Responsibilities We are seeking candidates with strong data science or machine learning engineering experience to deliver projects in the customer and front office domain. Duties and responsibilities (dependent on the mix of data more »

Stott and May has partnered with a global healthcare organisation within the private sector, to source a senior data engineer to join their growing tech team. Hybrid (3/4 days per month in London or Manchester) Salary: Circa £80k p/annum Key Responsibilities: Lead the consolidation … and migration of legacy data to our new cloud-based data platform. Design and implement master and transactional data models to ensure data integrity and consistency. Develop ETL pipelines and cloud data storage solutions that meet business requirements and non-functional needs. Collaborate closely with … data analysts, visualization engineers, and project managers to deliver data solutions. Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models. What we are looking for: Proficiency with Databricks and building data pipelines on Azure cloud platforms. Strong data more »

Be the first hire of this brand-new data engineering team and build it from the ground up. First up, you’re going to need to have done something similar before within finance, ideally algorithmic or systematic trading, with ETFs. You’re going to be given total autonomy to … build the team in the way you want. You’ll work closely with the quant teams to understand their requirements, but data strategy will be down to you. Using the right technologies will be down to you. It’s a hands-on engineering role to begin with, with engineering … leadership responsibilities in future. The focus is on collecting and processing data that’s critical to the business, so you’re not going to be building data ingestion strategies for every piece of data you can find. There’ll be specific data types, looking at things more »