226 to 250 of 289 Data Engineer Jobs in London

A specialist reinsurance broker is seeking a Data Engineer with Google Cloud Platform (GCP) experience to join their growing team in Central London. This is a hybrid role, requiring 2-3 days per week in the office. This is a modern, digitally native business with no legacy systems - a rare opportunity to work in a clean, forward-thinking … values innovation, adaptability, and continuous improvement. Key responsibilities will include: Lead and support the migration from Azure to Google Cloud Platform (GCP), including BigQuery Collaborate with stakeholders to understand data needs and ensure smooth transition and integration Become the internal GCP subject matter expert, with direct support from Google Contribute to the adoption of AI and emerging technologies post … migration Thrive in a fast-evolving environment with minimal legacy constraints Requirements : Proven experience as a Data Engineer. Hands-on experience with cloud migrations (on-prem to cloud or cloud-to-cloud). Strong knowledge of GCP, including BigQuery. Experience in Financial Services is desirable but not essential Exposure to AI technologies is a plus Excellent communication and stakeholder More ❯

A specialist reinsurance broker is seeking a Data Engineer with Google Cloud Platform (GCP) experience to join their growing team in Central London. This is a hybrid role, requiring 2-3 days per week in the office. This is a modern, digitally native business with no legacy systems - a rare opportunity to work in a clean, forward-thinking … values innovation, adaptability, and continuous improvement. Key responsibilities will include: Lead and support the migration from Azure to Google Cloud Platform (GCP), including BigQuery Collaborate with stakeholders to understand data needs and ensure smooth transition and integration Become the internal GCP subject matter expert, with direct support from Google Contribute to the adoption of AI and emerging technologies post … migration Thrive in a fast-evolving environment with minimal legacy constraints Requirements : Proven experience as a Data Engineer. Hands-on experience with cloud migrations (on-prem to cloud or cloud-to-cloud). Strong knowledge of GCP, including BigQuery. Experience in Financial Services is desirable but not essential Exposure to AI technologies is a plus Excellent communication and stakeholder More ❯

A specialist reinsurance broker is seeking a Data Engineer with Google Cloud Platform (GCP) experience to join their growing team in Central London. This is a hybrid role, requiring 2-3 days per week in the office. This is a modern, digitally native business with no legacy systems - a rare opportunity to work in a clean, forward-thinking … values innovation, adaptability, and continuous improvement. Key responsibilities will include: Lead and support the migration from Azure to Google Cloud Platform (GCP), including BigQuery Collaborate with stakeholders to understand data needs and ensure smooth transition and integration Become the internal GCP subject matter expert, with direct support from Google Contribute to the adoption of AI and emerging technologies post … migration Thrive in a fast-evolving environment with minimal legacy constraints Requirements : Proven experience as a Data Engineer. Hands-on experience with cloud migrations (on-prem to cloud or cloud-to-cloud). Strong knowledge of GCP, including BigQuery. Experience in Financial Services is desirable but not essential Exposure to AI technologies is a plus Excellent communication and stakeholder More ❯

Barcelona, Milan, Edinburgh and Madrid. With our focus on growth in the UK and Europe, now is the perfect time to join us on this high-speed journey. Introducing Data Engineering at Trainline Data Engineering is essential to how we unlock the value of data at Trainline. Our mission is to liberate Trainline data and delight … customers with great data products built on a frictionless, modern data platform. Our data products include machine learning models that add real value to the customer journey, streaming data applications that personalise the customer experience in real time, dashboards that drive deep business and customer insight and intuitive and efficient data marts and metrics built … on our modern Data Lakehouse. As a Data Engineer, you will be part of a cross-functional Data Platform team working alongside data engineers, data scientists, machine learning engineers and BI engineers. Our data product teams are deeply embedded in the business so your work will have high impact by either driving key More ❯

Comms and Creative, Digital Marketing, CRM and Loyalty, Nectar 360, Insights, and Corporate Responsibility and Sustainability. More people shopping with us each week means more interactions. And thanks to data insight, we understand customers in a way that almost nobody else does. We work alongside incredible brand partners and the best agencies around. So if you have a passion … to learn, grow and experience new teams, come and explore it all with us. By joining Sainsbury's as a Digital Marketing Executive specialising in Technology and Cloud Data, you will become an integral part of a forward-thinking organisation dedicated to leveraging cutting-edge technologies to drive marketing effectiveness and business growth with a customer-first approach. You … ll have the opportunity to work on developing and maintaining cloud-based data solutions, collaborating with internal and external stakeholders to deliver complex communications programmes through automated, data-driven pipelines. Our inclusive and dynamic environment encourages proactive thinking, continuous learning, and impactful contributions, allowing you to make a difference in the ever-evolving landscape of digital marketing through More ❯

team. What you will bring to the role: Develop and maintain Python scripts and applications using Databricks and PySpark Collaborate with cross-functional teams to design and implement effective data solutions Participate in code reviews to ensure adherence to best practices Write clean, maintainable Python code that adheres to SOLID principles and facilitates the robust development of our data infrastructure Troubleshoot and resolve technical issues promptly Stay ahead of the latest trends and advancements in Python development and data engineering Implement and maintain CI/CD pipelines for automated testing and deployment Design RESTful APIs that serve as the conduits for data flow across different systems within our enterprise Advance our AI/ML platform by … contributing to the data architecture that supports complex analytical models. Our values: We're all about people: Empowering them, supporting them, and helping protect what matters most to them We put people first, and stay true to our word, because we believe in the power of relationships and doing what's right We win together: We work as a More ❯

Senior Data Engineer Location: Remote Salary: £75K - £85K Data Idols are working with an exciting company who specialise in renewable energy solutions to hire a Senior Data Engineer. You will be at the forefront of the cutting edge data platform evolution and will be empowered to make decisions and have impact. The Opportunity Within this … role as a Senior Data Engineer, you will play a critical part in shaping and implementing the strategy and architecture of their data platform. You will work closely with the wider team to evolve the data platform capabilities. This is a hands-on role, and they are looking for someone with a strong background in Azure … Python, and SQL. Skills and Experience Strong experience working with Azure Strong in using Python and SQL Experience working with large complex data sets If you are looking for a new challenge, then please submit your CV for initial screening and more details. More ❯

Data Engineer - Active SC + NPPV3 Clearance Up to £550 per day (Outside IR35) 3 months initially Primarily Remote (Must be UK-based) My client is a major International Consultancy who urgently require Senior Data Engineers with active (SC) Security and NPPV3 Clearance to work with an end client. Key Requirements: Commercial experience as a Senior Data Engineer, with an active SC + NPPV3 Clearance Experience with Azure Data Factory for building and orchestrating data pipelines Experience with Databricks for Data transformation Experience with Azure Synapse Familiar with Azure Data Lake Active SC Clearance +NPPV3 Clearance Nice to have: Immediate availability Hays Specialist Recruitment Limited acts as an employment agency for More ❯

Data Engineer - Active SC + NPPV3 Clearance Up to £550 per day (Outside IR35) 3 months initially Primarily Remote (Must be UK-based) My client is a major International Consultancy who urgently require Senior Data Engineers with active (SC) Security and NPPV3 Clearance to work with an end client. Key Requirements: Commercial experience as a Senior Data Engineer, with an active SC + NPPV3 Clearance Experience with Azure Data Factory for building and orchestrating data pipelines Experience with Databricks for Data transformation Experience with Azure Synapse Familiar with Azure Data Lake Active SC Clearance +NPPV3 Clearance Nice to have: Immediate availability Hays Specialist Recruitment Limited acts as an employment agency for More ❯

security across land, sea and air. They are leaders in highly sensitive international protection and continually seek to lead the way for innovation in their domain. About this Big Data Engineer Role As a Big Data Engineer, you will play a crucial role in creating and maintaining systems to support our client's data science … AI and machine learning workloads. You will be required to work in a collaborative nature with different departments and ensure effective data integration. Why Work as a Big Data Engineer with Our Client? Competitive salary up to £115,000 Flexible working hours Private healthcare Holiday buy and sell Career development Performance bonus What is Expected of you … as a Big Data Engineer with Our Client? UKIC security vetting A minimum of 5 years of experience of working with Big Data as a Data Engineer Excellent communication skills and the ability to work in a collaborative nature with the wider team and explain complex technical details to those of varying technical literacy The More ❯

Treasury Quantitative Developer - Data Engineer Responsibilities Take part in the development and enhancement of the back-end distributed system, providing high performance and high availability margin and stress cash calculations and simulations to Senior Management, Portfolio Managers and Treasurers. Work closely with Quant researchers and developers, tech teams, middle office and business management teams in London, New York … Tel Aviv & Miami. Design, develop and maintain data models, pipelines and warehouse and caching stores Requirements Must-have qualifications/skills: Minimum 5+ years of experience developing systems in Python or other OOP background with Python knowledge. B.A. in computer science or another quantitative field. Experience with Cloud technologies Experience working with RDBMS (Postgres preferred) and other database technologies … data lakes, DuckDB, NoSQL) Good understanding of Design Patterns, Algorithms & Data structures Experience working with Git/GitHub and with CI/CD pipelines Ability to communicate effectively with senior stakeholders across the organization Able to work independently in a fast-paced environment. Detail oriented, organised, demonstrating thoroughness and strong ownership of work. Nice-to-have qualifications/ More ❯

Data Engineer Job Posted May 21, 2024 9:53 AM Location London About Us Safeguarding the future of food We're on a mission to accelerate the development of more productive, sustainable, nutritious & climate-resilient food sources. How? By building the world's first ML-driven target discovery platform for crop gene-editing. From drug target discovery to … class discovery platform for plant sciences. Team Led by co-founders Dom (CTO) and Cecy (CEO), we are now are a team of 7 including two ML engineers, a data engineer and two bioinformaticians. We also have a remote, part-time intern conducting ML research. We primarily work together in-person from our office in Spitalfields, London … days per week. ALT What we're looking for Working alongside our Data Engineering Lead, Dennis Schwartz , you'll be helping us build a best-in-class Data Engineering function, working across our core platform build, as well as helping to structure robust datasets for our ML teams to use across their knowledge graphs. This role would ideally More ❯

as GCP/AWS, Kubernetes, and Docker Proficiency in Unix systems, ideally Linux (Ubuntu) Strong communication skills and experience mentoring engineers Responsibilities Your main responsibilities will involve working on: Data pipeline and underlying infrastructure, especially Apache Kafka and PostgreSQL database Technologies like Kubernetes, Vault, Go microservices, and other cloud services On-premise infrastructure Your technical expertise will play a More ❯

WeDoData are working exclusively with a forward-thinking further education college in Greater London, who are looking for multi-skilled Data Engineer to join their busy MIS function. The senior leadership team really understand the value of a high performing data function and have embraced technology in order to deliver the best service possible. They are looking … for a detail-driven data professional to take the lead in managing and optimising the college data warehouse and also to build and maintain their reporting packages. You’ll collaborate with other teams and departments across the college to ensure a cohesive approach to system architecture and data flows. You’ll need to be full conversant with … T-SQL, SSIS, SSRS and Power BI and will ideally have an understanding of how data is used in the education sector . In return they can offer a salary up to £46,000 plus 25 days holiday (plus bank holidays and Christmas closure days), hybrid working arrangement (2 days WFH), access to a great pension and ongoing technical More ❯

Data Integrations Engineer - London THE GOAL The role of the Data Integrations Engineer is to manage the implementation, change, and maintenance of Product and Sales data within the KellyDeli group. This key role manages product data, enabling our kiosk network to print labels at POS with product pricing and label information. Sales data management is also a responsibility, ensuring inbound data feeds are managed promptly to support invoicing processes. WORKING RELATIONSHIPS Working within the IT Support team, the role has key relationships with marketing, quality, and partner networks, including retailers both large and small. The role reports to the IT Manager and is crucial to the business and IT operations. Working … closely with Product Owners in the Marketing and Quality teams to schedule and deliver data changes to our production systems in a timely manner. Building relationships across Europe is key to success. A second language (French, Italian, Spanish, Mandarin) would be beneficial but is not required, as the business language is English. WHAT THEY DO Maintain product information databases More ❯

Design and implement complex data pipelines and architectures. Utilising dbt and Prefect to automate and run your data pipelines. Collaborate with cross-functional teams to align data engineering efforts. Engaging with clients to identify available data and help them achieve business goals. Key Candidate Requirements Knowledge Advanced proficiency in programming languages and frameworks used in data engineering. Expertise in optimising and scaling data infrastructure. Strong understanding of data modelling, schema design, and database optimisation. Skills Experience with data orchestration tools and workflow management. Excellent written and verbal communication skills and an ability to effectively communicate technical details with non-technical stakeholders. Experience Computer Science Degree or other relevant technical background. At least … the product suite in direct partnership with customers, Cortex was launched in 2024 to better serve the digitally diverse sports industry as a quick-to-deploy SaaS platform for data and revenue driven sports marketing. Cortex products are used by multiple top tier sports organisations and clubs including; Arsenal FC, Formula 1, ECB, the Hundred, Euroleague Basketball, URC, Premiership More ❯

Job Title: Data Engineer/Software Engineer - AI/ML Research Location: London- UK (Hybrid role) Duration: Contract- Until Dec 25 with a possible extension About the Role We are seeking a Data Engineer/Software Engineer to support a pioneering project focused on LLM agents for research . You will play a key … position offers the opportunity to work 100% on an AI-driven project, collaborating with researchers to build tools that allow intelligent agents to manage and improve datasets autonomously. Responsibilities: Data Preprocessing : Transform raw datasets into formats suitable for filtering pipelines. Filtering : Clean, enhance, and filter data using client-provided pipelines . Post-processing : Apply filtering results to original … datasets, repackage them, and support re-ingestion workflows. Collaborate with cross-functional teams to ensure data readiness and quality. Contribute to system design and pipeline automation efforts. Build and maintain Python-based data pipelines. Engage in technical discussions with researchers and stakeholders. Execute data mitigation and filtering tasks with minimal overhead. Develop tools that enable LLM agents More ❯

Calling for a Lead Data Engineer to join our Housing sector client in London. This is a hybrid contract role: 2 days onsite - 3 days remote. Our client is looking for an experienced Lead Data Engineer with the following skill set: Experience with Azure data services, Azure Data Factory (ADF), API development and integration … Databricks, Python programming, Unit testing, GIT version control, Data management and data governance, Data security. If this is you, get in touch ASAP and send us your CV More ❯

Mackinnon Bruce International are partnered with an international development management and investment company specialising in real estate. We are searching for a Private Equity Junior Data Engineer to create and manage the technological part of data infrastructure. Essential requirements: Analytical background 1-2 years experience as a data engineer or in a similar position Highly … motivated and passionate individual about investment and real estate Proficiency in programming and data engineering tools, including SQL and Python/R More ❯

Principal Data Engineer - Contract - Inside IR35 Spinks are working with a scaling Digital Transformation Consultancy who have an exciting new project with a leading Media & Entertainment provider. They're looking for multiple experienced Data Engineers to join on an initial 6 month contract basis, with scope for further extensions. -Python, AWS, dbt, SQL, -Principal Data Engineer More ❯

Principal Data Engineer - Contract - Inside IR35 Spinks are working with a scaling Digital Transformation Consultancy who have an exciting new project with a leading Media & Entertainment provider. They're looking for multiple experienced Data Engineers to join on an initial 6 month contract basis, with scope for further extensions. -Python, AWS, dbt, SQL, -Principal Data Engineer More ❯

Data Engineer | Python | SQL | AWS | Opensearch | Elasticsearch Data Engineer (Individual Contributor Role) Up to £105,000 + Equity & Benefits London - Remote working available Method Resourcing have partnered with a rapidly scaling SaaS business to help them find their first Data Engineering hire. This is a fantastic time to be joining a business with ambitious plans … for their technology over the coming years. You will be an IC-level member of the technical team, with responsibility for the development, scaling and ownership of their data estate. On top of data storage solutions and pipeline development, you will also be focusing on the implementation of Elasticsearch and/or OpenSearch solutions. We are looking for … a highly experienced Data Engineer who can demonstrate strong technical acumen in: Proven ability with OpenSearch/ElasticSearch SaaS solutions Python and SQL fluency Expertise in AWS, particularly managed storage solutions Cloud infrastructure such as Docker, K8s and Terraform We are offering this role at a range of up to £105,000 for the right candidate. Our client More ❯

GCP Data Engineer (Java, Spark, ETL) Future Talent Pool, GCP Data Engineer, London, hybrid role new workstreams on digital Google Cloud transformation programme Proficiency in programming languages such as Python and Java Programming languages Pyspark & Java develop ETL processes for Data ingestion & preparation SparkSQL CloudRun, DataFlow, CloudStorage GCP BigQuery Google Cloud Platform Data Studio … Unix/Linux Platform Version control tools (Git, GitHub), automated deployment tools Google Cloud Platform services, Pub/Sub, BigQuery Streaming and related technologies. Deep understanding of Real Time data processing and event-driven architectures. Familiarity with data orchestration tools Google Cloud Platform cloud composer. Google Cloud Platform certification(s) is a strong advantage. Develop, implement, and optimize … Real Time data processing workflows using Google Cloud Platform services such as Dataflow, Pub/Sub, and BigQuery Streaming. 6 months initial, likely long term extensions This advert was posted by Staffworx Limited - a UK based recruitment consultancy supporting the global E-commerce, software & consulting sectors. Services advertised by Staffworx are those of an Agency and/or an More ❯

Lead Data Engineer | Financial Services | London | SQL Server | Python | Migration | Databricks | Azure | London | Hybrid | £120,000 - £140,000 Roles this good don't come around often! One of the most prestigious, global investment management services are looking to grow their data team. They are at the beginning of a major migration from their legacy SQL Server system … to Databricks and you could be their new Lead Data Engineer. This role will see you: Lead the development of the Databricks platform Ensure that data governance standards are adhered to Help to define and enhance data architecture and frameworks Transform and analyse data to enable seamless migration to Databricks Lead and mentor junior team members … robust and well-documented code Essential skills needed for this role include: Extensive experience in the Financial Services industry with a deep understanding of financial instruments (derivatives, cash, accounting data etc.) Familiarity with portfolio management systems (experience with Aladdin is greatly preferred) Knowledge of data governance frameworks Strong Databricks experience Knowledge of Azure This role will see you More ❯

renowned financial organisation you will be decommissioning a legacy commodities platform and then become part of new platform team! What you'll need to succeed Great experience as a Data Engineer in Financial Services or Insurance - Strong experience working in regulated environments. Vast expertise with Databricks - possess Databricks certifications (desirable) Strong experience with Python. Expertise with modern data More ❯