51 to 75 of 221 Data Engineering Jobs in London

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the design … and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust … data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration more »

Head of Data Platforms | Power BI | Microsoft | Strategy | London | £65,000 - £75,000 Are you a Senior Data Engineer who is looking for a step up into a Head of Data position, or a Head of Data who is looking for a new greenfield project? If … on… You’ll be joining an education organisation who due to a large amount of growth and acquisitions are looking to build an established Data Engineering function. This is a greenfield project where you will be solely responsible for managing their data capability. This includes BI reporting … and data warehousing. To be successful in this role you will: from a Data Engineering background and be able to build a data warehouse from scratch experience building reports in Power BI/Tableaux good experience with SQL previously helped shape a data function, including more »

Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity: For the Ministry of Defence (MOD), maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with this Big … Firm to support its multidisciplinary AI & Cloud Data Engineering Capabilities. The Role: As an AI & Cloud Data Engineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising data integration tools to optimise complex data solutions. Collaborating with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with data pipelines, ETL processes, and workflow orchestration - using core more »

We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise … ithin the Network Automations and Intelligence team in particular, we have identified a range of pre- and post-graduate level projects covering the broader data analytics space, specifically in the telecommunications context. These projects span data engineering, data science, machine learning, and systems development ; all of … which are areas that interns are expected to actively contribute What you'll do Work closely with network engineers, data scientists, and developers across Sky who will support you in enhancing your knowledge and skill sets. Generate ideas with the team and participate in improvement of existing projects Work more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and more real-time … which creates a range of engineering problems for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company … to design and deliver new components of our data landscape. You will have an end-to-end responsibility for your deliverables: from leading the work to agree the right approach, through coding, configuration and documentation, all the way to going live. In this process you will have significant impact more »

Type: Permanent Posted On: 03/12/2023 Head of Data Engineering required by an AI business who is changing an industry. You’ll be leading the build out of a real time streaming platform from scratch, that will become the organisation’s all in one data platform and golden source for data. This proprietary data platform has scope for a lasting impact worldwide. What we offer Lucrative Stock options Hybrid working in London office Our growing success comes from providing next generation technological solutions in an accessible and easy to operate way. We are … a Data-Driven company using Knowledge Graphs, with AI at the heart of our software. This is powered by mammoth quantities of data and is changing the way that software and data platforms are built. Role Head of the Data Engineering function but still cutting more »

Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and Data Engineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with Data Engineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »

Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and Data Engineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with Data Engineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »

Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and Data Engineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with Data Engineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »

Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and Data Engineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with Data Engineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »

Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and Data Engineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with Data Engineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »

Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and Data Engineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with Data Engineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »

Our client who is a house hold UK name branded business are urgently looking for a Data Engineering Manager to lead a small team of data engineers. Responsibilities: Manage a team of data engineers. (must have managed before, not looking for senior data engineers looking … to make the next step. Oversee the design, development, and maintenance of data pipelines. Collaborate with cross-functional teams to ensure data quality and availability. Lead projects related to data integration, transformation, and storage. Implement best practices for data engineering processes. Requirements: Previous experience managing … a team of data engineers. Proficiency in Azure (including services like Azure Data Factory, Azure Databricks, etc.). Strong programming skills in Python . Familiarity with data modeling, ETL processes, and data warehousing. Excellent communication and leadership abilities. Additional Information: This role offers a £100k + more »

Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data into actionable insights … that inspire ingenuity. The Company: The Organisation consists of 4000 high-performing Digital Strategists and Engineering Technologists - united in delivering human-centred innovation and making a meaningful impact on global society. Boasting a vast network of FTSE 100 and Fortune 500 clients, the Group specialises in executing complex technology … industry verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and SQL queries. more »

Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing, and … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely with … technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to MI5 more »

Roles and Responsibilities: • Analyse and organize raw data • Build data systems, pipelines, and data products. • Evaluate business needs and objectives • Interpret trends and patterns • Conduct complex data analysis and report on results • Prepare data for prescriptive and predictive modelling • Build algorithms and prototypes • Combine raw … information from different sources • Explore ways to enhance data quality and reliability • Identify opportunities for data acquisition • Develop analytical tools and programs • Collaborate with data scientists and architects on several projects • Automate Tasks • Create Models and Identify Patterns Key Skills: • Previous experience as a data engineer … or in a similar role • Technical expertise with data models, data mining, data migration, Data warehousing and segmentation techniques (GCP). • Big query, big tables and Compute engine in GCP. • Knowledge of programming languages Python, R, and java. • Machine learning will be added advantage. • Hands-on more »

Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in data assessment and … profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in Data Engineering or Data Warehousing (Data Engineer/DW Developer) with robust DW development and … ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL/ELT processes Extensive experience with Python Excellent numerical, analytical, and statistical skills Ability to visualize and present data and more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation! Our client is a not-for-profit charity that reviews/certifies companies … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You more »

Business Intelligence Engineer London – Hybrid £400 a day Inside IR35 Key Skills: • 3+ years of analyzing and interpreting data with Redshift, Oracle, NoSQL etc. experience • Experience with data visualization using Tableau, Quicksight, or similar tools • Experience with data modeling, warehousing and building ETL pipelines • Experience in Statistical … Analysis packages such as R, SAS and Matlab As a BIE, you will own partnering with data engineering and software engineering teams to drive best-in-class business intelligence solutions at scale. You will work with structured and unstructured data sources to develop deep business insights … and architect key business metrics. You will partner with scientists to build forward-looking data experimentation, predictive modeling, and machine learning algorithms. The role is cross functional and will require working closely with a wide variety of stakeholders including senior members across engineering, product, business leadership, and economics more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and other platforms for … large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance with best practices. Ideal Candidate: Significant experience in data more »

Data Engineer (Azure) Up to £80,000 North London office x1 day per week OVERVIEW A successful & established B2C Insurance giant are hiring for a Data Engineer to join a strong, cross-functional Data team in the UK. You will be spearheading some of their key Data Engineering projects, working on an Azure tech stack. Proven experience using Azure Cloud Technology is essential for this role. Your responsibilities as a Data Engineer will include, but not be limited to: Spearhead Data Engineering work within the team, including ETL pipelines, CI/CD … platform engineering. Help guide and mentor junior team members on key Data Engineering projects for the business. Engage with senior business stakeholders and communicate technical concepts and projects to non-technical audiences. YOUR SKILLS & EXPERIENCE A successful Data Engineer (Azure) will have the following. Strong proficiency with more »

better informed and clearer financial decisions to create better financial well-being. The company has created a new role in the company in there data team. It's an existing time to join this scale-up. About the Senior Product Manager role We are looking for a very data-centric Senior Product Manager for the company's data engineering mission. Data is at the heart of everything this company does. It is an exciting time to join them as they have recently overhauled the global data platform and built new foundations. The Senior Product … with prior experience is advantageous or someone who is looking for that next step in their career will suit this role well. Accountable for: Data engineering roadmap Collaboration with stakeholders globally across multiple functions eg engineering, and commercial. Develop a data platform strategy to keep the more »

Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve … their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions … like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse business units more »

GOAT Interactive is looking for a Junior Data Engineer to join our Data Engineering team, this role will be responsible for the development, testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be working with technologies … such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so the scale of our data, we are currently working on several … initiatives to improve our data solution and you would become an integral part of this. Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity and quality. Manage ETL and ELT pipelines across many data more »

Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such as automating manual tasks … and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes within a medallion architecture. Proficient in Data more »