Big Data Jobs in London

1 to 25 of 120 Big Data Jobs in London

Lead Data Engineer

Greater London, England, United Kingdom
OpenCredo
not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data focused technologist … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »
Posted:

Big Data Architect

Greater London, England, United Kingdom
Hybrid / WFH Options
InterEx Group
For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP … Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization more »
Posted:

Azure Synapse Data Engineer - £75K - Remote (London)

London, United Kingdom
Hybrid / WFH Options
In Technology Group
Azure Synapse Data Engineer - £75K - Remote (London) My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They are an innovation … a focus on delivering deep insights to clients, working collaboratively with our colleagues across the business. We are looking for an experienced Azure Synapse Data Engineer with exceptional technical, analytical, communication and project management skills to join our team of data and analytics experts, helping organize and leverage … arguably the richest, broadest data available on work and people, and support the build-out of a scalable, distributed data estate and supporting applications. The role will help us leverage critical data assets, set up data pipelines, transform data, and enable our data scientists more »
Employment Type: Permanent
Salary: £65000 - £75000/annum Benefits
Posted:

Senior Principal Consultant - Data Architect

London Area, United Kingdom
Genpact
we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Senior Principal Consultant, Data Architect/Data Engineer! In this role, you will … play a pivotal role in designing and implementing robust data solutions. Your technical expertise and leadership will drive the success of our big data initiatives. Good level of experience is required. Responsibilities: Build robust, high-performance, and adaptable solutions for modern platforms (GCP Big Query,Relational … OLAP) Finance data modelling extensive experience desired as the data lead. Talend/Informatica transformation logic experience is required Technical thought leadership on architecture, data modeling, and Big Data strategy Expertise in technical principles, vision, and standards for data warehouse. Scalability to handle increasing more »
Posted:

AWS Data Architect (Must have current SC)

London Area, United Kingdom
Amber Labs
AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision to provide specialist … services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You will work closely with various … teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using AWS services such as Glue, Lambda, Kinesis, and Data more »
Posted:

AWS Data Engineer

SW19, Dundonald, Greater London, United Kingdom
DataBuzz
Job Title: Data Engineer Location: London Job Type: Permanent Work Type: Hybrid Salary : £50,000 to £55,000 per annum Are you a sports enthusiast with a passion for working in the sports industry? Whether you're interested in the dynamic world of professional sports, the business of sports … of possibilities for those eager to immerse themselves in this thrilling and fast-paced environment. Databuzz is presently seeking an experienced candidate for a Data Engineer role with one of our clients located in London. About the Client: Our client is a sports tech company that leverages AI and … expert knowledge to offer data and analysis, addressing performance and commercial challenges in the sports and media industries. About the Role: As a Data Engineer you will be pivotal in designing, developing, and maintaining data architecture and infrastructure. The ideal candidate should have a strong foundation in more »
Employment Type: Permanent
Salary: £50000 - £55000/annum
Posted:

AWS Data Engineer

South West London, London, United Kingdom
DATABUZZ LTD
Job Title: Data Engineer Location: London Job Type: Permanent Work Type: Hybrid Salary : £50,000 to £55,000 per annum Are you a sports enthusiast with a passion for working in the sports industry? Whether you're interested in the dynamic world of professional sports, the business of sports … of possibilities for those eager to immerse themselves in this thrilling and fast-paced environment. Databuzz is presently seeking an experienced candidate for a Data Engineer role with one of our clients located in London. About the Client: Our client is a sports tech company that leverages AI and … expert knowledge to offer data and analysis, addressing performance and commercial challenges in the sports and media industries. About the Role: As a Data Engineer you will be pivotal in designing, developing, and maintaining data architecture and infrastructure. The ideal candidate should have a strong foundation in more »
Employment Type: Permanent
Salary: £55,000
Posted:

Data Architect

London Area, United Kingdom
Smart IT Frame LLC
Role: Data Architect Location: London, UK Define all architecture patterns (Data Mesh, Data Fabric, EventHub etc) Define each architecture pattern Data & Analytics Platform Functional Blueprint, Logical Layers and Each layer Capabilities Identify All Ingestion Patterns (Real Time, Batch, Structured, Unstructured (Images/PDF) for each data & analytics platform Analyze existing Data & Analytics Platform Architecture Playbook, Identify Gaps and Enrich Playbook Guided Tooling Framework (Scorecard based approach) Potential Engineering Frameworks (Structured/Semi-Structure) Define Intake Frameworks (Unstructured - OCR/Intake) Data Governance Capabilities/Framework/Integration with rest of Ecosystems Design & Recommend … Data Traceability/Lineage/DQ/Reconciliation and Observability Platform Understanding of Cloud (GCP, AWS) Services Offering Deep Understanding of Banking Regulations and solution required to adopt them in Hybrid Cloud Ecosystem Data & Analytics Platform Governance: FinOps, Regulatory Conduct MVP/POC Qualifying Criteria Must have 12+ more »
Posted:

Data Governance Analyst

London, United Kingdom
Hybrid / WFH Options
Deutsche Bank CWS
service, partner with Deutsche Bank to support contingent recruitment processes. Job description - the role On behalf of Deutsche Bank, we are looking for a Data Governance Analyst for an initial 6 month contract based in the Banks London Office on a hybrid working model of 3 days per week … tasks. 'Together we're sharing new perspectives and transforming what it means to be a bank.' Purpose of the role: Transaction Monitoring & Screening Global Data Steward Office is responsible for Data Governance, Data Quality Management (DQM) & Data Programme delivery covering key functions within Transaction Monitoring and … Screening. Working as part of the DQM team the Senior Data Analyst will be responsible for supporting the Data Quality Management Framework and for contributing towards the central Data Analytics capability. Data Quality Management Framework covers Data Quality Standards, Data lineage & Controls, Exception & DQ more »
Employment Type: Contract, Work From Home
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Better Days Recruitment
a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python, AWS and web scraping is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Solirius Consulting
of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »
Posted:

Azure Data Engineer

London Area, United Kingdom
Spencer Scott - Technology Recruitment
Azure Data Engineers wanted by a London based company at the forefront of revolutionising healthcare through cutting-edge technology and data-driven solutions. Our mission is to improve patient outcomes and streamline healthcare processes by leveraging the power of data. We are looking for a talented Azure Data Engineer to join our dynamic team and help us drive our mission forward. As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure. You will work closely with our data science, analytics, and engineering teams to ensure … that data systems are robust, scalable, and secure. Your expertise will help us harness the full potential of our data to deliver innovative healthtech solutions. The business is already a well established leader within their domain. However, they like to keep team sizes quite small as they want more »
Posted:

Data Models Lead - Data Engineering - MarTech

Greater London, England, United Kingdom
Mars
Data Models Lead - Data Engineering - MarTech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »
Posted:

Data Models Lead - Data Engineering - MarTech - Adtech

London Area, United Kingdom
Mars
Data Models Lead - Data Engineering - MarTech - Adtech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Franklin Fitch
Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the design … and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust … data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration more »
Posted:

Data Scientist

London Area, United Kingdom
Spencer Scott - Technology Recruitment
Data Scientist wanted by a London based company at the forefront of the energy revolution, driving innovation to power a sustainable future. Our mission is to deliver reliable, affordable, and clean energy solutions to our customers while reducing our environmental footprint. We are looking for a passionate and skilled … Data Scientist to join our dynamic team and help us harness the power of data to transform the energy industry. The business is already a well established leader within their domain. However, they like to keep team sizes quite small as they want people to have a major … say and influence on projects. Key Responsibilities: Data Analysis & Modeling: Analyse large, complex datasets to extract actionable insights and build predictive models to optimise energy production, distribution, and consumption. Algorithm Development: Develop and implement advanced machine learning algorithms to forecast energy demand, improve grid reliability, and enhance operational efficiency. more »
Posted:

Python Data Engineer

London Area, United Kingdom
Caspian One
We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real Time … data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such … as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data with minimal more »
Posted:

Data Analyst

London Area, United Kingdom
Response Informatics
Responsibilities:  Commercial acumen and a recent proven experience in a similar role (such as Commercial Insight Analyst, Data Insight analyst in Product Sales, Product Insight Analyst etc)  Success track in synthesising complex and ambiguous information in order to drive actionable insight brought to life through communication and visualisation  Proficiency … in SQL, Qlik sense and Big Data  Innate curiosity about customers, products and competitors  Cooperative and positive can-do attitude What I’ll be doing – your accountabilities Understanding business context and expectations and translating into practical approaches to data analysis Applying a broad range of techniques (A …/B hypothesis testing, multivarate test,data exploration, data preparation, big data analytics, visualisations, statisticalanalysis, business analysis) for gatheringthe insights and identifying meaningfultrends in the data Generating tactical analysis to distilthe insights, identify opportunities & make recommendations Articulating trends using tactical data visualisation techniques and more »
Posted:

Insights Analyst

Greater London, England, United Kingdom
Response Informatics
Responsibilities: · Commercial acumen and a recent proven experience in a similar role (such as Commercial Insight Analyst, Data Insight analyst in Product Sales, Product Insight Analyst etc) · Success track in synthesizing complex and ambiguous information in order to drive actionable insight brought to life through communication and visualization · Proficiency … in SQL and Big Data · Innate curiosity about customers, products and competitors · Cooperative and positive can-do attitude What I’ll be doing – your accountabilities Understanding business context and expectations and translating into practical approaches to data analysis Applying a broad range of techniques (A/B … hypothesis testing, multivariate test, data exploration, data preparation, big data analytics, visualizations, statisticalanalysis, business analysis) for gathering the insights and identifying meaningfultrends in the data Generating tactical analysis to distil the insights, identify opportunities & make recommendations Articulating trends using tactical data visualization techniques and more »
Posted:

Big Data Engineer - Python, Pyspark

City of London, London, United Kingdom
McGregor Boyall Associates Limited
Data Analytics Engineer - Inside IR35 - £600 - 800 Per day I am actively recruiting for an Immediate start Data analytics opportunity in Central London. This is for an international investment banking firm and will require a strong background in business change and transformation focussed expressly around Data analytics … and Big data platforms. 5+ years of Big Data Experience utilising Pyspark 5+ years of managing data analytical projects within a financial domain (Banking/Investments) Background within investment managment, financial services, etc. Project management experience, consultancy experience to deal and operate with internal and more »
Employment Type: Permanent
Salary: £600 - £800 per day
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Careers at MI5, SIS and GCHQ
Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing, and … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely with … technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to MI5 more »
Posted:

Senior Data Engineer - Quant Trading

London Area, United Kingdom
Understanding Recruitment
Senior Data Engineer Python, SQL, Big Data Frameworks London - 4x a week £80-90,000 + bonuses Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure that supports their … cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. Implement … data security measures and ensure compliance with industry standards. Requirements: Master’s degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer, preferably in the financial services or hedge fund industry. Technical Skills: Proficiency in Python and SQL. Experience more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Anson McCade
Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data into actionable insights … industry verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and SQL … queries. • Proficient in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on more »
Posted:

Data Engineer

London, England, United Kingdom
Version 1
we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data … ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design and implement more »
Posted:

Software Developer - API expert - Innovative Big Data Group - Hedge Fund

London Area, United Kingdom
Xcede
This innovative Systematic Trading firm , seeks an experienced and gifted Software Developer/Big Data Engineer with genuine expertise in Python to work within a fast paced Data team . You will work very closely with Quant Research, Trading, Quant Development and traditional ETL/ELT Data … enable the capture, ingestion, transformation, storage, and provision (up and downstream) of large alternate datasets covering structured, semi-structured, and unstructured - API Layer Central Data Platform Telemetry tools Bespoke Data tools for the front office teams Post 18-24 months successful tenure previous individuals have moved internally into … Opportunity for internal mobility to APAC and East Coast U.S promoted. Desired background and skills 3+ years of exp. as a Software Engineer/Big Data Engineer with an understanding of modern Data Architecture Previous Finance experience is NOT essential , you will develop a deep understanding of more »
Posted:
Big Data
London
10th Percentile
£58,375
25th Percentile
£75,000
Median
£95,000
75th Percentile
£118,750
90th Percentile
£143,750