Big Data Jobs in London

1 to 25 of 37 Big Data Jobs in London

Remote Big Data Engineer

South West London, London, United Kingdom
Hybrid / WFH Options
Xcede UK
Big Data Engineer - Fully Remote in Africa/EU As a Big Data Engineer you will have a strong understanding of big data technologies with an exceptional ability to code. You'll be providing technical leadership, working closely with the wider team and focusing … Code, TDD, BDD, continuous integration, continuous delivery, and DevOp s You will, among other tasks: Define, design, and develop services and solutions around large data ingestion, storage, and management such as withRDBMS, No SQL DBs, Log Files, Events. Define, design, and run robust data pipelines/batch jobs … Redis etc. Mocking (any of the following Mockito, ScalaTest Spock, Jasmine, Mocha). Build tools (One of SBT, Gradle, Maven). Knowledge of AWS Big Data/Analytics services - S3, EMR, Glue, Redshift, QuickSight, Kinesis. Desierables Skills Experience of big data environments (also advising best practices more »
Employment Type: Contract, Work From Home
Rate: US$280 - US$340 per day + Remote
Posted:

Senior Data Engineer

City of London, London, United Kingdom
CMC Markets UK Plc
This is a fantastic opportunity for a Senior Data Engineer to join CMC Markets as we develop new data driven products and services and transition to a more cloud-native architecture. As a Senior Data Engineer, you will be responsible for implementing CMCs data strategy, working … as part of the Core Data team on our cloud native data platform. *This is fully onsite role** No Agencies* The Core Data team engages and works with stakeholders across the organisation. A key responsibility of the team is to promote CMCs data strategy of providing … a decentralised approach to data, working with other teams to develop shared data capabilities that will allow them to operate with increased autonomy. A driving principle of the team is to realise better data citizenship, treat data as a product, and enable CMC to build scalable more »
Employment Type: Permanent
Posted:

NS - Data Engineer

City of London, England, United Kingdom
Hybrid / WFH Options
All the top bananas UK
Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. We are looking for experienced … Data Engineers to join our team following continuous growth and success. As a Data Engineer you will be involved in: Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces … Model data requirements, data sources and data flows to bring order and structure to programmes of work Defining how and where data is created, mastered and destroyed to ensure proper control over the lifecycle of corporate data assets Using categories of products that can be more »
Posted:

Athena - Data Consultant

City of London, London, United Kingdom
Hybrid / WFH Options
Sparta Global Limited
of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »
Employment Type: Permanent, Work From Home
Salary: £24,000
Posted:

Data Migrations Solution Architect - SC Cleared

London, United Kingdom
BrightBox Group
Data Migration Architect (Holds Active SC) Contract Remote Outside IR35 The data management industry is evolving rapidly, driven by the increasing volume of data generated daily and the growing need for efficient data storage, processing, and analysis. With the rise of cloud technologies and big data analytics, businesses are seeking robust data architectures to streamline operations and gain strategic insights. Our client stands at the forefront of this transformation, leveraging the latest advancements in data warehousing, lake houses, and cloud platforms. We are seeking a highly skilled Data Migration Architect … to join our client’s dynamic team. The successful candidate will play a pivotal role in designing and implementing data migration strategies, ensuring seamless integration across various platforms and systems. You will be required to have Public Sector experience working and supporting multi-disciplinary Agile teams. Key Responsibilities: Design more »
Employment Type: Contract
Posted:

Principal Data Engineer

London, United Kingdom
Hybrid / WFH Options
Investigo
Principal Data Engineer Location: London Hybrid (3 days a week) Salary: To £100,000 + Bonus + Benefits Job Description Investigo is partnered with an industry-leading technology logistical organisation, who are currently carrying out a huge data build out for their industry first application. This role would … having a true impact on the global supply chain and the ways some of the leading organisations move goods around the world. This Principal Data Engineer position would see you have critical involvement in implementing best-in-practice dataset and being 100% hands-on. They are looking for someone … who is comfortable with ambiguity and can really take ownership of the project, working in a small team of data engineers. You will be involved from inception to delivery of this project having a real say on all of the business's technology. You will be the Principal Data more »
Employment Type: Permanent
Salary: £95000 - £100000/annum
Posted:

Senior Data Engineer, Global Streaming

Brentford, Middlesex, United Kingdom
by a culture of respect. We embrace authenticity and inspire people to thrive. As part of the Direct-to-Consumer Decision Sciences team, the Data Engineer will be responsible for creating a connected data ecosystem that unleashes the power of our streaming data with a focus on … international propositions. We gather data from across all customer/prospect journeys in near real-time, to allow fast feedback loops across territories combined with our strategic data platform, this data ecosystem is at the core of being able to make intelligent customer and business decisions. In … this role, the Data Engineer will share responsibilities in the development and maintenance of optimized and highly available data pipelines that facilitate deeper analysis and reporting by the business, as well as support ongoing operations related to the Direct-to-Consumer data ecosystem. Responsibilities include, but are more »
Posted:

Senior Analytical Specialist

London, United Kingdom
Hybrid / WFH Options
NHS Counter Fraud Authority
of economic crime across the NHS. Further information can be found on our website. We are embarking on a piece of work to monitor data to identify and respond to patterns indicative of potential fraud. This will support our current work that reduces the likelihood of fraud occurring. We … will bring in data science capabilities to be deployed in counter fraud activity and work closely with partners across health and government to further maximise the preventative impact of proactive counter fraud analysis. We will combine this with our range of counter fraud and domain expertise to maximise our … of the Senior Analytical Specialist is pivotal within the program, requiring a deep understanding of analytical techniques and methods used to examine and explore data, additional expertise in anomaly detection is essential. You will be expected to apply advanced techniques including using machine learning and understanding how to select more »
Employment Type: Fixed-Term
Salary: £43742.00 - £50056.00 a year
Posted:

BI Support Lead

City of London, London, United Kingdom
Hybrid / WFH Options
360 Resourcing
will be responsible on a daily basis for: Oversee the BI Support and BAU activities of the team Define and defend the company's data standards and principles. Ensure the flow of data within Chaucer is as efficient as possible. Ensure data is organised and structured to … the business. Support BAU team members on prioritizing tasks, managing changes, and allocating resources. Identify improvements in the run processes and work with the Data and Analytics teams to streamline and improve the processes. To be considered for this role the BI Support Lead should have most of the … following experience: Proven experience driving digital agendas. Demonstratable experience of working with packaged cloud solutions (IaaS, PaaS, SaaS) and how to manage data limitations and dependencies between systems to provide a comprehensive data architecture. Knowledge of Cloud based big data frameworks such as data lake more »
Employment Type: Permanent, Work From Home
Salary: £70,000
Posted:

AWS DevOps Engineer

South West London, London, Dundonald, United Kingdom
DataBuzz
of our clients located in London. About the Client: Our client is a sports tech company that leverages AI and expert knowledge to offer data and analysis, addressing performance and commercial challenges in the sports and media industries. About the Role: Our client is seeking an individual who shares … further discussion. Why Us? At DataBuzz Ltd, we specialize in global talent acquisition. We are global recruitment firm with expertise in placing candidates in Data Science, Analytics, IoT, Big Data, Data Engineering & Software building, and much more. By applying to this advert, you are giving DataBuzz … Ltd authority to hold and process your data for this specific role and any other roles we may deem suitable to you over time. We will not pass your data to any third party without your verbal or written permission to do so. All incoming and outgoing calls more »
Employment Type: Permanent
Salary: £40000 - £50000/annum
Posted:

Technical Lead – Data Engineering

London, United Kingdom
Harnham
INFOData Engineer - Tech LeadFintechLondon110,000As a Tech Lead, you will be leading and managing a greenfield implementation for a disruptive Fintech. The data platform will be used to facilitate the launch of a new product.THE COMPANY:This company has gone through a period of hyper-growth over the last … the credit card space and have launched multiple successful products and are now one of the most trusted brands out there. They have several big data teams looking after their client's data for the advanced analytics team to gather insights on. They have established a robust … AWS architecture that allows the business to store and stream big data coming in from all types of sources.THE ROLE:As a Tech Lead you will be expected to be hands-on with Spark/Python, Kafka. You will be part of the design team to enhance their more »
Salary: £ 100 K
Posted:

Data Solution Architect - Financial Services

Bromley, London, United Kingdom
Hybrid / WFH Options
Tech Talent Identified Ltd
Data Solution Architect is required by this specialist Financial Services company as they look to improve their processes and grow their business. You'll be joining c25 people on a common goal to improve product offering for their clients, and internal processes for key stakeholders. You'll be leading … improve efficiency, working closely with the Technology Director and CEO around business strategy alignment. Ideally you'll come from a good technical background delivering data engineering solutions and will be able to demonstrate experience across - Moving previous solution (in Excel) to Snowflake, via ETL Power BI reporting Data Engineering - big data tools, data processing systems Excellent stakeholder management Excel modelling (understanding/background) Please note that this role requires 3-6 months of Full time work, 5 days per week in the office. After that period there will be some flexibility for hybrid working more »
Employment Type: Permanent, Work From Home
Salary: £90,000
Posted:

Deputy Data Warehouse Manager

London, United Kingdom
Hybrid / WFH Options
Imperial College Healthcare NHS Trust
There will be a particular emphasis in this role on developing within a Microsoft SQL Server development environment and/or an Apache Spark big data processing environment - creating algorithms and pipelines to ingest and transform data into information systems and solutions capable of answering clinical and … a range of technologies and ensure the ongoing maintenance and optimisation of these information systems Be a subject matter expert in the technical and data infrastructure of digital solutions You must already be an expert information system developer and preferably have had exposure developing algorithms in Python/pyspark. … of the job To be part of a team providing complete, accurate and timely Business Intelligence to support performance, research and education. The Deputy Data Warehouse Manager provides management of and direction for the maintenance and development of this important Trust asset. The role provides specialist advice where required more »
Employment Type: Permanent
Salary: £58698.00 - £65095.00 a year
Posted:

Software Analyst and Developer

SW4, Clapham North, Greater London, United Kingdom
SwallowTech
technical staff and business users. Key Responsibilities: Analyse complex business requirements for new development and enhancements, producing functional and technical specifications for software and data structure Apply innovative problem solving skills, handle challenging requirements to improve the strategic solution Partner with developers to ensure requirements are implemented as per … site development team, so understanding and being understood is crucial. Excellent documentation and presentation skills to write functional and technical specifications for software and data structure. Preferred: Bachelor’s Degree or equivalent in a highly numerate subject Experience of scripting languages, e.g. Unix Previous involvement in all stages of … the software development lifecycle Experience in design of, or technical exposure to, high performance systems, preferably in areas of big data, data analysis/aggregation SQL Server Transact-SQL Business/technical knowledge within the banking sector – Reconciliation, Cash Management systems Financial messaging, ISO20022 and FIN (MTs more »
Employment Type: Permanent
Salary: £40000 - £45000/annum
Posted:

Software Analyst and Developer

South West London, London, United Kingdom
Flat Fee Recruiter
technical staff and business users. Key Responsibilities: Analyse complex business requirements for new development and enhancements, producing functional and technical specifications for software and data structure Apply innovative problem solving skills, handle challenging requirements to improve the strategic solution Partner with developers to ensure requirements are implemented as per … site development team, so understanding and being understood is crucial. Excellent documentation and presentation skills to write functional and technical specifications for software and data structure. Preferred: Bachelors Degree or equivalent in a highly numerate subject Experience of scripting languages, e.g. Unix Previous involvement in all stages of the … software development lifecycle Experience in design of, or technical exposure to, high performance systems, preferably in areas of big data, data analysis/aggregation SQL Server Transact-SQL Business/technical knowledge within the banking sector Reconciliation, Cash Management systems Financial messaging, ISO20022 and FIN (MTs) in more »
Employment Type: Permanent
Salary: £50,000
Posted:

Senior Java Engineer - Multithreading

London, United Kingdom
Hybrid / WFH Options
Understanding Recruitment
principles. Day to day responsibilities will include building microservices, using Docker and Kubernetes and 3rd party API integrations. You will also be working with big data technologies like Hadoop, Kafka and Cassandra.This Senior Java Engineer (Multithreading) role will be a strong fit if you:Have extensive Core Java … multihreading, low-latency, concurrency experienceEnjoy working with big data technologies like Hadoop (or if you are keen to learn!)Have messaging experience with Kafka, RabbitMQ or MongoDBAs the Senior Java Engineer, you will be a strong advocate for modern development ways of working including pair programming, Agile and more »
Salary: £ 100 K
Posted:

Senior Data Analyst - Senior Vice President - London at Citi

london, south east england, united kingdom
Citi
for a hands-on, dynamic technical analyst with knowledge of wholesale lending. This individual should have prior agile development experience and be proficient in data, analytics and reporting. They should be ready to join a fast paced, world leader in the financial services industry. Key Responsibilities: Support the development … support day-to-day needs of senior leadership, with a focus on delivering accurate and rapid insights Creation of documentation for technology solutions and data pipelines to ensure robustness and auditability Contribute to critical reporting and business intelligence projects that have impact to the Lending Transformation Programs Proactively identify … and resolve data quality issues and opportunities for enhancing the organization's BI capabilities Contribute to timely and complete delivery of reporting, analytics, and BI commitments to internal stakeholders and external regulators Qualifications and Competencies: Bachelor of Science (BS) degree in a quantitative discipline with 10+ years strong relevant more »
Posted:

Azure Data/AI Consultant

London, United Kingdom
Hybrid / WFH Options
Certus Recruitment Group
Azure Data/AI Consultant Remote 60-65k Base + Great Benefits Our firmly established, award-winning and highly regarded MSP client requires an Azure Data/AI Consultantt to be based remotely in the UK. This amazing company has doubled in size in the last … trend is set to continue over the next 3-5 years. This presents an amazing development opportunity for the right candidate. As an Azure Data/AI Consultant, you will: Play a pivotal role in the design, development, and implementation of AI solutions - accelerating AI adoption Integrate AI solutions … with client data, APIs and production systems Conduct Datamodelling for training, predictions, and analytics Utilise Python (and C#) and cloud ML technology Deliver reliable solutions collaboratively Perform data analysis Azure Data/AI Consultant qualifications, experience, and traits: Computer science degree 3+ years as an Azure/ more »
Employment Type: Permanent
Salary: GBP 65,000 Annual
Posted:

Data Engineer - High growth SaaS company

London, United Kingdom
Venture Up
EngineerGrowing SaaS Software Company90,000 - 115,000 per year plus benefitsVenture Up working with a growing software company and they are recruiting for a Data Engineer to join their new R&D team in London. The company’s platform allows companies to build work management tools to fit their … every need and you will have the opportunity to plan and build data-related features, manage data sources on application and infrastructure levels, build the vision for scaling out data as they grow!You will be working with working with a small team of experienced and highly … deployment in a collaborative, fast-paced environment. Tech Stack includes: Elasticsearch, Cassandra, Kafka, MySQL, PostgreSQL, Redis, AWS, LinuxRequirementsExperience of at least 5+ years with data streaming application, performance optimization and scaling out data worldwide.Coding experience in high throughput real time data processing as well as analytic systems.Proven more »
Salary: £ 100 K
Posted:

Professional Services Team Lead

London, United Kingdom
Quant Capital
Services Manager to join our high profile client. My Client is a global financial technology (fintech) firm specialising in AML, Fraud, Financial Risk and Big Data Management. They have offices and clients across the globe. This role runs EMEA professional services in a team of 8 looking to … require exceptional experience leading and managing people in both local and remote locations. In addition, you will require strong client consultancy experience with software data management, data quality, master data management, and/or risk and compliance solutions. Strong analytic and problem solving skills, experience with Windows more »
Salary: £ 70 K
Posted:

Director of Analytics Consulting - Credit Risk

London, United Kingdom
Experian
Job DescriptionThe ESS Data Science Team supports Experian's global business. The team is responsible in supporting analytic and generative AI products for decisioning, analytics, and Fraud and ID. The team accelerates the use of Experian products, demos new solutions to clients, provides clients a clear understanding on how … the products are deployed on our platform. You will be focused on client interaction with a heavy concentration in Data Science and Experian GPT and be regarded as a specialist for Experian products. You will understand and have experience in credit risk management, data science and regulatory requirements … product development, feature prioritisation, and product evolution of tools and capabilities supported by the Ascend Platform.Lead teams in a collaborative effort involving Engineering and data science experts in the design and implementation of Machine Learning, Dashboarding, Ad Hoc Analysis and AI application on a true big data more »
Salary: £ 70 K
Posted:

Senior Analyst/Advisor for emerging Technologies

London, United Kingdom
Hybrid / WFH Options
Brimstone-Recruitment
to emerging technologies; staying abreast of emerging technology news and proactively sharing insights into the impact of news events on clients and sectors, leveraging data and insights on emerging technologies to help us identify and win new business as well as maintain and enhance existing client work; Knowledge assisting … qualified staff in the following areas: Forensic Accounting & Fraud - (AML/CTF, Investigation, CFE’s etc.); Legal and LegalTech (E-Discovery, Digital Forensics, EDRM); Big Data and Data Analytics- (MI/BI/CI); InfoSec and Cyber Crime; Audit; Accountancy and Finance; FinTech (Payments etc.); Risk - (Credit more »
Employment Type: Permanent
Salary: £75000 - £90000/annum Competitive Benefits package
Posted:

Senior Machine Learning Engineer

South East London, London, United Kingdom
Hybrid / WFH Options
Stepstone UK
Who we are At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With over … role will be about designing, planning and implementing systems based on LLM-inference, including advanced RAG. To this end you will collaborate tightly between Data Scientists, Machine Learning and Big Data Engineers, as well as Cloud Software Engineers and DevOps in a Scrum environment. You can support … and your background in coaching and mentoring more junior engineers. To thrive in our fast-paced environment you will contribute to our Chapters in Data Science and Machine Learning Engineering, able to work across teams to help everyone work together effectively Demonstrate your growth mindset and systematic approach to more »
Employment Type: Permanent, Work From Home
Posted:

Senior Data Engineer

London, United Kingdom
Hybrid / WFH Options
Understanding Recruitment
Senior Data Engineer - FinTech (Tech for Good!)London Office/Fully remote across UK and EuropeDo you want to utilise cutting-edge FinTech innovations to drastically reduce inequity within society?As a Senior Data Engineer, you will join a close-knit team based across the UK and Europe … that is continuously innovating and applying state-of-the-art technologies within greenfield projects.You will be building the team's modern data platform from the ground up as the foundation of the team's decision-making abilities. You will be leveraging your Python, AWS, and SQL experience o propel … of exciting growth.If you are a passionate techy looking for a position that will allow you to positively impact society, bridge the gaps with big data, and flexibility to work from London or remotely, this could be the role for you!Apply now if this is of interest more »
Salary: £ 100 K
Posted:

Solutions Architect

London, United Kingdom
Lloyds Banking Group
and business areas supporting the Customer Relationship Growth strategy to deepen relationships with our customers across both the retail & commercial bank. This includes the data, analytics, and technology to unlock the value of differentiating our branded channel experiences, proposition, price and communication; as well as paper-free sustainable ambitions.Job … are followed in accordance with engineering transformation strategy. About us…Like the modern Britain we serve, we’re evolving. Investing billions in our people, data and tech to transform the way we meet the ever-changing needs of our 26 million customers. We’re growing with purpose. Join us … patterns. Strong knowledge of microservices, containerisation, cloud native and event-driven design concepts.Strong understanding of API standards, security and gateway patterns. Strong understanding of data technologies – SQL/NoSQL, Big Data.Knowledge of cloud architecture, in particular GCP. Knowledge of monolith to microservice patterns. Strong experience & knowledge of some more »
Salary: £ 100 K
Posted:
Big Data
London
10th Percentile
£62,875
25th Percentile
£76,563
Median
£97,500
75th Percentile
£122,500
90th Percentile
£143,750