1 to 25 of 108 Permanent Big Data Jobs in London

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP … Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization more »

a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python, AWS and web scraping is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »

Data Models Lead - Data Engineering - MarTech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data … ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design and implement more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … CPU Compiler Engineer, you will collaborate with the founding team to improve and expand the core engine that we are building that massively accelerates Big Data pipelines. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is … being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Optimize code generation for executing JIT-compiled code on CPUs (Arm and x86 architectures). Diversify compiler optimizations based on more »

Role: Principle Data Engineer Salary:£120K Working pattern: Fully Remote Are you looking to work for a leading product developer operating in the pharmaceutical industry? They offer the ability to work with Global clients in a rapidly growing industry that has taken centre stage since the covid outbreak. Your … responsibilities include: Lead design and implementation of scalable, secure data products and integration solutions. Collaborate with cross-functional teams to define integration needs and gather requirements. Provide technical leadership, mentor engineers, and drive innovation and best practices. Develop and test APIs, data pipelines, and ETL processes for seamless … data integration. Evaluate and select data integration tools, ensuring scalability and performance. Tech stack: ETL frameworks REST APIs Messaging systems Python Java Databases and SQL Data warehousing Data modeling Data governance Cloud platforms and services (e.g., AWS) Big data technologies (e.g., Spark, Kafka more »

Complexio is Foundational AI. This works to automate business activities by ingesting whole company data – both structured and unstructured – and making sense of it. Using proprietary models and algorithms, Complexio forms a deep understanding of how humans are interacting and using it. Automation can then replicate and improve these … Marfin Management, C Transport Maritime, Trans Sea Transport and BW Epic Kosan. Key Responsibilities Collaborate with cross-functional teams to design and build scalable data solutions that support product innovations and business insights. Develop and maintain robust data pipelines that support complex data collection, ingestion, and transformation … processes. ‍ Work closely with R&D within data science and AI to provide data. Design and implement mechanisms for data validation, quality, and reliability to ensure the accuracy and trustworthiness of data sources. Diagnose and resolve data-related issues to improve the performance and scalability of more »

of our clients located in London. About the Client: Our client is a sports tech company that leverages AI and expert knowledge to offer data and analysis, addressing performance and commercial challenges in the sports and media industries. About the Role: As a Senior DevOps Engineer/Cloud Engineer … you will be looking to work on cross-functional teams with data engineers and data scientists and help to design the DevOps infrastructure using AWS products and also be responsible for establishing best-in-class CI/CD techniques while helping to scale the analytics capabilities in a … technologies to implement the necessary modifications when required. * Extensive familiarity with CI/CD platforms and best practises, including GitHub Actions. Nice to have: * Data Bricks setup using Terraform experience. * Experience of MLOps and DataOps. * Experience of using container technologies, cloud platforms (ideally AWS), and distributed processing frameworks like more »

At Innova-TSN, we specialize in crafting and implementing cutting-edge solutions in Business Intelligence, CRM, Business Analytics, Big Data, and Business Discovery. Our focus is on seamlessly integrating these solutions into decision-making processes, aiming to provide innovative and impactful solutions for our clients. We are looking … for a Technical Project Manager with 3 years of experience in project management and at least 2 years of technical expertise in Data Value, Big Data, and/or Business Intelligence environments Technical background is fundamental; we need someone who can assess technical implementations and solutions What more »

a holistic and multi-disciplinary approach to each of these mega processes. As part of Shepherd, a new role has been created to lead Data & Analytics within those process areas. What are we looking for? Bachelor’s degree or Equivalent (IT Degree preferred in particular computer science, Data … to Retire (HR) Experience working in sizeable and complex digital transformations in large global organizations resulting in high adoption of new tools Experience in Data cleansing/enrichment/migration along with over Data & Analytic skills. Hands-on data engineering/development experience, preferably in a cloud …/big data environment Able to manage expectations in an ambiguous and fast-paced environment and deliver excellence Strong people management skills with a track record of nurturing high-performing teams Excellent communication skills, capable of distilling complex concepts for a variety of audiences Demonstrated proactive and results more »

be challenged to help propel H5G to the top tier of social gaming through adoption and application of the latest in the Server side, Big Data and AI technology, such as high scalable cloud based infrastructure, stream analysis and machine learning. The person will be a key contributor … to aspects of design and delivery of all H5G Server Systems, Services and Data Stores. Technical expertise – Architecture & Systems Development Deep expertise in and experience with Java server side development, real time SOA and micro services architecture (6 years+) Expertise with REST API Concepts and Spring Boot 2.5+ Framework … infrastructures – Telcos/Trading/AdTech systems, etc. Excellent understanding of enterprise architecture patterns, UML. Gaming or Equity trading server side experience is a big plus Demonstrated experience delivering systems at large scale (20K+ mps) using Kafka and Hazelcast In depth understanding of the Distributed System Concepts: Leadership, Consensus more »

Cloud Architect/Data Architect Google Cloud/GCP, Machine Learning/Generative AI Remote-based or Hybrid should you prefer (London)£100k-£140k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life Insurance, Income Protection, Employee Assistance … Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning you will find your work extremely … clients, devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to their more »

countries. They create a suite of AI products for large enterprises across a diverse portfolio of sectors. They access a wide source of business data from across the globe, which offers a unique opportunity to design, lab-test and trial scalable business solutions in a reliable and secure environment. … in subsequent years. Lead customer-facing engagements and shape project pipelines. Working with partners to identify potential valuable insights and services across multiple potential data sources Work closely with the Data Science and Engineering and Product management teams. Establish and maintain relationships with key customers, Industry influencers and … Group stakeholders Requirements Previous software product/data/AI business development experience (£250K+ average deal value) Solid understanding of data analytics technologies including main data science and big data platforms Have experience of managing/mentoring/driving sales teams. Prepare proposals, presentations and more »

Senior Data Scientist – Media - (90% remote) - £90k Are you a pro at building and deploying ML models? Are you tired of just tinkering with the latest tech without actually making a real impact on business problems? Maybe you'd like to join our team of 50 like-minded ML … scientists and engineers who work with zero red tape to create practical solutions that actually work. We’re looking for a Senior Data Scientist who has experience in developing Machine Learning models, evaluating and choosing the tools and technologies and driving projects. Who are we? We’re one of … the UK’s largest media companies and we’re looking for a Senior Data Scientist to join our Data Science team who are working on modelling business problems including, our next generation of intelligent pricing, marketing, customer engagement tools. Building predictive and personalization models and deploying products at more »

Are you passionate about data quality and governance? We’re looking for a Data Governance Engineer to elevate our client’s data practices and ensure the integrity of the product usage data. The Offer: Annual Salary up to £65,000 doe 6-month contract – PAYE – with a … option – candidates must be present in the county with appropriate work visa – no work permits provided). What You’ll Need: 5+ years in big data analytics or database management. 1-3 years developing on the ServiceNow platform. Experience in GQL – Glide language puts you on top of … all candidates. Proficiency in PL/SQL and an additional programming language. Strong problem-solving skills and ability to design impactful data models. Expertise in rolling out analytics dashboards (Power BI, Tableau Server). Ability to translate business needs into technical requirements. Good to have: Knowledge of ServiceNow products. more »

As a Java developer, you will be working in a small focused team using some of the latest technologies to create large sets of data, which can be efficiently processed to provide actionable intelligence. • Candidates will be working with Big Data, innovative security and threat detection systems more »

About Us At Resolve, we're pioneering the future of privacy-centric advertising solutions. As new privacy laws reshape the digital landscape, traditional data collaboration tools like cookies, DMPs, and centralized data repositories are becoming obsolete. We've embraced federated learning, cryptography, blockchain and advanced forms of machine … within an Adtech organisation demonstrating autonomous project management and execution within a tech environment. Proficient in rapid prototyping and agile development methodologies. Understanding within Big Data, Cloud Solutions and Machine Learning within an Adtech environment Strong analytical skills with an ability to translate business requirements into technical solutions. more »

annual SOX compliance program, and will also participate in assurance and advisory projects within technology & product areas such as information security, machine learning and big data, tech infrastructure management and operations, and application & product development. Locations Stockholm London Job type Permanent The ideal candidate will have worked in more »

Key responsibilities: Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem. Implement and deploy big data platform and solutions on-premises and in hybrid cloud environments. Read, understand, and modify open-source code to implement bug fixes and perform … and support large scale migration for critical applications. Your Profile Key Skills/Knowledge/Experience: Proven experience in architecting, designing, building, and deploying big data platforms and applications using the Apache Hadoop ecosystem in hybrid cloud and private cloud scenarios. Experience with hybrid cloud big data platform designs and deployments, especially in AWS, Azure, or Google Cloud Platform. Experience in large-scale data platform builds and application migrations. Expert knowledge of Apache Hadoop ecosystem and associated Apache projects (eg, HDFS, Hive, HBase, Spark, Ranger, Kafka, Yarn etc.). Proficiency in Kubernetes for container orchestration. more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision to provide specialist … services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You will work closely with various … teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using AWS services such as Glue, Lambda, Kinesis, and Data more »

Data Models Lead - Data Engineering - MarTech - Adtech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real Time … data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such … as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data with minimal more »

Responsibilities:  Commercial acumen and a recent proven experience in a similar role (such as Commercial Insight Analyst, Data Insight analyst in Product Sales, Product Insight Analyst etc)  Success track in synthesising complex and ambiguous information in order to drive actionable insight brought to life through communication and visualisation  Proficiency … in SQL, Qlik sense and Big Data  Innate curiosity about customers, products and competitors  Cooperative and positive can-do attitude What I’ll be doing – your accountabilities Understanding business context and expectations and translating into practical approaches to data analysis Applying a broad range of techniques (A …/B hypothesis testing, multivarate test,data exploration, data preparation, big data analytics, visualisations, statisticalanalysis, business analysis) for gatheringthe insights and identifying meaningfultrends in the data Generating tactical analysis to distilthe insights, identify opportunities & make recommendations Articulating trends using tactical data visualisation techniques and more »

Working with a top tier Digital Asset Management firm who are looking for an adept and experienced Data Engineer to play a critical role in shaping and managing their data engineering platform. This role demands strong technical skills and a proven ability to work closely with quantitative researchers … ensuring seamless integration of data engineering processes to support our quantitative investment strategies. Key Responsibilities: Collaborate closely with quantitative researchers to understand their data needs, offer technical solutions, and effectively integrate data engineering with quantitative strategies. Design, develop, and optimize robust data pipelines, facilitating ETL processes … that support quantitative research, analysis, alpha forecasting, and execution. Implement stringent data quality assurance measures to ensure the accuracy, reliability, and consistency of data inputs and outputs. Evaluate, select, and manage appropriate data engineering tools, technologies, and infrastructure, with a focus on scalability and automation. Work with more »

ROLE SUMMARY DATA ENGINEER REMOTE/TRAVEL TO CLIENT SITE IN LONDON Valcon UK are looking to recruit a self-motivated, highly logical and intellectually curious Data Engineer’s to join our expanding Data capability in the UK. As a growing business area, the ideal candidate will … strategy, turn it into an actionable blueprint and help the client get it done. Who have deep expertise in operationalising strategy, process design, digitisation, data and analytics, automation, technology and change. RESPONSIBILITIES: Analyse and organise raw data Build data systems and pipelines Evaluate business needs and objectives … Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modelling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop analytical tools and more »