1 to 25 of 49 Hadoop Jobs in London

Senior Data Engineer - Security Cleared

Hiring Organisation
Hackajob Ltd
Location
South West London, South East, United Kingdom
Employment Type
Permanent Contract, On-site
Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Data Engineer

Location
Greater London, England, United Kingdom
Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting tools (e.g. Tableau, PowerBI ...

Data Engineer

Location
Greater London, England, United Kingdom
experience in their technologies You have experience in database technologies including writing complex queries against their (relational and non-relational) data stores (e.g. Postgres, Hadoop, Elasticsearch, Graph databases), and designing the database schemas to support those queries You have a good understanding of coding best practices and design patterns ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
experience building, scaling, and shipping large-scale data platforms in production. Deep practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis). End-to-end exposure to data pipeline lifecycle development, including ...

Senior Data Modeller

Hiring Organisation
EXL Service
Location
City of London, South East, United Kingdom
Employment Type
Permanent Contract, Hybrid
phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

Senior Data Modeller

Location
Greater London, England, United Kingdom
phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

Data Engineer

Location
Greater London, England, United Kingdom
scale ETL development. Proficiency in SQL and programming languages such as Python, Java, or Scala. Hands‐on experience with big data frameworks (e.g., Spark, Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow ...

Senior Data & AI Architect

Location
Greater London, England, United Kingdom
Azure or Google Cloud. Expertise in data modelling, SQL, NoSQL and modern database technologies. Experience with big data technologies, such as Apache Spark, Hadoop or distributed computing frameworks. Programming knowledge in Python, Scala, Java or similar languages. Experience architecting AI and machine learning solutions, including deploying models into production. ...

Senior Data & AI Architect

Hiring Organisation
National Institute for Health and Care Research
Location
London, England, United Kingdom
platforms using AWS, Azure or Google Cloud.Expertise in data modelling, SQL, NoSQL and modern database technologies.Experience with big data technologies, such as Apache Spark, Hadoop or distributed computing frameworks.Programming knowledge in Python, Scala, Java or similar languages.Experience architecting AI and machine learning solutions, including deploying models into production.A solid ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage). Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus. Knowledge of data governance and data security best practices. Strong problem-solving skills and attention to detail. Excellent communication ...

AI Engineer

Hiring Organisation
JCDecaux
Location
London, England, United Kingdom
learning or data science.Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow).Strong experience with ...

AI Engineer

Location
Greater London, England, United Kingdom
data science.* Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.* Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).* Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow).* Strong ...

Senior AI Solutions Architect - London

Location
Greater London, England, United Kingdom
engineering, data analytics, or data science, with the ability to work effectively with various data types and sources. Experience using big data technologies (e.g. Hadoop, Spark, Hive) and database management systems (e.g. SQL and NoSQL). Graph Database Expertise : Deep understanding of graph database concepts, data modeling, and query ...

Senior Solution Architect, Data & AI

Location
City Of London, England, United Kingdom
decisions and the trade-offs behind them. Demonstrable experience leading data estate modernisation, such as moving from legacy data warehouses, on-premises databases or Hadoop to modern cloud or hybrid data platforms. Deep expertise in at least one modern data platform (Databricks, Snowflake or Microsoft Fabric), plus a working ...

Data Engineer Vice President

Hiring Organisation
Hackajob Ltd
Location
South West London, South East, United Kingdom
Employment Type
Permanent Contract, On-site
relational database technologies (for example, MongoDB) and associated query patterns Familiarity with large-scale data processing and analytics platforms (for example, Apache Spark or Hadoop) Experience implementing, or partnering closely on, data quality, metadata, and governance controls to improve reliability and auditability Understanding of modern distributed systems patterns ...

Senior Data Engineer Job Details | BBC

Location
Greater London, England, United Kingdom
solutions on platforms such as Amazon Bedrock. Experience developing data-based apps in Streamlit/Shiny Skills in ‘Big Data’ technology tools like Hadoop/Spark Knowledge of Infrastructure as Code tools like CloudFormation/Terraform If you can bring some of these skills and experiences, along with transferable ...

Resiliency Data Products - Data Engineer Vice President

Location
Greater London, England, United Kingdom
relational database technologies (for example, MongoDB) and associated query patterns Familiarity with large-scale data processing and analytics platforms (for example, Apache Spark or Hadoop) Experience implementing, or partnering closely on, data quality, metadata, and governance controls to improve reliability and auditability Understanding of modern distributed systems patterns ...

Senior Application Architect

Location
Greater London, England, United Kingdom
/ML offerings. Strong programming skills (Python, Java, C++) and experience with DevOps practices (CI/CD). Knowledge of big data technologies (Hadoop, Spark, Flink). Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB), message queueing systems (Kafka, RabbitMQ), and version control systems (Git). Preferred Skills: Hugging Face ...

Data Scientist - QuantumBlack, AI by McKinsey

Location
Greater London, England, United Kingdom
experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice‐to‐have Strong understanding of machine learning methods and experience applying them to complex ...

Data & AI Senior Manager

Hiring Organisation
Hackajob Ltd
Location
South West London, South East, United Kingdom
Employment Type
Permanent Contract, On-site
identifying and managing sales opportunities at client engagements An understanding of database technologies e.g. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. Hadoop, Mahout, Pig, Hive, etc.; An understanding of statistical modelling techniques e.g. Classification and regression techniques, Neural Networks, Markov chains, etc.; An understanding of cloud ...

NLP Engineer

Location
Greater London, England, United Kingdom
Strong understanding of data structures, algorithms, and software design principles Experience working with large-scale data processing, distributed computing, or cloud-based platforms (e.g., Hadoop, Spark, AWS) is highly desirable Familiarity with ESG investing principles and market trends is a plus Excellent problem-solving, analytical, and debugging skills Strong ...

Lead Data Scientist - Receive Risk

Location
Greater London, England, United Kingdom
Ability to read through code, especially Java. Demonstrable experience collaborating with engineering on services Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL) Familiarity with anomaly detection, supervised and unsupervised learning methods, and real-time data analysis Experience with statistical analysis and good presentation skills ...

Solutions Engineer, London

Location
Greater London, England, United Kingdom
strong understanding of high-concurrency, high-throughput, mission-critical, and zero-downtime systems. Think in distributed systems: Apply practical knowledge of Spark, Hadoop, HBase, HDFS, Hive, Impala, and adjacent data-processing ecosystems to solve complex customer problems. Win technical evaluations: Guide enterprise prospects through demanding architecture reviews, competitive bake ...

Senior Azure Data Engineer (Databricks)

Hiring Organisation
Capco
Location
London, England, United Kingdom
schema design, and GDPR-compliant solutionsWorking knowledge of DevOps tools and CI/CD processesBonus Points ForDevelopment experience in Scala or JavaFamiliarity with Cloudera, Hadoop, HIVE, and Spark ecosystemUnderstanding of data privacy regulations, including GDPR, and experience working with sensitive dataAbility to learn and adapt new technologies quickly ...

Senior Data Scientist

Location
Greater London, England, United Kingdom
. Practical software development and machine learning experience (e.g. python, tensorflow, pytorch). Familiarity with SQL and large-scale data processing technologies such as Hadoop, Hive, Impala, Scala, Spark etc. Technology leadership experience from defining market driven visions/goals to the implementation of solutions in a production environment ...