1 to 25 of 54 Hadoop Jobs in London

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Flask, Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data qualityPreparing data for predictive and prescriptive modellingHands on coding experience, such ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

experience in their technologies You have experience in database technologies including writing complex queries against their (relational and non-relational) data stores (e.g. Postgres, Hadoop, Elasticsearch, Graph databases), and designing the database schemas to support those queries You have a good understanding of coding best practices and design patterns ...

experience building, scaling, and shipping large-scale data platforms in production. Deep practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis). End-to-end exposure to data pipeline lifecycle development, including ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

scale ETL development. Proficiency in SQL and programming languages such as Python, Java, or Scala. Hands‐on experience with big data frameworks (e.g., Spark, Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow ...

Azure or Google Cloud. Expertise in data modelling, SQL, NoSQL and modern database technologies. Experience with big data technologies, such as Apache Spark, Hadoop or distributed computing frameworks. Programming knowledge in Python, Scala, Java or similar languages. Experience architecting AI and machine learning solutions, including deploying models into production. ...

platforms using AWS, Azure or Google Cloud.Expertise in data modelling, SQL, NoSQL and modern database technologies.Experience with big data technologies, such as Apache Spark, Hadoop or distributed computing frameworks.Programming knowledge in Python, Scala, Java or similar languages.Experience architecting AI and machine learning solutions, including deploying models into production.A solid ...

Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage). Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus. Knowledge of data governance and data security best practices. Strong problem-solving skills and attention to detail. Excellent communication ...

learning or data science.Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow).Strong experience with ...

data science.* Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.* Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).* Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow).* Strong ...

engineering, data analytics, or data science, with the ability to work effectively with various data types and sources. Experience using big data technologies (e.g. Hadoop, Spark, Hive) and database management systems (e.g. SQL and NoSQL). Graph Database Expertise : Deep understanding of graph database concepts, data modeling, and query ...

experience with container orchestration and distributed application deployment. Experience developing Java-based data processing or event-driven applications. Additional Advantageous Experience Apache Spark, Flink, Hadoop or other Big Data technologies. Working with high-volume or complex enterprise datasets. Experience delivering solutions within government, defence or other secure environments. ...

decisions and the trade-offs behind them. Demonstrable experience leading data estate modernisation, such as moving from legacy data warehouses, on-premises databases or Hadoop to modern cloud or hybrid data platforms. Deep expertise in at least one modern data platform (Databricks, Snowflake or Microsoft Fabric), plus a working ...

solutions on platforms such as Amazon Bedrock. Experience developing data-based apps in Streamlit/Shiny Skills in ‘Big Data’ technology tools like Hadoop/Spark Knowledge of Infrastructure as Code tools like CloudFormation/Terraform If you can bring some of these skills and experiences, along with transferable ...

solutions on platforms such as Amazon Bedrock. Experience developing data-based apps in Streamlit/Shiny Skills in ‘Big Data’ technology tools like Hadoop/Spark Knowledge of Infrastructure as Code tools like CloudFormation/Terraform If you can bring some of these skills and experiences, along with transferable ...

relational database technologies (for example, MongoDB) and associated query patterns Familiarity with large-scale data processing and analytics platforms (for example, Apache Spark or Hadoop) Experience implementing, or partnering closely on, data quality, metadata, and governance controls to improve reliability and auditability Understanding of modern distributed systems patterns ...

building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets Experience with big data technologies such as: Hadoop, Hive, Spark, EMR Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

/ML offerings. Strong programming skills (Python, Java, C++) and experience with DevOps practices (CI/CD). Knowledge of big data technologies (Hadoop, Spark, Flink). Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB), message queueing systems (Kafka, RabbitMQ), and version control systems (Git). Preferred Skills: Hugging Face ...

experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice‐to‐have Strong understanding of machine learning methods and experience applying them to complex ...

improve productivity while maintaining appropriate human oversight, governance, and solution quality. Bonus Points For Development experience using Scala or Java. Familiarity with Cloudera, Hadoop, Hive, Spark, and related distributed data ecosystems. Experience working with sensitive data and applying data privacy regulations, including GDPR. Curiosity to explore new technologies, including ...

Strong understanding of data structures, algorithms, and software design principles Experience working with large-scale data processing, distributed computing, or cloud-based platforms (e.g., Hadoop, Spark, AWS) is highly desirable Familiarity with ESG investing principles and market trends is a plus Excellent problem-solving, analytical, and debugging skills Strong ...

Ability to read through code, especially Java. Demonstrable experience collaborating with engineering on services Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL) Familiarity with anomaly detection, supervised and unsupervised learning methods, and real-time data analysis Experience with statistical analysis and good presentation skills ...