23 of 23 Hadoop Jobs

quality checks into pipelines. Knowledge of cloud infrastructure (AWS, Azure, or GCP) and database technologies including relational and non-relational stores such as Postgres, Hadoop, Elasticsearch, and Graph databases. Solid understanding of coding best practices, design patterns, CI/CD tooling, versioning, dependency management, error handling, monitoring, and alerting. ...

related field, or in bioinformatics with a demonstrated IT expertise Experience in big data technologies and frameworks, such as Apache Spark, Hadoop or similar platforms Hands-on experience with CI/CD (GitLab CI/GitHub Actions) Familiarity with Java Familiarity with Google Cloud Platform or AWS Familiarity with ...

ability to think critically and analytically. Strong experience in documentation and data dictionaries. Knowledge of big data technologies and distributed computing frameworks such as Hadoop and Spark. Excellent communication skills to effectively collaborate with cross-functional teams and present insights to business stakeholders. ...

skills in Python, with a command of data science libraries (e.g., Pandas, NumPy, Scikit‐learn). Experience with big data technologies (e.g., Spark, Trino, Hadoop) and ideally cloud platforms (e.g., AWS, GCP, Azure) for scalable data processing, storage, and model deployment. Ideally having understanding and practical experience with graph ...

data science. Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials. Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives). Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow). Strong ...

Excellent troubleshooting and performance optimisation skills Desirable Experience Experience working within government, defence, or other highly regulated sectors Knowledge of Apache Kafka, Spark, or Hadoop Experience with Docker and Kubernetes Familiarity with monitoring and observability tools such as Prometheus , Grafana , or ELK Understanding of machine learning algorithms and their ...

automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience ...

automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience ...

unstructured datasets. Strong stakeholder management and communication skills. Desirable Insurance or financial services experience, ideally within pricing, underwriting, fraud, or claims. Experience with Spark, Hadoop, NoSQL, or modern big data platforms. Agile delivery experience and collaborative software development practices. Experience leading analytics teams and driving organisational change. Robert Walters ...

Relational databases (SQL Server, PostgreSQL, Oracle, MySQL) Data visualisation tools (Power BI, Tableau, Spotfire) Cloud platforms, particularly Microsoft Azure Big data technologies (Spark, Elasticsearch, Hadoop) Statistical modelling and advanced analytics Machine learning and pattern recognition techniques Web technologies such as HTML and JavaScript ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

Strong technical skills in Python and SQL, including building data pipelines and working with large-scale datasets and distributed data platforms (e.g., BigQuery, Snowflake, Hadoop or similar) Experience applying data science, machine learning, or data engineering approaches within data-intensive domains such as Finance or Operations Proficiency with ...

data migrator product and contributing to a new orchestration platform. Cloud infrastructure across AWS S3, Google Cloud Storage, and Azure. Big data stores including Hadoop and Apache Ozone. Integration with Snowflake, Databricks, and AI tooling including Claude, Gemini, and Codex. Building AI-powered applications and workflows ...

Based in or willing to relocate to Gloucester 5+ years' professional experience with cloud data engineering (AWS focus) Hands-on experience: Python or Java, Hadoop/distributed systems, CI/CD pipelines Proven ability to design scalable architectures and mentor technical teams What we're looking for You think ...

Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Equal Opportunity Statement Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. ...

Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected ...

Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g., Kubeflow, DVC, Ray). Experience with big data technologies (e.g., Spark, Hadoop). Have constructed batch and streaming microservices exposed as REST/gRPC endpoints. Familiarity with GraphQL. We recognize that our people are our strength ...

Experience with modeling tools such as R, scikit‐learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Equal Opportunity & Privacy Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. ...

mission-critical platform, driving architecture, performance optimisation, automation, and engineering best practice. Strong Java and distributed systems experience required. Exposure to AI, LLMs, Hadoop, Elasticsearch or Oracle would be advantageous. ...

team. Risk & Process Management: Improve workflows and manage project dependencies, blockers, and risks. Tech Collaboration: Work closely with software teams on complex Big Data (Hadoop) and Cybersecurity products. What We Need: Proven experience as a Product Owner in an Agile environment. Strong stakeholder management skills. Basic understanding of cybersecurity ...

Job Title Data Scientist III, Analytics – Expedia B2B Role Overview As a Data Scientist III on the Analytics team at Expedia B2B, you will lead data science initiatives that drive supply optimisation for our global ...

experience with enterprise integration and data platform tooling, including Informatica (PowerCenter, DEI), IBM middleware (Sterling, Message Broker, APIC), Azure integration services (ADF, APIM), Hadoop, Databricks. Experience with Informatica, Hadoop and Databricks is required. Modernization Expertise: 5+ years leading modernization initiatives transitioning enterprise environments from batch-processing to Event ...

help customers achieve more with the AWS cloud. BASIC QUALIFICATIONS - Experience as technical specialist in design and architecture - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in consulting, design and implementation of serverless distributed solutions - Experience in cloud based solution (AWS or equivalent), system, network … related field, or experience working with or evaluating AI systems - Experience in data applications using large scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting ...