25 of 25 Hadoop Jobs

quality checks into pipelines. Knowledge of cloud infrastructure (AWS, Azure, or GCP) and database technologies including relational and non-relational stores such as Postgres, Hadoop, Elasticsearch, and Graph databases. Solid understanding of coding best practices, design patterns, CI/CD tooling, versioning, dependency management, error handling, monitoring, and alerting. ...

ability to think critically and analytically. Strong experience in documentation and data dictionaries. Knowledge of big data technologies and distributed computing frameworks such as Hadoop and Spark. Excellent communication skills to effectively collaborate with cross-functional teams and present insights to business stakeholders. ...

Implement job orchestration using Databricks Workflows, Airflow, AWS Step Functions, or similar tools. Manage secrets, environment variables, and secure connections. Support migration from legacy Hadoop/Spark platforms to Databricks on AWS, if required. 'We are a Disability Confident Employer: Capgemini is proud to be a Disability Confident Employer ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

data platforms - Knowledge of AWS, Azure or GCP - Experience with Python, Java or Scala - Exposure to technologies such as Spark, Kafka, Airflow, dbt or Hadoop - Strong analytical and problem-solving skills - Excellent communication and stakeholder management - An entrepreneurial mindset with the desire to help build a new capability This ...

skills in Python, with a command of data science libraries (e.g., Pandas, NumPy, Scikit‐learn). Experience with big data technologies (e.g., Spark, Trino, Hadoop) and ideally cloud platforms (e.g., AWS, GCP, Azure) for scalable data processing, storage, and model deployment. Ideally having understanding and practical experience with graph ...

data science. Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials. Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives). Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow). Strong ...

Azure · Experience with multiple data storage types and technologies in data warehouse and data lake solutions. Examples include relational DBMS (e.g. Oracle), Hadoop, NoSQL (e.g. Hbase), Columnar DBs (e.g .Amazon Redshift), Graph DBs (e.g. Neo4J), cloud object storage (e.g. Amazon S3), cloud DB as a service (e.g. Amazon ...

This job is with Capgemini, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With ...

automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience ...

automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience ...

unstructured datasets. Strong stakeholder management and communication skills. Desirable Insurance or financial services experience, ideally within pricing, underwriting, fraud, or claims. Experience with Spark, Hadoop, NoSQL, or modern big data platforms. Agile delivery experience and collaborative software development practices. Experience leading analytics teams and driving organisational change. Robert Walters ...

Relational databases (SQL Server, PostgreSQL, Oracle, MySQL) Data visualisation tools (Power BI, Tableau, Spotfire) Cloud platforms, particularly Microsoft Azure Big data technologies (Spark, Elasticsearch, Hadoop) Statistical modelling and advanced analytics Machine learning and pattern recognition techniques Web technologies such as HTML and JavaScript ...

Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help ...

proficiency in machine learning frameworks and programming languages such as Python, R, or similar. Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL). Familiarity with anomaly detection, supervised, unsupervised learning methods, deep learning, and graph based solutions Demonstrated ability to work collaboratively in cross ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to improve platform Observability Experience in leading mid-scale teams with strong communication skills ...

Strong technical skills in Python and SQL, including building data pipelines and working with large-scale datasets and distributed data platforms (e.g., BigQuery, Snowflake, Hadoop or similar) Experience applying data science, machine learning, or data engineering approaches within data-intensive domains such as Finance or Operations Proficiency with ...

problems using data mining techniques and with statistical rigor Strong technical skills regarding data analysis, statistics, machine learning and programming. Strong working knowledge of Hadoop, Spark, SQL, Python and/or R. Excellent communication skills Strong skills in translating business problems into data problems Strong data visualization skills Strong ...

Based in or willing to relocate to Gloucester 5+ years' professional experience with cloud data engineering (AWS focus) Hands-on experience: Python or Java, Hadoop/distributed systems, CI/CD pipelines Proven ability to design scalable architectures and mentor technical teams What we're looking for You think ...

stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL Level of experience Senior (5+ years of experience) Tagged ...

Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected ...

Experience with modeling tools such as R, scikit‐learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Equal Opportunity & Privacy Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. ...

mission-critical platform, driving architecture, performance optimisation, automation, and engineering best practice. Strong Java and distributed systems experience required. Exposure to AI, LLMs, Hadoop, Elasticsearch or Oracle would be advantageous. ...

Job Title Data Scientist III, Analytics – Expedia B2B Role Overview As a Data Scientist III on the Analytics team at Expedia B2B, you will lead data science initiatives that drive supply optimisation for our global ...