1 to 25 of 68 Hadoop Jobs

Cloud) Understanding of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery) Strong problem-solving and analytical skills Preferred Skills Experience with big data technologies (e.g., Hadoop, Spark) Knowledge of data modeling techniques and schema design Familiarity with containerization tools (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices ...

years of experience with cloud data platforms such as AWS, Azure, or Google Cloud Platform . 3+ years of experience with Spark, Databricks, Snowflake, Hadoop, or other big data technologies . Nice to Have: Experience with orchestration tools such as Apache Airflow, Azure Data Factory, or AWS Glue. Knowledge ...

Quantexa components such as: Entity Resolution (ER), Scoring Framework, Contextual Network Generation, UI Configuration. Strong background in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch. Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable of interfacing ...

Quantexa components such as: Entity Resolution (ER) Scoring Framework Contextual Network Generation UI Configuration Strong background in Big Data technologies, including:Scala, Apache Spark, Hadoop, ElasticSearch Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable of interfacing ...

closely with stakeholders and translate business requirements into effective AI solutions Desirable Generative AI experience Large Language Models (LLMs) LangChain or similar frameworks Spark, Hadoop or other big data technologies Experience with distributed computing, streaming platforms or workflow orchestration tools Experience monitoring and optimising model performance in production environments ...

data science. Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials. Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives). Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow). Strong ...

Regression, and Times Series Modeling. • Experience using data with high-volume (1TB+) & high-dimensionality (500+ variables per schema), especially within a big data framework (HaDoop, Citus, MongoDB, etc). • Experience performing Data Wrangling, Exploratory Data Analysis (EDA), Correlation Analysis, Statistical Methodologies (distributions, hypothesis testing, confidence intervals) & Significance Testing ...

production. Strong knowledge of Python and core ML libraries (e.g., spaCy, NumPy, SciPy, Transformers). Understanding of big data and cloud technologies (Spark, Hadoop, Azure, AWS, or GCP). Deep expertise in MLOps principles, scalable model deployment, and model governance. Excellent communication and stakeholder management skills with the ability ...

production. Strong knowledge of Python and core ML libraries (e.g., spaCy, NumPy, SciPy, Transformers). Understanding of big data and cloud technologies (Spark, Hadoop, Azure, AWS, or GCP). Deep expertise in MLOps principles, scalable model deployment, model governance, and the practical application of responsible AI within enterprise environments. ...

Oracle, Snowflake, Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus. Domain Knowledge: Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge ...

Regression, and Times Series Modeling.• Experience using data with high-volume (1TB+) & high-dimensionality (500+ variables per schema), especially within a big data framework (HaDoop, Citus, MongoDB, etc).• Experience performing Data Wrangling, Exploratory Data Analysis (EDA), Correlation Analysis, Statistical Methodologies (distributions, hypothesis testing, confidence intervals) & Significance Testing ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

distributed data processing framework ( Spark or similar) - Proficiency in at least one cloud data Lakehouse platforms (AWS Data lake services or Databricks, alternatively Hadoop), - Proficiency in at least one scheduling/orchestration tools ( Airflow, if not AWS Step Functions or similar) -Proficiency with relational and NoSQL databases. - Proficiency ...

Understanding of Computer Vision: Familiarity with computer vision techniques and libraries like OpenCV. Experience with Big Data Tools: Experience with big data tools like Hadoop, Spark, or Hive. Knowledge of Reinforcement Learning: Understanding of reinforcement learning techniques and algorithms. Familiarity with Robotics: Experience with robotics and robotic process automation ...

improve productivity while maintaining appropriate human oversight, governance, and solution quality. Bonus Points For Development experience using Scala or Java. Familiarity with Cloudera, Hadoop, Hive, Spark, and related distributed data ecosystems. Experience working with sensitive data and applying data privacy regulations, including GDPR. Curiosity to explore new technologies, including ...

Life Sciences. Experience working for a software vendor, SaaS provider, or professional services organisation. Familiarity with Ataccama or similar enterprise data platforms. Exposure to Hadoop/Spark, NoSQL, XSLT, Hive, Kafka, Snowflake, or Databricks. Python or other programming languages. Familiarity with SDLC, code management and upgrades, and Unix/ ...

continuous improvement Skills & Experience * Commercial experience in Data Engineering * Strong Python or Java development skills * Experience with AWS cloud services * Knowledge of Apache Spark, Hadoop, NiFi or similar big data technologies * Experience building ETL/ELT pipelines and processing large datasets * Understanding of software engineering best practices, testing ...

addition to the above, we would be thrilled if you also had: Experience of working on migrations of enterprise scale data platforms including Hadoop and traditional data warehouses An understanding of machine learning model development lifecycle, feature engineering, training and testing Good understanding or hands‐on experience of Kafka ...

Cloud; Kubernetes and containerization. AI Expertise: Machine learning model development, GenAI models (e.g., GPT, BERT, DALL-E, GEMINI), NLP techniques. Big Data: Experience with Hadoop and Spark. Ethics: Knowledge of AI ethics and governance. Methodologies: Agile and Scrum project management. Other Requirements Verifiable Certification At least one recognized cloud ...

environments. Teradata 16.x with strong SQL/BTEQ, TPT, and SQL performance tuning. ETL development with Informatica 10.x and data migration/conversion experience. Hadoop ecosystem on Cloudera CDP, including Hive, Impala, PySpark, and Scala. UNIX shell scripting and workload automation with Autosys. CI/CD tools and processes ...

experience with MLOps, production ML systems, model lifecycle management, and monitoring.* Experience working with large-scale data systems and distributed computing frameworks (e.g. Spark, Hadoop).* Knowledge of experimental design, scientific methodology, and analysis.* Strong partner management and confirmed ability to influence large organisations without direct authority.* Demonstrated ability ...

automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience ...

Artificial Intelligence modeling techniques (logit, GLM, time series, random forests, clustering, XGBoost), statistical programming languages (SAS, R, Python, Matlab), big data tools and platforms (Hadoop, Hive, etc.) and cloud platforms (AWS, Azure, GCP). Solid academic record. Strong computer skills. Postgraduate studies and/or specialized courses ...

based ensembles (and experience applying them with packages like Pandas, sci-kit-learn, SciPy) is highly beneficial Experience processing big data, ideally in a Hadoop/Spark environment, would be beneficial Proven experience implementing CI/CD and DevOps practices, with the ability to improve deployment reliability, testing standards ...

This job is with Capgemini, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With ...