26 to 50 of 64 Hadoop Jobs

engage technical and non-technical stakeholders Nice to Have: Experience with modern analytics and BI platforms Knowledge of big data technologies (e.g. Spark, Hadoop) Experience with real-time or event-driven architectures Familiarity with data cataloguing and lineage tools Experience working in regulated or data-sensitive environments Relevant certifications ...

Machine Learning: TensorFlow, PyTorch, Scikit-learn GenAI/LLMs: OpenAI API, Hugging Face Transformers, LangChain, Langraph, RAG pipelines Data & Analytics: Pandas, NumPy, Spark, Databricks, Hadoop, Vector Databases, Snowflake Model Deployment: MLflow, FastAPI, Flask, Docker, Kubernetes Cloud & Infrastructure: AWS, Azure, GCP CI/CD pipelines (GitLab, Jenkins) Desirable Skills Experience ...

techniques, A/B testing methodologies, and experiment design. Solid background in ranking, recommendation, and retrieval systems. Familiarity with large-scale data tools (Hadoop, BigQuery, Amazon EMR, etc.). Experience with BI tools and visualization platforms such as Tableau, Qlik, or MicroStrategy. Bonus: Experience with geospatial data and advanced ...

Need: Experience in architecture & design and consulting services focused on enterprise solutions, data analytics platform, lake houses, data engineering, data processing, data warehousing, ETL, Hadoop & Big Data. Experience in BFSI Industry is required. Experience in defining and designing data governance, data management, and data security solutions for an enterprise ...

years' IT Architecture experience working in a software development, technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment ...

/Q or similar Experience with Airflow, Dagster or similar tools. Exposure to container technologies: Docker, Podman etc Knowledge of 'big data' technologies (Hadoop, Spark, Parquet) Experience with TAQ data, and exchange connectivity. Compensation Anticipated Salary Range for United States: $100,000 - $150,000 base salary, plus eligible ...

Cloud; Kubernetes and containerization. • AI Expertise: Advanced machine learning algorithms, GenAI models (e.g., GPT, BERT, DALL-E, GEMINI), NLP techniques. • Big Data: Experience with Hadoop and Spark. • Ethics: Knowledge of AI ethics and governance. • Methodologies: Agile and Scrum project management. Desired Skills & Experience • Deep knowledge of machine learning operations ...

setting technical standards and driving best practices across the organisation. The role demands hands-on expertise with Azure, big data technologies like Spark and Hadoop, and programming languages including Python. You will also oversee database architecture, data modelling, and ETL processes to ensure seamless integration across multiple platforms, using ...

NoSQL skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development skills, e.g. Python Big data technologies knowledge, e.g. Hadoop stack Containerization experience, e.g. Docker, Kubernetes Understanding of generative AI, NLP (Natural Language Processing) or OCR (Optical Character Recognition) Experience in the industrial ...

requiring data analysis and visual support. Skills: Experienced in either programming languages such as Python and/or R, big data tools such as Hadoop, or data visualization tools such as Tableau. The ability to communicate effectively in writing, including conveying complex information and promoting in-depth engagement ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

plus. Experience with ML frameworks and libraries (PyTorch, TensorFlow, XGBoost, LightGBM, etc.). Solid knowledge of distributed data processing systems (Spark, Flink, Hadoop) and query languages (SQL/HiveQL). Hands on experience with ML pipeline orchestration tools (e.g., Airflow, Kubeflow, MLflow). Experience with containerization and deployment platforms ...

standards. Familiar with Modern Web Development in React and/or Angular (2+), NodeJS, GraphQL etc. Familiar with Big Data/Analytics technologies like Hadoop, Spark, Python, Scala. Experience working with real-time or near real-time data ingestion. Understand procedures for onboarding applications to Mastercard portals like ...

Python skills; experience with deep learning frameworks (TensorFlow, PyTorch) Solid understanding of ML algorithms, statistics, and data modelling Experience with large‐scale data tools (Hadoop, Spark, Kafka) Cloud & MLOps experience (AWS, Azure, or GCP) NLP experience highly beneficial Strong leadership, communication, and stakeholder management ...

Python skills; experience with deep learning frameworks (TensorFlow, PyTorch) Solid understanding of ML algorithms, statistics, and data modelling Experience with large-scale data tools (Hadoop, Spark, Kafka) Cloud & MLOps experience (AWS, Azure, or GCP) NLP experience highly beneficial Strong leadership, communication, and stakeholder management ...

related to design and manage scalable batch and streaming Dataflow jobs for processing historical and real-time data. Develop Big Data applications using Hadoop, Hive, PySpark, and Python. Build centralized logging systems by integrating Dataflow logs with Cloud Logging for monitoring and troubleshooting. Use SQL and BigQuery for data ...

. Understanding of agile methodologies, CI/CD pipelines, application resiliency, and security best practices. Knowledge of data quality, governance, and big data technologies (Hadoop, Spark ...

exchange and processing experience including ETL, ESB and API-based integrations Development experience, ideally using Python Knowledge of big data technologies such as the Hadoop stack Exposure to NLP and OCR technologies Awareness or hands-on experience with Generative AI solutions Experience with containerisation technologies such as Docker Background ...

exchange and processing experience including ETL, ESB and API-based integrations Development experience, ideally using Python Knowledge of big data technologies such as the Hadoop stack Exposure to NLP and OCR technologies Awareness or hands-on experience with Generative AI solutions Experience with containerisation technologies such as Docker Background ...

support and migration experience Desirable knowledge and experience: AWS accreditation Knowledge of COTS products (including but not limited to; Elasticsearch, NiFi, Rabbit, Kafka, MongoDB, Hadoop, Ansible, Git and Kubernetes) Development of dashboards for monitoring and alerting through Grafana, Splunk, Prometheus and OpenText Om and Ops Bridge On prem ...

define OKRs and track the success of new features. Data Storytelling: Don't just pull the data-explain it. You'll translate complex Hadoop/SQL datasets into actionable insights for non-technical stakeholders. Innovate: Use Python, R, and Tableau to build intuitive visualizations and experiment with new ways ...

developed vetting) cleared & willing to undertake DV clearance Essential Skills required for the role: Java Spring Boot AWS Python Spark Hadoop Kafka ElasticSearch OpenShift/Kubernetes NiFi ...

undertake DV (developed vetting) clearance (eligible to undertake DV Security Clearance). Skills required for the role: Java, Spring Boot, AWS, Python, Spark, Hadoop, Kafka, ElasticSearch, OpenShift/Kubernetes, NiFi Please apply to this advertisement if you are interested SmartSourcing are a Disability Confident Employer and we promote, celebrate ...