1 to 25 of 71 Hadoop Jobs

implementing complex ETL/ELT processes from concept to production.Proficiency in SQL and data exploration across large, complex datasets.Experience with big data technologies (Hadoop, Hive, BigQuery, Snowflake) and working with terabyte-scale or larger datasets.Solid foundation in data structures, algorithms, and object-oriented design.Professional experience building REST services ...

complex ETL/ELT processes from concept to production. Proficiency in SQL and data exploration across large, complex datasets. Experience with big data technologies (Hadoop, Hive, BigQuery, Snowflake) and working with terabyte‐scale or larger datasets. Solid foundation in data structures, algorithms, and object‐oriented design. Professional experience building ...

Cloud) Understanding of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery) Strong problem-solving and analytical skills Preferred Skills Experience with big data technologies (e.g., Hadoop, Spark) Knowledge of data modeling techniques and schema design Familiarity with containerization tools (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices ...

Viya).Relational Databases and Data Warehousing concepts.Enterprise ETL tools such as Informatica, Talend, Datastage or Alteryx.Project experience using the any of the following technologies: Hadoop, Spark, Scala, Oracle, Pega, Salesforce.Cross and multi-platform experience.Financial services sector experience.Line management experience.Team building and leading.Mentoring/staff development experience.#TalanUK #LI-HB1QualificationsYou must ...

Bonus Points If You Have: Certifications: Google Cloud or AWS Certified Solutions Architect certification. ETL and Data Pipeline Expertise: Experience with ETL tools and Hadoop-based technologies (e.g., Spark) and/or batch/streaming data pipelines such as Beam and Flink. Data Architecture: Proven ability in designing ...

working with large datasets (terabyte scale and growing) and familiarity with various technologies and tooling associated with databases and big data:Big Data (i.e. Hadoop, Hive, BigQuery, Snowflake)Relational DB (MS SQL, PostgreSQL/MySQL)Comprehensive data design and data modeling experience Solid experience developing complex ETL processes from ...

Quantexa components such as: Entity Resolution (ER), Scoring Framework, Contextual Network Generation, UI Configuration. Strong background in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch. Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable of interfacing ...

Quantexa components such as: Entity Resolution (ER) Scoring Framework Contextual Network Generation UI Configuration Strong background in Big Data technologies, including:Scala, Apache Spark, Hadoop, ElasticSearch Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable of interfacing ...

closely with stakeholders and translate business requirements into effective AI solutions Desirable Generative AI experience Large Language Models (LLMs) LangChain or similar frameworks Spark, Hadoop or other big data technologies Experience with distributed computing, streaming platforms or workflow orchestration tools Experience monitoring and optimising model performance in production environments ...

learning or data science.Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow).Strong experience with ...

comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant What We Are Looking ...

comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant You'll also work with ...

products, claims processes, or actuarial environments Experience with ETL, data engineering concepts, or RDBMS systems (SQL Server, Oracle, Greenplum) Experience with big data ecosystems (Hadoop, Spark, Hive, Databricks, AWS/Azure) Background in advanced modeling techniques, MLOps, or deployment frameworks Employee Benefits & Well-Being Genworth employees make a difference ...

reporting, and self-service data capabilities. Understanding of emerging technologies including AI, machine learning, real-time analytics, and data lakes. Desirable Experience Experience with Hadoop, Spark, Kafka, or similar big data technologies. Exposure to advanced analytics and machine learning solutions. Relevant certifications such as CDMP, Azure Data Engineer ...

from concept to production.Strong knowledge of Python and core ML libraries (e.g., spaCy, NumPy, SciPy, Transformers).Understanding of big data and cloud technologies (Spark, Hadoop, Azure, AWS, or GCP).Deep expertise in MLOps principles, scalable model deployment, model governance, and the practical application of responsible AI within enterprise environments.Excellent ...

Oracle, Snowflake, Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) is a plus. Domain Knowledge Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge ...

infrastructure‐as‐code. Experience across major cloud providers (AWS, Azure, or GCP). Familiarity with modern data platforms (e.g. Snowflake, Databricks, Redshift, Hadoop ecosystems). Solid understanding of data science and machine learning workflows and their infrastructure pain points. Experience with Microsoft data platforms (SQL Server, Power BI, Azure ...

spirit Excellent verbal and written communication skills BS or MS degree in Computer Science or equivalent Experience in distributed computing frameworks like Hive/Hadoop, Apache Spark Experience in developing Finance or HR related applications Experience with cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic ...

continuous improvement Skills & Experience * Commercial experience in Data Engineering * Strong Python or Java development skills * Experience with AWS cloud services * Knowledge of Apache Spark, Hadoop, NiFi or similar big data technologies * Experience building ETL/ELT pipelines and processing large datasets * Understanding of software engineering best practices, testing ...

addition to the above, we would be thrilled if you also had: Experience of working on migrations of enterprise scale data platforms including Hadoop and traditional data warehouses An understanding of machine learning model development lifecycle, feature engineering, training and testing Good understanding or hands‐on experience of Kafka ...

Understanding of Computer Vision: Familiarity with computer vision techniques and libraries like OpenCV. Experience with Big Data Tools: Experience with big data tools like Hadoop, Spark, or Hive. Knowledge of Reinforcement Learning: Understanding of reinforcement learning techniques and algorithms. Familiarity with Robotics: Experience with robotics and robotic process automation ...

enabled tools responsibly to improve productivity while maintaining appropriate human oversight, governance, and solution quality.Bonus Points ForDevelopment experience using Scala or Java.Familiarity with Cloudera, Hadoop, Hive, Spark, and related distributed data ecosystems.Experience working with sensitive data and applying data privacy regulations, including GDPR.Curiosity to explore new technologies, including responsible ...

Life Sciences. Experience working for a software vendor, SaaS provider, or professional services organisation. Familiarity with Ataccama or similar enterprise data platforms. Exposure to Hadoop/Spark, NoSQL, XSLT, Hive, Kafka, Snowflake, or Databricks. Python or other programming languages. Familiarity with SDLC, code management and upgrades, and Unix/ ...

Scala. Strong knowledge of SQL and experience with data warehousing solutions. Familiarity with cloud platforms (AWS, Azure, Google Cloud) and big data technologies (Hadoop, Spark). Excellent problem-solving skills and a keen eye for detail. A collaborative spirit and a genuine passion for data! Our Client's Benefits ...

technical concepts clearly to non-technical business partners and consult pragmatically on architecture trade-offs. Bonus Experience: Migration of enterprise-scale legacy platforms (e.g., Hadoop, traditional RDBMS) to GCP. Exposure to streaming platforms like Kafka , MLOps workflows, or data governance tools like Dataplex and Cloud Data Catalog . ...