15 of 15 Hadoop Jobs

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

Degree in STEM, Data, AI, or Programming-related field Experience influencing technical decisions and supporting capability growth. Experience with big data tools e.g. Spark, Hadoop, NiFi Exposure to Ansible and Terraform Understanding of ML algorithms and deployment ...

solutions on platforms such as Amazon Bedrock. Experience developing data-based apps in Streamlit/Shiny Skills in 'Big Data' technology tools like Hadoop/Spark Knowledge of Infrastructure as Code tools like CloudFormation/Terraform If you can bring some of these skills and experiences, along with transferable ...

infrastructure underpinning data systems through a DevOps approach Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different ...

Python data science ecosystem (e.g. NumPy, Pandas, scikit-learn, PyTorch, TensorFlow). Experience with big data and distributed analytics platforms (e.g. Spark, Hadoop). Hands-on experience with Natural Language Processing, graph analytics and advanced analytical methods. Experience using cloud analytics platforms, with strong AWS and native tooling expertise. ...

gained concurrently): - Snowflake experience - AWS Athena serverless data warehousing One (1) year of experience in the following (experience may be gained concurrently): - Hadoop ecosystem - Hive and Presto - YARN resource management 40 hours/week, 9:30am-5:30pm, Salary: $160,056k - $165k/year. Telecommuting from a home office ...

cloud architecture and solution implementation experience - Strong hands-on development experience with modern programming languages (e.g., Python, Java) and data technologies (SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - 3+ years of AWS service suite, Infrastructure as Code (Terraform, CloudFormation), Security tools and frameworks, Compliance automation tool experience - Current, active ...

sales environments - Knowledge of AWS services including compute, storage, networking, security, databases, machine learning, and serverless technologies - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in scripting for automation (e.g. Python) and advanced SQL skills. - Experience in performance optimization and cost management for cloud environments - Knowledge ...

machine learning, and serverless technologies - Experience in external or internal customer facing, complex and large scale project management - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience with Machine and Deep Learning toolkits such as MXNet, TensorFlow, Caffe and PyTorch - Experience facilitating discussions with senior leadership regarding ...

developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs … Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls to identify missing, duplicate or inconsistent records. Implement robust data flows with retry mechanisms, error ...

Data PySpark Developer Location: Irving, TX (Hybrid 3 Days Onsite) Experience: 7+ Years Job Type: Full-Time Required Skills: PySpark, Python, Apache Spark, SparkSQL, Hadoop, SQL, Unix/Linux, Shell Scripting, and Apache Airflow. Interested candidates, please DM me or share your updated resume. VITS Consulting ...

achieve in the cloud. BASIC QUALIFICATIONS - 7+ years of technical specialist, design and architecture experience - 5+ years of database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) experience - 7+ years of consulting, design and implementation of serverless distributed solutions experience - 5+ years of software development with object oriented language experience ...