1 to 25 of 31 Hadoop Jobs

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Flask, Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data qualityPreparing data for predictive and prescriptive modellingHands on coding experience, such ...

. Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon). Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop). Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. Understanding of data governance, security, and compliance frameworks. Exposure ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

solutions on platforms such as Amazon Bedrock. Experience developing data-based apps in Streamlit/Shiny Skills in 'Big Data' technology tools like Hadoop/Spark Knowledge of Infrastructure as Code tools like CloudFormation/Terraform If you can bring some of these skills and experiences, along with transferable ...

Have : Experience with other Palantir products (e.g., Foundry) Experience with data visualization tools (e.g., Tableau, Power BI) Experience with big data technologies (e.g., Hadoop, Spark) Experience working in a consulting environment. Experience with Agile development methodologies (e.g. Scrum) Proficiency in at least one programming language, such as Python, Java ...

Have : Experience with other Palantir products (e.g., Foundry) Experience with data visualization tools (e.g., Tableau, Power BI) Experience with big data technologies (e.g., Hadoop, Spark) Experience working in a consulting environment. Experience with Agile development methodologies (e.g. Scrum) Proficiency in at least one programming language, such as Python, Java ...

system administration and troubleshooting. Familiarity with Git, Flux, Helm, and other development and deployment tools. Experience or familiarity with big data technologies such as: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Understanding of AGILE software development methodologies and use of standard software ...

willing/able to help open/close the workspace during regular business hours as needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with K9s, AWS CLI and other AWS services like ...

system administration and troubleshooting. Familiarity with Git, Flux, Helm, and other development and deployment tools. Experience or familiarity with big data technologies such as: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Understanding of AGILE software development methodologies and use of standard software ...

system administration and troubleshooting. Familiarity with Git, Flux, Helm, and other development and deployment tools. Experience or familiarity with big data technologies such as: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Understanding of AGILE software development methodologies and use of standard software ...

cloud architecture and solution implementation experience - Strong hands-on development experience with modern programming languages (e.g., Python, Java) and data technologies (SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - 3+ years of AWS service suite, Infrastructure as Code (Terraform, CloudFormation), Security tools and frameworks, Compliance automation tool experience - Current, active ...

proficiency in machine learning frameworks and programming languages such as Python, R, or similar. Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL).Familiarity with anomaly detection, supervised, unsupervised learning methods, deep learning, and graph based solutionsDemonstrated ability to work collaboratively in cross-functional teams ...

language, with demonstrable experience of working in rapidly changing client environments. Needs to be a practitioner and proponent of Agile and Dev OpsProficiency in Hadoop, Spark, Scala, Python, or a programming language associated with data engineeringExpertise in building and deploying production level data solutions maintained by application support teamsKnowledge ...

sales environments - Knowledge of AWS services including compute, storage, networking, security, databases, machine learning, and serverless technologies - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in scripting for automation (e.g. Python) and advanced SQL skills. - Experience in performance optimization and cost management for cloud environments - Knowledge ...

money doing something you are passionate about. My client is based in LondonFollow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...

machine learning, and serverless technologies - Experience in external or internal customer facing, complex and large scale project management - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience with Machine and Deep Learning toolkits such as MXNet, TensorFlow, Caffe and PyTorch - Experience facilitating discussions with senior leadership regarding ...

achieve in the cloud. BASIC QUALIFICATIONS - 7+ years of technical specialist, design and architecture experience - 5+ years of database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) experience - 7+ years of consulting, design and implementation of serverless distributed solutions experience - 5+ years of experience in cloud architecture and implementation - 5+ ...

developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs … Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls to identify missing, duplicate or inconsistent records. Implement robust data flows with retry mechanisms, error ...

developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs … Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls to identify missing, duplicate or inconsistent records. Implement robust data flows with retry mechanisms, error ...

Data PySpark Developer Location: Irving, TX (Hybrid 3 Days Onsite) Experience: 7+ Years Job Type: Full-Time Required Skills: PySpark, Python, Apache Spark, SparkSQL, Hadoop, SQL, Unix/Linux, Shell Scripting, and Apache Airflow. Interested candidates, please DM me or share your updated resume. VITS Consulting ...

achieve in the cloud. BASIC QUALIFICATIONS - 7+ years of technical specialist, design and architecture experience - 5+ years of database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) experience - 7+ years of consulting, design and implementation of serverless distributed solutions experience - 5+ years of software development with object oriented language experience ...

Oracle on-premise. Experience with Target Operating Model (TOM) design for data functions. Relevant certifications (OCI, DAMA, CDMP, etc.) is a plus. Experience with Hadoop/MongoDB is a plus Working experience with Denodo is a plus ...