1 to 25 of 29 Hadoop Jobs

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Flask, Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data qualityPreparing data for predictive and prescriptive modellingHands on coding experience, such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

platforms using AWS, Azure or Google Cloud.Expertise in data modelling, SQL, NoSQL and modern database technologies.Experience with big data technologies, such as Apache Spark, Hadoop or distributed computing frameworks.Programming knowledge in Python, Scala, Java or similar languages.Experience architecting AI and machine learning solutions, including deploying models into production.A solid ...

learning or data science.Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow).Strong experience with ...

data science. Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials. Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives). Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow). Strong ...

system administration and troubleshooting. Familiarity with Git, Flux, Helm, and other development and deployment tools. Experience or familiarity with big data technologies such as: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Understanding of AGILE software development methodologies and use of standard software ...

willing/able to help open/close the workspace during regular business hours as needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with K9s, AWS CLI and other AWS services like ...

Fort Meade and Annapolis Junction. Flexibility is essential to adapt to schedule changes as needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with K9s, AWS CLI and other AWS services like ...

cloud architecture and solution implementation experience - Strong hands-on development experience with modern programming languages (e.g., Python, Java) and data technologies (SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - 3+ years of AWS service suite, Infrastructure as Code (Terraform, CloudFormation), Security tools and frameworks, Compliance automation tool experience - Current, active ...

more of the following is preferred: Advanced Python or Scala CI/CD tools (Jenkins, Ansible, Fortify, DevOps pipelines) Microservices and Big Data (Spark, Hadoop/HDFS) AWS services (EC2, EMR, Lambda, S3, Glue) QA automation (Cucumber, Selenium, Karate) Preferred Domain Knowledge Financial data systems: Equity, Commodities, Forex, Futures ...

interest in how AI and emerging technologies can improve analytics, reporting and ways of working. Experience of legacy MI or data environments such as Hadoop or SQL Server would also be beneficial, particularly where you've supported migration, simplification or decommissioning activity. Why should you apply ...

needed. Preferred Requirements Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g. Cloudera's Distribution of Hadoop, Hortonworks Data Platform, MapR, etc ) is a plus. Experience with CI/CD pipelines (e.g. Gitlab-CI, Travis-CI, Jenkins, etc.) Understanding of agile software ...

proficiency in machine learning frameworks and programming languages such as Python, R, or similar. Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL).Familiarity with anomaly detection, supervised, unsupervised learning methods, deep learning, and graph based solutionsDemonstrated ability to work collaboratively in cross-functional teams ...

language, with demonstrable experience of working in rapidly changing client environments. Needs to be a practitioner and proponent of Agile and Dev OpsProficiency in Hadoop, Spark, Scala, Python, or a programming language associated with data engineeringExpertise in building and deploying production level data solutions maintained by application support teamsKnowledge ...

needed. Preferred Requirements Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g. Cloudera's Distribution of Hadoop, Hortonworks Data Platform, MapR, etc ) is a plus. Experience with CI/CD pipelines (e.g. Gitlab-CI, Travis-CI, Jenkins, etc.) Understanding of agile software ...

sales environments - Knowledge of AWS services including compute, storage, networking, security, databases, machine learning, and serverless technologies - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in scripting for automation (e.g. Python) and advanced SQL skills. - Experience in performance optimization and cost management for cloud environments - Knowledge ...

storage, networking, security, databases, machine learning, and serverless technologies - Experience in performance optimization and cost management for cloud environments - Database experience (e.g. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience with automation and scripting (e.g., Terraform, Python) - Knowledge of security and compliance standards (e.g., HIPAA, GDPR) - Experience with AWS data ...

money doing something you are passionate about. My client is based in LondonFollow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...

machine learning, and serverless technologies - Experience in external or internal customer facing, complex and large scale project management - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience with Machine and Deep Learning toolkits such as MXNet, TensorFlow, Caffe and PyTorch - Experience facilitating discussions with senior leadership regarding ...

achieve in the cloud. BASIC QUALIFICATIONS - 7+ years of technical specialist, design and architecture experience - 5+ years of database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) experience - 7+ years of consulting, design and implementation of serverless distributed solutions experience - 5+ years of experience in cloud architecture and implementation - 5+ ...

developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs … Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls to identify missing, duplicate or inconsistent records. Implement robust data flows with retry mechanisms, error ...

Data PySpark Developer Location: Irving, TX (Hybrid 3 Days Onsite) Experience: 7+ Years Job Type: Full-Time Required Skills: PySpark, Python, Apache Spark, SparkSQL, Hadoop, SQL, Unix/Linux, Shell Scripting, and Apache Airflow. Interested candidates, please DM me or share your updated resume. VITS Consulting ...