deployment. - Experience with Infrastructure as Code (IaC) by tools such as CDK. - Experience with streaming data processing and real-time analytics. - Experience with big data technologies (e.g., Hadoop, Spark, Hive). Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application More ❯
and ETL - informatica - Experience in SQL and database management systems - Knowledge of data modelling , warehousing concepts , and ETL processes - Experience with big data technologies and frameworks such as Hadoop, Hive, Spark. Programming experience in Python or Scala. - Demonstrated analytical and problem-solving skills. - Familiarity with cloud platforms (e.g Azure , AWS ) and their data related services - Proactive and detail oriented More ❯
S3, EC2, etc. Experience with coding languages like Python/Java/Scala Experience in maintaining data warehouse systems and working on large scale data transformation using EMR, Hadoop, Hive, or other Big Data technologies Experience mentoring and managing other Data Engineers, ensuring data engineering best practices are being followed Experience with hardware provisioning, forecasting hardware usage, and managing More ❯
data architectures, Lambda type architectures - Proficiency in writing and optimizing SQL - Knowledge of AWS services including S3, Redshift, EMR, Kinesis and RDS. - Experience with Open Source Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.) - Ability to write code in Python, Ruby, Scala or other platform-related Big data technology - Knowledge of professional software engineering practices & best practices for the More ❯
Experience with PostgreSQL, ElasticSearch, MongoDB, and graph databases. Experience with GenAI enabled daily workflows (coding, testing, analytics). Experience with one or more SQL-on-Hadoop technology (Spark SQL, Hive, Impala, Presto, etc.) Experience with short-release cycles and the full software lifecycle Experience with Agile development methodology (e.g., Scrum) Current Security+ certification (or must obtain within 30 days More ❯
machine learning libraries/packages (sklearn, TensorFlow, PyTorch, statsmodels, etc.). Experience in multiple tools/language/frameworks within the Big Data & cloud ecosystem (Hadoop, MongoDB, Neo4j, Spark, Hive, HBase, Cassandra, etc.). Demonstrated experience of managing and mentoring teams of data scientists, ML engineers, and data engineers on the execution of specific business use cases for AI More ❯
will also accept TS/SCI or TS/SCI with CI Polygraph Desired Experience: Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Work could possibly require some on-call work. The Swift Group and Subsidiaries are an Equal Opportunity/Affirmative Action employer. All qualified applicants More ❯
will also accept TS/SCI or TS/SCI with CI Polygraph Desired Experience: Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Work could possibly require some on-call work. The Swift Group and Subsidiaries are an Equal Opportunity/Affirmative Action employer. All qualified applicants More ❯
will also accept TS/SCI or TS/SCI with CI Polygraph Desired Experience: Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Work could possibly require some on-call work. The Swift Group and Subsidiaries are an Equal Opportunity/Affirmative Action employer. All qualified applicants More ❯
tools and LLMs. Ability to work independently and collaboratively within a team. Preferred Skills: Experience in GenAI/LLMs projects. Familiarity with distributed data/computing tools (e.g., Hadoop, Hive, Spark, MySQL Background in financial business-like banking, risk management. Should be familiar with capital markets and financial instruments and modeling More ❯
data analytic frameworks and pipelines using databases and tools such as (but not limited to) NoSQL, SQL, NiFi, Kafka, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Flink, Hadoop, Kafka, Hive, and others. • Apply distributed systems concepts and principles such as consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms. • Administrate cloud computing and CI/CD More ❯
to help open/close the workspace during regular business hours as needed. Preferred Requirements • Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. • Experience with containers, EKS, Diode, CI/CD, and Terraform are a plus. Benefits $152,000-$198,000 salary per year, depending on experience. More ❯
as Hadoop, Spark, or Kafka. Frontend development using HTML, CSS, JavaScript, and frameworks like React or Angular. Proficiency in programming languages such as PowerShell, Python, C++, C#, Java, TypeScript, Hive, R, or NoSQL. Knowledge of data visualization tools like Microsoft Power BI. Experience with containerization technologies like Docker and Kubernetes. What we look for You have an agile, growth More ❯
Title: GCP -Data Engineer Location: Philadelphia PA (Can submit who are willing to relocate) GCP Data Engineer - GCP Dataflow and Apache Beam (Key skills) Primary Skills- PySpark, Spark, Python, Big Data, GCP, Apache Beam, Dataflow, Airflow, Kafka and BigQuery GFO, Google Analytics Javascript is Must Strong Experience with Dataflow and BigQuery A person should have leading the team … Platforms (preferably GCP) provided Big Data technologies Hands-on experience with real-time streaming processing as well as high volume batch processing, and skilled in Advanced SQL, GCP BigQuery, Apache Kafka, Data-Lakes, etc. Hands-on Experience in Big Data technologies - Hadoop, Hive, and Spark, and an enterprise-scale Customer Data Platform (CDP) Experience in at least one More ❯
complex technical projects to senior-level audiences. Coach direct and indirect reports on personal growth and analytical skills by conducting training on leading analytical tools and techniques including Hadoop, Hive, Python, R, SAS, Scala, Spark, Power BI and SQL. This position will require up to 10% travel within the U.S. to client sites and other EXL offices. Position may More ❯
MySQL, RDS) US citizenship and an active TS/SCI with Full Scope Polygraph security clearance required Desired Experience: Experience with distributed databases and streaming tools (Hadoop, Spark, Yarn, Hive, Trino) Experience with Remote Desktop Protocol (RDP) technologies Experience with data access control, specifically Role-Based Access Control (RBAC) and Attribute-Based Access Control (ABAC) Familiarity with data science More ❯
modelling – Dimensional & transactional modelling using RDBMS, NO-SQL and Big Data technologies. Data visualization – Tools like Tableau Big data – Hadoop eco-system, Distributions like Cloudera/Hortonworks, Pig and HIVE Data processing frameworks – Spark & Spark streaming More ❯
modelling – Dimensional & transactional modelling using RDBMS, NO-SQL and Big Data technologies. Data visualization – Tools like Tableau Big data – Hadoop eco-system, Distributions like Cloudera/Hortonworks, Pig and HIVE Data processing frameworks – Spark & Spark streaming More ❯
be advantageous if you had Experience working with relational and experience with NoSQL databases (such as tuning and optimising complex queries for highly scalable systems) and query languages (specifically Hive/SparkSQL and ANSI SQL).Experience building large scale Spark 3.x applications & data pipelines, ideally with Batch processing running on Hadoop clusters. If you had experience with messaging queues More ❯
modelling – Dimensional & transactional modelling using RDBMS, NO-SQL and Big Data technologies. Data visualization – Tools like Tableau Big data – Hadoop eco-system, Distributions like Cloudera/Hortonworks, Pig and HIVE Data processing frameworks – Spark & Spark streaming More ❯
modelling – Dimensional & transactional modelling using RDBMS, NO-SQL and Big Data technologies. Data visualization – Tools like Tableau Big data – Hadoop eco-system, Distributions like Cloudera/Hortonworks, Pig and HIVE Data processing frameworks – Spark & Spark streaming More ❯
london (city of london), south east england, united kingdom
HCLTech
modelling – Dimensional & transactional modelling using RDBMS, NO-SQL and Big Data technologies. Data visualization – Tools like Tableau Big data – Hadoop eco-system, Distributions like Cloudera/Hortonworks, Pig and HIVE Data processing frameworks – Spark & Spark streaming More ❯
ML models in cloud environments (GCP, AWS, or Azure Experience with containerization tools (Docker, Kubernetes) and ML workflow tools (MLflow, TFX Familiarity with big data technologies such as Spark, Hive, or Hadoop. Experience with Google Vertex AI and writing Terraform scripts for infrastructure automation. Experience with CI/CD pipelines, configuration management, and onboarding/monitoring of ML systems. More ❯
Demonstrated experience in micro service architecture using Spring Framework, Spring Boot, Tomcat, AWS, Docker Container or Kubernetes solutions. 5. Demonstrated experience in big data solutions (Hadoop Ecosystem, MapReduce, Pig, Hive, DataStax, etc.) in support of a screening and vetting mission. More ❯
development of database solution in both traditional as well as columnar databases. Experience in data integration with ETL techniques and frameworks Experience in Big Data querying tools, such as Hive, Impala and Spark SQL Work Schedule: MULTIPLE SHIFTS AVAILABLE Work Type: Full Time More ❯
