51 to 75 of 127 Hadoop Jobs

/DEI, including mappings, workflows, applications, transformations, and reusable components. Support the migration of data assets, ETL pipelines, and workloads from the Cloudera Hadoop platform (HDFS, Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon ...

observability platforms, including distributed tracing, logging, metrics, and tools such as Prometheus, Grafana, ELK, or OpenTelemetry. Experience with site reliability engineering practices, relational databases, Hadoop, big data technologies, or cloud-native services. Familiarity with cloud-native architecture and managed services across AWS, Azure, or Google Cloud Platform. Knowledge ...

Strong understanding of Apache HTTP, Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data formats. Knowledge of Iceberg, Databricks, and Hadoop ecosystems. Skills that will help Follows TDD, ATDD and Clean Coding practices and used to setting up or working in an environment using ...

Belangrijkste vereisten 3+ years as a Data Engineer or similar role Strong understanding of software and data engineering practices Proficient in Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, Git Clear communicator Self-starter Innovator Python PySpark Airflow ...

large data sets, model development, statistics, experimentation, data visualization, optimization, software development Cross-functional collaboration experience in ML product development Strong Python, Java, Kafka, Hadoop, SQL, Spark or equivalent; version control experience Excellent English communication skills and ability to drive initiatives and lead teams cross-functional collaboration leadership ...

with demonstrable experience of working in rapidly changing client environments. Needs to be a practitioner and proponent of Agile and Dev Ops Proficiency in Hadoop, Spark, Scala, Python, or a programming language associated with data engineering Expertise in building and deploying production level data solutions maintained by application support ...

Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with Kafka technologies Clear ...

Have:*** Experience in the development of algorithms leveraging R, Python, or SQL/NoSQL* Experience with distributed data and computing tools, including MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL* Experience with visualization packages, including Plotly, Seaborn, or ggplot2* TS/SCI clearance with a polygraph **Clearance:**Applicants ...

systems, event-driven architectures, and message queues (Kafka, RabbitMQ, etc.) Experience with relational and/or NoSQL databases; design and query optimization; familiarity with Hadoop, Spark, or Flink is valuable Proven ability to lead end-to-end system design, create technical design docs, guide reviews, and evaluate tradeoffs (scalability ...

/or NoSQL databases (Oracle/Postgres/MySQL, Cassandra/MongoDB) with schema design and query optimization Familiarity with Big Data technologies (Hadoop, Spark, Flink) and ability to perform architectural tradeoffs Ability to own end-to-end system design and write technical design docs; capable of design reviews ...

platform engineering standards using Databricks Asset Bundles (DABs), Terraform and Azure DevOps or GitHub Actions Lead migrations from legacy platforms (SQL Server, Oracle, SAS, Hadoop, Synapse) with clear cut-over and reconciliation plans Monitor and optimise DBU consumption and cluster policies, giving the client clear cost visibility Enable MLOps ...

React.JS, Angular, or similar JavaScript framework Exposure to cloud technologies - AWS EC2, EKS, RDS, S3, Lambdas Big Data Technologies, such as Ab Initio, ETL, Hadoop, Spark, etc. Dress Codes: Business Casual Pay Range: $70 - $72/hr (W2 Only) The specific compensation for this position will be determined ...

support. A core component of the role is applying, modifying and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary modelling focus will be neural network‐based forecasting, with a strong emphasis on rigorous evaluation against ...

required, including experience with SAS macros Additional experience with other statistical packages and database tools such as SQL, Python, R, Tableau, Hadoop, Hive, MapReduce and/or other large data systems is welcome but not essential. Prior work with healthcare or administrative claims data is strongly preferred. Strong skills ...

required, including experience with SAS macros Additional experience with other statistical packages and database tools such as SQL, Python, R, Tableau, Hadoop, Hive, MapReduce and/or other large data systems is welcome but not essential. Prior work with healthcare or administrative claims data is strongly preferred. Strong skills ...

microservices, and data integration layers to support high-throughput regulatory reporting. Big Data Processing: Develop and optimize distributed data processing jobs using Apache Spark, Hadoop, and Hive to aggregate and transform large-scale financial datasets. Real-Time Streaming: Build and maintain real-time data ingestion and streaming pipelines using … using Spring Boot , Spring Cloud, Spring Data, and Spring Security. Big Data Technologies: Strong, hands-on experience with distributed computing frameworks, specifically Apache Spark , Hadoop , and Hive . Proven ability to write and optimize complex Spark jobs. Real-Time Streaming: Practical experience designing and implementing event-driven systems using ...

ervaring in databases, data pipelines en BI-tools Kennis van SQL, NoSQL, Azure Data Factory, Data Lake, PowerBI, Python, Streaming, CI/CD, Databricks, Hadoop, Spark of Kafka Communicatief sterk Teamspeler met goede samenwerking Zelfstandig kunnen werken en beslissingen nemen SQL NoSQL Azure Data Factory ...

architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Hands on experience with databricks a distinct ...

moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree ...

from kernel, networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow ...

Data Platforms, Cloud, AI/ML, Analytics, and Enterprise Integration. The ideal candidate will have strong hands-on architecture experience with Databricks, Cloudera, Snowflake, Hadoop, Data Engineering, and Cloud Platforms, along with the ability to design scalable, secure, resilient, and future-ready enterprise solutions. This role will work closely … emerging technologies and recommend solutions that provide measurable business and operational value. Data Platform Architecture Architect enterprise-scale data platforms using Databricks, Cloudera, Snowflake, Hadoop, and cloud-native data services. Design and implement modern Lakehouse, Data Warehouse, Data Lake, Data Mesh, and Data Fabric architectures. Define enterprise data governance ...

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster ...

We are seeking a Data Engineering Specialist to join the Architecture & Modernization team. You will be instrumental in building and maintaining the data infrastructure for our Data AI platforms. This role will involve hands‐on ...

related field or equivalent practical experience Strong foundation in algorithms and data structures Experience with distributed systems, databases, and big data tools (Apache Spark, Hadoop) customer-focused results-oriented ability to navigate multi-year roadmaps with incremental deliverables Java Scala C++ ...

data availability, quality, and efficiency across markets. This role is onsite in London and requires strong SQL and programming skills, plus experience with Spark, Hadoop, and cloud platforms. #J-18808-Ljbffr ...