76 to 100 of 174 Hadoop Jobs

observability platforms, including distributed tracing, logging, metrics, and tools such as Prometheus, Grafana, ELK, or OpenTelemetry. Experience with site reliability engineering practices, relational databases, Hadoop, big data technologies, or cloud-native services. Familiarity with cloud-native architecture and managed services across AWS, Azure, or Google Cloud Platform. Knowledge ...

Strong understanding of Apache HTTP, Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data formats. Knowledge of Iceberg, Databricks, and Hadoop ecosystems. Skills that will help Follows TDD, ATDD and Clean Coding practices and used to setting up or working in an environment using ...

Python or Go. Expertise in constructing highly available and fault-tolerant big data environments in the cloud, utilizing NoSQL and RDMS technologies like Hadoop, Spark, PostgreSQL, and cloud-based management tools such as EMR, Athena, and RDS.Ability to implement systems with a security-first mindset, adhering to firm-wide ...

Artificial Intelligence modeling techniques (logit, GLM, time series, random forests, clustering, XGBoost), statistical programming languages (SAS, R, Python, Matlab), big data tools and platforms (Hadoop, Hive, etc.) and cloud platforms (AWS, Azure, GCP). Solid academic record. Strong computer skills. Postgraduate studies and/or specialized courses ...

Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with Kafka technologies Clear ...

Government, Public Sector, Security, Justice, Defence, Healthcare or other similarly challenging environments . Experience with large-scale data technologies such as SQL, Spark or Hadoop would also be beneficial. About You You will be a technically credible leader who is still comfortable getting into the detail. You will understand ...

related technical field plus 30 months experience in data science, machine learning, or related field. Must have experience with Python, SQL, ML frameworks, Hadoop/Spark, Docker/Kubernetes, REST APIs, statistical modeling, data visualization tools, and AWS or Azure. Salary $164,403.00 per year. Send resume to (email ...

possibility of making serious money doing something you are passionate about. Follow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...

related fields. 5+ years of experience in Big Data; prior experience with Tier-1 Cloud Service Providers (CSPs) is highly preferred. Expertise in the Hadoop ecosystem and deep understanding of components like Spark, Flink, Elasticsearch, Doris, ClickHouse, and Trino., Strong knowledge of big data architecture, including Data Lake (Iceberg ...

support. A core component of the role is applying, modifying and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary modelling focus will be neural network‐based forecasting, with a strong emphasis on rigorous evaluation against ...

following would be beneficial but not essential: Working with big data technology, ideally Spark but others will also be useful such as Hadoop or ElasticsearchExperience with DevOps tooling and approaches (automation and tooling is something we are passionate about, we even have a dedicated Developer Tooling team)Building data ...

microservices, and data integration layers to support high-throughput regulatory reporting. Big Data Processing: Develop and optimize distributed data processing jobs using Apache Spark, Hadoop, and Hive to aggregate and transform large-scale financial datasets. Real-Time Streaming: Build and maintain real-time data ingestion and streaming pipelines using … using Spring Boot , Spring Cloud, Spring Data, and Spring Security. Big Data Technologies: Strong, hands-on experience with distributed computing frameworks, specifically Apache Spark , Hadoop , and Hive . Proven ability to write and optimize complex Spark jobs. Real-Time Streaming: Practical experience designing and implementing event-driven systems using ...

Job Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to 500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting ...

Data Formats: Strong understanding of Apache HTTP, Envoy, and REST API design, plus experience with Protobuf, Avro, and Parquet. Knowledge of Iceberg, Databricks, and Hadoop ecosystems. TDD, ATDD, and Clean Coding practices within a CI/CD environment (e.g. Jenkins, Gradle). Experience with Scrum/Agile methods ...

Monitoring utilising products such as: Prometheus, Grafana, ELK, filebeat etc. Observability - SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Edge technologies e.g. NGINX, HAProxy etc. Excellent knowledge of YAML or similar languages It is essential for this role that you hold ...

systems such as: Ansible, Terraform, Jenkins, Bamboo, Concourse etc. Observability – SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Excellent knowledge of YAML or similar languages The following Technical Skills & Experience would be desirable: Jupyter Hub Awareness RabbitMQ or other common queue technology ...

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them to be commercially successful through insight ...

architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Experience leading data platform migrations Experience managing ...

architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Hands on experience with databricks a distinct ...

generated code and recommendations. Excellent stakeholder communication and collaboration skills. Desirable Experience Python programming experience. Databricks experience. Experience with platforms such as Snowflake, Hadoop, Microsoft SQL Server, or similar enterprise data technologies. Exposure to data architecture, infrastructure optimisation, and performance tuning. Experience within the Microsoft ecosystem, including Teams, Outlook ...

role you should have the following skills: Experience implementing data processes for Data Warehouse and production systems. Strong experience with Big Data technologies (e.g., Hadoop/Spark). Programming in modern languages (e.g., Scala and Python). Strong delivery engineering tooling: Git/GitHub, Jenkins, Ansible, and JIRA ...

moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree ...

from kernel, networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow ...

sales environments - Knowledge of AWS services including compute, storage, networking, security, databases, machine learning, and serverless technologies - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in scripting for automation (e.g. Python) and advanced SQL skills. - Experience in performance optimization and cost management for cloud environments - Knowledge ...

storage, networking, security, databases, machine learning, and serverless technologies - Experience in performance optimization and cost management for cloud environments - Database experience (e.g. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience with automation and scripting (e.g., Terraform, Python) - Knowledge of security and compliance standards (e.g., HIPAA, GDPR) - Experience with AWS data ...