20 of 20 Hadoop Jobs

quality checks into pipelines. Knowledge of cloud infrastructure (AWS, Azure, or GCP) and database technologies including relational and non-relational stores such as Postgres, Hadoop, Elasticsearch, and Graph databases. Solid understanding of coding best practices, design patterns, CI/CD tooling, versioning, dependency management, error handling, monitoring, and alerting. ...

closely with stakeholders and translate business requirements into effective AI solutions Desirable Generative AI experience Large Language Models (LLMs) LangChain or similar frameworks Spark, Hadoop or other big data technologies Experience with distributed computing, streaming platforms or workflow orchestration tools Experience monitoring and optimising model performance in production environments ...

Quantexa components such as: Entity Resolution (ER), Scoring Framework, Contextual Network Generation, UI Configuration. Strong background in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch. Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable of interfacing ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure ...

performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure ...

. Commercial experience in Data Engineering . Strong Python or Java development skills . Experience with AWS cloud services . Knowledge of Apache Spark, Hadoop, NiFi or similar big data technologies . Experience building ETL/ELT pipelines and processing large datasets . Understanding of software engineering best practices ...

unstructured datasets. Strong stakeholder management and communication skills. Desirable Insurance or financial services experience, ideally within pricing, underwriting, fraud, or claims. Experience with Spark, Hadoop, NoSQL, or modern big data platforms. Agile delivery experience and collaborative software development practices. Experience leading analytics teams and driving organisational change. Robert Walters ...

with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink, Hadoop, Cassandra, etc. Other Relevant Job Details For additional information about location requirements, please discuss with the recruiter following submission of your application. Some travel ...

Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists and engineering teams Opportunity to shape platform ...

Job Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to 500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting ...

achieve in the cloud. BASIC QUALIFICATIONS- 7+ years of technical specialist, design and architecture experience - 5+ years of database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) experience - 7+ years of consulting, design and implementation of serverless distributed solutions experience - 5+ years of software development with object oriented language experience ...

lineage. Support Data Governance initiatives, ensuring data security, privacy and compliance standards are maintained. Work with large and complex datasets using SQL, Python, Spark, Hadoop and modern data technologies. Collaborate with technical and business stakeholders within Agile delivery environments. Support data architecture and data modelling activities across enterprise platforms. … skills and proficiency in Python or similar programming languages. Experience with ETL/ELT tools, data warehousing and automated data pipelines. Knowledge of Spark, Hadoop or similar big data technologies. Strong understanding of Data Governance principles, policies, controls and data lifecycle management. Experience working within Agile delivery environments. Familiarity ...

Based in or willing to relocate to Gloucester 5+ years' professional experience with cloud data engineering (AWS focus) Hands-on experience: Python or Java, Hadoop/distributed systems, CI/CD pipelines Proven ability to design scalable architectures and mentor technical teams What we're looking for You think ...

Based in or willing to relocate to Gloucester 5+ years' professional experience with cloud data engineering (AWS focus) Hands-on experience: Python or Java, Hadoop/distributed systems, CI/CD pipelines Proven ability to design scalable architectures and mentor technical teams What we're looking for You think ...

stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL We recognize that our people are our strength ...

Data Platform technologies. Experience operating within Data Product, Data Platform or Enterprise Data environments. Financial Services experience. Knowledge of legacy platform migration initiatives including Hadoop, Teradata, Oracle or SAS environments. Experience working within data governance, security and regulatory environments ...

processes and systems within the domain of expertise Knowledge of Puppet or similar configuration management tools Knowledge of ‘big data' platforms, e.g. Horton Works, Hadoop etc. ...

scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists Enrich data and load into big data environment (Apache Hadoop on Cloudera) Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop) Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten State-of-the-Art Technologies ...

experience with enterprise integration and data platform tooling, including Informatica (PowerCenter, DEI), IBM middleware (Sterling, Message Broker, APIC), Azure integration services (ADF, APIM), Hadoop, Databricks. Experience with Informatica, Hadoop and Databricks is required. Modernization Expertise: 5+ years leading modernization initiatives transitioning enterprise environments from batch-processing to Event ...