1 to 25 of 46 Hadoop Jobs

platforms. Strong expertise in SQL, data modelling, and database optimisation (relational, vector and NoSQL). Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data ...

closely with stakeholders and translate business requirements into effective AI solutions Desirable Generative AI experience Large Language Models (LLMs) LangChain or similar frameworks Spark, Hadoop or other big data technologies Experience with distributed computing, streaming platforms or workflow orchestration tools Experience monitoring and optimising model performance in production environments ...

Quantexa components such as: Entity Resolution (ER), Scoring Framework, Contextual Network Generation, UI Configuration. Strong background in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch. Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable of interfacing ...

Oracle, Snowflake, Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) is a plus. Domain Knowledge Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge ...

Data Platforms: BigQuery, Snowflake, Redshift, Databricks, PostgreSQL, MySQL, MongoDB, or other SQL/NoSQL technologies Data Tooling: Airflow, dbt, AWS Glue, Step Functions, Spark, Hadoop, or similar tooling Infrastructure: AWS, Terraform, Docker, Kubernetes, or other cloud/platform technologies CI/CD: GitHub Actions, Jenkins, ArgoCD, or similar deployment ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

Life Sciences. Experience working for a software vendor, SaaS provider, or professional services organisation. Familiarity with Ataccama or similar enterprise data platforms. Exposure to Hadoop/Spark, NoSQL, XSLT, Hive, Kafka, Snowflake, or Databricks. Python or other programming languages. Familiarity with SDLC, code management and upgrades, and Unix/ ...

addition to the above, we would be thrilled if you also had: Experience of working on migrations of enterprise scale data platforms including Hadoop and traditional data warehouses An understanding of machine learning model development lifecycle, feature engineering, training and testing Good understanding or hands‐on experience of Kafka ...

production. Strong knowledge of Python and core ML libraries (e.g., spaCy, NumPy, SciPy, Transformers). Understanding of big data and cloud technologies (Spark, Hadoop, Azure, AWS, or GCP). Deep expertise in MLOps principles, scalable model deployment, and model governance. Excellent communication and stakeholder management skills with the ability ...

performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure ...

performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure ...

continuous improvement Skills & Experience * Commercial experience in Data Engineering * Strong Python or Java development skills * Experience with AWS cloud services * Knowledge of Apache Spark, Hadoop, NiFi or similar big data technologies * Experience building ETL/ELT pipelines and processing large datasets * Understanding of software engineering best practices, testing ...

Understanding of Computer Vision: Familiarity with computer vision techniques and libraries like OpenCV. Experience with Big Data Tools: Experience with big data tools like Hadoop, Spark, or Hive. Knowledge of Reinforcement Learning: Understanding of reinforcement learning techniques and algorithms. Familiarity with Robotics: Experience with robotics and robotic process automation ...

detail.* Strong partner management and ability to influence across teams and organisations.* Continuous learning and improvement mentality.## **Desired*** Experience with big data technologies (e.g. Hadoop, Hive, Spark).* Experience with generative AI, LLMs, or retrieval-augmented generation (RAG).* Exposure to Agentic AI concepts, including autonomous agents, tool ...

experience with MLOps, production ML systems, model lifecycle management, and monitoring.* Experience working with large-scale data systems and distributed computing frameworks (e.g. Spark, Hadoop).* Knowledge of experimental design, scientific methodology, and analysis.* Strong partner management and confirmed ability to influence large organisations without direct authority.* Demonstrated ability ...

ownership Qualifications Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins , Harness Strong experience of developing on Apache Spark/Hadoop Strong experience with AWS cloud services including AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience of the full development ...

ownership Qualifications Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins , Harness Strong experience of developing on Apache Spark/Hadoop Strong experience with AWS cloud services including AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience of the full development ...

with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink, Hadoop, Cassandra, etc. Other Relevant Job Details For additional information about location requirements, please discuss with the recruiter following submission of your application. Some travel ...

should meet the following requirements: Knowledge and experience analysing large and complex datasets to yield actionable technical and business insight Strong experience with Hadoop and/or Cloud Technologies (ideally GCP) and a willingness to build knowledge in these areas quickly Proficient understanding of data types and fluency ...

Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists and engineering teams Opportunity to shape platform ...

Job Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to 500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting ...

security. Collaborate across software engineering disciplines including analysis, development, testing, and deployment. Required Skills & Qualifications: Proficiency in Big Data development and toolsets (e.g., Hadoop, Greenplum, or similar). Strong understanding of Agile methodologies and common frameworks. Hands-on experience with CI/CD, TDD, cloud development, resiliency, and security ...

reliability and quality. Required Skills & Qualifications: Technical degree or related work experience. Experience with relational and non-relational databases such as SQL, MySQL, NoSQL, Hadoop, and MongoDB. Experience programming and architecting back-end solutions in languages such as Java or J2EE. Knowledge of data mining practices, algorithms, and applied ...

The Leonardo Cyber & Security Division, one of the three divisions in Leonardo UK, is a pivotal innovator, helping customers deliver and secure their digital transformation. The Cyber & Security Division is at the forefront of supplying ...

lineage. Support Data Governance initiatives, ensuring data security, privacy and compliance standards are maintained. Work with large and complex datasets using SQL, Python, Spark, Hadoop and modern data technologies. Collaborate with technical and business stakeholders within Agile delivery environments. Support data architecture and data modelling activities across enterprise platforms. … skills and proficiency in Python or similar programming languages. Experience with ETL/ELT tools, data warehousing and automated data pipelines. Knowledge of Spark, Hadoop or similar big data technologies. Strong understanding of Data Governance principles, policies, controls and data lifecycle management. Experience working within Agile delivery environments. Familiarity ...