17 of 17 Apache Hive Jobs in London

robust, efficient, and ready to support advanced analytics and business insights. Responsibilities Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data. Collaborate with cross-functional teams to understand data … with SQL-based databases including Oracle and Microsoft SQL Server; solid understanding of database design principles. Familiarity with big data frameworks like Hadoop, Spark, Apache Hive, and related ecosystem components. Experience working with ETL tools such as Informatica for data integration tasks. Demonstrated ability to analyze complex datasets ...

provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based pipelines … patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards, and control evidence packs. Technical Skills Strong ...

pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of scheduling/orchestration tools such as Autosys and/or Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift or equivalent … such as Tableau dashboards (data validation, extract refresh checks, reconciliation to source). Nice-to-Have Experience with tools such as PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases. Exposure to data governance concepts: critical data elements (CDEs), lineage, data quality dimensions, audit frameworks. Experience running delivery ...

. Strong proficiency in Python for data engineering and automation. Hands‐on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases. Experience designing and supporting ETL/ELT pipelines and data quality frameworks (rules … thresholds, exception handling). Working knowledge of Autosys and Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift or equivalent). Familiarity with AWS S3 for large‐scale data storage and dataset movement patterns. ...

future needs of the department. This is an exciting opportunity to work on cutting edge technologies including Big Data and NoSQL databases (Hadoop, HBase, Hive, Spark and MongoDB) to allow the business to gain advanced insight into their portfolios and valuation metrics. Key responsibilities include:* Lead business requirements elicitation ...

Programming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-have Strong understanding of machine learning methods and experience applying them ...

including mappings, workflows, applications, transformations, and reusable components. Support the migration of data assets, ETL pipelines, and workloads from the Cloudera Hadoop platform (HDFS, Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop ...

eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video,etc. Knowledge of machine learning modelling techniques ...

sales opportunities at client engagements An understanding of database technologies e.g. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. Hadoop, Mahout, Pig, Hive, etc. An understanding of statistical modelling techniques e.g. Classification and regression techniques, Neural Networks, Markov chains, etc. An understanding of cloud technologies e.g. ...

languages eg. Python, R, Scala, etc.; (Python preferred) Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

languages eg. Python, R, Scala, etc.; (Python preferred) Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

design, development, and optimization of our data infrastructure in a hybrid role based in Hounslow. You will build scalable pipelines with Spark, Hadoop, Hive, and AWS, maintain data warehouses on Oracle/SQL Server, and drive data quality and security. You will leverage Informatica and scripting in Python ...

/Azure also relevant). Containerisation & orchestration: Kubernetes, Docker. Strong CICD exposure: GitHub, Terraform, automated pipelines. Familiarity with SQL/NoSQL databases (e.g. Bigtable, Hive). Experience working in Agile environments (Scrum, Kanban, or stream-aligned team models). Nice to Have ✔️ Experience with predictive analytics/big data ...

generation of Big Data Analytics solutions tailored to our client needs. Development: Create MR1/YARN applications using Java, Scala, or Python. Additionally, develop Hive and Impala scripts. Project Leadership: Take charge of the end‐to‐end successful delivery of Information Management and analytics, specifically focusing on Big Data ...

Hive Science is a tech start-up whose technologies are in use by many of the world’s largest brands including Land Rover, Edward Jones & numerous other fortune 500 brands. The Hive platform is delivering novel intelligence at the intersection of quantitative social psychology, behavioral science & AI/… join our team and get on board this rocket ship with us.. About the role: You'll help design & drive the data infrastructure behind Hive's enrichment products: how Hive intelligence is joined to external client &partner datasets. You'll design &build extensible, repeatable systems and integration capabilities ...

Job Description: Job Title: Quantitative Engineer Corporate Title: Up to Vice President Location: Bromley Company Overview: At Bank of America, we are guided by a common purpose to help make financial lives better through the ...

Deep Learning, Gradient Boosting, Random Forests, SVMs, Neural Networks* Helpful to have experience with programming, statistical, and querying languages like Python, R, SQL/Hive, Java* Helpful to have understanding of distributed file systems, scalable datastores, distributed computing and related technologies (Spark, Hadoop, etc.); implementation experience of MapReduce techniques … able to effectively communicate and engage with a variety of partners (e.g., internal, external, technical, non-technical people)* Helpful to have Java, R, C++, Hive, Hadoop, Microsoft SQL Server knowledge **What We Offer:**Successful candidates will receive a competitive compensation package including the benefits below and others:* The compensation ...