1 to 25 of 29 Apache Hive Jobs in England

robust, efficient, and ready to support advanced analytics and business insights. Responsibilities Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data. Collaborate with cross-functional teams to understand data … with SQL-based databases including Oracle and Microsoft SQL Server; solid understanding of database design principles. Familiarity with big data frameworks like Hadoop, Spark, Apache Hive, and related ecosystem components. Experience working with ETL tools such as Informatica for data integration tasks. Demonstrated ability to analyze complex datasets ...

provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based pipelines … patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards, and control evidence packs. Technical Skills Strong ...

HiveQL, SparkSQL, Scala) Experience with one or more scripting language (e.g., Python, KornShell) Preferred Qualifications Experience with big data technologies such as: Hadoop, Hive, Spark, EMR Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc. Amazon is an equal opportunities employer. We believe passionately that employing ...

pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of scheduling/orchestration tools such as Autosys and/or Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift or equivalent … such as Tableau dashboards (data validation, extract refresh checks, reconciliation to source). Nice-to-Have Experience with tools such as PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases. Exposure to data governance concepts: critical data elements (CDEs), lineage, data quality dimensions, audit frameworks. Experience running delivery ...

. Strong proficiency in Python for data engineering and automation. Hands‐on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases. Experience designing and supporting ETL/ELT pipelines and data quality frameworks (rules … thresholds, exception handling). Working knowledge of Autosys and Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift or equivalent). Familiarity with AWS S3 for large‐scale data storage and dataset movement patterns. ...

focus on production reliability. Essential skills and experience Strong hands-on experience developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge … software development tools. Exposure to agentic AI, workflow orchestration or retrieval-augmented generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions ...

future needs of the department. This is an exciting opportunity to work on cutting edge technologies including Big Data and NoSQL databases (Hadoop, HBase, Hive, Spark and MongoDB) to allow the business to gain advanced insight into their portfolios and valuation metrics. Key responsibilities include:* Lead business requirements elicitation ...

Programming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-have Strong understanding of machine learning methods and experience applying them ...

including mappings, workflows, applications, transformations, and reusable components. Support the migration of data assets, ETL pipelines, and workloads from the Cloudera Hadoop platform (HDFS, Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop ...

eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video,etc. Knowledge of machine learning modelling techniques ...

sales opportunities at client engagements An understanding of database technologies e.g. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. Hadoop, Mahout, Pig, Hive, etc. An understanding of statistical modelling techniques e.g. Classification and regression techniques, Neural Networks, Markov chains, etc. An understanding of cloud technologies e.g. ...

languages eg. Python, R, Scala, etc.; (Python preferred) Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

languages eg. Python, R, Scala, etc.; (Python preferred) Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

design, development, and optimization of our data infrastructure in a hybrid role based in Hounslow. You will build scalable pipelines with Spark, Hadoop, Hive, and AWS, maintain data warehouses on Oracle/SQL Server, and drive data quality and security. You will leverage Informatica and scripting in Python ...

/Azure also relevant). Containerisation & orchestration: Kubernetes, Docker. Strong CICD exposure: GitHub, Terraform, automated pipelines. Familiarity with SQL/NoSQL databases (e.g. Bigtable, Hive). Experience working in Agile environments (Scrum, Kanban, or stream-aligned team models). Nice to Have ✔️ Experience with predictive analytics/big data ...

generation of Big Data Analytics solutions tailored to our client needs. Development: Create MR1/YARN applications using Java, Scala, or Python. Additionally, develop Hive and Impala scripts. Project Leadership: Take charge of the end‐to‐end successful delivery of Information Management and analytics, specifically focusing on Big Data ...

Elastic search and understanding of Hadoop ecosystem Experience working with large data sets, experience working with distributed computing tools like Map/Reduce, Hadoop, Hive, Pig etc. Advanced use of Excel spread sheets for analytical purposes MSc or PhD in Data Science or an analytical subject (Physics, Mathematics, Computing ...

Elastic search and understanding of Hadoop ecosystem Experience working with large data sets, experience working with distributed computing tools like Map/Reduce, Hadoop, Hive, Pig etc. Advanced use of Excel spread sheets for analytical purposes An MSc or PhD in Data Science or an analytical subject (Physics, Mathematics ...

Data, Data Warehousing, Business Intelligence, Machine Learning). Data Ecosystems: Familiarity with modern data architectures and tools, such as Big Data frameworks (Hadoop, Spark, Hive, BigQuery), Data Warehouses, and Machine Learning. Role Qualifications Industry Experience: 10+ years of experience in the Manufacturing and broader industrial supply chain environment. Sales ...

needs, entrepreneurial spirit Excellent verbal and written communication skills BS or MS degree in Computer Science or equivalent Experience in distributed computing frameworks like Hive/Hadoop, Apache Spark Experience in developing Finance or HR related applications Experience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront … DynamoDB, VPC, Elastic Cache, Lambda Working experience with Terraform Experience in creating workflows for Apache Airflow What the job involves The Roku Enterprise Engineering team is at the forefront of building a robust, integrated, and scalable platform that powers critical business processes across the organization As a cornerstone ...

critical role in keeping our business connected, efficient, and scalable. We’re now looking for a Lead Web Developer to take ownership of Hive , our in-house operations platform, and shape its next stage of growth. About Hive Hive is a Laravel + Livewire platform that powers … shape how it grows across the business. What you'll be doing Ownership & Development Take full ownership of the development, maintenance, and roadmap of Hive Build and ship new features in response to evolving business needs Design and maintain database architecture and backend logic Develop and maintain Livewire ...

kernel methods and deep learning. Responsibilities include translating business needs into technical requirements and leveraging distributed computing tools such as Map/Reduce, Hadoop, Hive and Pig. A MSc/PhD is advantageous. #J-18808-Ljbffr ...

Python ML libraries (scikit‐learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data(image, audio, video ...

similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems … similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems ...

Hive Science is a tech start-up whose technologies are in use by many of the world’s largest brands including Land Rover, Edward Jones & numerous other fortune 500 brands. The Hive platform is delivering novel intelligence at the intersection of quantitative social psychology, behavioral science & AI/… join our team and get on board this rocket ship with us.. About the role: You'll help design & drive the data infrastructure behind Hive's enrichment products: how Hive intelligence is joined to external client &partner datasets. You'll design &build extensible, repeatable systems and integration capabilities ...