1 to 25 of 26 Apache Hive Jobs in England

robust, efficient, and ready to support advanced analytics and business insights. Responsibilities Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data. Collaborate with cross-functional teams to understand data … with SQL-based databases including Oracle and Microsoft SQL Server; solid understanding of database design principles. Familiarity with big data frameworks like Hadoop, Spark, Apache Hive, and related ecosystem components. Experience working with ETL tools such as Informatica for data integration tasks. Demonstrated ability to analyze complex datasets ...

replay, backfill, recoverability and schema evolution Define and enhance operational telemetry, monitoring and platform observability Streaming & Distributed Data Processing Build and optimise solutions using:Apache Kafka Apache NiFi Apache Spark/PySpark Hadoop ecosystem technologies Hive and large-scale data storage platforms Develop scalable matching, enrichment … interested in engineers who can demonstrate strong expertise across several of the following areas: Core Technical Skills Python development in enterprise environments Apache Spark/PySpark Apache Kafka Apache NiFi Hadoop and Hive Advanced SQL REST API integration and development Data modelling and data lineage Distributed ...

system deployment using tools such as Ansible, Puppet or Chef Desirable Skills/Experience Familiar with the Big Data tech stacks, including: Trino Spark Apache Hive Apache Airflow Zeppelin notebooks Our Package Tailored benefits make a real difference. That’s why we offer a comprehensive range ...

system deployment using tools such as Ansible, Puppet or Chef Desirable Skills/Experience Familiar with the Big Data tech stacks, including: Trino Spark Apache Hive Apache Airflow Zeppelin notebooks Our Package Tailored benefits make a real difference. That’s why we offer a comprehensive range ...

system deployment using tools such as Ansible, Puppet or Chef Desirable Skills/Experience Familiar with the Big Data tech stacks, including: Trino Spark Apache Hive Apache Airflow Zeppelin notebooks Our Package Tailored benefits make a real difference. That’s why we offer a comprehensive range ...

provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based pipelines … patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards, and control evidence packs. Technical Skills Strong ...

/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets Experience with big data technologies such as: Hadoop, Hive, Spark, EMR Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting ...

focus on production reliability. Essential skills and experience Strong hands-on experience developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge … software development tools. Exposure to agentic AI, workflow orchestration or retrieval-augmented generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions ...

Points For Expertise in data modelling, schema design, and working with structured and semi‐structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating cloud-based ingestion and transformation frameworks. Experience delivering data engineering solutions within highly regulated industries such ...

Points For Expertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within highly regulated industries ...

Programming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice‐to‐have Strong understanding of machine learning methods and experience applying them ...

analytics, or data science, with the ability to work effectively with various data types and sources. Experience using big data technologies (e.g. Hadoop, Spark, Hive) and database management systems (e.g. SQL and NoSQL). Graph Database Expertise : Deep understanding of graph database concepts, data modeling, and query languages (e.g. ...

design, design patterns, core programming concepts Experience delivering analytical use cases in a cloud-based environment Bonus experience Exposure to Hadoop technologies (e.g., HDFS, Hive, HBase) or experience with high-volume, low-latency data storage and analytics platforms Exposure to GCP cloud tooling (e.g., Cloud DataFlow, BigQuery) Benefits What ...

Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion for mentoring ...

improve productivity while maintaining appropriate human oversight, governance, and solution quality. Bonus Points For Development experience using Scala or Java. Familiarity with Cloudera, Hadoop, Hive, Spark, and related distributed data ecosystems. Experience working with sensitive data and applying data privacy regulations, including GDPR. Curiosity to explore new technologies, including ...

eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video,etc. Knowledge of machine learning modelling techniques ...

design, development, and optimization of our data infrastructure in a hybrid role based in Hounslow. You will build scalable pipelines with Spark, Hadoop, Hive, and AWS, maintain data warehouses on Oracle/SQL Server, and drive data quality and security. You will leverage Informatica and scripting in Python ...

/Azure also relevant). Containerisation & orchestration: Kubernetes, Docker. Strong CICD exposure: GitHub, Terraform, automated pipelines. Familiarity with SQL/NoSQL databases (e.g. Bigtable, Hive). Experience working in Agile environments (Scrum, Kanban, or stream-aligned team models). Nice to Have ✔️ Experience with predictive analytics/big data ...

Practical software development and machine learning experience (e.g. python, tensorflow, pytorch). Familiarity with SQL and large-scale data processing technologies such as Hadoop, Hive, Impala, Scala, Spark etc. Technology leadership experience from defining market driven visions/goals to the implementation of solutions in a production environment ...

understanding of high-concurrency, high-throughput, mission-critical, and zero-downtime systems. Think in distributed systems: Apply practical knowledge of Spark, Hadoop, HBase, HDFS, Hive, Impala, and adjacent data-processing ecosystems to solve complex customer problems. Win technical evaluations: Guide enterprise prospects through demanding architecture reviews, competitive bake-offs ...

experience in deploying and maintaining machine learning models in production environments·Processing massive amounts of structured and unstructured data using Spark/SQL/Hive·Familiar with offline (batch) and online (live/stream) data pipelines·Writing production code in Python·Understanding the full software development life-cycle (conduct ...

generation of Big Data Analytics solutions tailored to our client needs. Development: Create MR1/YARN applications using Java, Scala, or Python. Additionally, develop Hive and Impala scripts. Project Leadership: Take charge of the end‐to‐end successful delivery of Information Management and analytics, specifically focusing on Big Data ...

Data, Data Warehousing, Business Intelligence, Machine Learning). Data Ecosystems: Familiarity with modern data architectures and tools, such as Big Data frameworks (Hadoop, Spark, Hive, BigQuery), Data Warehouses, and Machine Learning. Role Qualifications Industry Experience: 10+ years of experience in the Manufacturing and broader industrial supply chain environment. Sales ...

will own data lifecycle, building scalable pipelines and ensuring governance in a regulated financial environment. You'll work with Python, Spark, Kafka, NiFi, Hadoop, Hive, and modern data-platform technologies, delivering production-grade controls and observability. #J-18808-Ljbffr ...

Python ML libraries (scikit‐learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data(image, audio, video ...