big data technology with experience ranging from platform architecture, data management, data architecture and application architecture High Proficiency working with Hadoop platform including Spark/Scala, Kafka, SparkSQL, HBase, Impala, Hive and HDFS in multi-tenant environments Solid base in data technologies like warehousing, ETL, MDM, DQ, BI and analytical tools extensive experience in metadata management and data quality More ❯
translating complex technical issues for non-technical audiences. Self-motivated and able to work independently. Preferred Qualifications: Background in investment banking or financial services. Hands-on experience with Hive, Impala, and the Spark ecosystem (e.g., HDFS, Apache Spark, Spark-SQL, UDFs, Sqoop). Proven experience building and optimizing big data pipelines, architectures, and data sets. More ❯
Belfast, County Antrim, Northern Ireland, United Kingdom
Hays
delivery. Essential Criteria 5+ years of experience in Technical Data Analysis. Proficiency in SQL, Python, and Spark. Experience within an investment banking or financial services environment. Exposure to Hive, Impala, and Spark ecosystem technologies (e.g. HDFS, Apache Spark, Spark-SQL, UDF, Sqoop). Experience building and optimizing Big Data pipelines, architectures, and data sets. Familiarity with Hadoop and Big More ❯
development working in Low latency applications Financial background preferable Spark expertise (micro batching, EOD/real time) Python In-memory databases SQL Skills & RDBMS concepts Linux Hadoop Ecosystem (HDFS, Impala, HIVE, HBASE, etc.) Python , R or equivalent scripting language(s) Excellent Excel Analysis skills Good understanding of Investment Banking data A history of delivering against agreed objectives Ability to More ❯
Tools, Monitoring utilities, Disaster recovery process/tools Experience in troubleshooting and problem resolution Experience in System Integration Knowledge of the following: Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming Experience of ETL tools incorporating Big Data Shell Scripting, Python Beneficial Skills: Understanding of: LAN, WAN, VPN and SD Networks Hardware and Cabling set-up More ❯
These are ourvalues and influence everything we do. Preferred Qualifications Experience with PL/SQL or other database procedural language Experience with Hadoop technologies such as HDFS, Pig, Hive, Impala and management of the Hadoop system. Experience with Azure, AWS, or OCI including their native database services. Experience with Snowflake Experience with Kafka and Elasticsearch Experience with SAS software More ❯
in Hadoop, Spark, and related technologies YOUR PROFILE Expertise on Hadoop, Spark & Scala Experience in developing complex data transformation workflows(ETL) using Big Data Technologies Good expertise on HIVE, Impala, HBase Hands on experience to finetune Spark jobs Experience with Java and distributed computing ABOUT CAPGEMINI Capgemini is a global business and technology transformation partner, helping organizations to accelerate More ❯
is preferred High level of competence in SQL, Python, Spark/Scala, and Unix/Linux scripts Real world experience using Hadoop and the related query engines (Hive/Impala) for big data processing Ability to construct model features utilizing open-banking data, in-house data,and/or third-party data to enhance rules and models Experience utilizing More ❯
RDBMS such as DB2, Oracle. • Exposure and hands on in Microservices, Distributed Cache (REDIS, Couchbase) and Cloud technologies • Good to have knowledge and experience in Big data - HBASE and Impala concepts. • Experienced with XML parsing (including schemas), JSON and third-party libraries like Gauva, lombok. • Well versed with design standards & frameworks; experience in working on multiple technologies. • Quick learner More ❯
for containerization Experience with Microsoft-based infrastructures (not open-source) Desirable Skills: Background in financial services, particularly Market Risk Knowledge of Chef, Ansible, SQL, and Hadoop ecosystems (HDFS, Hive, Impala) Understanding of observability tools (Elasticsearch, Filebeat, Kibana) Familiarity with network protocols and certificate/SSH key management More ❯
over 12,000 people working across more than 60 offices. The Trafigura Group owns global multi-metals producer Nyrstar; fuel storage and distribution company Puma Energy; and joint ventures Impala Terminals, a port and logistics provider, and Nalo Renewables, investing in wind, solar and battery storage projects. More ❯
Science, Statistics, Applied Mathematics, or Engineering - Strong experience with Python and R - A strong understanding of a number of the tools across the Hadoop ecosystem such as Spark, Hive, Impala & Pig - An expertise in at least one specific data science area such as text mining, recommender systems, pattern recognition or regression models - Previous experience in leading a team, ideally More ❯
over 12,000 people working across more than 60 offices. The Trafigura Group owns global multi-metals producer Nyrstar; fuel storage and distribution company Puma Energy; and joint ventures Impala Terminals, a port and logistics provider, and Nalo Renewables, investing in wind, solar and battery storage projects. More ❯
over 12,000 people working across more than 60 offices. The Trafigura Group owns global multi-metals producer Nyrstar; fuel storage and distribution company Puma Energy; and joint ventures Impala Terminals, a port and logistics provider, and Nalo Renewables, investing in wind, solar and battery storage projects. #J-18808-Ljbffr More ❯
over 12,000 people working across more than 60 offices. The Trafigura Group owns global multi-metals producer Nyrstar; fuel storage and distribution company Puma Energy; and joint ventures Impala Terminals, a port and logistics provider, and Nalo Renewables, investing in wind, solar and battery storage projects. More ❯
over 12,000 people working across more than 60 offices. The Trafigura Group owns global multi-metals producer Nyrstar; fuel storage and distribution company Puma Energy; and joint ventures Impala Terminals, a port and logistics provider, and Nalo Renewables, investing in wind, solar and battery storage projects. More ❯