76 to 96 of 96 Hadoop Jobs

reconciliation data platform built on Scala Spark. We are currently on an ambitious journey to migrate and modernize our platform from a legacy Cloudera Hadoop environment to Databricks on AWS — adopting cloud-native patterns, simplifying pipelines, and unlocking new capabilities along the way. The work is technically complex, high … scalable engineering solutionsWhat Makes Our Team Interesting:We are working on a high-impact, technically challenging modernization — moving a production-grade reconciliation platform from Hadoop to Databricks on AWSThe domain — data reconciliation at scale — is inherently complex and intellectually rewarding, involving large datasets, performance-critical pipelines, and precision engineeringWe ...

team. What We’re Looking For Proficient in one of Python, Scala or Java, with strong experience in Big Data technologies such as Spark, Hadoop etc. Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis). Proficiency in AWS cloud environments. Proven experience developing … GDPR. Bonus Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. ...

this role, so we need to see multiple full life-cycle projects across Insurance technology stack, ie, Guidewire, Duck Creek, MuleSoft, BizTalk, webMethods, Hadoop, Terradata, Earnix, Radar, Opentext etc. We also require a Programme Director that knows Agile, DevOps and someone that has Cloud experience too. Our client ...

Enterprise Business Development Manager Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are amongst the fastest growing company among the Silicon Valley ...

Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are amongst the fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented ...

ready to support advanced analytics and business insights. Responsibilities Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data. Collaborate with cross-functional teams to understand data requirements and translate them into … best practices in database design and management. Lead efforts in integrating diverse data sources through tools like Informatica and manage big data ecosystems involving Hadoop clusters. Conduct analysis of complex datasets to uncover insights that drive strategic business decisions. Experience Proven experience as a Data Engineer ...

related technologies. You will ingest structured and unstructured data into our data lake and collaborate with Machine Learning Engineers and Data Scientists in Hadoop, Spark, Teradata, GCP, and Azure environments. You should be passionate about developing new solutions, evaluating new tech, and translating data into analytics opportunities. What … Develop high-quality, reusable data pipelines at scale and ingest data into the data lake Collaborate with Machine Learning Engineers and Data Scientists in Hadoop, Spark, Teradata, GCP, and Azure Evaluate new technologies and translate data into analytics-based opportunities Essential experience Good coding/scripting experience using Python ...

Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro … Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro ...

Role Overview Experian Credit Services & Verifications are looking for a Lead Data Platform Engineer to provide hands‐on technical leadership for a new fraud data capability that will connect fraud‐related data assets into Experian ...

Company DescriptionExperian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many ...

Adaptavate is seeking a Data Engineer to turn raw data into actionable insights within our Technical team. You will build data pipelines, run ETL tasks, and design an integrated data platform to support decision making ...

extensive experience delivering large-scale programmes (>£50m) in the insurance sector, with full life-cycle insurance tech stacks (Guidewire, Duck Creek, MuleSoft, BizTalk, webMethods, Hadoop, Teradata, Earnix, Radar, OpenText). Strong Agile, DevOps and cloud credentials are required, with ability to engage the C-suite and coordinate #J ...

Java development Deep expertise in Kafka Commitment to writing high-quality, maintainable code Experience or strong interest in low-latency systems Bonus: Familiarity with Hadoop Client: FinTech Firm Salary: Up to £130,000 + Bonus Location: Hybrid (London) Experience: 6-30+ Years #J-18808-Ljbffr ...

Company DescriptionExperian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many ...

more years of experience with a PhD. PhD degree in computer science or relevant area. Experience in solving data problems using data technologies (e.g., Hadoop, Hive, Kafka, Redis, NoSQL, RDBMS). Experience with Big Data and Analytics in general leveraging technologies like Hadoop, Spark, Flink and MapReduce. Information ...

simplifies the execution of Spark jobs, facilitating the analysis of terabytes of data with ease and cost-effectiveness. The runtime environment is based on Hadoop clusters on EC2 spot instances, dynamically scaling up as required, ensuring high resource utilization and stability. Our team is responsible for the development … implementing computational improvements Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others Acting as an expert on Spark and Scala Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions ...

A leading consulting firm is seeking a Senior Data Engineer to design and build AWS-based data pipelines in a hybrid model. The role involves collaborating with clients to gather requirements and applying AWS principles ...

minimal support.A core component of the role is applying, modifying, and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary focus will be forecasting and related statistical or probabilistic modelling, with a strong emphasis on rigorous … minimal support.A core component of the role is applying, modifying, and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary focus will be forecasting and related statistical or probabilistic modelling, with a strong emphasis on rigorous ...

with ML platforms such as CML, SparkMLlib, and Python ML libraries (scikit‐learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell … . Collaborate closely with data scientists tooperationalize machine learning models using Cloudera Machine Learning(CML). Perform performance tuning and optimization of dataapplications on Hadoop to ensure optimal resource utilization. Technopals Pte.Ltd. is an Equal Opportunity Employer and does not discriminate on the basis of race or ethnicity, religion ...

Position: Solutions Architect II - AMZ27770.1 Location: Atlanta, GA Multiple Positions Available: Act as a technical liaison between customers, service engineering teams and support. Analyze application portfolios, identify dependencies and common infrastructure platform components, and access ...

data ecosystem to work in a customer facing capacity.Our customers, who are on their journey to become a data-drivenorganisation often leverage Hadoop as a part of the overall architecture. As an architect, you will be the link between business, big data developers & data scientists. You will be able … experience in consultative technical sales or professional services with a proven record of success Commercial solution architecture experience in Big Data technologies e.g. Spark, Hadoop, EMR, MapR etc. Strong verbal and written communications skills are a must, as well as the ability to lead effectively across internal and external ...