1 to 25 of 30 Hadoop Jobs in London

traditional patterns remain appropriate – and where modern approaches add measurable value.Data Engineering & Platform Understanding:Strong knowledge of distributed processing (e.g. Apache Spark).Familiarity with Hadoop ecosystem components.Working knowledge of SQL and NoSQL technologies.Understanding of ETL/ELT design trade-offs.Awareness of DevOps practices and CI/CD for data ...

learning or data science.Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow).Strong experience with ...

technologies in scope include:Data processing and logic: ANSI SQL, Apache Spark, KafkaData formats: JSON, Avro, ParquetPlatforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQEngineering and deployment: CI/CD tooling, containerised or Kubernetes-based deployment approaches where relevantYou will also work with internal data management ...

software development lifecycleSolid background in Java/Scala and a scripting language like Python.Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc.Experience with relational SQL and NoSQL databases, including Postgres/ ...

Vault Kimball methodology Dimensional modelling Data warehousing principles Enterprise data architecture concepts Modernisation & Migration Experience Experience delivering migrations from legacy platforms such as: Teradata Hadoop Oracle SAS Preferred Experience Financial Services or Banking sector experience. Experience working within regulated environments. Large-scale cloud transformation programmes. Agile delivery methodologies. Working ...

analytical needs into scalable Databricks-based solutions.Your expertiseYou have:• proven experience with Azure and Databricks in large-scale data environments• strong understanding of Spark, Hadoop ecosystems and big data engineering concepts• hands-on data engineering experience• experience delivering at least one end-to-end Databricks project• strong knowledge ...

enabled tools responsibly to improve productivity while maintaining appropriate human oversight, governance, and solution quality.Bonus Points ForDevelopment experience using Scala or Java.Familiarity with Cloudera, Hadoop, Hive, Spark, and related distributed data ecosystems.Experience working with sensitive data and applying data privacy regulations, including GDPR.Curiosity to explore new technologies, including responsible ...

based ensembles (and experience applying them with packages like Pandas, sci-kit-learn, SciPy) is highly beneficial Experience processing big data, ideally in a Hadoop/Spark environment, would be beneficial Proven experience implementing CI/CD and DevOps practices, with the ability to improve deployment reliability, testing standards ...

Artificial Intelligence modeling techniques (logit, GLM, time series, random forests, clustering, XGBoost), statistical programming languages (SAS, R, Python, Matlab), big data tools and platforms (Hadoop, Hive, etc.) and cloud platforms (AWS, Azure, GCP). Solid academic record. Strong computer skills. Postgraduate studies and/or specialized courses ...

large-scale analytics platformsExpert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network GenerationExpertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearchStrong stakeholder management and communication skills - capable of interfacing with both business and technical audiences.The work is heavily weighted toward Financial Services, Fraud ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

languages such as Python, SQL, or SparkExpertise in data visualisation tools such as Qlik, Power BI (Business Intelligence) or TableauData engineering tools such as Hadoop, Kafka, SQLExperience of analytics and being able to review and present insights in large data sets formed of complex data, including with software such ...

related field, or experience in a professional field or military- Experience as technical specialist in design and architecture- Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis)- Experience in software development with object oriented language- Experience in cloud based solution (AWS or equivalent), system, network and operating system ...

Strong technical skills in Python and SQL, including building data pipelines and working with large-scale datasets and distributed data platforms (e.g., BigQuery, Snowflake, Hadoop or similar) Experience applying data science, machine learning, or data engineering approaches within data-intensive domains such as Finance or Operations Proficiency with ...

following would be beneficial but not essential:Working with big data technology, ideally Spark but others will also be useful such as Hadoop or ElasticsearchExperience with DevOps tooling and approaches (automation and tooling is something we are passionate about, we even have a dedicated Developer Tooling team)Building data ...

serious money doing something you are passionate about.My client is based in LondonFollow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...

Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc.- Experience with large scale distributed systems such as Hadoop, Spark etc.Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions ...

prior roles.Prior experience using causal inference/econometric techniques and bayesian methodologies for hypothesis testing.Prior experience using large datasets with distributed computing (e.g. spark, hadoop or other map-reduce tech)Experience working in a fast-moving tech company or startup.This role is a full-time role based in Sunnyvale ...

mindset: Exceptional teamwork skills for cross-functional projects in a fast-paced, global environment.Nice-to-Have:Experience with big data platforms (e.g., ELK, Splunk, Hadoop) for security analytics.Familiarity with enterprise security tools (SIEMs, EDR/XDR, firewalls) and cloud architectures.Knowledge of low-level systems (OS internals, CPU architectures ...

enhance collaboration and delivery.What We're Looking ForStrong proficiency in Python, Scala, or Java, with hands-on experience of Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks.Experience building real-time event streaming solutions using technologies such as Kafka, Spark Streaming, or Amazon Kinesis within AWS environments.Proven … practical, high-quality technical solutions.Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets.Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation.Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms.Experience delivering solutions within highly regulated ...

multi-threaded JavaAble to build to develop high throughput services where performance mattersExperienced with continuous integrationA strong communicatorAdditional exposure to the following is desired:Hadoop and FlinkJunit 5, Mockito, AvroLinux, JenkinsDocker, Kubernetes, PuppetInvolvement in the Java communityMy client is based London. ...

development experience ideally purely in RubyExperience designing and building Rails applicationsRubyJavascriptWorking knowledge of LinuxUnderstanding of Applications on AWSExperience with mobile applications would be beneficialCurrently Hadoop is used but not requiredThe environment is that of Facebook or Google, relaxed open with time to think and make the right decisions. ...

Rails application in a commercial environmentRubyJavascriptIdeally Angular or Node.jsHTMLCSSRails, jQuery,Version control using gitWorking knowledge of LinuxExperience with mobile applications would be beneficialCurrently Hadoop is used but not requiredThe environment is that of Facebook or Google, relaxed open with time to think and make the right decisions. The atmosphere ...

development experience ideally purely in RubyExperience designing and building Rails application could be at homeRubyJavascriptHTML5CSS3Working knowledge of LinuxExperience with mobile applications would be beneficialCurrently Hadoop is used but not requiredThe environment is that of Facebook or Google, relaxed open with time to think and make the right decisions. ...

Experience or ability to demonstrate mentoring experience – jQuery, – Version control using git – Working knowledge of Linux – Experience with mobile applications would be beneficial – Currently Hadoop is used but not requiredThe environment is that of Facebook or Google, relaxed open with time to think and make the right decisions. ...