1 to 25 of 28 Hadoop Jobs in London

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting tools (e.g. Tableau, PowerBI ...

deployment and monitoring using CI/CD tools and infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark) Track record of collaborating with cross-functional teams (engineering, analytics, business stakeholders) to deliver ...

comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant What We Are Looking ...

Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across GCP, AWS, or Azure . Experience with Databricks, Snowflake, or Hadoop ecosystems . Knowledge of data ingestion, ETL/ELT frameworks, and batch/real-time processing. Applications are now open. ...

Life Sciences. Experience working for a software vendor, SaaS provider, or professional services organisation. Familiarity with Ataccama or similar enterprise data platforms. Exposure to Hadoop/Spark, NoSQL, XSLT, Hive, Kafka, Snowflake, or Databricks. Python or other programming languages. Familiarity with SDLC, code management and upgrades, and Unix/ ...

grade data platforms — ingestion, transformation, orchestration, governance through Unity Catalog, and downstream BI/ML enablement. Lead large-scale migrations (legacy DW/ETL, Hadoop, on-prem estates) and cloud transformation projects to Databricks on Azure/AWS/GCP, including assessment, wave planning, and cutover. Stay hands ...

based ensembles (and experience applying them with packages like Pandas, sci-kit-learn, SciPy) is highly beneficial Experience processing big data, ideally in a Hadoop/Spark environment, would be beneficial Proven experience implementing CI/CD and DevOps practices, with the ability to improve deployment reliability, testing standards ...

Strong understanding of Apache HTTP, Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data formats. Knowledge of Iceberg, Databricks, and Hadoop ecosystems. Skills that will help Follows TDD, ATDD and Clean Coding practices and used to setting up or working in an environment using ...

Artificial Intelligence modeling techniques (logit, GLM, time series, random forests, clustering, XGBoost), statistical programming languages (SAS, R, Python, Matlab), big data tools and platforms (Hadoop, Hive, etc.) and cloud platforms (AWS, Azure, GCP). Solid academic record. Strong computer skills. Postgraduate studies and/or specialized courses ...

Government, Public Sector, Security, Justice, Defence, Healthcare or other similarly challenging environments . Experience with large-scale data technologies such as SQL, Spark or Hadoop would also be beneficial. About You You will be a technically credible leader who is still comfortable getting into the detail. You will understand ...

Preferred: Experience in supply optimisation, pricing, marketplace analytics, or a related domain Familiarity with big data querying tools such as Presto, Hive, BigQuery, or Hadoop Exposure to Bayesian methods, causal inference, or multi-armed bandit approaches Experience collaborating with Machine Learning Data Science teams to validate and scale models ...

Preferred: Experience in supply optimisation, pricing, marketplace analytics, or a related domain Familiarity with big data querying tools such as Presto, Hive, BigQuery, or Hadoop Exposure to Bayesian methods, causal inference, or multi-armed bandit approaches Experience collaborating with Machine Learning Data Science teams to validate and scale models ...

improvements and automation Strong Python development skills (including Pandas and related data-processing libraries). Experience with big data technologies such as Spark, PySpark, Hadoop, and Hive. Exposure to quantitative modelling or financial modelling is a plus but not required. Skills that will help: Global Risk Management experience Benefits ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

related fields. 5+ years of experience in Big Data; prior experience with Tier-1 Cloud Service Providers (CSPs) is highly preferred. Expertise in the Hadoop ecosystem and deep understanding of components like Spark, Flink, Elasticsearch, Doris, ClickHouse, and Trino., Strong knowledge of big data architecture, including Data Lake (Iceberg ...

from kernel, networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow ...

role. You will lead requirements for the Treasury Analytics Group, support FIS Quantum & TBSM, and work on a new risk/analytics platform using Hadoop, Spark, and NoSQL tools. The role reqs 5+ years of experience, Linux/Oracle/MS SQL, ITIL, and scripting with Java/Python. ...

stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL We recognize that our people are our strength ...

experience with modeling tools such as Python, PyTorch, TensorFlow, scikit‐learn, etc. Hands‐on experience building large‐scale distributed machine learning systems such as Hadoop, Spark, etc. Effective communication skills in Chinese. Equal Opportunity Employment At JD.com, we’re committed to building a diverse and inclusive workplace where everyone ...

Experience with building highly scalable distributed systems and batch processing pipelines with a focus on data integrity Experience with multiple data storage technologies (MySQL, Hadoop, Cassandra) Experience with AWS (DynamoDB, RDS, Step functions, EC2, Kinesis) is a plus. Experience with unit, integration, and end-to-end testing paradigms Experience ...

architecture design. Experience with RDS like MySQL or PostgreSQL, and experienced with NoSQL like Redis or MongoDB. Familiarity with BigData technologies like Hadoop eco-system is a plus. #J-18808-Ljbffr ...

Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are amongst the fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented ...

growing and future needs of the department. This is an exciting opportunity to work on cutting edge technologies including Big Data and NoSQL databases (Hadoop, HBase, Hive, Spark and MongoDB) to allow the business to gain advanced insight into their portfolios and valuation metrics. Key responsibilities include:* Lead business … Skills:*** Experience in FIS Quantum application* Experience in financial services industry, specifically in Capital Markets and Treasury* Experience with Big Data and NoSQL databases (Hadoop/HBase/Spark) and Spark SQL is a bonus* Familiarity with other programming languages is a plus (e.g., Python)* Practical experience of support ...

Job Description New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location ...