18 of 18 Hadoop Jobs in London

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc.Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting tools (e.g. Tableau, PowerBI, Qlik ...

quality checks into pipelines. Knowledge of cloud infrastructure (AWS, Azure, or GCP) and database technologies including relational and non-relational stores such as Postgres, Hadoop, Elasticsearch, and Graph databases. Solid understanding of coding best practices, design patterns, CI/CD tooling, versioning, dependency management, error handling, monitoring, and alerting. ...

Implement job orchestration using Databricks Workflows, Airflow, AWS Step Functions, or similar tools. Manage secrets, environment variables, and secure connections. Support migration from legacy Hadoop/Spark platforms to Databricks on AWS, if required. 'We are a Disability Confident Employer: Capgemini is proud to be a Disability Confident Employer ...

skills in Python, with a command of data science libraries (e.g., Pandas, NumPy, Scikit‐learn). Experience with big data technologies (e.g., Spark, Trino, Hadoop) and ideally cloud platforms (e.g., AWS, GCP, Azure) for scalable data processing, storage, and model deployment. Ideally having understanding and practical experience with graph ...

skills in Python, with a command of data science libraries (e.g., Pandas, NumPy, Scikit‐learn). Experience with big data technologies (e.g., Spark, Trino, Hadoop) and ideally cloud platforms (e.g., AWS, GCP, Azure) for scalable data processing, storage, and model deployment. Ideally having understanding and practical experience with graph ...

unstructured datasets. Strong stakeholder management and communication skills. Desirable Insurance or financial services experience, ideally within pricing, underwriting, fraud, or claims. Experience with Spark, Hadoop, NoSQL, or modern big data platforms. Agile delivery experience and collaborative software development practices. Experience leading analytics teams and driving organisational change. Robert Walters ...

tree-based ensembles (and experience applying them with packages like Pandas, sci-kit-learn, SciPy) is highly beneficialExperience processing big data, ideally in a Hadoop/Spark environment, would be beneficialProven experience implementing CI/CD and DevOps practices, with the ability to improve deployment reliability, testing standards ...

with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink, Hadoop, Cassandra, etc. Other Relevant Job Details For additional information about location requirements, please discuss with the recruiter following submission of your application. Some travel ...

emerging data technologies, products and delivery approaches Familiarity with cloud platforms such as Azure, AWS or GCP, alongside technologies including Databricks, Snowflake, Power BI, Hadoop, SQL and Python Experience working with delivery methodologies including Agile, SAFe and Waterfall Strong proficiency with tools such as Jira, Confluence and Planview ...

proficiency in machine learning frameworks and programming languages such as Python, R, or similar. Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL). Familiarity with anomaly detection, supervised, unsupervised learning methods, deep learning, and graph based solutions Demonstrated ability to work collaboratively in cross ...

proficiency in machine learning frameworks and programming languages such as Python, R, or similar. Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL). Familiarity with anomaly detection, supervised, unsupervised learning methods, deep learning, and graph based solutions Demonstrated ability to work collaboratively in cross ...

About the Job you are considering: Results-driven Hadoop Data Engineer with experience designing, developing, and maintaining large-scale data processing solutions for financial services organizations. Skilled in building robust data pipelines, managing big data platforms, and transforming high-volume structured and unstructured financial data into actionable insights. Proficient … Hadoop ecosystem technologies including HDFS, Hive, Spark, Sqoop, Kafka, Oozie, and YARN , along with SQL and cloud-based data platforms Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend ...

Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists and engineering teams Opportunity to shape platform ...

Strong technical skills in Python and SQL, including building data pipelines and working with large-scale datasets and distributed data platforms (e.g., BigQuery, Snowflake, Hadoop or similar) Experience applying data science, machine learning, or data engineering approaches within data-intensive domains such as Finance or Operations Proficiency with ...

stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL Level of experience Senior (5+ years of experience) Tagged ...

Experience with modeling tools such as R, scikit‐learn, Spark MLLib, MxNet, TensorFlow, NumPy, SciPy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting ...

qualifications, capabilities, and skills \n \n Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) \nExperience of big data technologies (e.g. Spark, Hadoop)Have constructed batch and streaming microservices exposed as REST/gRPC endpointsFamiliarity with GraphQL\n #CIBAppliedAI \n ABOUT US \n J.P. Morgan ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...