17 of 17 Permanent Hadoop Jobs in the City of London

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

environments (AWS, Azure, GCP) including services like S3, BigQuery, Azure ML, etc. Solid understanding of data engineering principles , SQL, and distributed computing frameworks (Spark, Hadoop). Experience in consulting or client-facing roles , with ability to manage stakeholders and deliver strategic insights. Strong knowledge of machine learning algorithms , statistical ...

Strong proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms like Azure. Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Proficiency in SQL and database management systems. Familiarity with data warehousing concepts and tools. Ability to work collaboratively with cross-functional ...

Palantir Foundry (full training provided). Familiarity with AI/ML Ops pipelines , real-time analytics, or edge deployments. Big Data stack knowledge (e.g., Hadoop, Spark, Kafka). GenAI/LLM experience (e.g., AWS Bedrock, LangChain). Why this is a great move 🌳 Mission & impact: Work on projects where ...

techniques. Cloud & MLOps: Experience with AWS, GCP, or Azure; Docker/Kubernetes; MLflow or similar tools. Data Handling: Familiarity with big data frameworks (Spark, Hadoop) and data versioning tools (DVC). Soft Skills: Strong problem-solving, communication, and ability to work in agile teams. Preferred Qualifications Experience with transformer ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

platforms (Azure, AWS, GCP) and data migration tools (Azure Data Factory, Informatica, Talend, etc.). Proficiency in SQL , Python , and big data technologies (Spark, Hadoop). Knowledge of data governance , security , and compliance frameworks . Excellent communication and stakeholder management skills. Preferred Qualifications Experience with modern data platforms (Snowflake ...

platforms like AWS, Azure, or Google Cloud. Data Modeling: Knowledge of data modeling principles and techniques. Big Data: Experience with big data technologies like Hadoop, Spark, etc. Data Governance: Understanding of data governance principles and practices. Data Security: Knowledge of data security principles and best practices. Project Management: Experience ...

/B Testing, Statistics, Google Cloud Platform, Google Big Query, Agile Development, DevOps, Date Engineering, ETL Data Processing Strong Migration experience of production Hadoop Cluster to Google Cloud. Relevant Certifications Certifications: Google Professional Cloud architect ...

accelerators for common BFSI use cases (customer 360, finance reporting, regulatory packs). Your Profile Essential skills/knowledge/experience: Experience on Hadoop based architecture is desirable. Experience on Any one of On-prem Tech – Oracle Exadata, Teradata, SAP Hana or Netezza desirable. Hands-on experience in Data ...

15. Experience in DevOps and release pipelines 16. Apache Camel 17. Postgresql Good to Have: 1. OBIEE Knowledge 2. TOGAF Certified 3. Splunk 4. Hadoop/EMR/Apache Spark Experience 5. Machine learning and Analytics Profile Summery: 1. The Software Architect should be responsible for making intuitive high ...

Infrastructure as Code tools like Terraform and CloudFormation . The candidate will automate deployments and CI/CD pipelines, configure and tune Cloudera and Hadoop services, manage cluster operations, security (Kerberos/Ranger), and troubleshoot performance issues. Strong hands-on experience with AWS services, DevOps practices, scripting (Python/ ...

Job description S.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers. As a Lead Data Engineer you'll play a pivotal role in helping public sector organisations become truly data-lead, by ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

generative AI applications. - Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow … Ensure scalability, security, and compliance of AI systems. Required Skills: Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree ...

Programming: Python (Java familiarity is a plus). AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different Direct Impact: Build AI tools that traders and quants use daily to optimise strategies. Creative Freedom: Open collaboration … either engineering or analytical roles. Passion for being hands-on and contributing to a collaborative engineering culture. Nice to Have Experience with on-prem Hadoop and Kubernetes. Familiarity with AWS cost management and optimisation tools. Knowledge of front-office developer workflows in financial services. ...

Programming: Python (Java familiarity is a plus). AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different Direct Impact: Build AI tools that traders and quants use daily to optimise strategies. Creative Freedom: Open collaboration … Functions, MSK, CloudFormation). Passion for being hands-on while enabling and growing a small engineering team. Nice to Have Experience with on-prem Hadoop and Kubernetes. Familiarity with AWS cost management and optimisation tools. Knowledge of front-office developer workflows in financial services. ...