20 of 20 Permanent Hadoop Jobs in the UK

NoSQL technologies Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) Experience with big data technologies such as Spark, Hadoop, or Kafka Proficiency with ETL/ELT tools and frameworks (e.g. Airflow, dbt, Informatica) Strong programming skills in Python, Java, Scala, or similar Experience ...

event ingestion. Cloud Storage: For scalable and durable object storage. Cloud Composer (Apache Airflow): For workflow orchestration and pipeline management. Cloud Dataproc: For managed Hadoop and Spark clusters (good to have). Cloud SQL/Cloud Spanner/Cloud Bigtable: Experience with relational and NoSQL databases. Strong proficiency ...

platforms. Strong expertise in SQL, data modelling, and database optimisation (relational, vector and NoSQL). Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data ...

desirable. Desirable STEM/Data/AI‐related degree. Experience influencing technical design decisions. CI/CD exposure. Familiarity with big data ecosystems (Spark, Hadoop, NiFi). Knowledge of Kubernetes, IaC (Terraform/Ansible), or ML deployment patterns. ...

applying emerging ML techniques. Desirable: Experience with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes). Exposure to big data technologies (Spark, Hadoop) and Apache tools. Knowledge of NLP, computer vision, and deep learning architectures. Familiarity with Agile and DevOps practices. STEM degree or equivalent experience ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

with stakeholder engagement and solution design. Key Responsibilities Build and optimise data pipelines, ETL processes, and data platforms Develop solutions using Python, Spark, Kafka, Hadoop or similar Work in Agile teams to deliver production-ready systems Translate business requirements into technical data solutions Engage with stakeholders and communicate technical ...

manipulating, and preparing data from relational databases. Experience with NoSQL databases is a plus. Big Data/Cloud: Experience with big data tools ( Spark, Hadoop ) and cloud computing platforms ( AWS, Azure, or GCP ) for scalable ML workflows. Visualization: Ability to create clear, compelling data visualizations using tools like Matplotlib ...

workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka). Experience of Waterfall and Agile delivery methodologies Contact: Please apply via the link or contact (url removed) for more information. Modis ...

Server development Experience designing enterprise data architectures Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Experience leading data platform migrations Cloud architecture expertise ...

science or machine learning initiatives Experience with BI tools such as Tableau or Power BI Familiarity with big data tools such as Spark or Hadoop Knowledge of healthcare or NHS services Please note we will only progress applications from candidates who clearly meet the essential criteria outlined above. About … machine learning tools. Business intelligence tools: Experience of using tools like Tableau and Power BI. Big Data Tools: Familiarity with big data tools (e.g., Hadoop, Spark, Hive). NHS/Domain Knowledge: Knowledge of the health sector, NHS and the delivery of healthcare services in primary care and urgent ...

integration Python development experience Experience working in on-prem or hybrid environments (not purely cloud-based) Understanding of big data technologies such as Hadoop is beneficial Nice to have: Exposure to NLP, OCR or Generative AI Experience with containerisation tools like Docker Background in engineering, industrial or defence environments ...

Patterns) Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, Api Gateway, Step Functions, MSK, Cloudformation etc.) Experience with On-Prem Hadoop and Kubernetes. Strong programming skills in Python; familiarity with Java is a plus. Knowledge of how quantitative or front-office developers operate ...

support and migration experience Desirable knowledge and experience: AWS accreditation Knowledge of COTS products (including but not limited to; Elasticsearch, NiFi, Rabbit, Kafka, MongoDB, Hadoop, Ansible, Git and Kubernetes) Development of dashboards for monitoring and alerting through Grafana, Splunk, Prometheus and OpenText Om and Ops Bridge On prem ...

stakeholder engagement and solution design. Key Responsibilities Build and optimise data pipelines, ETL processes, and data platforms Develop solutions using Python, xkybehq Spark, Kafka, Hadoop or similar Wo Have you got the right qualifications and skills for this job Find out below, and hit apply to be considered. Please ...

About the Job you are considering: We are seeking a highly experienced Data Engineer ( Hadoop/Spark/Scala/Python) to join our Financial Services Data Practice. You will have deep hands‐on expertise in Hadoop, Spark, Scala, Python. Hybrid working: The places that you work from … needs, and those of the business; it will be a blend of Company offices, client sites, and your home. Your Role: Design and develop Hadoop based applications and data pipelines Build operate monitor and troubleshoot Hadoop clusters Write scalable ETL processes using tools like Hive Pig and Spark ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...