1 to 25 of 26 Hadoop Jobs in the UK

platforms. Strong expertise in SQL, data modelling, and database optimisation (relational, vector and NoSQL). Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data ...

Java/Scala. Databases: Experience across Relational (SQL), NoSQL (MongoDB/Cassandra), and Graph (Neo4j). Big Data: Hands-on experience with Hadoop or Spark. Infrastructure: Comfortable with Linux/Bash, Docker, and Cloud IaaS/PaaS environments. Integrations: Familiarity with BI tools (PowerBI/Tableau) and integration platforms ...

management tools Strong expertise in SQL, data modelling, and database optimisation (relational, vector and NoSQL) Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop) Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services, with proven data governance and security practices Strong programming skills ...

with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes) Experience working in secure or regulated environments Exposure to big data technologies (Spark, Hadoop) and Apache tools Familiarity with Agile and DevOps practices Industry certifications (e.g., TensorFlow Developer, AWS Machine Learning Specialty) Knowledge of NLP, computer vision ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

with stakeholder engagement and solution design. Key Responsibilities Build and optimise data pipelines, ETL processes, and data platforms Develop solutions using Python, Spark, Kafka, Hadoop or similar Work in Agile teams to deliver production-ready systems Translate business requirements into technical data solutions Engage with stakeholders and communicate technical ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

work with modern, “shiny” tools and influence what we adopt next. Use workflow tools such as ADF/Airflow and big data technologies (Spark, Hadoop, Kafka) Private healthcare for you and your family Company pension scheme Flexible benefits (gym membership, tech, health assessments and more) Access to an online ...

with stakeholder engagement and solution design. Key Responsibilities Build and optimise data pipelines, ETL processes, and data platforms Develop solutions using Python, Spark, Kafka, Hadoop or similar Work in Agile teams to deliver production-ready systems Translate business requirements into technical data solutions Engage with stakeholders and communicate technical ...

Knowledge of MLOps, DevOps, CI/CD, and automated model pipelines within Foundry and cloud-based environments. Familiarity with big data ecosystems (Foundry, Spark, Hadoop) and commercial data source integration. ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka). Experience of Waterfall and Agile delivery methodologies Contact: Please apply via the link or contact (url removed) for more information. Modis ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. Minimum 5 years in Big Data technologies (e.g., , Hadoop). Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. Minimum 5 years in ML model development, data ...

Senior Data Engineer - Geospatial and Big Data We are seeking an experienced Senior Data Engineer to help develop and scale a data platform focused on geospatial and sensor analytics. The role involves building end-to ...

Technical Self-Assessment (1-10) Candidates will be asked to rate their knowledge of: Languages: Python, Java, Scala Compute/Distributed: RAY , Spark, Databricks, Hadoop Orchestration/Cloud: Kafka, Airflow, Prefect, AWS Storage/Warehouse: Clickhouse, Snowflake, Redshift, Greenplum Note: Experience with Petabyte/Exabyte scale is a strong ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

DataWorks DevOps requires demonstrable experience of: AWS CI/CD deployment pipelines such as GitLab CI and Concourse Terraform Big data tooling such as Hadoop, Hive, Spark and ideally Amazon EMR or equivalent Strong Linux experience Kubernetes/EKS or other container services would also be helpful ...

Agile ceremonies and actively engage with the team. Must Have Skills: Hands-on experience with Cloudera Data Platform (CDP) on AWS or recent Hadoop administration on similar platforms. AWS administration and platform management experience. Strong experience in Spark, Airflow, Apache Ranger, Impala (AWS CDK is a plus). Agile ...

with stakeholder engagement and solution design. Key Responsibilities Build and optimise data pipelines, ETL processes, and data platforms Develop solutions using Python, Spark, Kafka, Hadoop or similar Wo click apply for full job details ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Science (IT/Computer Science/Engineer) Employment Type: Full-Time UK based candidates only. Role Overview: We are seeking an experienced Scala/Hadoop/Big Data Developer . The role will focus on building and enhancing data-driven solutions, working within a fast-paced financial services environment. … Responsibilities: Design, develop, and maintain applications using Scala, Python, Hadoop and Java . Work with Big Data technologies , including Spark, Hive (nice to have). Collaborate with cross-functional teams to deliver scalable, high-performance solutions. Participate in code reviews, testing, and performance optimization. Ensure best practices in coding ...

driven trading. Tech Stack Programming: Python AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and Databricks On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. What we are looking for 5 – 10 years of experience in data engineering, ideally in platform or infra roles. Strong programming skills in Python; passion … life. Visibility: Be a big player in a small, high-impact team with exposure across the organisation. Nice to Have Experience with on-prem Hadoop and Kubernetes. Familiarity with AWS cost management and optimisation tools. Knowledge of front-office developer workflows in financial services. ...

Hands-On Experience with Deep Learning Frameworks (TensorFlow, PyTorch, XGBoost) Deep Knowledge of Data Warehousing, ETL/ELT Architectures & Heavy Analytic Environments (Apache Beam, Hadoop, Spark, Hive) Responsibilities: Leading Customer-Facing AI Deployments across Europe, from the Initial Consulting Phase right through to the Live Implementation of Production … Systems Architecting & Optimising Scalable Data Pipelines, ETL/ELT Solutions & Distributed ML Environments (using Hadoop, Spark & Apache Beam). Deploying Recommendation Engines & Deep Learning Models (TensorFlow, PyTorch) to solve specific Client Problems. Running Technical Design Sessions, Tailoring ML Ops Architectures using Vertex AI & Gen AI. Writing Automation-Focused Code ...

Programming: Python (Java familiarity is a plus). • AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. • On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different • Direct Impact: Build AI tools that traders and quants use daily to optimize strategies. • Creative Freedom: Open collaboration … Functions, MSK, CloudFormation). • Passion for being hands-on while enabling and growing a small engineering team. Nice to Have • Experience with on-prem Hadoop and Kubernetes. • Familiarity with AWS cost management and optimisation tools. • Knowledge of front-office developer workflows in financial services. ...