1 to 25 of 26 Hadoop Jobs in the UK

NoSQL technologies Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) Experience with big data technologies such as Spark, Hadoop, or Kafka Proficiency with ETL/ELT tools and frameworks (e.g. Airflow, dbt, Informatica) Strong programming skills in Python, Java, Scala, or similar Experience ...

Cloud) Understanding of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery) Strong problem-solving and analytical skills Preferred Skills Experience with big data technologies (e.g., Hadoop, Spark) Knowledge of data modeling techniques and schema design Familiarity with containerization tools (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices ...

event ingestion. Cloud Storage: For scalable and durable object storage. Cloud Composer (Apache Airflow): For workflow orchestration and pipeline management. Cloud Dataproc: For managed Hadoop and Spark clusters (good to have). Cloud SQL/Cloud Spanner/Cloud Bigtable: Experience with relational and NoSQL databases. Strong proficiency ...

platforms. Strong expertise in SQL, data modelling, and database optimisation (relational, vector and NoSQL). Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data ...

Java/Scala. Databases: Experience across Relational (SQL), NoSQL (MongoDB/Cassandra), and Graph (Neo4j). Big Data: Hands-on experience with Hadoop or Spark. Infrastructure: Comfortable with Linux/Bash, Docker, and Cloud IaaS/PaaS environments. Integrations: Familiarity with BI tools (PowerBI/Tableau) and integration platforms ...

applying emerging ML techniques. Desirable: Experience with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes). Exposure to big data technologies (Spark, Hadoop) and Apache tools. Knowledge of NLP, computer vision, and deep learning architectures. Familiarity with Agile and DevOps practices. STEM degree or equivalent experience ...

with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes) Experience working in secure or regulated environments Exposure to big data technologies (Spark, Hadoop) and Apache tools Familiarity with Agile and DevOps practices Industry certifications (e.g., TensorFlow Developer, AWS Machine Learning Specialty) Knowledge of NLP, computer vision ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

Knowledge of additional AWS services such as S3, Lambda, Athena, Kinesis, EMR, Fargate, or API Gateway. Experience with big data technologies including Spark, Databricks, Hadoop, or Dask. Familiarity with data visualisation tooling such as Plotly. Experience mentoring junior engineers or leading technical initiatives. What You’ll Receive Base salary ...

teams Cloud experience (AWS preferred: S3, Lambda, Athena, EMR, etc.) CI/CD and Infrastructure-as-Code (CDK, CloudFormation) Big data tools (Spark, Databricks, Hadoop, Parquet, etc.) API development and data integration (REST, web APIs) Interest in AI/ML systems and modern data tooling Experience mentoring or leading ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

with stakeholder engagement and solution design. Key Responsibilities Build and optimise data pipelines, ETL processes, and data platforms Develop solutions using Python, Spark, Kafka, Hadoop or similar Work in Agile teams to deliver production-ready systems Translate business requirements into technical data solutions Engage with stakeholders and communicate technical ...

manipulating, and preparing data from relational databases. Experience with NoSQL databases is a plus. Big Data/Cloud: Experience with big data tools ( Spark, Hadoop ) and cloud computing platforms ( AWS, Azure, or GCP ) for scalable ML workflows. Visualization: Ability to create clear, compelling data visualizations using tools like Matplotlib ...

workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka). Experience of Waterfall and Agile delivery methodologies Contact: Please apply via the link or contact (url removed) for more information. Modis ...

/B Testing, Statistics, Google Cloud Platform, Google Big Query, Agile Development, DevOps, Date Engineering, ETL Data Processing Strong Migration experience of production Hadoop Cluster to Google Cloud. Good To Have:- Expert in Big Query, Dataproc, Data Fusion, Dataflow, Bigtable, Fire Store, CloudSQL, Cloud Spanner, Google Cloud Storage, Cloud ...

Server development Experience designing enterprise data architectures Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Experience leading data platform migrations Cloud architecture expertise ...

science or machine learning initiatives Experience with BI tools such as Tableau or Power BI Familiarity with big data tools such as Spark or Hadoop Knowledge of healthcare or NHS services Please note we will only progress applications from candidates who clearly meet the essential criteria outlined above. About … machine learning tools. Business intelligence tools: Experience of using tools like Tableau and Power BI. Big Data Tools: Familiarity with big data tools (e.g., Hadoop, Spark, Hive). NHS/Domain Knowledge: Knowledge of the health sector, NHS and the delivery of healthcare services in primary care and urgent ...

DataWorks DevOps requires demonstrable experience of: AWS CI/CD deployment pipelines such as GitLab CI and Concourse Terraform Big data tooling such as Hadoop, Hive, Spark and ideally Amazon EMR or equivalent Strong Linux experience Kubernetes/EKS or other container services would also be helpful ...

integration Python development experience Experience working in on-prem or hybrid environments (not purely cloud-based) Understanding of big data technologies such as Hadoop is beneficial Nice to have: Exposure to NLP, OCR or Generative AI Experience with containerisation tools like Docker Background in engineering, industrial or defence environments ...

with stakeholder engagement and solution design. Key Responsibilities Build and optimise data pipelines, ETL processes, and data platforms Develop solutions using Python, Spark, Kafka, Hadoop or similar Wo click apply for full job details ...

About the Job you are considering: We are seeking a highly experienced Data Engineer ( Hadoop/Spark/Scala/Python) to join our Financial Services Data Practice. You will have deep hands‐on expertise in Hadoop, Spark, Scala, Python. Hybrid working: The places that you work from … needs, and those of the business; it will be a blend of Company offices, client sites, and your home. Your Role: Design and develop Hadoop based applications and data pipelines Build operate monitor and troubleshoot Hadoop clusters Write scalable ETL processes using tools like Hive Pig and Spark ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

manual Excel and macro-driven processes and replacing them with scalable, production-grade data pipelines. Required Skills & Experience Strong commercial Experience with: Python PySpark Hadoop Job Title: Data Engineer Location: Sheffield, UK Rate/Salary: 500.00 - 500.00 GBP Daily Job Type: Contract Trading as TEKsystems. Allegis Group Limited, Maxis ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...