1 to 25 of 26 Hadoop Jobs in the UK

NoSQL technologies Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) Experience with big data technologies such as Spark, Hadoop, or Kafka Proficiency with ETL/ELT tools and frameworks (e.g. Airflow, dbt, Informatica) Strong programming skills in Python, Java, Scala, or similar Experience ...

Cloud) Understanding of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery) Strong problem-solving and analytical skills Preferred Skills Experience with big data technologies (e.g., Hadoop, Spark) Knowledge of data modeling techniques and schema design Familiarity with containerization tools (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices ...

event ingestion. Cloud Storage: For scalable and durable object storage. Cloud Composer (Apache Airflow): For workflow orchestration and pipeline management. Cloud Dataproc: For managed Hadoop and Spark clusters (good to have). Cloud SQL/Cloud Spanner/Cloud Bigtable: Experience with relational and NoSQL databases. Strong proficiency ...

platforms. Strong expertise in SQL, data modelling, and database optimisation (relational, vector and NoSQL). Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data ...

applying emerging ML techniques. Desirable: Experience with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes). Exposure to big data technologies (Spark, Hadoop) and Apache tools. Knowledge of NLP, computer vision, and deep learning architectures. Familiarity with Agile and DevOps practices. STEM degree or equivalent experience ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

with stakeholder engagement and solution design. Key Responsibilities Build and optimise data pipelines, ETL processes, and data platforms Develop solutions using Python, Spark, Kafka, Hadoop or similar Work in Agile teams to deliver production-ready systems Translate business requirements into technical data solutions Engage with stakeholders and communicate technical ...

manipulating, and preparing data from relational databases. Experience with NoSQL databases is a plus. Big Data/Cloud: Experience with big data tools ( Spark, Hadoop ) and cloud computing platforms ( AWS, Azure, or GCP ) for scalable ML workflows. Visualization: Ability to create clear, compelling data visualizations using tools like Matplotlib ...

process automation functions Highly proficient coding skills in SQL, Python & PySpark Proven knowledge in at least one of the following big data technologies – HIVE, Hadoop, MongoDB, Spark Experience within the Life Science, Medical Research or Pharmaceutical sector highly advantageous Analytically minded with the ability to solve problems creatively ...

workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka). Experience of Waterfall and Agile delivery methodologies Contact: Please apply via the link or contact (url removed) for more information. Modis ...

Server development Experience designing enterprise data architectures Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Experience leading data platform migrations Cloud architecture expertise ...

least one data-oriented programming language (Python, Scala, or similar) Experience with cloud-based data platforms and big data technologies (eg AWS, Spark, Hadoop, or equivalent) Ability to lead delivery on complex, multi-story work streams with minimal oversight Experience working in Agile teams, collaborating with Product Owners ...

science or machine learning initiatives Experience with BI tools such as Tableau or Power BI Familiarity with big data tools such as Spark or Hadoop Knowledge of healthcare or NHS services Please note we will only progress applications from candidates who clearly meet the essential criteria outlined above. About … machine learning tools. Business intelligence tools: Experience of using tools like Tableau and Power BI. Big Data Tools: Familiarity with big data tools (e.g., Hadoop, Spark, Hive). NHS/Domain Knowledge: Knowledge of the health sector, NHS and the delivery of healthcare services in primary care and urgent ...

Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help ...

teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to improve platform Observability Experience in leading mid-scale teams with strong communication skills ...

Patterns) Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, Api Gateway, Step Functions, MSK, Cloudformation etc.) Experience with On-Prem Hadoop and Kubernetes. Strong programming skills in Python; familiarity with Java is a plus. Knowledge of how quantitative or front-office developers operate ...

large, imperfect datasets Experience in product-led or scale-up environments Engineers who take ownership and enjoy solving complex problems Nice to have Kafka, Hadoop, Cassandra, Redis or similar Experience with real-time or event-driven systems Exposure to recommendation systems, ML or data-driven products Cloud experience ...

support and migration experience Desirable knowledge and experience: AWS accreditation Knowledge of COTS products (including but not limited to; Elasticsearch, NiFi, Rabbit, Kafka, MongoDB, Hadoop, Ansible, Git and Kubernetes) Development of dashboards for monitoring and alerting through Grafana, Splunk, Prometheus and OpenText Om and Ops Bridge On prem ...

About the Job you are considering: We are seeking a highly experienced Data Engineer ( Hadoop/Spark/Scala/Python) to join our Financial Services Data Practice. You will have deep hands‐on expertise in Hadoop, Spark, Scala, Python. Hybrid working: The places that you work from … needs, and those of the business; it will be a blend of Company offices, client sites, and your home. Your Role: Design and develop Hadoop based applications and data pipelines Build operate monitor and troubleshoot Hadoop clusters Write scalable ETL processes using tools like Hive Pig and Spark ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design. Strong Spark development experience. Hands-on experience with Hadoop - configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka … Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB. Proven delivery of streaming pipelines and real-time data processing solutions. Delivered streaming pipelines and real-time data processing solutions. What you'll get in return Flexible working options ...

Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design. Strong Spark development experience. Hands-on experience with Hadoop - configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka … Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB. Proven delivery of streaming pipelines and real-time data processing solutions. Delivered streaming pipelines and real-time data processing solutions. What you'll get in returnFlexible working options available. ...