1 to 25 of 37 Hadoop Jobs in the UK

Cloud) Understanding of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery) Strong problem-solving and analytical skills Preferred Skills Experience with big data technologies (e.g., Hadoop, Spark) Knowledge of data modeling techniques and schema design Familiarity with containerization tools (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices ...

NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

Bonus Points If You Have: Certifications: Google Cloud or AWS Certified Solutions Architect certification. ETL and Data Pipeline Expertise: Experience with ETL tools and Hadoop-based technologies (e.g., Spark) and/or batch/streaming data pipelines such as Beam and Flink. Data Architecture: Proven ability in designing ...

line manage small team of junior data engineers.Continual learning through internal and external training.Essential Skills/ExperienceProficient in building Big Data solutions using Hadoop or GCP or AWS.Skilled in technologies such as Scala, Java, Python, Spark (PySpark/Scala), Kafka, Kinesis, BigQuery, Dataflow, BigTable, Terraform, and SQL.Experience with Terraform ...

technologies in scope include:Data processing and logic: ANSI SQL, Apache Spark, KafkaData formats: JSON, Avro, ParquetPlatforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQEngineering and deployment: CI/CD tooling, containerised or Kubernetes-based deployment approaches where relevantYou will also work with internal data management ...

software development lifecycleSolid background in Java/Scala and a scripting language like Python.Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc.Experience with relational SQL and NoSQL databases, including Postgres/ ...

Experience with data warehousing concepts and technologies.Knowledge of other BI tools (e.g., Tableau, Looker) and data modelling techniques.Familiarity with big data technologies (e.g., Hadoop, Spark).Familiarity with modern data architecture (e.g., Data Mesh, Fabric).An understanding of infrastructure as code (e.g., Terraform)Experience with CI/CD pipelines ...

continuous improvement Skills & Experience * Commercial experience in Data Engineering * Strong Python or Java development skills * Experience with AWS cloud services * Knowledge of Apache Spark, Hadoop, NiFi or similar big data technologies * Experience building ETL/ELT pipelines and processing large datasets * Understanding of software engineering best practices, testing ...

Scala. Strong knowledge of SQL and experience with data warehousing solutions. Familiarity with cloud platforms (AWS, Azure, Google Cloud) and big data technologies (Hadoop, Spark). Excellent problem-solving skills and a keen eye for detail. A collaborative spirit and a genuine passion for data! Our Client's Benefits ...

country where you are applying, as well as apply for travel visas as required by travel needsPreferred qualifications • Additional data and analytics experience in Hadoop framework and coding using Impala, Hive, or PySpark • Experience generating new knowledge or creating innovative solutions for a firm • Relevant industry expertise • Working knowledge ...

complex business requirements and render them as prototype systems with quick turnaround time.Implementation and tuning experience in the Big Data Ecosystem, (such as EMR, Hadoop, Spark, R, Presto, Hive), Database (such as Oracle, MySQL, PostgreSQL, MS SQL Server), NoSQL (such as DynamoDB, HBase, MongoDB, Cassandra, design principles) and Data ...

based ensembles (and experience applying them with packages like Pandas, sci-kit-learn, SciPy) is highly beneficial Experience processing big data, ideally in a Hadoop/Spark environment, would be beneficial Proven experience implementing CI/CD and DevOps practices, with the ability to improve deployment reliability, testing standards ...

business objectives.A bit about you: Strong Python knowledge. Ability to read through code. Demonstrable experience collaborating with engineers.Experience with big data technologies such as Hadoop, Spark, or similar. Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and data warehousing solutions.Strong knowledge in at least a few of the following ...

preferred. Having built ELT or ETL pipelines processing large amounts of data. Experience with dbt or Airbyte is preferred. Experience developing production Spark or Hadoop applications Gained experience with a workload scheduling and orchestration tool such as Apache Airflow/Cloud Composer Familiarity with modern DataOps (e.g. quality ...

ownership Qualifications Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins , Harness Strong experience of developing on Apache Spark/Hadoop Strong experience with AWS cloud services including AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience of the full development ...

Artificial Intelligence modeling techniques (logit, GLM, time series, random forests, clustering, XGBoost), statistical programming languages (SAS, R, Python, Matlab), big data tools and platforms (Hadoop, Hive, etc.) and cloud platforms (AWS, Azure, GCP). Solid academic record. Strong computer skills. Postgraduate studies and/or specialized courses ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

related fields. 5+ years of experience in Big Data; prior experience with Tier-1 Cloud Service Providers (CSPs) is highly preferred.Expertise in the Hadoop ecosystem and deep understanding of components like Spark, Flink, Elasticsearch, Doris, ClickHouse, and Trino.,Strong knowledge of big data architecture, including Data Lake (Iceberg, Hudi ...

Windows, UNIX, and/or Linux - Programming and scripting experience (e.g., C, C++, Java, Assembly, Python, Perl, Ruby, Bash, Node.js, Spark, Puppet, SALT, KAFKA, HADOOP) - Database design/development (e.g., NiFi, MongoDB) - Network protocols and hardware - Virtualization fundamentals - Cloud architecture - Security architectures and appliances - Firewalls boundary device solutions/ ...

Job Description:Salary Range: 50,000 - 61,950Leonardo UK operates a grade-based salary framework with broad bands. The salary range shown reflects the approved grade band for this role, or a narrower hiring range ...

troubleshoot software. What you will need: Bachelor's degree in computer science or related discipline required. Experience with distributed data processing systems (e.g. Hadoop, Kafka). Hands on experience writing code with modern procedural programming languages such as Java and Python. Good understanding of design concepts and ability ...

following would be beneficial but not essential:Working with big data technology, ideally Spark but others will also be useful such as Hadoop or ElasticsearchExperience with DevOps tooling and approaches (automation and tooling is something we are passionate about, we even have a dedicated Developer Tooling team)Building data ...

Based in or willing to relocate to Gloucester 5+ years' professional experience with cloud data engineering (AWS focus) Hands-on experience: Python or Java, Hadoop/distributed systems, CI/CD pipelines Proven ability to design scalable architectures and mentor technical teams What we're looking for You think ...

Expected capabilities may include: Data product design and delivery AWS data engineering (Glue, DBT, Databricks, etc.) Data pipeline design, build, and testing Teradata and Hadoop migration expertise Data modelling and business data product design Data governance, lineage, and metadata management Enterprise architecture and security alignment End-to-end delivery ...

prior roles.Prior experience using causal inference/econometric techniques and bayesian methodologies for hypothesis testing.Prior experience using large datasets with distributed computing (e.g. spark, hadoop or other map-reduce tech)Experience working in a fast-moving tech company or startup.This role is a full-time role based in Sunnyvale ...