1 to 25 of 38 Hadoop Jobs in the UK

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

Scala, and SQL. \n Hands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). \n Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. \n Experience working with cloud‐native data platforms ...

Scala, and SQL. \n Hands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). \n Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. \n Experience working with cloud‐native data platforms ...

Docker \n Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo \n Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. \n Data acquisition and development of data sets and improving data quality \n Preparing data for predictive and prescriptive modelling \n Hands ...

Docker \n Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo \n Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. \n Data acquisition and development of data sets and improving data quality \n Preparing data for predictive and prescriptive modelling \n Reporting ...

quality checks into pipelines. Knowledge of cloud infrastructure (AWS, Azure, or GCP) and database technologies including relational and non-relational stores such as Postgres, Hadoop, Elasticsearch, and Graph databases. Solid understanding of coding best practices, design patterns, CI/CD tooling, versioning, dependency management, error handling, monitoring, and alerting. ...

degree, or experience in a professional field or military - Experience as technical specialist in design and architecture - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in consulting, design and implementation of serverless distributed solutions - Experience in cloud based solution (AWS or equivalent), system, network and operating ...

ability to think critically and analytically. Strong experience in documentation and data dictionaries. Knowledge of big data technologies and distributed computing frameworks such as Hadoop and Spark. Excellent communication skills to effectively collaborate with cross-functional teams and present insights to business stakeholders. ...

skills in Python, with a command of data science libraries (e.g., Pandas, NumPy, Scikit‐learn). Experience with big data technologies (e.g., Spark, Trino, Hadoop) and ideally cloud platforms (e.g., AWS, GCP, Azure) for scalable data processing, storage, and model deployment. Ideally having understanding and practical experience with graph ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record with data ...

Strong understanding of best practice DataOps and MLOps \n Up-to-date understanding of various data engineering technologies including Apache Spark, Databricks and Hadoop \n Strong understanding of agile ways of working \n Up-to-date understanding of various programming languages including Python, Scala ...

underpinning data systems through a DevOps approach \n Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop \n Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different ...

performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure ...

performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure ...

unstructured datasets. Strong stakeholder management and communication skills. Desirable Insurance or financial services experience, ideally within pricing, underwriting, fraud, or claims. Experience with Spark, Hadoop, NoSQL, or modern big data platforms. Agile delivery experience and collaborative software development practices. Experience leading analytics teams and driving organisational change. Robert Walters ...

ensembles (and experience applying them with packages like Pandas, sci-kit-learn, SciPy) is highly beneficial \n Experience processing big data, ideally in a Hadoop/Spark environment, would be beneficial \n Proven experience implementing CI/CD and DevOps practices, with the ability to improve deployment reliability, testing ...

emerging data technologies, products and delivery approaches Familiarity with cloud platforms such as Azure, AWS or GCP, alongside technologies including Databricks, Snowflake, Power BI, Hadoop, SQL and Python Experience working with delivery methodologies including Agile, SAFe and Waterfall Strong proficiency with tools such as Jira, Confluence and Planview ...

Relational databases (SQL Server, PostgreSQL, Oracle, MySQL) Data visualisation tools (Power BI, Tableau, Spotfire) Cloud platforms, particularly Microsoft Azure Big data technologies (Spark, Elasticsearch, Hadoop) Statistical modelling and advanced analytics Machine learning and pattern recognition techniques Web technologies such as HTML and JavaScript ...

data warehousing, OLTP systems, data integration, and the software development lifecycle (SDLC). Hands-on experience with big data frameworks such as Spark, Hadoop, or Hive, including derivatives like PySpark (preferred), Spark Scala, or Spark SQL, along with familiarity with development-accelerating libraries and frameworks. Experience using data modelling … tools such as ERwin, ER/Studio, PowerDesigner, or similar. Experience with major database platforms, including SQL Server, Oracle, Azure Data Lake, Hadoop, Azure Synapse (SQL Data Warehouse), Snowflake, Redshift, and others. Strong experience with orchestration tools such as Azure Data Factory, HDInsight, Cloud Composer, Data Pipeline, or equivalent. ...

About the Job you are considering: Results-driven Hadoop Data Engineer with experience designing, developing, and maintaining large-scale data processing solutions for financial services organizations. Skilled in building robust data pipelines, managing big data platforms, and transforming high-volume structured and unstructured financial data into actionable insights. Proficient … Hadoop ecosystem technologies including HDFS, Hive, Spark, Sqoop, Kafka, Oozie, and YARN , along with SQL and cloud-based data platforms Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend ...

Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists and engineering teams Opportunity to shape platform ...

Strong technical skills in Python and SQL, including building data pipelines and working with large-scale datasets and distributed data platforms (e.g., BigQuery, Snowflake, Hadoop or similar) Experience applying data science, machine learning, or data engineering approaches within data-intensive domains such as Finance or Operations Proficiency with ...

core component of the role is applying, modifying and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary modelling focus will be neural network-based forecasting, with a strong emphasis on rigorous evaluation against robust baselines ...

Job Description hackajob is collaborating with Leonardo to connect them with exceptional professionals for this role. \n The Opportunity: \n The Leonardo Cyber & Security Division, one of the three divisions in Leonardo UK, is a ...

Job Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to £500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting ...