15 of 15 Hadoop Jobs in the UK excluding London

pipelines and ETL - informatica - Experience in SQL and database management systems - Knowledge of data modelling , warehousing concepts , and ETL processes - Experience with big data technologies and frameworks such as Hadoop, Hive, Spark. Programming experience in Python or Scala. - Demonstrated analytical and problem-solving skills. - Familiarity with cloud platforms (e.g Azure , AWS ) and their data related services - Proactive and detail More ❯

both relational databases (SQL Server, MySQL) and NoSQL solutions (MongoDB, Cassandra) Hands-on knowledge of AWS S3 and associated big data services Extensive experience with big data technologies including Hadoop and Spark for large-scale dataset processing Deep understanding of data security frameworks, encryption protocols, access management and regulatory compliance Proven track record building automated, scalable ETL frameworks and More ❯

data architecture, integration, governance frameworks, and privacy-enhancing technologies Experience with databases (SQL & NoSQL - Oracle, PostgreSQL, MongoDB), data warehousing, and ETL/ELT tools Familiarity with big data technologies (Hadoop, Spark, Kafka), cloud platforms (AWS, Azure, GCP), and API integrations Desirable: Data certifications (TOGAF, DAMA), government/foundational data experience, cloud-native platforms knowledge, AI/ML data requirements More ❯

with Trino/Starburst Enterprise/Galaxy administration and CLI operations Container Orchestration : Proven track record with Kubernetes/OpenShift in production environments Big Data Ecosystem : Strong background in Hadoop, Hive, Spark, and cloud platforms (AWS/Azure/GCP) Systems Architecture : Understanding of distributed systems, high availability, and fault-tolerant design Security Protocols : Experience with LDAP, Active Directory More ❯

work experience). Proven experience with Trino/Starburst Enterprise/Galaxy administration/CLI. Implementation experience with container orchestration solutions (Kubernetes/OpenShift). Knowledge of Big Data (Hadoop/Hive/Spark) and Cloud technologies (AWS, Azure, GCP). Understanding of distributed system architecture, high availability, scalability, and fault tolerance. Familiarity with security authentication systems such as More ❯

leadership experience Proficiency in modern data platforms (Databricks, Snowflake, Kafka), container orchestration (Kubernetes/OpenShift), and multi-cloud deployments across AWS, Azure, GCP Advanced knowledge of Big Data ecosystems (Hadoop/Hive/Spark), data lakehouse architectures, mesh topologies, and real-time streaming platforms Strong Unix/Linux skills, database connectivity (JDBC/ODBC), authentication systems (LDAP, Active Directory More ❯

Neo4J, InfluxDB). Hands-on experience with data processing and integration tools , including ETL, ESB, and APIs. Proficiency in Python or similar programming languages. Exposure to big data technologies (Hadoop or similar frameworks). Familiarity with Generative AI, NLP, or OCR applications is highly desirable. Previous experience in the industrial or defence sector is advantageous. Salary & Working Model More ❯

month contract - Inside IR35 - Financial Services This role will require travel to Milton Keyenes and the London offices. Experience: Advanced knowledge and 3yrs+ experience of programming languages Hadoop SQL, Spark, SAS etc. Exceptional problem-solving skills. Track record of developing high quality analysis that has resulted in customer centric decisions that achieve business objectives. Understanding of the customer and More ❯

on experience (coding, configuration, automation, delivery, monitoring, security). ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Significant hands-on experience of HDFS/Hadoop and on-prem (coding, configuration, automation, delivery, monitoring, security). Extensive Big Data hands-on experience - Cloudera or similar. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks … the UK long-term without the need for Company Sponsorship. KEYWORDS Senior Data Engineer, Coding Skills, Spark, Java, Python, PySpark, Scala, ETL Tools, Azure Data Fabric (ADF), Databricks, HDFS, Hadoop, Big Data, Cloudera, Data Lakes, Azure Data, Delta Lake, Data Lake, Databricks Lakehouse, Data Analytics, SQL, Geospatial Data, FME, QGIS, PostGIS. Please note that due to a high level More ❯

None Preferred education Bachelor's Degree Required technical and professional expertise Design, develop, and maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka. Collaborate with cross-functional teams to define, design, and ship data-intensive features and services. Optimize existing data processing pipelines for efficiency, scalability, and reliability. Develop … s degree in Computer Science, Information Technology, or a related field, or equivalent experience. Experience in Big Data Java development. In-depth knowledge of Big Data frameworks, such as Hadoop, Spark, and Kafka, with a strong emphasis on Java development. Proficiency in data modeling, ETL processes, and data warehousing concepts. Experience with data processing languages like Scala, Python, or More ❯

This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud technologies and big data solutions - knowledge of Hadoop and HDFS is 100% required! You MUST have also run a team to be considered for this role - it could be a small or medium sized team but you … Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. To be considered for this role you MUST have in-depth experience of Hadoop and HDFS. The role comes with an extensive benefits package including a good pension, good holiday allowance, healthcare, bonus and more! Please note, to be considered for this opportunity … offering sponsorship for this role. KEYWORDS Lead Data Engineer, Senior Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable More ❯

data sources, including SQL and NoSQL databases. Implementing and optimizing data warehouse solutions and ETL/ELT pipelines for analytics and reporting. Working with big data ecosystems such as Hadoop, Spark, and Kafka to build scalable solutions. What you’ll bring... Strong expertise in SQL and NoSQL technologies, such as Oracle, PostgreSQL, MongoDB, or similar. Proven experience with data … warehousing concepts and ETL/ELT tools. Knowledge of big data platforms and streaming tools like Hadoop, Spark, and Kafka. A deep understanding of scalable data architectures, including high availability and fault tolerance. Experience working across hybrid or cloud environments. Excellent communication skills to engage both technical teams and senior stakeholders. What’s in it for you... This is More ❯

banking-focused data model. Liaise with IT teams to transition data models into production environments. Conduct data mining and exploratory data analysis to support model development. Apply strong SQL, Hadoop, and cloud-based data processing skills to manage and analyse large datasets. Support the design and structure of data models, with a working understanding of data modelling principles. Present … scalable data solutions within a cloud architecture. Key Skills & Experience: Proven experience as a technical data analyst or data engineer in a project-focused environment. Strong proficiency in SQL, Hadoop, and cloud platforms (preferably AWS). Experience with data mining, data modelling, and large-scale data processing. Familiarity with tools such as Python, R, and Power BI. Understanding of More ❯

About Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of 4.7M hotels and holiday properties worldwide, plus flights, activities, and more. More ❯

Java Software Engineer - Data Storage Technologies - (MySQL, Hadoop, Cassandra,AWS (RDS, Step functions, EC2, Kinesis) Location: Manchester Duration: 5 months *Urgent 5-Month Contract - Role hiring now!* This is a *Manchester* based role with an excellent immediate start within a Global T echnology Client that is working on *delivering innovative regulatory technology solutions that ensure compliance, manage risk, and … compliance and risk management through advanced tools and analytics. Skills & Experience 3+ years' software development experience (Java essential). Strong background with microservices and distributed systems. Experience with MySQL, Hadoop, Cassandra . Knowledge of AWS services (RDS, Step Functions, EC2, Kinesis). Experience with testing frameworks and performance monitoring. FinTech, compliance, or payments experience (a plus). Please send More ❯