76 to 100 of 154 Hadoop Jobs in the UK

Strong understanding of Apache HTTP, Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data formats. Knowledge of Iceberg, Databricks, and Hadoop ecosystems. Skills that will help Follows TDD, ATDD and Clean Coding practices and used to setting up or working in an environment using ...

Python or Go. Expertise in constructing highly available and fault-tolerant big data environments in the cloud, utilizing NoSQL and RDMS technologies like Hadoop, Spark, PostgreSQL, and cloud-based management tools such as EMR, Athena, and RDS.Ability to implement systems with a security-first mindset, adhering to firm-wide ...

Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with Kafka technologies Clear ...

Government, Public Sector, Security, Justice, Defence, Healthcare or other similarly challenging environments . Experience with large-scale data technologies such as SQL, Spark or Hadoop would also be beneficial. About You You will be a technically credible leader who is still comfortable getting into the detail. You will understand ...

data and analytics platforms Expertise in cloud architectures (preferably Azure, incl. Azure Data Factory, Synapse, Databricks, Fabric, etc.) Experience with big data technologies (Spark, Hadoop, distributed systems) Proficiency in data modelling, especially time-series and simulation datasets Knowledge of APIs, microservices, and event-driven architectures Energy Domain Knowledge Understanding ...

support. A core component of the role is applying, modifying and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary modelling focus will be neural network‐based forecasting, with a strong emphasis on rigorous evaluation against ...

following would be beneficial but not essential: Working with big data technology, ideally Spark but others will also be useful such as Hadoop or ElasticsearchExperience with DevOps tooling and approaches (automation and tooling is something we are passionate about, we even have a dedicated Developer Tooling team)Building data ...

microservices, and data integration layers to support high-throughput regulatory reporting. Big Data Processing: Develop and optimize distributed data processing jobs using Apache Spark, Hadoop, and Hive to aggregate and transform large-scale financial datasets. Real-Time Streaming: Build and maintain real-time data ingestion and streaming pipelines using … using Spring Boot , Spring Cloud, Spring Data, and Spring Security. Big Data Technologies: Strong, hands-on experience with distributed computing frameworks, specifically Apache Spark , Hadoop , and Hive . Proven ability to write and optimize complex Spark jobs. Real-Time Streaming: Practical experience designing and implementing event-driven systems using ...

Job Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to 500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting ...

Data Formats: Strong understanding of Apache HTTP, Envoy, and REST API design, plus experience with Protobuf, Avro, and Parquet. Knowledge of Iceberg, Databricks, and Hadoop ecosystems. TDD, ATDD, and Clean Coding practices within a CI/CD environment (e.g. Jenkins, Gradle). Experience with Scrum/Agile methods ...

Monitoring utilising products such as: Prometheus, Grafana, ELK, filebeat etc. Observability - SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Edge technologies e.g. NGINX, HAProxy etc. Excellent knowledge of YAML or similar languages It is essential for this role that you hold ...

systems such as: Ansible, Terraform, Jenkins, Bamboo, Concourse etc. Observability – SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Excellent knowledge of YAML or similar languages The following Technical Skills & Experience would be desirable: Jupyter Hub Awareness RabbitMQ or other common queue technology ...

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them to be commercially successful through insight ...

architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Experience leading data platform migrations Experience managing ...

architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Hands on experience with databricks a distinct ...

generated code and recommendations. Excellent stakeholder communication and collaboration skills. Desirable Experience Python programming experience. Databricks experience. Experience with platforms such as Snowflake, Hadoop, Microsoft SQL Server, or similar enterprise data technologies. Exposure to data architecture, infrastructure optimisation, and performance tuning. Experience within the Microsoft ecosystem, including Teams, Outlook ...

moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree ...

from kernel, networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow ...

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster ...

We are seeking a Data Engineering Specialist to join the Architecture & Modernization team. You will be instrumental in building and maintaining the data infrastructure for our Data AI platforms. This role will involve hands‐on ...

data availability, quality, and efficiency across markets. This role is onsite in London and requires strong SQL and programming skills, plus experience with Spark, Hadoop, and cloud platforms. #J-18808-Ljbffr ...

work in a multidisciplinary, highly technical environment, developing scalable data mining and ML solutions. Proficiency with C++, Java, Python, SQL/Excel and Hadoop-based tools is required. MSc or PhD in a quantitative field is preferred. #J-18808-Ljbffr ...

stakeholders. Architecture design informed through the use of principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...

models and using ML tools (e.g., sklearn) Familiarity with data visualisation in Python and R Understanding of underlying data systems such as Cloud architectures, Hadoop, or SQL, Experience with Consulting and/or Customer-facing Data Science roles Experience with Data Engineering or MLOps Experience developing WebApps in JavaScript ...

money doing something you are passionate about. My client is based in LondonFollow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...