226 to 250 of 258 Hadoop Jobs in the UK excluding London

machine learning models encompassing data from traffic management sensors and other data sources Experience working with large data sets, experience working with distributed computing a plus (Map/Reduce, Hadoop, Hive, Apache Spark, etc.) Develop advanced data reporting capabilities and data visualizations; combining multiple disparate data sources to gain detailed insights into photo enforcement programs. Provide architectural expertise, direction More ❯

Good experience with Monitoring tools such as ITRS Geneos, AppDynamics. Good experience with Log Aggregation tools such as ELK, Splunk, Grafana (GEM) is preferred. Experience working with Oracle Database, Hadoop, Apache Spark, Hive, Starburst. Experience with Middleware solutions such as Tibco EMS, Kafka. Good written and verbal communication skills. What we can offer you The SMBF Production Management organization More ❯

Good Experience with Monitoring tools such as ITRS Geneos, AppDynamics Good Experience with Log Aggregation tools such as ELK, Splunk, Grafana(GEM) is preferred Experience working with Oracle Database, Hadoop, Apache Spark, Hive, Starburst Experience with Middleware solutions such as Tibco EMS, Kafka Good written and verbal communication skills What we can offer you The SMBF Production Management organization More ❯

Linux, GitHub, Continuous Integration, Cloud technologies, Virtualisation Tools, Monitoring utilities, Disaster recovery process/tools Experience in troubleshooting and problem resolution Experience in System Integration Knowledge of the following: Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming Experience of ETL tools incorporating Big Data Shell Scripting, Python Beneficial Skills: Understanding of: LAN, WAN, VPN and … SD Networks Hardware and Cabling set-up experience Experience of implementing and supporting Big Data analytics platforms built on top of Hadoop Knowledge and appreciation of Information security If you are looking for a challenging role in an exciting environment, then please do not hesitate to apply More ❯

Knowledge of CI/CD processes and infrastructure-as-code. • Eligible for SC clearance (active clearance highly advantageous). Desirable Skills • Exposure to large data processing frameworks (e.g., Spark, Hadoop). • Experience deploying data via APIs and microservices. • AWS certifications (Solution Architect Associate, Data Analytics Speciality, etc.). • Experience in public sector programmes or government frameworks. Package & Benefits More ❯

as Java, TypeScript, Python, and Go Web libraries and frameworks such as React and Angular Designing, building, and maintaining CI/CD pipelines Big data technologies, such as NiFi, Hadoop, Spark Cloud and containerization technologies such as AWS, OpenShift, Kubernetes, Docker DevOps methodologies, such as infrastructure as code and GitOps Database technologies, e.g. relational databases, Elasticsearch, Mongo Why join More ❯

experience designing or delivering large-scale pricing, AI or recommendation systems. Deep technical knowledge of ML frameworks (TensorFlow, PyTorch), cloud platforms (AWS, GCP, Azure), and big data tools (Spark, Hadoop). Demonstrated success in building business-critical, real-time algorithmic solutions. Strong communication and stakeholder engagement skills – translating complexity into business value. A commercial, data-led mindset and a More ❯

languages. Proficiency in working with large datasets, data wrangling, and data preprocessing. Ability to work independently and lead projects from inception to deployment. Experience with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, GCP, Azure). Preferred Skills: • MSc or PhD in Computer Science, Artificial Intelligence, or related field. ADDITIONAL NOTES: • Ability to work independently or More ❯

engineering or data warehousing and/or a similar data developing role required Experience using Azure Data Factory, Microsoft SSIS, or other leading ETL tools preferred. Experience with Spark, Hadoop, or cloud technologies preferred PHYSICAL DEMANDS AND WORKING ENVIRONMENT The physical demands and work environment are representative of those that must be met or encountered to successfully perform the More ❯

/product management environmenta Relevant experience within core java and spark Experience in systems analysis and programming of java applications Experience using big data technologies (e.g. Java Spark, hive, Hadoop) Ability to manage multiple/competing priorities and manage deadlines or unexpected changes in expectations or requirements Prior financial services/trade surveillance experience is desirable Strong analytical and More ❯

Join to apply for the Senior/Lead Big Data Engineer (Scala/Spark) role at Grid Dynamics . Responsibilities Development of Spark jobs for data synchronization between different storage systems. Development of big data pipelines and infrastructure. Planning and More ❯

and CI/CD paradigms and systems such as: Ansible, Terraform, Jenkins, Bamboo, Concourse etc. Observability - SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Excellent knowledge of YAML or similar languages The following Technical Skills & Experience would be desirable: Jupyter Hub Awareness RabbitMQ or other common queue technology e.g. ActiveMQ NiFi Rego More ❯

Azure Functions. Strong knowledge of scripting languages (e.g., Python, Bash, PowerShell) for automation and data transformation. Proficient in working with databases, data warehouses, and data lakes (e.g., SQL, NoSQL, Hadoop, Redshift). Familiarity with APIs and web services for integrating external systems and applications into orchestration workflows. Hands-on experience with data transformation and ETL (Extract, Transform, Load) processes. More ❯

users or large data sets with 10M+ database records. This is a very Big Data platform. Experience building REST services (orchestration layer) on CRUD data services based on Cloudera Hadoop stack, with an emphasis on performance optimization. Understanding how to secure data in a REST architecture. Knowledge of scaling web applications, including load balancing, caching, indexing, normalization, etc. Proficiency … in Java/Spring web application development. Experience with Test Driven Development and Agile methodologies; Behavior Driven Development is a plus. Knowledge of Hadoop, Big Data, Hive, Pig, NoSQL is a plus, though most engineers with this background may have limited REST experience. Additional Information All your information will be kept confidential according to EEO guidelines. Direct Staffing Inc More ❯

security principles, system performance optimisation, and infrastructure reliability. Experience working on large-scale, production-grade systems with distributed architectures. Nice to Have: Exposure to tools like Elasticsearch/Kibana, Hadoop/HBase, OpenSearch, or VPN/proxy architectures. Ideal Candidate will: Bring technical vision, initiative, and a passion for exploring and implementing emerging technologies. Are a natural technical leader More ❯

security principles, system performance optimisation, and infrastructure reliability. Experience working on large-scale, production-grade systems with distributed architectures. Nice to Have: Exposure to tools like Elasticsearch/Kibana, Hadoop/HBase, OpenSearch, or VPN/proxy architectures. Ideal Candidate will: Bring technical vision, initiative, and a passion for exploring and implementing emerging technologies. Are a natural technical leader More ❯

fraudsters Build and optimize systems, tools, and validation strategies to support new features Help design/build distributed real-time systems and features Use big data technologies (e.g. Spark, Hadoop, HBase, Cassandra) to build large scale machine learning pipelines Develop new systems on top of real-time streaming technologies (e.g. Kafka, Flink) Minimum Requirements: 5+ years software development experience More ❯

and machine learning. PREFERRED QUALIFICATIONS Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy, etc. Experience with large scale distributed systems such as Hadoop, Spark, etc. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the More ❯

with Temporal or similar orchestration tools. • Messaging & Streaming: Exposure to RabbitMQ or similar message/streaming broker technologies. • Advanced Technologies: Interest or experience in big data technologies (e.g., HBase, Hadoop), machine learning frameworks (e.g., Spark), and orbit dynamics. Why Join Us? • Innovative Environment: Be part of projects at the cutting edge of space systems and security. • Agile Culture: Work More ❯

.NET code Experience working on distributed systems Strong knowledge of Kubernetes and Kafka Experience with Git, and Deployment Pipelines Having worked with at least one of the following stacks: Hadoop, Apache Spark, Presto Experience profiling performance issues in database systems Ability to learn and/or adapt quickly to complex issues Happy to collaborate with a wide group of More ❯

Core Java Highly motivated Delivery-focused and accountable Ideally experienced in server-side multi-threaded Java (experience outside large firms is acceptable) Additional exposure to the following is desired: Hadoop and Flink Involvement in the Java community The client is based in London. Remote work is encouraged, but you will need to be able to come to the City More ❯

team and the customer • Investment in your own skills development with support from the team and wider organisation • GNU/Linux software customisation, configuration and integration • Kubernetes Operators and Hadoop customisation, API integration and configuration with Ansible, Kustomize and Helm • System performance analysis and improvement of multiple, high spec large clusters Required qualifications to be successful in this role More ❯

their use in AI-driven retrieval systems. Familiarity with anomaly detection techniques using deep learning and traditional ML approaches. Experience working with large-scale data processing frameworks (e.g., Spark, Hadoop, or similar technologies). Knowledge of indexing and search systems such as Elasticsearch, Neo4j, or PostgreSQL. Strong problem-solving and analytical skills. Excellent communication skills for cross-functional collaboration. More ❯

As a Scala Data Engineer, you will design, develop, and maintain Scala applications for Big Data purposes. In this role, you will be responsible for migrating an on-premise Hadoop system onto the AWS cloud platform. Designing and implementing ETL pipelines, and using a combination of Big Data technologies and modern cloud stack will be your day-to-day. … Requirements: Strong Scala Programming Experience (Data) Hadoop Experience AWS Experience This role is an urgent requirement; please do not hesitate to apply or you could miss this opportunity! Get in touch by contacting me at j.shaw-bollands@tenthrevolution.com or on 0191 338 6641! Keywords: Big Data, Hadoop, Scala, Spark, AWS, Migration, Data Engineer, Consultancy, Banking, Finance #J More ❯

enterprise-level systems; Excellent object-oriented design skills, including OOA/OOD; Experience with multi-tier architectures and service-oriented architecture; Exposure to and understanding of RDBMS, NoSQL, and Hadoop is desirable; Knowledge of the software development lifecycle and agile practices, including TDD/BDD; Strategic thinking, collaboration, and consensus-building skills. Please note: Familiarity with DevOps is important More ❯