Data Engineer (Big Data/ Hadoop/ Spark Dev)
- Hiring Organisation
- Hays Specialist Recruitment Limited
- Location
- London, South East, England, United Kingdom
- Employment Type
- Contractor
- Contract Rate
- £550 - £700 per day
Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design. Strong Spark development experience. Hands-on experience with Hadoop - configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka … Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB. Proven delivery of streaming pipelines and real-time data processing solutions. Delivered streaming pipelines and real-time data processing solutions. What you'll get in return Flexible working options ...