Data Engineer | Learn Kafka & Databricks | Big Data Technologies | 10% Bonus
Data EngineerBristol | Hybrid (3 Days Onsite) Salary + Benefits – £60,000 to £71,000 + 10% bonus, 33 days holiday, pension, healthCareer Progression + Modern Tech StackPyspark | ML | AI | Databricks | Kafka | AWSAre you a Data Engineer with strong Python, SQL and PySpark skills who is looking for the opportunity to step up and accelerate your career We're partnering with a market-leading technology business that is investing heavily in its data platform and is at the forefront of innovation within the smart housing sector. Processing billions of sensor readings every month, they're looking for a talented Data Engineer to join their growing team and help build the next generation of scalable data solutions.This opportunity is ideally suited to a mid-level Data Engineer who is ready to take on more responsibility, work on complex technical challenges, and gain exposure to cutting-edge technologies including Databricks, Kafka, Streaming, AI and Machine Learning.The OpportunityYou'll be joining a collaborative team of engineers and data specialists working on large-scale, real-time data platforms. This is a business that embraces new technologies and encourages engineers to learn, innovate and have a genuine impact on technical direction.You'll have the opportunity to:
- Build and optimise large-scale data pipelines
- Work with billions of data points generated from IoT devices
- Develop solutions using Python, SQL and PySpark
- Gain exposure to Databricks, Kafka and streaming technologies
- Contribute to Machine Learning and AI initiatives
- Work alongside Data Scientists and Software Engineers
- Influence architecture and engineering best practices
- Play a key role in exciting greenfield projects
- Strong commercial experience as a Data Engineer
- Advanced Python and SQL skills
- Strong PySpark experience
- Experience building and maintaining scalable data pipelines
- Understanding of data modelling and database design principles
- Strong analytical and problem-solving capabilities
- Excellent communication and stakeholder engagement skills
- Degree in Computer Science, Mathematics, Statistics or a related discipline would be advantageous
- Databricks
- Apache Kafka
- Real-time streaming technologies
- AWS services
- ClickHouse
- Infrastructure as Code
- CI/CD practices