2 of 2 Batch Processing Jobs in Lancashire

the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data processing pipelines using platforms like Apache Kafka or cloud-native tools. Optimize batch processing workflows with tools like Apache Spark and Flink for … What are we looking for? Advanced proficiency with databases (SQL Server, Oracle, MySQL, PostgreSQL). Expertise in building and managing data pipelines and data processing workflows. Strong understanding of data warehousing concepts, schema design, and data modelling. Hands-on experience with cloud platforms (AWS, Azure, Google Cloud) for scalable More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯