Senior Data Engineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a Data Engineer (BigData Technologies) for our client who are firmly positioned in the "Tech For Good" space. This … is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we are ideally looking … for a Senior Data Engineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data, and curate data to provide real more »
will be working within a global Agile squad responsible for developing Transaction Reporting systems with robust controls to ensure timeliness and accuracy of reported data to enable client to manage its risk. The role will expose the candidate to all phases of the production development lifecycle including working with … their requirements. There is scope to grow and learn both technically (migration to AWS/Azure Public cloud, being part of a modernization programme, bigdata management) as well as opportunity to deepen business understanding of financial regulations and products. Skill Set: Java 8, Kafka, Collections, Multi-threading … team. Willingness to learn domain fundamentals and explain calculation logic to users. Qualifications Computing fundamentals: Working knowledge of common search and sort algorithms, basic data structures such as lists, maps, trees, and graphs, multi-threaded programming, computer networking, and operating systems. Databases: Basic knowledge of SQL. Familiarity with non more »
Hive SQL Queries/Spark SQL Statements. * Experience in working with large databases - multi terabytes (3+ Terabytes). * Minimum of 5 years' experience in BigData Space (Hive, Impala, Spark Sql, HDFS etc). * Any cloud experience (AWS/Azure/Google/Oracle). * Solid experience with more »
exciting possibility of extension. As a PySpark/Python Lead Software Engineer/Developer, you will play a crucial role in developing and maintaining data processing applications using PySpark and Python within our leading financial institution. This is a unique opportunity to contribute to a long-term project, where … the future of the development process. If you are interested in the role, please email me on daniel.bennett@hamilton-barnes.com Responsibilities: Develop and maintain data processing applications using PySpark and Python. Collaborate with cross-functional teams to gather requirements and implement solutions. Optimize and tune PySpark jobs for performance … and scalability. Ensure data quality, reliability, and integrity throughout the data processing pipelines. Troubleshoot and resolve issues related to data processing and analysis. Skills: Hands-on experience with PySpark and Python is essential. Proven experience developing and maintaining data processing applications. Strong understanding of distributed computing more »
