6 Big Data Jobs in Glasgow

Senior Data Engineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a Data Engineer (Big Data Technologies) for our client who are firmly positioned in the "Tech For Good" space. This … is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we are ideally looking … for a Senior Data Engineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data, and curate data to provide real more »

Hive SQL Queries/Spark SQL Statements. * Experience in working with large databases - multi terabytes (3+ Terabytes). * Minimum of 5 years' experience in Big Data Space (Hive, Impala, Spark Sql, HDFS etc). * Any cloud experience (AWS/Azure/Google/Oracle). * Solid experience with more »

exciting possibility of extension. As a PySpark/Python Lead Software Engineer/Developer, you will play a crucial role in developing and maintaining data processing applications using PySpark and Python within our leading financial institution. This is a unique opportunity to contribute to a long-term project, where … the future of the development process. If you are interested in the role, please email me on daniel.bennett@hamilton-barnes.com Responsibilities: Develop and maintain data processing applications using PySpark and Python. Collaborate with cross-functional teams to gather requirements and implement solutions. Optimize and tune PySpark jobs for performance … and scalability. Ensure data quality, reliability, and integrity throughout the data processing pipelines. Troubleshoot and resolve issues related to data processing and analysis. Skills: Hands-on experience with PySpark and Python is essential. Proven experience developing and maintaining data processing applications. Strong understanding of distributed computing more »

will be working within a global Agile squad responsible for developing Transaction Reporting systems with robust controls to ensure timeliness and accuracy of reported data to enable client to manage its risk. The role will expose the candidate to all phases of the production development lifecycle including working with … their requirements. There is scope to grow and learn both technically (migration to AWS/Azure Public cloud, being part of a modernization programme, big data management) as well as opportunity to deepen business understanding of financial regulations and products. Skill Set: Java 8, Kafka, Collections, Multi-threading … team. Willingness to learn domain fundamentals and explain calculation logic to users. Qualifications Computing fundamentals: Working knowledge of common search and sort algorithms, basic data structures such as lists, maps, trees, and graphs, multi-threaded programming, computer networking, and operating systems. Databases: Basic knowledge of SQL. Familiarity with non more »

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? Big Data Architect First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. … few. What will you do? You will be responsible for the ownership of key projects across the SDLC developing and implementing an overall organizational data strategy that is in line with business processes. This strategy must include data model designs, database development standards, implementation and management of data warehouses and data analytics systems. What experience will you need? Apache Spark Azure Databricks ETL Snowflake Big Query What's in it for you? You will embark upon a career with life-long learning at its core, facilitating rapid professional and personal development and the opportunity to more »

leading technologists to manage, anticipate and solve complex technical items within your domain of expertisePractical software development experience across technologies, including Java, Spring Framework, BigData, Python, AWS, AI/ML.Demonstrated ability to drive cultural change without direct team ownership across a globally diverse organization.Experience developing or leading cross-functional teams … of technologists.Experience with hiring, developing, and recognizing talent.Experience in agile transformation at scale.Experience in working with and leveraging a data driven approach to decision making.Experience working with SRE and Support teams to foster a culture of observability, maintainability and constantly work toward meeting SLIs/SLOs as well as more »