9 of 9 Batch Processing Jobs in Scotland

You will own the data operations infrastructure, manage and optimise performance, reliability, and scalability of the system to meeting growing demands on ingestion and processing pipelines. To succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. … Develop, Deploy and Support data infrastructure, pipelines and architecture. Implement reliable, scalable, and tested solutions to automate data ingestion. Development of systems to manage batch processing and real-time streaming of data Evaluate business needs and objectives. Facilitate pipelines, which prepare data for prescriptive and predictive modelling. Working … with domain teams to scale the processing of data. Combine raw information from different sources. Manage and maintain automated tools for data quality and reliability. Explore ways to enhance data quality and reliability. Collaborate with data scientists, IT and architects on several projects What you'll bring Successful Candidates More ❯

MQ. Expertise Knowledge in Data Management workflow & integration such as Data Lake, ETL, Data Ingestion, Sharding, Data Stream, Data Catalogue, Data Cleansing, Data Analytics, Batch, Scheduling. Implementation knowledge on principles such as ACID, SOLID, OWASP. Implementation of designs related to Batch processing patterns involving Talend, Databricks, Snowflake … an Asset and Architect & provide Solutions aligned to it. Strong working knowledge in Java 8+ with Clean Architecture, Mockito, Java Spring, Spring Boot, Spring Batch, Apache Camel. Needs to possess an expert depth and breadth of knowledge regarding multiple technologies and their inter-relationships, e.g.: Web applications, Java & Oracle. More ❯

Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of More ❯

Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of More ❯

Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of More ❯

Lake, Synapse, Data Factory) and AWS (., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of More ❯

efficient use of databases (MSSQL, PostgreSQL, MySQL). Work with data engineers to enable secure, efficient data movement between systems, including real-time and batch processing pipelines. Support analytics and reporting needs through the engineering of clean, reliable data sources and APIs. Security Engineering & Governance Partner with security More ❯

efficient use of databases (MSSQL, PostgreSQL, MySQL). Work with data engineers to enable secure, efficient data movement between systems, including real-time and batch processing pipelines. Support analytics and reporting needs through the engineering of clean, reliable data sources and APIs. Security Engineering & Governance Partner with security More ❯

Support: Manage and resolve incidents to ensure minimal disruption to business operations. Monitor system performance and address issues promptly. Oversee intra-day and overnight batch processes. Schedule and run ad-hoc and scheduled jobs, such as generating statements. Perform routine tasks to maintain system stability. Proactive Support: Conduct incident … Respond to customer service requests with timely resolutions. Maintain strong knowledge of the Sonata application and experience with incident management, system performance monitoring, and batch processing. Apply excellent problem-solving skills and work under pressure. Collaborate effectively with stakeholders. Knowledge of financial services, especially in life, wealth, and pensions More ❯