1 to 25 of 28 Batch Processing Jobs in the UK

deployment (e.g., promoting ML Pipelines to Production), leveraging MLOps practices and technologies. Experience & Skills Required Skilled in EDW and big data storage, data provisioning, processing, and pipeline orchestration. Comprehensive understanding of data modeling, possessing expertise and experience in data architecture. Proficient coding abilities in Python, SQL, following best software … development practices such as code versioning, code reviews, unit testing, documentation, and use of collaboration tools. Extensive experience in scripting, batch processing, and stream processing. Experience with or at least an interest in Machine Learning and widely used technologies, such as NumPy, Pandas, Matplotlib, Scikit-learn, TensorFlow, and more »

Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL. In addition, you should have proficiency or … and unstructured data, including integration of data through Azure cloud-based ingestion and curation processes. Knowledge of data mining, machine learning, and natural language processing is considered advantageous. Familiarity with Agile methodologies and participation in Scrum ceremonies. Competence in designing and constructing solutions tailored for the Azure cloud environment more »

Staff Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You’ll be joining the batch processing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »

initiatives for operational resilience and change frameworks. Oversee the development of data movement controls and collaborate with platform teams. Lead the definition of critical batch processes. Ensure accurate maintenance of the Data Resilience Information Asset Register. About the Role: As a Senior Data Resilience Middleware Engineer, you will play … infrastructure administration, middleware, and integration. Proficiency in cryptographic key management and encryption deployments. Familiarity with operating systems and network protocols. Experience in event streaming, batch processing, and data movement tooling. Strong understanding of disaster recovery principles. Technical knowledge of regulatory guidelines on operational resilience. Additional Experience: Candidates with more »

be able to provide an accurate assessment of the current capabilities and limitations of the systems. They will understand the critical path of their batch and the associated downstream, upstream and business impacts. They will work closely with Level 3 application with other CTB Project and input and check … ensuring effective capacity management is being performed across all applications and underpinning platform technologies that support your applications. You will contribute towards ensuring all batch SLA's/OLA's are appropriate, understood and agreed for the critical path of your batch processes, ensuring that you understand the more »

and replication to guarantee the highest performance and reliability of data streams. Configure Kafka Connectors: Apply your expertise to set up Kafka connectors for batch processing, managing both source and sink connectors to seamlessly integrate data. Python and Apache Beam Proficiency: Utilize Python and Apache Beam to craft … tailored data processing logic and transformations within pipelines, enabling swift and effective data analysis. Ensure Security: Implement SSL/TLS encryption, SASL authentication, and ACL-based authorization to fortify Kafka clusters and communication channels, ensuring data integrity and privacy. What you will Ideally Bring: Hands-On Kafka Configuration: Proven … expertise in configuring Kafka connectors for batch processing, optimizing their number for improved performance. Python and DataFlow/Apache Beam Proficiency: Skilled in Python and DataFlow/Apache Beam, adept at developing custom data processing logic within pipelines Streaming Data Management: Demonstrated ability in handling streaming data more »

least 2 years experience of Nice Actimize. - Analyzing current installation of Actimize WLF solution at a client side - Recommend improvements on data ingestion and batch process performance - Recommend optimal Threshold setting and Scoring configuration which adhere to the client requirements - Improve detection and alert generation Must Have: - Minimum more »

role As a Senior Software Engineer for this role, you will collaborate with the founding team to expand the integration of our Big Data processing acceleration technology with Apache Spark to drive new optimizations and broader SQL operation coverage. Your contributions to our core solution will directly impact data … infrastructure processing 10s of petabytes every day where Xonai is being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Implement extensible optimizations in various query processing components such … as batch processing code, data parsing, shuffling and data partitioning algorithms. Maintain the solution up to date and compatible with a variety of supported Apache Spark runtimes. Independently and diligently write, test and deploy production code driven by modern software engineering practices. Work with the internals of leading more »

Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL. Handling substantial volumes of structured and unstructured more »

to work in a major project across the company. In the engineering function the newer SQL Servers will include certification process, installation, testing, and batch processes, where this person will help this process across the bank. This role will sit at the Project support/Operations level 3, so more »

stable CHO cell lines for antibody production at multi-gram scale. 3. As Protein Expression Scientist you will be conducting antibody production using fed-batch processes in mid-scale bioreactors. 4. Your role will also involve investigating new technologies within the protein expression domain. ROLE REQUIREMENTS: To be successful more »

ownership for projects which are delivered by a highly technical team that supports a complex environment which includes:  Workforce Management and People Systems Solutions  Batch processes, Payroll, Time, and Attendance applications  Data design  Integration design  Experience of various design techniques  Familiar with Service Design and Introduction • Negotiate with key more »

technologies for ETL, data warehouse, and data lake design. Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. Capable of processing large volumes of structured and unstructured data on AWS. Familiarity with AWS best practices in data engineering, data science, and product development. Knowledgeable in … both stream and batch processing. Comfortable designing and building for AWS cloud, including Platform-as-a-Service, server-less, and container technologies. Diverse skills in ETL, data warehouse, and Data Lake design. Familiarity with various tools, cloud technologies, and approaches. Expertise in AWS or equivalent open-source tools. Proficient more »

Familiarity with streaming/event-driven architecture, including tools like Kafka and Kinesis/Firehose. Expertise in data ingestion techniques, encompassing both stream and batch processing. Proficiency using tools like Terraform for Infrastructure-as-Code and AWS infrastructure management. What's in it for you? Free Membership and more »

using Guidewire BillingCenter Strong domain knowledge in Property & Casualty Insurance Strong experience in Guidewire integration mechanisms including predefined & custom plug-in, messaging destination, custom batch process, predefined and custom web services. Experience in Integrating BillingCenter with external reporting systems such as (but not limited to) motor vehicle reports, property more »

Install, configure and licensing Load client software and accounts, Undertake user administration and setup users as per the client standards Schedule and set up batch processing required as per business requirements, Setup printer's and print spoolers, Liaise with the Application stake holders to facilitate any testing requirements … functions Very good experience in Unibasic, PickBasic, Unidata Administrative experience on working with UniVerse file utilities Intense Troubleshooting skill sets and exp in analysing Batch Failures At Cognizant you will experience an exciting mix of innovation by design, creativity, collaboration, and efficiency within a framework of stimulating objectives and more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

the Enterprise Warehouse and the database backend of the accounting platform. This platform handles large volumes of rapidly processed data and is transitioning from batch processing to real-time operations. Key Responsibilities Collaborate with a team of offshore developers and QA professionals, alongside the London Technical Lead Develop more »

ETL assessments to identify potential gaps impacting IBS Impact Tolerance thresholds. Track record of developing strategies for Operational Resilience. Experience leading definition of critical batch processes. Ability to contribute insights to group policies and procedures. Confidence in communicating with stakeholders across different levels. Technical background: 10+ years' experience in … Infrastructure administration, Middleware & integration. Experience of event streaming and batch processing, including point-to-point data transfer Proficient in Cryptographic key management and encryption deployments. Knowledge of Operating Systems (Windows, Linux, zOS, F5) and network protocols Familiar with analytic platforms and databases such as MSSQL, Kafka, S3, etc more »

and support of the Dynamics365 F&O solution. You will initiate and drive the systems optimisation projects (finance processes/functional changes, reporting, integrations & batch jobs). By working closely with our Finance Team, Data & Technology Team, and support from our managed service provider’s specialists. The finance systems … Experience managing and configuring D365 environments such as TST and managing the deployment of new MS releases. Experience managing and creating new workflows and batch processes in D365. Excellent time management skills with the ability to meet deadline Desired Experience Strong knowledge and expertise in DevOps Solution delivery and more »

Troubleshoot and fix intricate technical problems, providing first and second-line support and escalating when necessary. Operational Excellence: Work to ensure seamless operation of batch processes which underpin the business functions. Bridge technology and finance: Collaborate with traders, actuaries, technologists, and more. Prior finance experience is a requirement Efficiency more »

initiatives for operational resilience and change frameworks. Oversee the development of data movement controls and collaborate with platform teams. Lead the definition of critical batch processes. Ensure accurate maintenance of the Data Resilience Information Asset Register. About the Role: As a Senior Data Resilience Middleware Engineer, you will play … infrastructure administration, middleware, and integration. Proficiency in cryptographic key management and encryption deployments. Familiarity with operating systems and network protocols. Experience in event streaming, batch processing, and data movement tooling. Strong understanding of disaster recovery principles. Technical knowledge of regulatory guidelines on operational resilience. Additional Experience: Candidates with more »