1 to 17 of 17 Batch Processing Jobs in the UK excluding London

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

ownership for projects which are delivered by a highly technical team that supports a complex environment which includes:  Workforce Management and People Systems Solutions  Batch processes, Payroll, Time, and Attendance applications  Data design  Integration design  Experience of various design techniques  Familiar with Service Design and Introduction • Negotiate with key more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

Experience with Apache Spark and/or Databricks. Familiarity with BI visualization tools like Power BI Experience in managing end-to-end analytics pipelines (batch and streaming) Proficiency in root cause analysis and post-incident reporting in a production environment Excellent interpersonal skills Strong report writing, presentation, and record … Computer Science, Engineering, or related field Certifications such as Azure Data Engineer Associate are desirable. Knowledge of data ingestion methods for real-time and batch processing Proficiency in PySpark and debugging Apache Spark workloads. What’s in it for you? Annual bonus scheme – up to 10% Excellent pension more »

services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable, efficient, and robust data architectures. This involves creating … 3NF and dimensional data models, designing and developing robust batch processing pipelines, and working with the operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work closely with Data Scientists more »

Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL. Handling substantial volumes of structured and unstructured more »

Troubleshoot and fix intricate technical problems, providing first and second-line support and escalating when necessary. Operational Excellence: Work to ensure seamless operation of batch processes which underpin the business functions. Bridge technology and finance: Collaborate with traders, actuaries, technologists, and more. Prior finance experience is a requirement Efficiency more »

Familiarity with streaming/event-driven architecture, including tools like Kafka and Kinesis/Firehose. Expertise in data ingestion techniques, encompassing both stream and batch processing. Proficiency using tools like Terraform for Infrastructure-as-Code and AWS infrastructure management. What's in it for you? Free Membership and more »

to work in a major project across the company. In the engineering function the newer SQL Servers will include certification process, installation, testing, and batch processes, where this person will help this process across the bank. This role will sit at the Project support/Operations level 3, so more »

ETL assessments to identify potential gaps impacting IBS Impact Tolerance thresholds. Track record of developing strategies for Operational Resilience. Experience leading definition of critical batch processes. Ability to contribute insights to group policies and procedures. Confidence in communicating with stakeholders across different levels. Technical background: 10+ years' experience in … Infrastructure administration, Middleware & integration. Experience of event streaming and batch processing, including point-to-point data transfer Proficient in Cryptographic key management and encryption deployments. Knowledge of Operating Systems (Windows, Linux, zOS, F5) and network protocols Familiar with analytic platforms and databases such as MSSQL, Kafka, S3, etc more »

Health and Safety and Company Policies. What skills will you need? Essential qualifications/requirements: High volume manufacturing experience to include continuous processes and batch processes Significant experience of working with a maintenance background Experience in electrical and mechanical fault finding Planned maintenance systems and procedures development experience Proven more »

Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL. In addition, you should have proficiency or … and unstructured data, including integration of data through Azure cloud-based ingestion and curation processes. Knowledge of data mining, machine learning, and natural language processing is considered advantageous. Familiarity with Agile methodologies and participation in Scrum ceremonies. Competence in designing and constructing solutions tailored for the Azure cloud environment more »

our insights are published through our own digital portal (using React, typescript node.js). Technical know-how in data engineering techniques which cover both batch processing and/or streaming. Strong awareness of advantages/disadvantages of public cloud and technical leadership for the transition to Google Cloud more »

Lead Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You'll be joining the batch processing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »

Lead Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You'll be joining the batch processing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »