19 of 19 Batch Processing Jobs in London

similar analytics engineering roles with focus on product analytics and data modelling is highly desirable. Experience working with distributed event stores and stream-processing platforms such as Kafka of Kinesis. Experience working with batch processing frameworks, such as DBT, Argo Workflows, Apache Airflow, etc. Familiarity with Docker ...

background in modern data platforms, cloud-native architecture and Databricks? We're supporting a major programme that is modernising and transforming large-scale data processing capabilities and are looking for a hands-on architect who can bridge strategy, design and delivery. Role This position will play a key role … technical implementation layers, helping to guide migration activity while remaining hands-on with infrastructure, automation and platform delivery. Key Responsibilities Design scalable data processing solutions using AWS, Databricks and associated cloud services. Lead the transition of existing data workloads and integrations onto a modern cloud-native platform. Define platform ...

Develop and optimise Oracle database objects (PL/SQL procedures, functions, queries) Write and maintain UNIX shell scripts for automation, job scheduling, and data processing Perform data analysis, mapping, and transformation for complex data sources Ensure data quality, integrity, and performance optimisation across ETL processes Collaborate with business … experience working in Data Warehouse/ETL environments Experience in data integration, transformation, and performance tuning Strong understanding of ETL frameworks, data pipelines, and batch processing Desirable Skills Working knowledge of SAS (especially in ETL context) Experience in migrating SAS workloads to Informatica ETLs Familiarity with data modelling ...

platforms used by banks, governments and regulated organisations. Their software helps organisations understand exactly who they're doing business with, combining large-scale data processing, entity resolution, graph intelligence and modern cloud architecture. Join an engineering team solving genuinely difficult technical problems - processing millions of records through asynchronous … Design and evolve backend services for high-volume, distributed screening workloads Build event-driven pipelines (AWS SNS/SQS) with idempotent consumers, DLQs and batch processing Design clean APIs and contribute to architecture across multiple products Integrate external identity, KYC and payments platforms (e.g. Senzing, Auth0, Stripe ...

experience working in Data Warehouse/ETL environments Experience in data integration, transformation, and performance tuning Strong understanding of ETL frameworks, data pipelines, and batch processing Desirable Skills Working knowledge of SAS (especially in ETL context) Experience in migrating SAS workloads to Informatica ETLs Familiarity with data modelling ...

Agent Kit, MCP Toolbox for Databases)* Familiarity with dbt for transformation and data modeling at scale* Experience building or operating streaming data infrastructure alongside batch processing* Background in compliance-sensitive environments (SOX, regulatory reporting, audit systems)* Published work, conference talks, or open-source contributions in knowledge engineering, semantic ...

leadership and mentorship to cross-functional data teams Define best practices across data architecture, cloud engineering, and security Design and oversee real-time and batch processing solutions, including streaming architectures Ensure compliance with government standards, security policies, and data regulations Monitor delivery against architectural designs and manage ...

Role Design and deliver APIs using API-led connectivity (System, Process, Experience layers) Build complex integration solutions including event-driven architectures, orchestration, streaming, and batch processing Lead development on key projects, ensuring high-quality engineering standards Produce reusable assets, modules, and DataWeave transformations Contribute to API specifications (RAML ...

Role Design and deliver APIs using API-led connectivity (System, Process, Experience layers) Build complex integration solutions including event-driven architectures, orchestration, streaming, and batch processing Lead development on key projects, ensuring high-quality engineering standards Produce reusable assets, modules, and DataWeave transformations Contribute to API specifications (RAML ...

function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners. The Role Data Engineering & Pipeline Development Transform legacy batch processes into scalable, observable data pipelines Build and deliver high-quality data products in line with architectural designs Work across modern cloud platforms including ...

developing complex solutions in a corporate environment. \n Solid understanding of working with production codebases, such as version control, CI/CD, and batch processing. Practical experience working on cloud-based ML platforms.\n Development and coaching \n \n A strong awareness and understanding of technology trends and direction ...

experience of developing complex solutions in a corporate environment. Solid understanding of working with production codebases, such as version control, CI/CD, and batch processing. Practical experience working on cloud-based ML platforms. Development and coaching A strong awareness and understanding of technology trends and direction in Data ...

microservices, APIs, cloud-native design). AI & Data Platform Architecture/Deployment: Architect robust, secure AI and data platforms that support real-time inference, batch processing, and scalable enterprise workloads, integrating with clients' incumbent technology estates. Implement hybrid-cloud and multi-cloud strategies using modern data infrastructure (Kafka ...

Design and oversee integration approaches between Endur and surrounding applications, data platforms and enterprise systems Shape integration and data architecture patterns across APIs, messaging, batch, event‐driven flows, canonical data models and enterprise data platforms Facilitate architecture, solution design and requirements workshops with business and technology stakeholders Advise clients … Endur architecture, configuration principles and application deployment models Strong understanding of Endur technical components, including JVS/OpenComponents, Connex or equivalent integration mechanisms, reporting, batch processing, environment strategy, upgrade impacts and performance considerations Proven capability designing integrations between Endur and surrounding enterprise applications, data platforms and reporting environments ...

similar between APIs, microservices and event-driven components Build realistic integration environments using Docker, LocalStack and seeded MongoDB datasets Test complex asynchronous workflows, including batch processing, retries, dead-letter queues, idempotency and long-running operations Design reusable test data and automation frameworks Perform exploratory testing where needed Work ...

highly desirable. Strong capability across Salesforce Lightning, Flow automation, and security configuration is expected, along with familiarity in Apex development (including triggers and batch processing) and Lightning Web Components. Experience with Omnistudio (including Omniscripts, Flex Cards, DataRaptors, and Integration Procedures) will be highly advantageous, particularly in enterprise-scale ...

systems where stability is critical. Data Savvy: Experience working with data pipelines and a solid grasp of the trade-offs between real-time and batch processing. Mindset: An eye for usability. You know how to make high-stakes, complex workflows feel simple and foolproof for non-technical users. ...

configuration approaches Act as a technical escalation point for complex development and integration issues Ensure high quality integrations with external systems (APIs, messaging, batch processes, plugins) Coach, and mentor Guidewire developers across multiple experience levels Support skills development, career growth, and succession planning within the team Foster a culture … clear technical direction Proven hands on experience designing and delivering Guidewire ClaimCenter solutions Strong knowledge of Gosu and Java Integration patterns (web services, messaging, batch processes, plugins) Strong experience working in Agile delivery environments Experience authoring and governing technical documentation Strong experience with CI/CD, source control ...

technical escalation point for complex development and integration issues \n\n \n Ensure high‐quality integrations with external systems (APIs, messaging, batch processes, plugins) \n\n \n Coach, and mentor Guidewire developers across multiple experience levels \n\n \n Support skills development, career growth, and succession planning within … experience designing and delivering Guidewire ClaimCenter solutions \n\n \n Strong knowledge of Gosu and Java \n\n \n Integration patterns (web services, messaging, batch processes, plugins) \n\n \n Strong experience working in Agile delivery environments \n\n \n Experience authoring and governing technical documentation ...