15 of 15 Batch Processing Jobs in London

Senior Data Engineer – SC Cleared We are seeking a hands-on Senior Data Engineer with deep expertise in building and managing streaming and batch data pipelines . The ideal candidate will have strong experience working with large-scale data systems operating on cloud-based platforms such as AWS, Databricks or Snowflake . This role also involves close collaboration with … to evaluate and document Proofs of Concept (PoCs) for modern data platforms, while effectively engaging with senior stakeholders across the organisation. Key Responsibilities: Design, develop, and maintain streaming and batch data pipelines using modern data engineering tools and frameworks. Work with large volumes of structured and unstructured data , ensuring high performance and scalability. Collaborate with cloud providers and data … and Security teams to align data platform initiatives with business and technical strategies. Required Experience & Skills: Proven experience as a Data Engineer with a strong focus on streaming and batch processing . Hands-on experience with cloud-based data plaforms such as AWS/Databricks/IBM/Snowflake . Strong programming skills in Python, Scala, or Java More ❯

field Experience: Proven experience in ML model lifecycle management Core Competencies : Model lifecycle: You've got hands-on experience with managing the ML model lifecycle, including both online and batch processes Statistical Methodology: You have worked with GLMs and other machine learning algorithms and have in-depth knowledge of how they work Python: You have built and deployed production More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

will have direct global impact. In this role, you will own the full data stack from ingestion through to analytics, building and maintaining scalable pipelines across API, streaming, and batch processes. You will manage cloud infrastructure on AWS with a DevOps mindset, including CI/CD, infrastructure as code, monitoring, and scaling. Working closely with engineering and product teams More ❯

will have direct global impact. In this role, you will own the full data stack from ingestion through to analytics, building and maintaining scalable pipelines across API, streaming, and batch processes. You will manage cloud infrastructure on AWS with a DevOps mindset, including CI/CD, infrastructure as code, monitoring, and scaling. Working closely with engineering and product teams More ❯

will have direct global impact. In this role, you will own the full data stack from ingestion through to analytics, building and maintaining scalable pipelines across API, streaming, and batch processes. You will manage cloud infrastructure on AWS with a DevOps mindset, including CI/CD, infrastructure as code, monitoring, and scaling. Working closely with engineering and product teams More ❯

will have direct global impact. In this role, you will own the full data stack from ingestion through to analytics, building and maintaining scalable pipelines across API, streaming, and batch processes. You will manage cloud infrastructure on AWS with a DevOps mindset, including CI/CD, infrastructure as code, monitoring, and scaling. Working closely with engineering and product teams More ❯

skills and experience with relational databases. Solid experience in automation testing using tools such as Selenium, Java, PHP, Go, or similar technologies. Experience with Postman, SOAP UI, and Cucumber. Batch processing experience. Financial services/fintech experience. If you're passionate about testing, automation, and continuous learning, we would love to hear from you More ❯

API integrations, data feeds, and calculation discrepancies. Maintain Vertex REST/SOAP API integrations and support FBDI/ADFdi data loads. Monitor performance and optimize tax data loads and batch processes. Compliance & Reporting Support tax compliance reporting (Sales & Use Tax, VAT/GST, Withholding, 1099/1042). Assist with SOX audits, ensuring controls and documentation are maintained. Reconcile More ❯

API integrations, data feeds, and calculation discrepancies. Maintain Vertex REST/SOAP API integrations and support FBDI/ADFdi data loads. Monitor performance and optimize tax data loads and batch processes. Compliance & Reporting Support tax compliance reporting (Sales & Use Tax, VAT/GST, Withholding, 1099/1042). Assist with SOX audits, ensuring controls and documentation are maintained. Reconcile More ❯

API integrations, data feeds, and calculation discrepancies. Maintain Vertex REST/SOAP API integrations and support FBDI/ADFdi data loads. Monitor performance and optimize tax data loads and batch processes. Compliance & Reporting Support tax compliance reporting (Sales & Use Tax, VAT/GST, Withholding, 1099/1042). Assist with SOX audits, ensuring controls and documentation are maintained. Reconcile More ❯

API integrations, data feeds, and calculation discrepancies. Maintain Vertex REST/SOAP API integrations and support FBDI/ADFdi data loads. Monitor performance and optimize tax data loads and batch processes. Compliance & Reporting Support tax compliance reporting (Sales & Use Tax, VAT/GST, Withholding, 1099/1042). Assist with SOX audits, ensuring controls and documentation are maintained. Reconcile More ❯