5 of 5 Remote/Hybrid Batch Processing Jobs in London

experience AWS Azure Desirable Skills: Hands-on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large-scale batch processing. Data engineering at scale in government or similarly complex domains, including performance tuning and data quality management. CI/CD & DevOps: pipelines ...

noting that you will be unable to work at home 100% of the time. Your Role: Design, develop, and maintain scalable data pipelines and processing frameworks using Databricks, Python, and PySpark Build and optimize data workflows to support analytics, reporting, and operational needs Collaborate with cross-functional teams … data lakes and (optionally) Snowflake Your Skills: Strong hands-on experience with Databricks (must-have) Proficiency in Python and PySpark for large-scale data processing Solid understanding of data engineering fundamentals (ETL/ELT, batch processing, transformations) Proven experience building scalable and efficient data pipelines Exposure ...

Rate: 300 GBP Per Day Eight years of experience with Mainframe technologies including COBOL, CICS, JCL, DB2, and VSAM, with proven expertise in batch processing and online transaction processing (OLTP) environmen tsSolid experience in application support, with a good understanding of Incident and Problem Management processes, along ...

Role Design and deliver APIs using API-led connectivity (System, Process, Experience layers) Build complex integration solutions including event-driven architectures, orchestration, streaming, and batch processing Lead development on key projects, ensuring high-quality engineering standards Produce reusable assets, modules, and DataWeave transformations Contribute to API specifications (RAML ...

offers the chance to shape the future-state data platform for a large, complex financial services organisation. The focus is on moving from slow, batch-based analytics towards a more modern, streaming-led architecture, with clear ownership over data vision, use cases, and delivery direction. The Company They … Databricks-based medallion architecture, with a strong focus on a robust Gold layer for analytics. Improve data availability by shifting from monthly batch processes towards more frequent or streaming ingestion where appropriate. Act as the senior technical decision-maker on data use cases, prioritisation, and trade-offs. Work closely ...