1 to 25 of 49 Remote Batch Processing Jobs in London

Python, SKLearn, XGBoost, SparkML, etc. Experience with deep learning frameworks like TensorFlow or PyTorch. Knowledge of ML model deployment options (e.g., Azure Functions, FastAPI, Kubernetes) for real-time and batch processing. Experience with CI/CD pipelines (e.g., DevOps pipelines, Git actions). Knowledge of infrastructure as code (e.g., Terraform, ARM Template, Databricks Asset Bundles). Understanding of advanced … machine learning techniques, including graph-based processing, computer vision, natural language processing, and simulation modeling. Experience with generative AI and LLMs, such as LLamaIndex and LangChain Understanding of MLOps or LLMOps. Familiarity with Agile methodologies, preferably Scrum We are actively seeking candidates for full-time, remote work within the UK. #J-18808-Ljbffr More ❯

Responsibilities: Design, implement, and maintain robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

Responsibilities: Design, implement, and maintain robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. More ❯

Responsibilities: Design, implement, and maintain robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. More ❯

Responsibilities: Design, implement, and maintain robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. More ❯

Responsibilities: Design, implement, and maintain robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. More ❯

Responsibilities: Design, implement, and maintain robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. More ❯

company. Responsibilities Partner with stakeholders across Product, Data, and Engineering to translate strategic goals into platform capabilities. Lead and mentor 1-2 squads responsible for experimentation, analytics event logging, batch data platform, real-time infrastructure, data observability and governance. Collaborate closely with stakeholders to define and drive the technical roadmap for Depop's modern data platform, enabling reliable and … Deep understanding of distributed systems and modern data ecosystems - including experience with Databrick, Apache Spark, Apache Kafka and DBT. Demonstrated success in managing data platforms at scale, including both batch processing and real-time streaming architectures. Deep understanding of data warehousing concepts, ETL/ELT processes, and analytics engineering. Strong programming skills, particularly in Python, Scala or Java More ❯

scalability, and maintainability. Data Integration & Pipeline Engineering: Design and implement resilient ETL/ELT workflows using technologies such as BigQuery, Dataflow, Informatica, or IBM DataStage, supporting real-time and batch processing. Governance & Data Quality Management: Establish data governance frameworks, including metadata management and quality assurance, using platforms like Unity Catalog, Alation, Profisee, or DQ Pro. Strategic Advisory & Stakeholder Engagement More ❯

field Experience: Proven experience in ML model lifecycle management Core Competencies: Model lifecycle: You’ve got hands-on experience with managing the ML model lifecycle, including both online and batch processes Statistical Methodology: You have worked with GLMs and other machine learning algorithms and have in-depth knowledge of how they work Python: You have built and deployed production More ❯

and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source technology such as React More ❯

a part of our Wellcreator development team. Duties & Responsibilities: Hands-on experience in developing applications using Java EE platforms, Spring Framework, Spring Boot, Hibernate, Java Swing, Java FX, JPA, Batch Processing, Java 8, or higher versions. Expertise in producing RESTful APIs and back-end services. Experience in agile development, GIT, or Maven. Familiarity with continuous integration and build More ❯

As a Senior Data Engineer, you'll build and maintain the robust data systems that power our analytics and operational needs.You'll work across our entire data platform, from batch processing to real-time event streams, ensuring our solutions are scalable, maintainable, and deliver real value to our users. You'll have the opportunity to work with modern More ❯

modelling, data access patterns, and efficient use of databases (MSSQL, PostgreSQL, MySQL). Work with data engineers to enable secure, efficient data movement between systems, including real-time and batch processing pipelines. Support analytics and reporting needs through the engineering of clean, reliable data sources and APIs. Security Engineering & Governance Partner with security engineers to integrate security throughout More ❯

modelling, data access patterns, and efficient use of databases (MSSQL, PostgreSQL, MySQL). Work with data engineers to enable secure, efficient data movement between systems, including real-time and batch processing pipelines. Support analytics and reporting needs through the engineering of clean, reliable data sources and APIs. Security Engineering & Governance Partner with security engineers to integrate security throughout More ❯

for clients utilizing messaging standards (incl. FIX, SWIFT and custom XML formats) over MQ, APIs, SFTP, TCP/IP and other protocols. Typically solutions include a combination of messaging, batch processing and data transformation, and are commonly written in Python. This role can be performed in a hybrid model, where you can balance work from home and office More ❯

tools such as Visio. A good knowledge of financial products used in Asset Management including, Equities, Cash, Fixed Income and complex Swap instruments. Nice to have skills Knowledge of Batch processing Knowledge of Jira, Aha! and Confluence Ability to communicate, present, influence, reason and demonstrate the ability to articulate fund accounting concepts to non-fund accounting personnel in More ❯

our goals. Key Responsibilities Architect and Design: Lead the design of reference architectures and applications for multiple patterns in each public cloud provider, e.g., message-driven, simple web applications, batch processing. Mentorship: Provide guidance and mentorship to other engineers, fostering a culture of continuous learning and improvement. Customization and Flexibility: Develop solutions that support flexibility and customization for advanced More ❯

change and configuration management. Experience configuring and working with JBOSS Application Server 7. Knowledge of file transfer protocols and configuration, e.g., SFTP, FTP. Experience providing production support. Understanding of batch processing. Knowledge of enterprise scheduling tools, e.g., Control-M. Personal attributes Good analytical skills. A 'can-do' problem-solving approach. Ability to manage workload and switch between tasks, prioritizing More ❯

Month Contract Hybrid Working Leading London Based Investment Bank You will: Design and build foundation components that will underpin our data mesh ecosystem. Build enterprise class real-time and batch solutions that support mission critical processes. Build solutions in line with our Digital Principles. Partner with our Product team(s) to create sustainable and resilient solutions. Your experience: Bachelor … more; Azure (preferred). Demonstrate hands-on engineering in large scale complex Enterprise(s), ideally in the banking/financial industry. Worked with modern tech - data streaming, real-time & batch processing and compute clusters. Working knowledge of relational and NoSQL databases, designing and implementing scalable solutions. Experience of working in continuous architecture environment, iterating and improving solutions including More ❯

calls are logged, updated and followed through to resolution. 7. Familiarity with source code and change management 8. Provide support for, and perform, monitor, the daily End-of-Day batch processing operation for Flexcube. Key Skills/Experience: University degree educated. Computer Sciences or other related discipline is a must. Key Technical Skills: Oracle FLEXCUBE WS02 API platform More ❯

calls are logged, updated and followed through to resolution. 7. Familiarity with source code and change management 8. Provide support for, and perform, monitor, the daily End-of-Day batch processing operation for Flexcube. Key Skills/Experience: University degree educated. Computer Sciences or other related discipline is a must. Key Technical Skills: Oracle FLEXCUBE WS02 API platform More ❯

calls are logged, updated and followed through to resolution. 7. Familiarity with source code and change management 8. Provide support for, and perform, monitor, the daily End-of-Day batch processing operation for Flexcube. Key Skills/Experience: University degree educated. Computer Sciences or other related discipline is a must. Key Technical Skills: Oracle FLEXCUBE WS02 API platform More ❯