1 to 25 of 88 Remote Batch Processing Jobs

data from sources like Facebook, Google Analytics, and payment providers. Using tools like AWS Redshift, S3, and Kafka, you'll optimize data models for batch and real-time processing. Collaborating with stakeholders, you'll deliver actionable insights on player behavior and gaming analytics, enhancing experiences and driving revenue with … robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data More ❯

the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data processing pipelines using platforms like Apache Kafka or cloud-native tools. Optimize batch processing workflows with tools like Apache Spark and Flink for … What are we looking for? Advanced proficiency with databases (SQL Server, Oracle, MySQL, PostgreSQL). Expertise in building and managing data pipelines and data processing workflows. Strong understanding of data warehousing concepts, schema design, and data modelling. Hands-on experience with cloud platforms (AWS, Azure, Google Cloud) for scalable More ❯

and implement streaming data pipelines using AWS EMR and PySpark to generate real-time (fast-moving) features for the feature store. Develop and maintain batch processing pipelines using DBT and BigQuery to generate batch (slow-moving) features, ensuring data quality, consistency and reliability. Work with Feast feature … recruiting and related purposes. Our Privacy Notice explains what personal information we will process, where we will process your personal information, its purposes for processing your personal information, and the rights you can exercise over our use of your personal information. More ❯

robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data More ❯

deployment of critical software components Collaborate closely with our team of data science engineers to seamlessly integrate and enhance AI systems within our data processing pipeline Contribute to the continuous evolution of our codebase, architectural enhancements, and exploration of new technologies Engage with our diverse software architectures, including microservices … event-driven systems, batch processing and service-based architecture Utilise a wide array of technologies across the stack, including but not limited to Scala, Python, Kubernetes, Couchbase, PubSub, Postgres, and Google Cloud Platform (GCP) Drive enhancements in the performance and resilience of our software ecosystem to effectively align … with business KPIs and meet client SLAs Solve challenges inherent to large-scale systems processing vast volumes of data efficiently and effectively Profil Must haves 3+ years experience with a JVM-based language such as Java, Scala, or Kotlin, or proficiency in a functional language like Haskell Proficiency in More ❯

Pydantic). Scalable Infrastructure: Design, implement, and optimise cloud-based solutions for AI workloads. AI Workload Optimisation: Architect and scale compute infrastructure for inference, batch processing, and real-time AI interactions. Event-Driven Architecture: Develop and maintain real-time, event-driven systems (SNS/SQS, Kafka, Redis Streams … resilience. Problem-Solving: Proven ability to debug and optimise distributed systems. Nice to Have AI Scaling: Experience running AI/ML workloads in production (batch vs. real-time inference, GPU optimisation). Vector Databases: Familiarity with vector search and retrieval systems. Kubernetes: Hands-on experience managing and deploying Kubernetes More ❯

and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open More ❯

London Based Investment Bank You will: Design and build foundation components that will underpin our data mesh ecosystem. Build enterprise class real-time and batch solutions that support mission critical processes. Build solutions in line with our Digital Principles. Partner with our Product team(s) to create sustainable and … hands-on engineering in large scale complex Enterprise(s), ideally in the banking/financial industry. Worked with modern tech - data streaming, real-time & batch processing and compute clusters. Working knowledge of relational and NoSQL databases, designing and implementing scalable solutions. Experience of working in continuous architecture environment More ❯

Knowledge of database technologies such as PostgreSQL or relational DB. Knowledge in microservices development and various integration patterns. Knowledge in event driven development and batch processing. Knowledge in ALM integrations, analytics & business intelligence integrations Ability to mentor and develop junior developers. Excellent leadership, communication (written and oral), and interpersonal More ❯

business objectives. Manage the technical product backlog, prioritising system enhancements and platform stability. Work closely with engineering and architecture teams to ensure API integrations, batch processing, and data flow across platforms. Lead and oversee broker and partner onboarding, ensuring seamless integration (direct, API, or via Software House solutions More ❯

modeling and design, relational database architecture, metadata and repository creation and configuration management. Designs and implements databases with respect to access methods, access time, batch processes, device allocation, validation checks, organization, ETL tasks, protection and security, documentation, and statistical methods. May provide technical consulting in the definition, design, and More ❯

Experience with deep learning frameworks like TensorFlow or PyTorch. Knowledge of ML model deployment options (e.g., Azure Functions, FastAPI, Kubernetes) for real-time and batch processing. Experience with CI/CD pipelines (e.g., DevOps pipelines, Git actions). Knowledge of infrastructure as code (e.g., Terraform, ARM Template, Databricks Asset … Bundles). Understanding of advanced machine learning techniques, including graph-based processing, computer vision, natural language processing, and simulation modeling. Experience with generative AI and LLMs, such as LLamaIndex and LangChain Understanding of MLOps or LLMOps. Familiarity with Agile methodologies, preferably Scrum We are actively seeking candidates for More ❯

adaptations. Troubleshoot complex SAP issues and drive root cause analysis and resolution. Maintain strong knowledge of financial systems integrations (FI, CO, PS modules) and batch processing using Redwood. Mentor junior developers and collaborate with project teams to ensure successful project delivery. More ❯

modeling and design, relational database architecture, metadata and repository creation and configuration management Designs and implements databases with respect to access methods, access time, batch processes, device allocation, validation checks, organization, ETL tasks, protection and security, documentation, and statistical methods May provide technical consulting in the definition, design, and More ❯

modeling and design, relational database architecture, metadata and repository creation and configuration management Designs and implements databases with respect to access methods, access time, batch processes, device allocation, validation checks, organization, ETL tasks, protection and security, documentation, and statistical methods May provide technical consulting in the definition, design, and More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯