1 to 25 of 47 Batch Processing Jobs in England

collaboration, and high performance. Hold team members accountable for their performance and professional growth. Technical Expertise: Bring a deep understanding of data technologies, including batch processing, stream processing, storage, analytics, machine learning, and AI. Collaborate with Engineering teams to ensure the data platform meets technical requirements and … data-focused environment. Strong technical background and a degree in Computer Science, Engineering, or a related field. Hands-on experience with data technologies, including batch processing, stream processing, data warehousing, and analytics platforms. Proven track record of successfully leading product strategies that drive significant business outcomes. Experience … experience in mentoring and developing Product Managers. Ability to inspire and lead cross-functional teams toward common goals. Deep understanding of data architectures, data processing frameworks, and data modelling. Familiarity with technologies such as AWS and other cloud-based data services. Knowledge of data privacy laws and compliance requirements More ❯

metadata-forward, CI/CD-driven platform represents and enables the entire application and analysis lifecycle including interactive development and explorations (notebooks), large-scale batch processing, observability and production application deployments. The optimization team's focus is on maximizing scale and performance of all aspects of the platforms. … for delivery of scalable solutions to the Compute and AIML Platforms that supports the entire application lifecycle (interactive development and explorations/analysis, scalable batch processing, application deployment) with particular focus on performance at scale Partner with both AIML and Compute platform teams as well as scientific users More ❯

data from sources like Facebook, Google Analytics, and payment providers. Using tools like AWS Redshift, S3, and Kafka, you'll optimize data models for batch and real-time processing. Collaborating with stakeholders, you'll deliver actionable insights on player behavior and gaming analytics, enhancing experiences and driving revenue with … robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data More ❯

the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data processing pipelines using platforms like Apache Kafka or cloud-native tools. Optimize batch processing workflows with tools like Apache Spark and Flink for … What are we looking for? Advanced proficiency with databases (SQL Server, Oracle, MySQL, PostgreSQL). Expertise in building and managing data pipelines and data processing workflows. Strong understanding of data warehousing concepts, schema design, and data modelling. Hands-on experience with cloud platforms (AWS, Azure, Google Cloud) for scalable More ❯

experts, stakeholders, and senior management across the NHSCFA and our wider stakeholders. The primary responsibilities will include developing, evaluating, maintaining, and managing data pipelines, processing, preparing data suitable for analysis, and developing and maintaining data models. You will support the design of analytical services, products, and models that meet … Lakehouses. Build data pipelines that clean, transform, and present granular and aggregate data from disparate sources. Design, build, test, automate, and maintain architectures and processing workflows for analytics and business intelligence (BI) systems which are scalable. Plan, develop and evaluate methods and processes for gathering, extracting, transforming, and cleaning … data warehouse, infrastructure and ETL solutions covering multiple sources of data. Knowledge of using techniques to ensure datasets and efficient queries are optimised, including batch processing, partitions, and indexing etc. Ability to build API integration to integrate various external NHS data sources and optimise code and data pipelines. More ❯

and implement streaming data pipelines using AWS EMR and PySpark to generate real-time (fast-moving) features for the feature store. Develop and maintain batch processing pipelines using DBT and BigQuery to generate batch (slow-moving) features, ensuring data quality, consistency and reliability. Work with Feast feature … recruiting and related purposes. Our Privacy Notice explains what personal information we will process, where we will process your personal information, its purposes for processing your personal information, and the rights you can exercise over our use of your personal information. More ❯

robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data More ❯

business area. Comfortable making presentations covering business, technical or sales. Detailed knowledge of; Project phasing and reporting On-site delivery Systems support Operational procedures Batch processing System sizing and capacity planning System backup, contingency and disaster recovery Regional roll outs Education & Preferred Qualifications Third level qualification essential ideally More ❯

join wider cross-functional teams. You’ll have significant experience building distributed systems both on-prem and in public cloud, CI/CD pipelines, batch compute tooling and developer productivity tooling. You will be excited and committed to providing an excellent developer experience, with a constant eye on continuous … Software Engineering teams, as well as providing the mechanism for discovering and consuming shared components. Including but not limited to: K8s configuration and usability, batch processing and HPC interactions and hybrid cloud deployments Staying informed on open source and 3rd party tooling that we should consider adopting rather … Exposure to the following would be beneficial: Developer portals and software catalogues Infrastructure-as-code tools such as Ansible or Terraform Experience in using batch compute frameworks, HPC tooling Company Description For almost 50 years, Williams Racing has been at the forefront of one of the fastest sports on More ❯

join wider cross-functional teams. You’ll have significant experience building distributed systems both on-prem and in public cloud, CI/CD pipelines, batch compute tooling and developer productivity tooling. You will be excited and committed to providing an excellent developer experience, with a constant eye on continuous … Software Engineering teams, as well as providing the mechanism for discovering and consuming shared components. Including but not limited to: K8s configuration and usability, batch processing and HPC interactions and hybrid cloud deployments Staying informed on open source and 3rd party tooling that we should consider adopting rather … Exposure to the following would be beneficial: Developer portals and software catalogues Infrastructure-as-code tools such as Ansible or Terraform Experience in using batch compute frameworks, HPC tooling Company Description For almost 50 years, Williams Racing has been at the forefront of one of the fastest sports on More ❯

join wider cross-functional teams. You’ll have significant experience building distributed systems both on-prem and in public cloud, CI/CD pipelines, batch compute tooling and developer productivity tooling. You will be excited and committed to providing an excellent developer experience, with a constant eye on continuous … Software Engineering teams, as well as providing the mechanism for discovering and consuming shared components. Including but not limited to: K8s configuration and usability, batch processing and HPC interactions and hybrid cloud deployments Staying informed on open source and 3rd party tooling that we should consider adopting rather … Exposure to the following would be beneficial: Developer portals and software catalogues Infrastructure-as-code tools such as Ansible or Terraform Experience in using batch compute frameworks, HPC tooling Company Description For almost 50 years, Williams Racing has been at the forefront of one of the fastest sports on More ❯

for end-to-end ETL, ELT & reporting solutions using key components like Spark SQL & Spark Streaming. Strong knowledge of multi-threading and high-volume batch processing. Proficiency in performance tuning for Java/Python and Spark. Deep knowledge of AWS products/services and Kubernetes/container technologies and More ❯

join wider cross-functional teams. You’ll have some experience building distributed systems both on-prem and in public cloud, CI/CD pipelines, batch compute tooling and developer productivity tooling. You will be excited and committed to providing an excellent developer experience, with a constant eye on continuous … Software Engineering teams, as well as providing the mechanism for discovering and consuming shared components. Including but not limited to: K8s configuration and usability, batch processing and HPC interactions and hybrid cloud deployments Stay informed on open source and 3rd party tooling that we should consider adopting rather … Exposure to the following would be beneficial: Developer portals and software catalogues Infrastructure-as-code tools such as Ansible or Terraform Experience in using batch compute frameworks, HPC tooling Company Description For almost 50 years, Williams Racing has been at the forefront of one of the fastest sports on More ❯

join wider cross-functional teams. You’ll have some experience building distributed systems both on-prem and in public cloud, CI/CD pipelines, batch compute tooling and developer productivity tooling. You will be excited and committed to providing an excellent developer experience, with a constant eye on continuous … Software Engineering teams, as well as providing the mechanism for discovering and consuming shared components. Including but not limited to: K8s configuration and usability, batch processing and HPC interactions and hybrid cloud deployments Stay informed on open source and 3rd party tooling that we should consider adopting rather … Exposure to the following would be beneficial: Developer portals and software catalogues Infrastructure-as-code tools such as Ansible or Terraform Experience in using batch compute frameworks, HPC tooling Company Description For almost 50 years, Williams Racing has been at the forefront of one of the fastest sports on More ❯

join wider cross-functional teams. You’ll have some experience building distributed systems both on-prem and in public cloud, CI/CD pipelines, batch compute tooling and developer productivity tooling. You will be excited and committed to providing an excellent developer experience, with a constant eye on continuous … Software Engineering teams, as well as providing the mechanism for discovering and consuming shared components. Including but not limited to: K8s configuration and usability, batch processing and HPC interactions and hybrid cloud deployments Stay informed on open source and 3rd party tooling that we should consider adopting rather … Exposure to the following would be beneficial: Developer portals and software catalogues Infrastructure-as-code tools such as Ansible or Terraform Experience in using batch compute frameworks, HPC tooling Company Description For almost 50 years, Williams Racing has been at the forefront of one of the fastest sports on More ❯

to support LLM-based querying, semantic search, and metadata retrieval. Integrate structured (SQL-based) and unstructured (documents, reports) data sources for real-time and batch processing. Maintain and troubleshoot Airflow pipelines for embedding extraction and document processing. Ensure data governance, security, and compliance across all applications. Manage Vector Database More ❯

in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use More ❯

projects, topical workshops, and lead implementation projects. These professional services engagements will focus on key customer solutions such as, web applications, enterprise applications, HPC, batch processing and big data, archiving and disaster recovery, education and government. Professional Services engage in a wide variety of projects for customers and More ❯

in a BI leadership role in a global or matrixed organisation. Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation, and self More ❯

and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open More ❯

Service Bus. Design, develop and maintain MS SQL Server relational databases with change tracking/CDC. Keep multiple applications in sync - real time/batch processing. Responsible for the delivery of the non-functional requirements within a project. Work with the architect to help set the development coding standards More ❯

London Based Investment Bank You will: Design and build foundation components that will underpin our data mesh ecosystem. Build enterprise class real-time and batch solutions that support mission critical processes. Build solutions in line with our Digital Principles. Partner with our Product team(s) to create sustainable and … hands-on engineering in large scale complex Enterprise(s), ideally in the banking/financial industry. Worked with modern tech - data streaming, real-time & batch processing and compute clusters. Working knowledge of relational and NoSQL databases, designing and implementing scalable solutions. Experience of working in continuous architecture environment More ❯

and Kafka, and collaborating with internal stakeholders to deliver insights into player behaviour and gaming analytics. You’ll work across both real-time and batch processing, helping to optimize infrastructure and drive innovation in a data-rich, high-performance environment. The role is 4 days p/w More ❯

and Kafka, and collaborating with internal stakeholders to deliver insights into player behaviour and gaming analytics. You’ll work across both real-time and batch processing, helping to optimize infrastructure and drive innovation in a data-rich, high-performance environment. The role is 4 days p/w More ❯

business objectives. Manage the technical product backlog, prioritising system enhancements and platform stability. Work closely with engineering and architecture teams to ensure API integrations, batch processing, and data flow across platforms. Lead and oversee broker and partner onboarding, ensuring seamless integration (direct, API, or via Software House solutions More ❯