1 to 25 of 38 Permanent Batch Processing Jobs in England

cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. We’re looking for candidates with over 3 years of relevant experience in … the following skills or proven experience: Apache NiFi Expertise: Deep understanding of core NiFi concepts: FlowFiles, Processors, Controller Services, Schedulers, Web UI. Experience designing and optimizing data flows for batch, real-time streaming, and event-driven architectures. Ability to identify and resolve flow issues, optimize performance, and implement error-handling strategies. Optional scripting skills for creating custom NiFi processors. More ❯

cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. We’re looking for candidates with over 3 years of relevant experience in … the following skills or proven experience: Apache NiFi Expertise: Deep understanding of core NiFi concepts: FlowFiles, Processors, Controller Services, Schedulers, Web UI. Experience designing and optimizing data flows for batch, real-time streaming, and event-driven architectures. Ability to identify and resolve flow issues, optimize performance, and implement error-handling strategies. Optional scripting skills for creating custom NiFi processors. More ❯

Cloud) and big data technologies (e.g., Hadoop, Spark). Strong knowledge of data workflow solutions like Azure Data Factory, Apache NiFi, Apache Airflow etc Good knowledge of stream and batch processing solutions like Apache Flink, Apache Kafka Good knowledge of log management, monitoring, and analytics solutions like Splunk, Elastic Stack, New Relic etc Given that this is just More ❯

a recent focus on developing data and analytics solutions on cloud platform (e.g. GCP/AWS/Azure). Technical know-how in data engineering techniques which cover both batch processing and/or streaming Agile Delivery: Significant experience in scoping and development of technical solutions in an Agile environment. Technical Proficiency: Deep technical expertise in software and … data engineering, programming languages (python, java etc.). Understanding of orchestration (Composer, DAGs), data processing (Kafka, Flink, DataFlow, dbt), and database capabilities (e.g. BigQuery, CloudSQL, BigTable). Container technologies (Docker, Kubernetes), IaaC (Terraform) and experience with cloud platforms such as GCP. CI/CD: Detailed understanding of working automated CI/CD pipelines and experience of working with tools … had Industry Standard: GCP Data Engineer/Cloud Architect certifications Good appreciation of data security and privacy, and architectural implications it has on application design. Modern progressive technologies– e.g. batch/streaming pipelines, machine learning, artificial intelligence etc. High-level knowledge of QA, data quality, and software quality tools such as SonarQube, etc. About working for us Our ambition More ❯

Google Cloud) and big data technologies (e.g., Hadoop, Spark). Strong knowledge of data workflow solutions like Azure Data Factory, Apache NiFi, Apache Airflow Good knowledge of stream and batch processing solutions like Apache Flink, Apache Kafka Good knowledge of log management, monitoring, and analytics solutions like Splunk, Elastic Stack, New Relic Note: The following line contains removed More ❯

domain and sharing insights with the team WHAT YOU'LL BRING: Writes clean, maintainable Python code (ideally with type hints, linters, and tests like pytest) Understands data engineering basics: batch processing, schema evolution, and building ETL pipelines Has experience with or is eager to learn Apache Spark for large-scale data processing Is familiar with the AWS More ❯

currently recruiting for a Platfrom Support Engineer to join an industry leading and ambitious financial services company. This is an exciting opportunity with multifaceted responsibilities, including infrastructure, application and batch support. As well as developing and maintaining Grafana dashboards. What you’ll do: • Support batch processing and carry out proactive analysis across squads and services. • Support and … resolve production incidents, problems, and change requests. • Offer expertise on business processes for projects and production support issues. • Maintain core systems and related infrastructure like Kubernetes and SOLR. • Improve batch efficiency and reduce costs, including audit-ready data archiving strategies. • Provide data analysis to support business decisions • Deliver patching, database fixes, and business-critical data correction services. What we More ❯

currently recruiting for a Platfrom Support Engineer to join an industry leading and ambitious financial services company. This is an exciting opportunity with multifaceted responsibilities, including infrastructure, application and batch support. As well as developing and maintaining Grafana dashboards. What you'll do: • Support batch processing and carry out proactive analysis across squads and services. • Support and … resolve production incidents, problems, and change requests. • Offer expertise on business processes for projects and production support issues. • Maintain core systems and related infrastructure like Kubernetes and SOLR. • Improve batch efficiency and reduce costs, including audit-ready data archiving strategies. • Provide data analysis to support business decisions • Deliver patching, database fixes, and business-critical data correction services. What we More ❯

high motivated individual to bring a diverse skill set and proactive mindset to help ensure the stability, efficiency, and resilience of applications across esure. What you’ll do: Support batch processing and carry out proactive analysis across squads and services. Review Java code and suggest improvements to enhance quality and performance. Investigate and resolve production incidents, problems, and … change requests. Offer expertise on business processes for projects and production support issues. Maintain core Insurance systems and related infrastructure like Kubernetes and SOLR. Improve batch efficiency and reduce costs, including audit-ready data archiving strategies. Provide data analysis to support business decisions across Operations and Claims. Deliver patching, database fixes, and business-critical data correction services. What we More ❯

high motivated individual to bring a diverse skill set and proactive mindset to help ensure the stability, efficiency, and resilience of applications across esure. What you’ll do: Support batch processing and carry out proactive analysis across squads and services. Review Java code and suggest improvements to enhance quality and performance. Investigate and resolve production incidents, problems, and … change requests. Offer expertise on business processes for projects and production support issues. Maintain core Insurance systems and related infrastructure like Kubernetes and SOLR. Improve batch efficiency and reduce costs, including audit-ready data archiving strategies. Provide data analysis to support business decisions across Operations and Claims. Deliver patching, database fixes, and business-critical data correction services. What we More ❯

CloudSQL, Spanner, Pub Sub, Cloud composer and GKE. Data Engineering : Proficient in modern data tools and frameworks for building, operating, and optimising ETL/ELT pipelines, streaming data, and batch processing. SRE & Automation : Strong understanding of SRE principles, CI/CD, infrastructure as code, and operational automation. Data Literacy : Ability to design, develop, and apply data and analytics experience More ❯

field Experience: Proven experience in ML model lifecycle management Core Competencies : Model lifecycle: You've got hands-on experience with managing the ML model lifecycle, including both online and batch processes Statistical Methodology: You have worked with GLMs and other machine learning algorithms and have in-depth knowledge of how they work Python: You have built and deployed production More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

Java, SQL, C#, Python Connex Gateways for trade booking and market data integration Real-Time Position Engine (RTPE) and Automated Position Management (APM) Performance tuning and optimization for EOD batch processing If interested please apply here or reacj out to me on +44 More ❯

data solutions that support diverse trading activities. Take full ownership of data products, guiding them from initial concept through to stable production. Design, build, and maintain systems for both batch processing and real-time streaming of time series datasets, ensuring high data quality and reliability. Develop APIs and data access methods for fast, intuitive retrieval of historical and … Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at More ❯

skills and experience with relational databases. Solid experience in automation testing using tools such as Selenium, Java, PHP, Go, or similar technologies. Experience with Postman, SOAP UI, and Cucumber. Batch processing experience. Financial services/fintech experience. If you're passionate about testing, automation, and continuous learning, we would love to hear from you More ❯

skills and experience with relational databases. Solid experience in automation testing using tools such as Selenium, Java, PHP, Go, or similar technologies. Experience with Postman, SOAP UI, and Cucumber. Batch processing experience. Financial services/fintech experience. If you're passionate about testing, automation, and continuous learning, we would love to hear from you More ❯

API integrations, data feeds, and calculation discrepancies. Maintain Vertex REST/SOAP API integrations and support FBDI/ADFdi data loads. Monitor performance and optimize tax data loads and batch processes. Compliance & Reporting Support tax compliance reporting (Sales & Use Tax, VAT/GST, Withholding, 1099/1042). Assist with SOX audits, ensuring controls and documentation are maintained. Reconcile More ❯

API integrations, data feeds, and calculation discrepancies. Maintain Vertex REST/SOAP API integrations and support FBDI/ADFdi data loads. Monitor performance and optimize tax data loads and batch processes. Compliance & Reporting Support tax compliance reporting (Sales & Use Tax, VAT/GST, Withholding, 1099/1042). Assist with SOX audits, ensuring controls and documentation are maintained. Reconcile More ❯

API integrations, data feeds, and calculation discrepancies. Maintain Vertex REST/SOAP API integrations and support FBDI/ADFdi data loads. Monitor performance and optimize tax data loads and batch processes. Compliance & Reporting Support tax compliance reporting (Sales & Use Tax, VAT/GST, Withholding, 1099/1042). Assist with SOX audits, ensuring controls and documentation are maintained. Reconcile More ❯

API integrations, data feeds, and calculation discrepancies. Maintain Vertex REST/SOAP API integrations and support FBDI/ADFdi data loads. Monitor performance and optimize tax data loads and batch processes. Compliance & Reporting Support tax compliance reporting (Sales & Use Tax, VAT/GST, Withholding, 1099/1042). Assist with SOX audits, ensuring controls and documentation are maintained. Reconcile More ❯