26 to 50 of 93 Batch Processing Jobs in the UK

methods to transform raw data into processed data. You will own the DataOps infrastructure, ensuring the performance, reliability, and scalability of data ingestion and processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills … ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. What you'll do Orchestrate the ingestion, processing, and storage of raw data within structured and unstructured data repositories. Design, Develop, Deploy and Support data infrastructure, pipelines and architecture. Implement reliable, scalable ...

cutting edge What we’re looking for Software & Data Engineering Strong expertise in Python Passion for writing: clean reliable production-grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience ...

fast-paced environmentPreferred skillsExperience with AWS GlueExperience deploying Python-based data engineering workloads into production environmentsExperience automating data workflows using cloud-native servicesUnderstanding of batch processing, scheduling, and scalable data solutionsExperience within insurance, financial services, or another data-intensive industryWhat success looks likeIn this role, success ...

metadata-forward, CI/CD-driven platform represents and enables the entire application and analysis lifecycle including interactive development and explorations (notebooks), large-scale batch processing, observability and production application deployments. A Sr. Compute Platform Engineer is a leading technical contributor who can consistently take a poorly defined … business problems, Responsible for development of key components of a hybrid on-prem/cloud compute platform for both interactive and scalable batch computing and establishing of processes and workflows to transition existing HPC users and teams to this platform, Responsible for code-driven environment, applications, and container/ ...

solutions using APIs, ESB, Event-Driven Architecture, and Messaging platforms. Define integration patterns between banking applications and third-party systems. Architect real-time and batch processing solutions. Governance & Security Ensure architecture compliance with banking regulatory requirements. Define security architecture, authentication, authorization, and data protection strategies. Support audit, governance … DevOps & Automation CI/CD Pipelines GitHub Jenkins Terraform Infrastructure as Code Banking Domain Knowledge Required Must Have Experience In Core Banking Systems Payment Processing SWIFT Messaging SEPA/CHAPS/Faster Payments Open Banking PSD2 Regulations Basel Frameworks KYC & AML Processes Financial Crime Prevention Regulatory Reporting Required Qualifications ...

placement, policy, claims, exposure, bordereaux, and risk analytics. Strong knowledge of data integration patterns including ETL/ELT, APIs, event-driven architecture, and batch processing. Experience with modern cloud-based data platforms and distributed data architectures. Experience with both relational and non-relational data platforms , including exposure to MongoDB ...

transformation technologies such as Liquid templates and XSLT for data manipulation.• Design, document, and build integration solutions using a variety of approaches including APIs, batch processes, and flat-file exchanges.• Integrate core business applications across multiple business domains, spanning on premises systems and SaaS platforms.• Lead data mapping ...

consumers. You’ve built architectures that held up as they grew with a focus on data warehousing, data lakes, and both real-time and batch processing.Teams bring you their hardest data problems. You’ve made the hard tradeoffs in distributed, multi-tenant systems and lived with the consequences. ...

experienced AWS Data Engineer to help design, build, and maintain a secure, scalable data platform for a government client - supporting real-time and batch processing that underpins critical analytics and decision-making. What you'll be doing: Building, testing, and maintaining robust data pipelines Designing logical and physical … data models Scaling the data platform to meet evolving use cases Analysing data flows and improving processing performance Ensuring data architecture aligns with agreed standards Troubleshooting issues and driving continuous improvement What we're looking for: Essential: Proven experience building data pipelines Strong understanding of data modelling and structures ...

Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise in data warehousing concepts, advanced ETL/ELT processes, and analytics engineering best practices. Exceptional programming ...

experienced AWS Data Engineer to help design, build, and maintain a secure, scalable data platform for a government client – supporting real-time and batch processing that underpins critical analytics and decision-making.What you’ll be doing:Building, testing, and maintaining robust data pipelinesDesigning logical and physical data modelsScaling … data platform to meet evolving use casesAnalysing data flows and improving processing performanceEnsuring data architecture aligns with agreed standardsTroubleshooting issues and driving continuous improvementWhat we’re looking for:Essential:Proven experience building data pipelinesStrong understanding of data modelling and structuresHands-on experience with AWS services (EC2, RDS, Lambda, Athena ...

supporting and enhancing a suite of internal applications within a complex enterprise environment. You'll play a key role in maintaining live services, supporting batch processing, and delivering high-quality enhancements while ensuring system stability and performance. This is an excellent opportunity for someone who enjoys balancing production ...

experience of developing complex solutions in a corporate environment. Solid understanding of working with production codebases, such as version control, CI/CD, and batch processing.Practical experience working on cloud-based ML platforms.Development and coachingA strong awareness and understanding of technology trends and direction in Data Science, analytics ...

Just Eat Takeaway.com is seeking a Senior Data Platform Engineer to join the Batch Data Tools team, advancing Mobius, our internal analytics platform. You will own batch processing components, work on a Kubernetes-native stack, and collaborate across teams to deliver scalable data products. The role requires ...

client inquiries in a timely and professional manner in support superior customer experience model • Install my clients software products on site or remotely • Use batch processes to integrate products into client processes • Use software application programming to integrate products into client systems as needed Technical Support Consultants Must have … years commercial experience • Arabic Speaker • Experience with SQL databases and SQL programming language • Experience of Application support or Implementation • Experience with scripting, batch processing, data file manipulation, or Web services • Knowledge of data management concepts, data analytics, data quality, data integration, business intelligence, CRM, Report Writer, or similar ...

support diverse trading activities.Take full ownership of data products, guiding them from initial concept through to stable production.Design, build, and maintain systems for both batch processing and real-time streaming of time series datasets, ensuring high data quality and reliability.Develop APIs and data access methods for fast, intuitive … relational databasesHave a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experienceFor more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at . California residents, please review the California Privacy Notice for information ...

trading activities. Take full ownership of data products, guiding them from initial concept through to stable production. Design, build, and maintain systems for both batch processing and real‐time streaming of time series datasets, ensuring high data quality and reliability. Develop APIs and data access methods for fast … databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about DRW’s processing activities and our use of job applicants’ data, please view our Privacy Notice at https://drw.com/privacy-notice. California residents, please ...

maintain reports using Endur reporting tools Support CI/CD processes and deployments within Endur environments Troubleshoot issues across development, testing, and production Support batch processes and EOD activities as needed Work with business users and analysts to understand requirements and deliver working solutions Required (Endur-specific) Hands … working within Endur reporting tools (Report Builder or similar) Familiarity with CI/CD processes in Endur environments Experience supporting or working with Endur batch/EOD processes 3–5+ years of Endur-specific development experience Transferable experience (CTRM/general development) Development experience with Java, JavaScript, .NET ...

where requiredDesign and oversee integration approaches between Endur and surrounding applications, data platforms and enterprise systemsShape integration and data architecture patterns across APIs, messaging, batch, event-driven flows, canonical data models and enterprise data platformsFacilitate architecture, solution design and requirements workshops with business and technology stakeholdersAdvise clients on ETRM … Endur architecture, configuration principles and application deployment modelsStrong understanding of Endur technical components, including JVS/OpenComponents, Connex or equivalent integration mechanisms, reporting, batch processing, environment strategy, upgrade impacts and performance considerationsProven capability designing integrations between Endur and surrounding enterprise applications, data platforms and reporting environmentsStrong understanding ...

Design and oversee integration approaches between Endur and surrounding applications, data platforms and enterprise systems Shape integration and data architecture patterns across APIs, messaging, batch, event-driven flows, canonical data models and enterprise data platforms Facilitate architecture, solution design and requirements workshops with business and technology stakeholders Advise clients … Endur architecture, configuration principles and application deployment models Strong understanding of Endur technical components, including JVS/OpenComponents, Connex or equivalent integration mechanisms, reporting, batch processing, environment strategy, upgrade impacts and performance considerations Proven capability designing integrations between Endur and surrounding enterprise applications, data platforms and reporting environments ...

with at least one programming language such as (but not limited to) C#, Java, .Net, or other related languages or technologies Experience with scripting, batch processing, data file manipulation, or Web services My client is based in London Hybrid Working Consultant, Hosted Support, AWS, AZURE, SQL Fixed Income ...

Experience with at least one programming language such as (but not limited to) C#, Java, .Net, or other related languages or technologiesExperience with scripting, batch processing, data file manipulation, or Web servicesMy client is based in London Hybrid WorkingConsultant, Hosted Support, AWS, AZURE, SQL Fixed Income Implementation FINTECH ...

data marts, reports and interfaces. Good understanding of data tools and delivery mechanisms used across investment platforms, including ETL tooling, data warehouses, data marts, batch processing, APIs, SFTP, vendor feeds and automated comparison tools. Familiarity with common investment data formats and exchange methods, including CSV, XML, fixed-width ...

reconciliations, data marts, reports and interfaces.Good understanding of data tools and delivery mechanisms used across investment platforms, including ETL tooling, data warehouses, data marts, batch processing, APIs, SFTP, vendor feeds and automated comparison tools.Familiarity with common investment data formats and exchange methods, including CSV, XML, fixed-width files ...

U.S. production, disaster recovery, and certification systems for issuesAssisting build team to resolve build/deployment issuesWorking Jira tickets assigned to DevOpsCapacity planningManaging operational batch processingProjects: supporting implementation of new environments and new busines requirementsDevOps Engineers Must Have:Experience in a technical operations support roleLinux experienceA knack for automationHigh ...