Batch Processing Jobs in the UK excluding London

16 Batch Processing Jobs in the UK excluding London

GCP Data Streaming Engineer - 3 months - Inside IR35 - Hybrid

Cardiff, South Glamorgan, United Kingdom
Hybrid / WFH Options
Hamilton Barnes
and replication to guarantee the highest performance and reliability of data streams. Configure Kafka Connectors: Apply your expertise to set up Kafka connectors for batch processing, managing both source and sink connectors to seamlessly integrate data. Python and Apache Beam Proficiency: Utilize Python and Apache Beam to craft … tailored data processing logic and transformations within pipelines, enabling swift and effective data analysis. Ensure Security: Implement SSL/TLS encryption, SASL authentication, and ACL-based authorization to fortify Kafka clusters and communication channels, ensuring data integrity and privacy. What you will Ideally Bring: Hands-On Kafka Configuration: Proven … expertise in configuring Kafka connectors for batch processing, optimizing their number for improved performance. Python and DataFlow/Apache Beam Proficiency: Skilled in Python and DataFlow/Apache Beam, adept at developing custom data processing logic within pipelines Streaming Data Management: Demonstrated ability in handling streaming data more »
Employment Type: Contract
Rate: GBP 550 Daily
Posted:

Senior Databricks Engineer

Edinburgh, Scotland, United Kingdom
Version 1
deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »
Posted:

Senior Databricks Engineer

Belfast, Northern Ireland, United Kingdom
Version 1
deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »
Posted:

Senior Databricks Engineer

Birmingham, England, United Kingdom
Version 1
deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »
Posted:

Data Engineer

Borehamwood, England, United Kingdom
Hybrid / WFH Options
Addition+
deployment (e.g., promoting ML Pipelines to Production), leveraging MLOps practices and technologies. Experience & Skills Required Skilled in EDW and big data storage, data provisioning, processing, and pipeline orchestration. Comprehensive understanding of data modeling, possessing expertise and experience in data architecture. Proficient coding abilities in Python, SQL, following best software … development practices such as code versioning, code reviews, unit testing, documentation, and use of collaboration tools. Extensive experience in scripting, batch processing, and stream processing. Experience with or at least an interest in Machine Learning and widely used technologies, such as NumPy, Pandas, Matplotlib, Scikit-learn, TensorFlow, and more »
Posted:

Data Scientist

Exeter, Devon, United Kingdom
Akkodis
communicating to the relevant stakeholders on technical matters Capable of Integrating Machine Learning models into production systems and deploy them for real-time or batch processing Senior Data Scientist/Data Scientist/Machine Learning Engineer/Exeter/Torquay/Weymouth/Python/C#/Unity more »
Employment Type: Permanent
Salary: £45000 - £55000/annum
Posted:

Lead Data Engineer

Edinburgh, Scotland, United Kingdom
Hybrid / WFH Options
Cathcart Technology
Staff Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You’ll be joining the batch processing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »
Posted:

BI and Reporting Administrator

Bournemouth, Dorset, South West, United Kingdom
Hybrid / WFH Options
Allianz Insurance Plc
to-day administration to ensure maintenance of systems Application of technical knowledge to ensure support issues are appropriately fielded and managed Monitoring of automated batch processes Dealing with user queries in a timely manner Documentation of procedures. Taking part in System Testing, UAT, etc. Supporting continuous improvement to meet more »
Employment Type: Permanent, Work From Home
Posted:

Elastic Consultant/Data Engineer

Birmingham, England, United Kingdom
GIOS Technology
with Elastic Strong understanding of data modelling, indexing strategies, and Sharding. Experience with data ingestion, transformation, and loading (ETL) processes. Knowledge of data pipelines, batch processing, and real-time streaming. Familiarity with distributed computing for scalability. Programming or Scripting languages such as Python or Java (e.g Nifi) Distributed more »
Posted:

Middleware Technical Lead

Manchester, England, United Kingdom
Hybrid / WFH Options
McGregor Boyall
ETL assessments to identify potential gaps impacting IBS Impact Tolerance thresholds. Track record of developing strategies for Operational Resilience. Experience leading definition of critical batch processes. Ability to contribute insights to group policies and procedures. Confidence in communicating with stakeholders across different levels. Technical background: 10+ years' experience in … Infrastructure administration, Middleware & integration. Experience of event streaming and batch processing, including point-to-point data transfer Proficient in Cryptographic key management and encryption deployments. Knowledge of Operating Systems (Windows, Linux, zOS, F5) and network protocols Familiar with analytic platforms and databases such as MSSQL, Kafka, S3, etc more »
Posted:

Lead Engineer

Banbury, England, United Kingdom
OX Seven Talent Partners
discipline or equivalent qualification. You’ll have experience in a similar role working in a high-volume manufacturing environment, which includes continuous processes and batch processes – preferably within the food manufacturing sector. A practical hands-on approach would be very beneficial and we are also looking for significant experience more »
Posted:

UniVerse Admin

Northampton, Northamptonshire, East Midlands, United Kingdom
Cognizant
Install, configure and licensing Load client software and accounts, Undertake user administration and setup users as per the client standards Schedule and set up batch processing required as per business requirements, Setup printer's and print spoolers, Liaise with the Application stake holders to facilitate any testing requirements … functions Very good experience in Unibasic, PickBasic, Unidata Administrative experience on working with UniVerse file utilities Intense Troubleshooting skill sets and exp in analysing Batch Failures At Cognizant you will experience an exciting mix of innovation by design, creativity, collaboration, and efficiency within a framework of stimulating objectives and more »
Employment Type: Permanent
Posted:

Solutions Architect

Reading, England, United Kingdom
Hybrid / WFH Options
Primark
ownership for projects which are delivered by a highly technical team that supports a complex environment which includes:  Workforce Management and People Systems Solutions  Batch processes, Payroll, Time, and Attendance applications  Data design  Integration design  Experience of various design techniques  Familiar with Service Design and Introduction • Negotiate with key more »
Posted:

Data Engineer

Belfast, Northern Ireland, United Kingdom
Anson McCade
technologies for ETL, data warehouse, and data lake design. Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. Capable of processing large volumes of structured and unstructured data on AWS. Familiarity with AWS best practices in data engineering, data science, and product development. Knowledgeable in … both stream and batch processing. Comfortable designing and building for AWS cloud, including Platform-as-a-Service, server-less, and container technologies. Diverse skills in ETL, data warehouse, and Data Lake design. Familiarity with various tools, cloud technologies, and approaches. Expertise in AWS or equivalent open-source tools. Proficient more »
Posted:

Data Engineer

Greater Bristol Area, United Kingdom
Hybrid / WFH Options
Anson McCade
Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL. In addition, you should have proficiency or … and unstructured data, including integration of data through Azure cloud-based ingestion and curation processes. Knowledge of data mining, machine learning, and natural language processing is considered advantageous. Familiarity with Agile methodologies and participation in Scrum ceremonies. Competence in designing and constructing solutions tailored for the Azure cloud environment more »
Posted:

Azure Data Engineer

Cheltenham, Gloucestershire, United Kingdom
Hybrid / WFH Options
Third Nexus Group Limited
Azure Stream Analytics, and Azure Synapse Analytics. · A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. · Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL. In addition, you should have proficiency or … and unstructured data, including integration of data through Azure cloud-based ingestion and curation processes. · Knowledge of data mining, machine learning, and natural language processing is considered advantageous. · Familiarity with Agile methodologies and participation in Scrum ceremonies. · Competence in designing and constructing solutions tailored for the Azure cloud environment more »
Employment Type: Permanent
Salary: £50000 - £65000/annum
Posted:
Batch Processing
the UK excluding London
10th Percentile
£46,250
25th Percentile
£55,545
Median
£57,500
75th Percentile
£87,500