NXLog Agent batch processing

Understanding how NXLog Agent batches records helps you tune throughput and diagnose performance bottlenecks. You can specify batch settings globally or at the module level using the BatchSize and BatchFlushInterval directives. The module-level settings override the global settings.

Input modules organize records into batches. Input modules accumulate records until they reach the batch size or flush interval. Once reaching either of these limits, the module writes the batch to a queue for processing by the following module(s) in the route. Output modules read the batched records from their log queues, process them, and write them to the output buffer in the same order they read them.

NXLog Agent batch processing
Figure 1. NXLog Agent batch processing