Overview of Appliance Logging

The Volera Excelerator appliance provides a high-performance proxy cache system capable of handling thousands of transactions per second. Even though Excelerator can log extensive details of each transaction and the disk space reserved for log files is quite generous on most appliances, Excelerator can fill up the available disk space in a matter of minutes if transaction volume is high and log entries consume a few hundred bytes each.

This section explains how appliance logging works and presents management options you can use to ensure optimal use of the available log file disk space and timely migration (downloading) of log files to other storage devices.


What the Appliance Can Log

The following table shows the transactions the appliance can log and the formats available for each service type.

Service Common Extended

Transparent/Forward Proxy

Yes

Yes

Web Server Accelerator

Yes

Yes

Clustered Services (all types)

Yes

Yes

Content Filtering

Yes*

No

Dynamic Bypass

No*

Yes

* These common log formats differ from the industry standard proxy cache common log format.


The Costs of Logging


Performance

Turning on logging for a given service increases system overhead and causes some performance degradation. Therefore, logging should be used only when service transactions must be tracked for customer billing purposes or other compelling reasons.


Disk Space

Transaction volume and log entry size can cause available log disk space to fill up quickly. Proxy cache disk space is unaffected by log files.

See Planning Step 3: Calculating Log Rollover Requirements for formulas you can use to estimate how quickly your logging disk will fill.


System Constraints

To plan a logging strategy, you must know the capacity and limitations of your appliance.


Disk Space Is Preset

It is essential that you know how much logging disk space is available on your appliance.

Logging disk space is not user-configurable; it is preset by the vendor who produced your appliance. Most vendors allocate different amounts of disk space for log files on each level or tier of appliance they produce.

If you don't have this information, you must get it from your appliance vendor before you can plan a logging strategy. After you determine how much disk space is available, you can plan when to download and delete log files so the disk does not become full.


Log Files Must Be Rolled Over Before Deletion

Excelerator will not allow the deletion of active log files---files that are currently in use by the caching system. Only log files that have been rolled over and closed can be deleted.

You can ensure you have closed files on the system by scheduling regular rolling over of log files. During each rollover, the current log file is closed and a new log file is opened.

You must plan your log file rollover schedule to coincide with your download and deletion schedule so that you have at least one closed log file per service when the download and delete cycle starts.

NOTE:  Although you can download active log files, this is normally useful only for periodic administrative checks.

Active files contain only the transaction data up to the moment of the download and are incomplete from customer billing and other business standpoints.


Logging Ceases When the Logging Disk Is Full

When the appliance encounters a log disk full condition, it stops logging and closes all active log files. Information that would have been logged after that point is lost. Other appliance functions continue without interruption.


Log Filenames Are Limited

The appliance automatically generates log filenames as follows:

This naming convention accommodates up to 702 log files per service per day. If the rollover options are set so that all the possible filenames are used in one day, the log file with the ZZ letter identifier is not closed until the start of the next day (unless the logging disk becomes full).


The Appliance Offers Two Log Rollover Options

Appliance log rollover options let you specify when the appliance closes active log files and opens new files so that the closed files can be downloaded and deleted.

Because of the limitations explained in this section, it is essential that you develop a solid log file rollover plan. This will ensure that your appliance doesn't run out of logging disk space or overwrite log files before they are downloaded and deleted.

You can have the appliance roll log files over according to time or file size, as explained in the following table:

Option Considerations

Roll Over by Time

If you plan to download and delete older log files at a set time, you must configure the appliance so that at least two log files exist per service at the time you've scheduled for downloading and deleting. One file will be active, the other closed and ready for download and deletion.

For example, if you determine that your log disk space will fill every 12 hours, then you must configure the appliance to roll the log files over in intervals less than 6 hours, so that at least one log file per service is closed and ready to be downloaded and deleted.

Roll Over by Size

If you aren't certain how long it will take to fill your appliance's logging disk space, you can roll the log files over by size.

For example, you might be logging transactions for three services and have a log volume size of 6 GB. Because you must have at least two log files per service before the disk space fills, each log file must be smaller than 1 GB when the appliance rolls it over.