My main site has been getting between 60K and 83K page impressions per day. Most of these are due to Google deep spidering the site and it is a sustained level of traffic. (1.3M pages last month, 977K pages already this month.) The box serving the site is a 3G P4 and I've been thinking of implementing mod_deflate in order to reduce the bandwidth. I think Google's googlebot spider can handle gzipped/compressed pages. Can the other major spiders handle compression or is there any problem with mod_deflate and browsers? The other aspect is that the box is serving a page roughly every second. Will mod_deflate slow this rate down or significantly increase the load on the server?
Regards...jmcc
Regards...jmcc