Quote:
Originally Posted by redpoint5
Even if these bots don't respect rules, you'd think they would at least schedule their crawls in the middle of the night to maximize the available bandwidth, and maybe annoy the site owners a little less, which might reduce the countermeasures from being implemented.
|
The AI crawlers want to do this, but they do not know when night is in redpoint5's time zone
If only they'd do it during my time zone's night...
__________________
e·co·mod·ding: the art of turning vehicles into what they should be
What matters is
where you're going, not
how fast.
"... we humans tend to screw up everything that's good enough as it is...or everything that we're attracted to, we love to go and defile it." - Chris Cornell
[Old] Piwoslaw's Peugeot 307sw modding thread