org.erowid.sperowider
Class DownloaderRobotsFilter

java.lang.Object
  org.erowid.sperowider.DownloaderRobotsFilter

public class DownloaderRobotsFilter

extends Object

Provides robots.txt filtering for the Downloader.

Version:

: $Header: /cvsroot/sperowider/SPEROWIDER_MODULE/javasource/org/erowid/sperowider/DownloaderRobotsFilter.java,v 1.9 2005/01/15 23:26:15 gurustu Exp $

Author:

: $Author: gurustu $

Constructor Summary

DownloaderRobotsFilter()

Method Summary

boolean

allow(URL url) Returns true if the robots.txt file indicates that this URL can be downloaded.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DownloaderRobotsFilter

public DownloaderRobotsFilter()

Method Detail

allow

public boolean allow(URL url)

Returns true if the robots.txt file indicates that this URL can be downloaded.