grab.spider.task

Module Contents

Classes

BaseTask
Task	Task for spider.

class grab.spider.task.BaseTask

class grab.spider.task.Task(name: None | str = None, url: None | str | grab.request.HttpRequest = None, request: None | grab.request.HttpRequest = None, priority: None | int = None, priority_set_explicitly: bool = True, network_try_count: int = 0, task_try_count: int = 1, valid_status: None | list[int] = None, use_proxylist: bool = True, delay: None | float = None, raw: bool = False, callback: None | collections.abc.Callable[Ellipsis, None] = None, fallback_name: None | str = None, store: None | dict[str, Any] = None, **kwargs: Any)

Bases: BaseTask

Task for spider.

check_init_kwargs(kwargs: collections.abc.Mapping[str, Any]) → None

get(key: str, default: Any = None) → Any

Return value of attribute or None if such attribute does not exist.

process_delay_option(delay: None | float) → None

clone(url: None | str = None, request: None | grab.request.HttpRequest = None, **kwargs: Any) → Task

Clone Task instance.

Reset network_try_count, increase task_try_count. Reset priority attribute if it was not set explicitly.

__repr__() → str

Return repr(self).

__lt__(other: Task) → bool

Return self<value.

__eq__(other: object) → bool

Return self==value.