grab.spider.queue_backend.mongodb

Module Contents

Classes

MongodbTaskQueue

Attributes

LOG

grab.spider.queue_backend.mongodb.LOG[source]
class grab.spider.queue_backend.mongodb.MongodbTaskQueue(connection_args: None | dict[str, Any] = None, collection_name: None | str = None, database_name: str = 'grab_spider')[source]

Bases: grab.spider.queue_backend.base.BaseTaskQueue

size() → int[source]
put(task: grab.spider.task.Task, priority: int, schedule_time: None | datetime.datetime = None) → None[source]
get() → grab.spider.task.Task[source]

Return Task object or raise Queue.Empty exception.

@returns: grab.spider.task.Task object @raises: Queue.Empty exception

clear() → None[source]

Remove all tasks from the queue.

close() → None[source]