Skip to content

Commit

Permalink
docs: Add admonition about low poll intervals with the default spider…
Browse files Browse the repository at this point in the history
…queue, closes #475
  • Loading branch information
jpmckinney committed May 31, 2024
1 parent bbd1bf5 commit f7eaea3
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions docs/config.rst
Original file line number Diff line number Diff line change
Expand Up @@ -164,6 +164,10 @@ The interval used to poll queues, in seconds.
Defaults to ``5.0``.
Can be a float, such as ``0.2``

.. attention::

It is not recommended to use a low interval like 0.1 when using the default :ref:`spiderqueue`. Consider a custom queue based on `queuelib <https://github.com/scrapy/queuelib>`__.

.. _prefix_header:

prefix_header
Expand Down

0 comments on commit f7eaea3

Please sign in to comment.