Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loop de redirecionamento no Folha Spider #3

Open
gilsondev opened this issue Oct 19, 2017 · 0 comments
Open

Loop de redirecionamento no Folha Spider #3

gilsondev opened this issue Oct 19, 2017 · 0 comments
Labels

Comments

@gilsondev
Copy link
Member

Ao iniciar a raspagem dos metadados das notícias no sistema de busca da Folha, ocorre um loop de redirecionamento. Segue o log:

2017-10-18 22:09:39 [scrapy.core.engine] INFO: Spider opened
2017-10-18 22:09:39 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2017-10-18 22:09:39 [scrapy.extensions.httpcache] DEBUG: Using filesystem cache storage in /media/STORAGE/Developer/Projects/gilsondev/meucandidato/news/.scrapy/httpcache
2017-10-18 22:09:39 [scrapy.extensions.telnet] DEBUG: Telnet console listening on 127.0.0.1:6023
2017-10-18 22:09:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET http://search.folha.uol.com.br/search/?q=Michel%20Temer&site=todos> from <GET http://search.folha.uol.com.br/search/?q=Michel%20Temer&site=todos>
2017-10-18 22:09:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET http://search.folha.uol.com.br/search/?q=Michel%20Temer&site=todos> from <GET http://search.folha.uol.com.br/search/?q=Michel%20Temer&site=todos>
2017-10-18 22:09:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET http://search.folha.uol.com.br/search/?q=Michel%20Temer&site=todos> from <GET http://search.folha.uol.com.br/search/?q=Michel%20Temer&site=todos>
@gilsondev gilsondev added the bug label Oct 19, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant