Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace example.com domains with Scrapinghub demo toscrape.com domains in the documentation #149

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

ankitjavalkar
Copy link
Contributor

@ankitjavalkar ankitjavalkar commented Jun 2, 2023

Fixes #107

@ankitjavalkar
Copy link
Contributor Author

I am little concerned that the changes may dilute the context or the relevance of the examples. Need a second opinion on this.

@ankitjavalkar ankitjavalkar requested review from Gallaecio and BurnzZ June 2, 2023 11:04
@codecov
Copy link

codecov bot commented Jun 2, 2023

Codecov Report

Merging #149 (5eebbf3) into master (5167ed6) will not change coverage.
The diff coverage is n/a.

❗ Current head 5eebbf3 differs from pull request most recent head f896a7d. Consider uploading reports for the commit f896a7d to get more accurate results

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #149   +/-   ##
=======================================
  Coverage   85.39%   85.39%           
=======================================
  Files          14       14           
  Lines         815      815           
=======================================
  Hits          696      696           
  Misses        119      119           

@ankitjavalkar
Copy link
Contributor Author

I am checking the tox ci/cd failure

@@ -62,7 +62,7 @@ Suppose we have the following Page Object:

# Simulates clicking on a button that says "View All Images"
response: web_poet.HttpResponse = await self.http.get(
f"https://api.example.com/v2/images?id={item['product_id']}"
f"https://api.toscrape.com/v2/images?id={item['product_id']}"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not a working URL; is it possible to have a real example? I think the idea to use toscrape.com domain is to actually make the examples runnable.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree @kmike . Though, the situation here is that we do not have a toscrape.com website that supports API calls. Now there are websites that support dummy/test API calls but the mandate of the issue was that we should not be using other external domains.

Can we setup an API based toscrape website?

Copy link
Member

@kmike kmike Jun 10, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure how it fits the example, but I think http://quotes.toscrape.com/scroll uses an AJAX call.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Use websites in the docs and examples in toscrape.com
2 participants