Code

Article spider template#91

Code

Merged

kmike merged 26 commits intomainzytedata/zyte-spider-templates:mainfrom articles_to_mainzytedata/zyte-spider-templates:articles_to_mainCopy head branch name to clipboardDec 16, 2024

+5,986-63

Commits

Commits on Dec 6, 2024

• remove old file

  PyExplorer

  committed
  17d9f95

  Copy full SHA for 17d9f95

• merge from article repo

  PyExplorer

  committed
  c3fa843

  Copy full SHA for c3fa843

• update api.rst

  PyExplorer

  committed
  d5b8adc

  Copy full SHA for d5b8adc

• add DefaultSearchRequestTemplatePage to pages api.rst

  PyExplorer

  committed
  98b4e9c

  Copy full SHA for 98b4e9c

Commits on Dec 8, 2024

• add tests for coverage utils.py

  PyExplorer

  committed
  e04c7b3

  Copy full SHA for e04c7b3

• add tests for coverage PageParamsMiddlewareBase

  PyExplorer

  committed
  2623342

  Copy full SHA for 2623342

Commits on Dec 9, 2024

• add tests for OnlyFeedsMiddleware and PageParamsMiddlewareBase

  PyExplorer

  committed
  1045617

  Copy full SHA for 1045617

• add tests for DummyDupeFilter

  PyExplorer

  committed
  124e123

  Copy full SHA for 124e123

• add from_crawler for TrackSeedsSpiderMiddleware test

  PyExplorer

  committed
  80c7022

  Copy full SHA for 80c7022

• add from_crawler for PageParamsMiddlewareBase test

  PyExplorer

  committed
  492a7be

  Copy full SHA for 492a7be

• add tests for DupeFilterSpiderMiddleware + tune others

  PyExplorer

  committed
  758ec6f

  Copy full SHA for 758ec6f

• fix async test for DupeFilterSpiderMiddleware

  PyExplorer

  committed
  61fab4e

  Copy full SHA for 61fab4e

• add test for from_crawler for TrackSeedsSpiderMiddleware, MaxRequestsPerSeedDownloaderMiddleware

  PyExplorer

  committed
  b24de1e

  Copy full SHA for b24de1e

• add test for TrackNavigationDepthSpiderMiddleware

  PyExplorer

  committed
  8ad76ce

  Copy full SHA for 8ad76ce

• formatting

  PyExplorer

  committed
  728f84e

  Copy full SHA for 728f84e

Commits on Dec 12, 2024

• fix auth issue on staging

  PyExplorer

  committed
  970743b

  Copy full SHA for 970743b

• test

  PyExplorer

  committed
  951bcd7

  Copy full SHA for 951bcd7

• clean todo

  PyExplorer

  committed
  68371f2

  Copy full SHA for 68371f2

Commits on Dec 13, 2024

• Only enable DropLowProbabilityItemPipeline for the articles spider.

  wRAR

  committed
  769bcd0

  Copy full SHA for 769bcd0

• Merge pull request #98 from zytedata/articles-probability-pipeline

  Show description for 8927379
  wRAR

  authored
  8927379

  Copy full SHA for 8927379

• add validation for incremental_collection_name

  kmike

  committed
  ad6a58c

  Copy full SHA for ad6a58c

• fix formatting

  kmike

  committed
  0a6cad3

  Copy full SHA for 0a6cad3

• Merge pull request #100 from zytedata/fix-collection-name-validation

  Show description for 80aa641
  kmike

  authored
  80aa641

  Copy full SHA for 80aa641

• Mark Articles spider as experimental

  Show description for 9f2ef4b
  kmike

  committed
  9f2ef4b

  Copy full SHA for 9f2ef4b

• Merge pull request #101 from zytedata/mark-articles-as-experimental

  Show description for 96376a5
  kmike

  authored
  96376a5

  Copy full SHA for 96376a5

Commits on Dec 16, 2024

• Merge branch 'main' into articles_to_main

  Show description for bacdae4
  kmike

  committed
  bacdae4

  Copy full SHA for bacdae4