Skip to content

Releases: EdJoPaTo/website-stalker

v0.9.0

12 Jul 13:33
Compare
Choose a tag to compare

RSS Feeds

A new editor rss is now able to generate RSS 2.0 feeds from input. See more details about this new editor in the README.

v0.8.0

02 Jul 11:49
Compare
Choose a tag to compare

More generic config file format

Each site in the config file is now more generic. Before each entry was an html or utf8 entry. Now each entry is basically the same.
Each entry has an URL and a file extension which is then used to save the resulting file.
Each site can also have editors. An editor manipulates the content before saving the result.
css_selector and regex_replacer are now editors. The default behavior of html to prettify the content is now and editor too: html_prettify.
Additionally this update includes a new editor html_text which only returns text entries from the HTML.

To give an example:

sites:
  - url: "https://edjopato.de/post/"
    extension: html
    editors:
      - css_selector: article
      - css_selector:
          selector: .meta
          remove: true
      - html_prettify

If you want to see a config migration see this commit.

css_selector remove elements

The css_selector can now remove matching HTML elements from the result. This is already included in the example above.

html_text Editor

This editor only returns text entries from the HTML.
To give an example: This will save every h1 heading to the resulting file.

  - url: "https://edjopato.de/post/"
    extension: txt
    editors:
      - css_selector: h1
      - html_text

systemd improvements

v0.7.1

23 Jun 18:02
Compare
Choose a tag to compare

systemd user service/timer

You can use the website-stalker systemd units now as a user too. Check out the systemd/README.md for more details.
580bb5f 953a038

v0.7.0

20 Jun 18:31
Compare
Choose a tag to compare

systemd files

Adds a systemd service and timer to be used locally 3a210f2

libgit2

Migrate some functions from running git as a commandline tool towards libgit2.
This should make handling and detecting easier on the code side of things.
Not everything is migrated (yet?). Some outputs like the git diff are just fine currently via the commandline command.
0074611 bf08eb4 20f07d5 9398cd6

This also allows for running from within a subfolder of a git repo 9398cd6

Minor changes

  • fix(settings): require config file existance 662c18c
  • fix: improve readability of run error 2d827ea

v0.6.0

15 Jun 00:01
Compare
Choose a tag to compare

Commit message summary

Show a summary of changes in the commit message body

63aae58 cf16544 754c7e3 799d740

Console output

  • refactor(logger): rename HINT to INFO 791c21b
  • feat: add ChangeKind init for first run 6b474b6
  • refactor: improve stdout message when filtered 078d5b6

v0.5.0

02 Jun 16:43
Compare
Choose a tag to compare
  • 7c709d4 feat(completions): generate completions
  • ade3b70 perf: improve release build performance

v0.4.0

27 May 13:47
Compare
Choose a tag to compare
  • 2f258ea feat(filename): remove domain www prefix
  • d1fa404 feat(html): error when css_selector selects nothing
  • 9ac837c refactor: simplify git add/commit logic

v0.3.0: fix(logger): use also all uppercase for hint

26 May 07:11
Compare
Choose a tag to compare
  • b221c47 feat(http): support gzip and brotli decompression
  • 52aa5f3 feat: hint on multiple same domain requests
  • 073e60e feat: print warn/error to stderr instead of stdout
  • 5d801bc feat(git): warn when no git repo / no git commit
  • ec51415 fix(logger): use also all uppercase for hint
  • improve docs

v0.2.0

24 May 19:01
Compare
Choose a tag to compare
  • feat: run async and wait 5s between same domain 70f4a4e 70c0ba2
  • feat: show time it took b130729
  • feat: improve validation of FROM header 0bf3ba6
  • fix(http): set user_agent once 58ad848
  • perf(git): do git add once with all files e6f8334
  • fix(git): remove version from git message 9af4cde
  • fix(git): never use a pager d47fe63

v0.1.0

22 May 14:12
Compare
Choose a tag to compare

Initial release