Skip to content

Latest commit

 

History

History
42 lines (25 loc) · 625 Bytes

README.md

File metadata and controls

42 lines (25 loc) · 625 Bytes

go-feedcrawler

Feed (RSS and Atom) crawler library (an example application included).

Features

  • Support RSS and Atom
  • Filtering entries
    • Regexp based filter for title, description, content, author and categories
    • Callback function filter
  • State management (keep published date and detect new entries)
  • Multiple workers

Examples

See _examples directory.

  • TOML based configuration file
  • Fake feed server (dynamic entries feed)

TODO

  • Support local files (local path and/or file scheme such as "file://")

License

MIT

Author

Yuki (@yukithm)