tnypxl 02e39baf38 flatten scrape config to 'sites:' ...

* flatten scrape config to 'sites:'. Update unit tests and readme.
* remove check for file_extensions configuration. 
* show progress indication after 5 seconds.
* add documentation to functions
* fix: remove MaxDepth and link extraction functionality
* fix: Remove MaxDepth references from cmd/web.go

2024-10-14 16:09:58 -05:00

..

files_test.go

flatten scrape config to 'sites:'

2024-10-14 16:09:58 -05:00

files.go

flatten scrape config to 'sites:'

2024-10-14 16:09:58 -05:00

generate.go

flatten scrape config to 'sites:'

2024-10-14 16:09:58 -05:00

root.go

fix: Remove redeclaration of cfg variable in cmd/root.go

2024-09-22 17:07:57 -05:00

web_test.go

fix: Resolve playwright function deprecations and io/ioutil function deprecations.

2024-09-24 15:13:36 -05:00

web.go

flatten scrape config to 'sites:'

2024-10-14 16:09:58 -05:00