3 Commits

Author	SHA1	Message	Date
tnypxl	02e39baf38	flatten scrape config to 'sites:' ... * flatten scrape config to 'sites:'. Update unit tests and readme. * remove check for file_extensions configuration. * show progress indication after 5 seconds. * add documentation to functions * fix: remove MaxDepth and link extraction functionality * fix: Remove MaxDepth references from cmd/web.go	2024-10-14 16:09:58 -05:00
Arik Jones	333b9a366c	fix: Resolve playwright function deprecations and io/ioutil function deprecations.	2024-09-24 15:13:36 -05:00
Arik Jones	73116e8d82	Fix logging and other issues from preventing scraping	2024-09-21 15:54:33 -05:00