7 Commits

Author	SHA1	Message	Date
Arik Jones	ad5147551a	Add function documentation	2024-10-12 20:33:11 -05:00
Arik Jones	6870258944	remove check for file_extensions configuration. show progress indication after 5 seconds.	2024-10-12 15:11:15 -05:00
Arik Jones	da92da21dc	flatten scrape config to 'sites:'. Update unit tests and readme.	2024-10-12 13:47:21 -05:00
Arik Jones	73116e8d82	Fix logging and other issues from preventing scraping	2024-09-21 15:54:33 -05:00
Arik Jones (aider)	53dcd6eb71	feat: Add support for exclusionary CSS paths in config.go	2024-09-14 20:59:08 -05:00
Arik Jones (aider)	52c7de255d	feat: Implement scraping of multiple URLs with optional CSS locators and separate output files	2024-09-14 20:35:35 -05:00
Arik Jones	0163c4e504	Adds a configuration layer for use rollup.yml which may be preferred over CLI flags.	2024-09-05 23:41:39 -05:00