11 Commits

Author	SHA1	Message	Date
tnypxl	02e39baf38	flatten scrape config to 'sites:' ... * flatten scrape config to 'sites:'. Update unit tests and readme. * remove check for file_extensions configuration. * show progress indication after 5 seconds. * add documentation to functions * fix: remove MaxDepth and link extraction functionality * fix: Remove MaxDepth references from cmd/web.go	2024-10-14 16:09:58 -05:00
Arik Jones (aider)	1869dae89a	docs: update configuration section in README.md	2024-09-22 18:36:17 -05:00
Arik Jones (aider)	d3ff7cb862	docs: Update README.md CLI flag documentation	2024-09-22 18:33:24 -05:00
Arik Jones (aider)	ea410e4abb	feat: Update README.md to reflect recent changes in functionality	2024-09-22 18:31:06 -05:00
Arik Jones	f9eee282bc	docs: Update readme to include generate command that produces default config file.	2024-09-19 12:22:42 -05:00
Arik Jones	1e88fae75d	docs: Update the readme	2024-09-19 11:08:13 -05:00
Arik Jones	41fb9e3fad	Correction in web scraping example.	2024-09-14 21:38:17 -05:00
Arik Jones (aider)	6cb2f03d74	feat: Add web scraping functionality and exclusionary CSS paths	2024-09-14 21:26:59 -05:00
Arik Jones (aider)	5264023cba	feat: add MIT license	2024-09-14 20:15:05 -05:00
Arik Jones (aider)	87c2a81375	feat: Add README.md	2024-09-14 20:13:00 -05:00
Arik Jones	7dd149417a	Initial commit	2024-09-03 10:50:10 -05:00