7 Commits

Author	SHA1	Message	Date
Claude	09608cf073	fix: resolve 5 bugs identified in code review ... - Fix malformed YAML in config_test.go (incorrect indentation) - Add validation for empty file_extensions in Config.Validate() - Remove obsolete max_depth test case (field no longer exists) - Remove unused global cfg variable in main.go - Fix race condition in ScrapeSites by counting URLs before goroutines - Remove unreachable JavaScript code in scroll script, add proper delay - Standardize file extensions to not include leading dot	2025-11-27 15:56:37 +00:00
tnypxl	02e39baf38	flatten scrape config to 'sites:' ... * flatten scrape config to 'sites:'. Update unit tests and readme. * remove check for file_extensions configuration. * show progress indication after 5 seconds. * add documentation to functions * fix: remove MaxDepth and link extraction functionality * fix: Remove MaxDepth references from cmd/web.go	2024-10-14 16:09:58 -05:00
Arik Jones (aider)	71f63ddaa8	fix: resolve undefined config variable in cmd/files.go	2024-09-22 17:07:32 -05:00
Arik Jones (aider)	574800c241	fix: Update runRollup function to accept config parameter	2024-09-22 17:06:18 -05:00
Arik Jones (aider)	59994c085c	fix: improve file ignore logic and preserve newlines in extracted content	2024-09-22 16:58:53 -05:00
Arik Jones (aider)	396f092d50	fix: improve file ignore pattern matching for nested directories	2024-09-22 16:58:22 -05:00
Arik Jones (aider)	eabf1ba23f	feat: add files subcommand and refactor rollup functionality	2024-09-19 11:38:09 -05:00