tnypxl
eb3b611864
Merge branch 'claude/fix-bugs-and-gaps-01DvJSzruQh49DU6XK5AykQU' ( #4 )
2025-11-27 10:50:03 -06:00
tnypxl
877a7876c0
fix: resolve 5 bugs identified in code review ( #3 )
2025-11-27 09:58:09 -06:00
tnypxl
02e39baf38
flatten scrape config to 'sites:'
...
* flatten scrape config to 'sites:'. Update unit tests and readme.
* remove check for file_extensions configuration.
* show progress indication after 5 seconds.
* add documentation to functions
* fix: remove MaxDepth and link extraction functionality
* fix: Remove MaxDepth references from cmd/web.go
2024-10-14 16:09:58 -05:00
Arik Jones (aider)
21d3e8ee68
fix: Handle missing configuration file for help command
2024-09-16 09:52:48 -05:00
Arik Jones (aider)
a6ebf0062a
fix: Add --verbose flag to web subcommand
2024-09-14 20:41:23 -05:00
Arik Jones (aider)
6f4750c900
fix: Remove references to non-existent CSSLocator field in Config struct
2024-09-14 20:36:31 -05:00
Arik Jones (aider)
b1db362a94
fix: Initialize logger before calling InitPlaywright
2024-09-14 19:59:39 -05:00
Arik Jones (aider)
595c451ad9
feat: Pass scraper configuration to command execution
2024-09-14 15:15:39 -05:00
Arik Jones
a3b23a6d34
...
2024-09-14 15:11:24 -05:00
Arik Jones (aider)
8932f503c6
feat: Pass configuration to command execution
2024-09-14 15:09:57 -05:00
Arik Jones
0163c4e504
Adds a configuration layer for use rollup.yml which may be preferred over CLI flags.
2024-09-05 23:41:39 -05:00
Arik Jones
ef89da6c39
Add main.go
2024-09-03 11:07:45 -05:00