Arik Jones (aider)
|
7676638fa4
|
fix: remove MaxDepth and link extraction functionality
|
2024-10-12 20:42:16 -05:00 |
|
Arik Jones
|
ad5147551a
|
Add function documentation
|
2024-10-12 20:33:11 -05:00 |
|
Arik Jones
|
6870258944
|
remove check for file_extensions configuration. show progress indication after 5 seconds.
|
2024-10-12 15:11:15 -05:00 |
|
Arik Jones
|
da92da21dc
|
flatten scrape config to 'sites:'. Update unit tests and readme.
|
2024-10-12 13:47:21 -05:00 |
|
Arik Jones
|
73116e8d82
|
Fix logging and other issues from preventing scraping
|
2024-09-21 15:54:33 -05:00 |
|
Arik Jones (aider)
|
53dcd6eb71
|
feat: Add support for exclusionary CSS paths in config.go
|
2024-09-14 20:59:08 -05:00 |
|
Arik Jones (aider)
|
52c7de255d
|
feat: Implement scraping of multiple URLs with optional CSS locators and separate output files
|
2024-09-14 20:35:35 -05:00 |
|
Arik Jones
|
0163c4e504
|
Adds a configuration layer for use rollup.yml which may be preferred over CLI flags.
|
2024-09-05 23:41:39 -05:00 |
|