5 commits

Author	SHA1	Message	Date
xfnw	3e051c0feb	better crawl.php logging	2021-01-08 17:35:14 -05:00
xfnw	459c295488	better crawl.php logging	2021-01-08 16:54:16 -05:00
xfnw	036e3addb2	re-crawl sites	2020-12-22 10:13:45 -05:00
xfnw	8c4421108b	dont track svgs and drop the / from the end of urls so they wont be duplicated	2020-12-15 09:59:19 -05:00
xfnw	69de9f49dc	working	2020-12-14 16:59:16 -05:00