Commit graph

32 commits

Author SHA1 Message Date
xfnw
854aa79255 clean up css a bit 2022-02-24 19:01:20 -05:00
xfnw
34b11fa5af fix mdash not being htmldecoded 2021-12-11 12:50:41 -05:00
xfnw
9acb68d457 automatic focus of search bar 2021-10-27 19:03:53 -04:00
f10cd8d3fe rename LICENSE 2021-10-22 16:12:28 -04:00
xfnw
e9b6f113d9 limit filesize of crawls 2021-10-22 11:43:33 -04:00
xfnw
f23fdaad28 use sqlite's FTS5 as the ranking algorithm 2021-10-20 16:41:36 -04:00
xfnw
4643aeec70 increase crawling timeout 2021-10-20 15:19:56 -04:00
xfnw
34e9d6b8ca add wildcards to gitignore 2021-10-20 15:18:29 -04:00
xfnw
cbb1173184 oops remove debug print 2021-06-24 14:08:08 -04:00
xfnw
9dcc667bc1 ignore script and style tags from content, and make newlines into spaces so words are not combined 2021-06-24 14:02:37 -04:00
xfnw
9a2ff10616 fix the double-escaping of htmlspecialchars 2021-06-24 14:00:33 -04:00
xfnw
826e3c2b7c delete page before downloading new one, so dead pages do not sit in the database 2021-01-27 20:33:25 -05:00
xfnw
c6b476c4a3 crawl slower so sites wont ban it lol 2021-01-16 13:39:46 -05:00
xfnw
3e051c0feb better crawl.php logging 2021-01-08 17:35:14 -05:00
xfnw
459c295488 better crawl.php logging 2021-01-08 16:54:16 -05:00
xfnw
3fdad57505 Merge branch 'main' of github.com:xfnw/searpl into main 2020-12-31 21:07:10 -05:00
xfnw
d4d5e67da8 uniquely sort urls and put the db the gitignore 2020-12-31 21:05:50 -05:00
8098d8d1af
no more cloudflare 2020-12-29 16:40:36 -05:00
xfnw
036e3addb2 re-crawl sites 2020-12-22 10:13:45 -05:00
xfnw
8fa66770b1 dont use a cdn for one little search icon 2020-12-16 21:42:08 -05:00
xfnw
2fb507356e some index stats and instructions 2020-12-16 11:36:46 -05:00
xfnw
96a12ecd4b change scoring system to discourage long feeds of keywords 2020-12-16 10:58:08 -05:00
xfnw
6a1b3d66d8 make sorting case-insensitive 2020-12-15 21:02:31 -05:00
xfnw
be5b250319 go through down sites faster 2020-12-15 12:33:00 -05:00
6b7002417d
fix the checkboxes in the readme 2020-12-15 11:02:24 -05:00
xfnw
5eb94a6834 some instructions 2020-12-15 10:59:23 -05:00
xfnw
2b46e8899f set a useragent 2020-12-15 10:17:28 -05:00
xfnw
8c4421108b dont track svgs and drop the / from the end of urls so they wont be duplicated 2020-12-15 09:59:19 -05:00
xfnw
75be84f895 fix tagging, oops lol 2020-12-14 22:07:22 -05:00
xfnw
79ba217da2 sort them 2020-12-14 17:50:06 -05:00
xfnw
c62b48ae1f unique urls 2020-12-14 17:22:28 -05:00
xfnw
69de9f49dc working 2020-12-14 16:59:16 -05:00