tiny php sqlite search engine

Go to file

xfnw 96a12ecd4b change scoring system to discourage long feeds of keywords		2020-12-16 10:58:08 -05:00
assets	working	2020-12-14 16:59:16 -05:00
crawl.php	dont track svgs and drop the / from the end of urls so they wont be duplicated	2020-12-15 09:59:19 -05:00
create.sql	some instructions	2020-12-15 10:59:23 -05:00
index.php	change scoring system to discourage long feeds of keywords	2020-12-16 10:58:08 -05:00
LICENCE	some instructions	2020-12-15 10:59:23 -05:00
README.md	fix the checkboxes in the readme	2020-12-15 11:02:24 -05:00
urls.sh	go through down sites faster	2020-12-15 12:33:00 -05:00

searpl

searpl is a small php search engine with the following features:

robot.txt compliant
sqlite, so theres no need to run some fancy database daemon
javascript-free
it uses a cloudflare cdn for the search button icon, but you can block it without impacting much.
read-only database, nothing is written except with the shell

licensing

searpl is licenced under an MIT licence, see LICENSE for more information

this guide assumes you have shell access and are comfortable using command line tools like git.

make sure you have php, php-pdo, wget, sqlite3 and git installed
go in your htdocs, public_html or whatever and git clone this repo
touch db.sqlite to create the database
copy the contents of create.sql and paste it into the prompt on sqlite3 db.sqlite to create the table

to crawl a site, do ./urls.sh https://example.com

to recursively crawl, change the recursion limit with -l

./urls.sh -l5 https://example.com