xfnw/searpl
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
tiny php sqlite search engine
26 commits 1 branch 0 tags 44 KiB
PHP 72.1%
CSS 22.1%
Shell 5.8%
Find a file
xfnw 4643aeec70 increase crawling timeout
2021-10-20 15:19:56 -04:00
assets dont use a cdn for one little search icon 2020-12-16 21:42:08 -05:00
.gitignore add wildcards to gitignore 2021-10-20 15:18:29 -04:00
crawl.php oops remove debug print 2021-06-24 14:08:08 -04:00
create.sql some instructions 2020-12-15 10:59:23 -05:00
index.php fix the double-escaping of htmlspecialchars 2021-06-24 14:00:33 -04:00
LICENCE some instructions 2020-12-15 10:59:23 -05:00
README.md no more cloudflare 2020-12-29 16:40:36 -05:00
urls.sh increase crawling timeout 2021-10-20 15:19:56 -04:00

README.md

searpl

searpl is a small php search engine with the following features:

  • robot.txt compliant
  • sqlite, so theres no need to run some fancy database daemon
  • javascript-free
  • no cdns!
  • read-only database, nothing is written except with the shell

licensing

searpl is licenced under an MIT licence, see LICENSE for more information

setup

this guide assumes you have shell access and are comfortable using command line tools like git.

  • make sure you have php, php-pdo, wget, sqlite3 and git installed
  • go in your htdocs, public_html or whatever and git clone this repo
  • touch db.sqlite to create the database
  • copy the contents of create.sql and paste it into the prompt on sqlite3 db.sqlite to create the table

crawling

to crawl a site, do ./urls.sh https://example.com

to recursively crawl, change the recursion limit with -l

./urls.sh -l5 https://example.com