From ed901ab18edddcfd566ac37ddb1b429969ccc2ad Mon Sep 17 00:00:00 2001 From: Markus Heiser Date: Sat, 10 Dec 2022 16:20:09 +0100 Subject: [mod] improve 'Autodetect search language' plugin - Add documentation to the plugin - Harmonize FastText language model with SearXNG's language model Reosurces:: import fasttext # --> +10 MB fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB Suggested-by: @dalf - To speed up and simplify the deployment use fasttext-wheel instead of fasttext - Building numpy on the Alpine Linux of docker-images takes ages --> install py3-numpy from Alpines package manager (apk) - Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu libc) --> patch Dockerfile and build from fastetxt: sed -i s/fasttext-wheel/fasttext/ requirements.txt Signed-off-by: Markus Heiser --- Dockerfile | 3 +++ 1 file changed, 3 insertions(+) (limited to 'Dockerfile') diff --git a/Dockerfile b/Dockerfile index 66f58395d..ece20c86b 100644 --- a/Dockerfile +++ b/Dockerfile @@ -36,6 +36,7 @@ RUN apk add --no-cache -t build-dependencies \ su-exec \ python3 \ py3-pip \ + py3-numpy \ libxml2 \ libxslt \ openssl \ @@ -43,6 +44,8 @@ RUN apk add --no-cache -t build-dependencies \ uwsgi \ uwsgi-python3 \ brotli \ + && pip3 install --no-cache setuptools wheel \ + && sed -i s/fasttext-wheel/fasttext/ requirements.txt \ && pip3 install --no-cache -r requirements.txt \ && apk del build-dependencies \ && rm -rf /root/.cache -- cgit v1.2.3