summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2023-11-12Bump fasttext-predict from 0.9.2.1 to 0.9.2.2dependabot[bot]
Bumps [fasttext-predict](https://github.com/searxng/fasttext-predict) from 0.9.2.1 to 0.9.2.2. - [Release notes](https://github.com/searxng/fasttext-predict/releases) - [Commits](https://github.com/searxng/fasttext-predict/compare/v0.9.2.1...v0.9.2.2) --- updated-dependencies: - dependency-name: fasttext-predict dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
2023-11-12Docker: add UWSGI_WORKERS and UWSGI_THREAD environment variables (#2992)Alexandre Flament
* Docker: add UWSGI_WORKERS and UWSGI_THREAD. UWSGI_WORKERS specifies the number of process. UWSGI_THREADS specifies the number of threads. The Docker convention is to specify the whole configuration through environment variables. While not done in SearXNG, these two additional variables allows admins to skip uwsgi.ini In additional, https://github.com/searxng/preview-environments starts Docker without additional files through searxng-helm-chat. Each instance consumes 1Go of RAM which is a lot especially when there are a lot of instances / pull requests. * [scripts] add environments UWSGI_WORKERS and UWSGI_THREADS - UWSGI_WORKERS specifies the number of process. - UWSGI_THREADS specifies the number of threads. Templates for uwsgi scripts can be tested by:: UWSGI_WORKERS=8 UWSGI_THREADS=9 \ ./utils/searxng.sh --cmd\ eval "echo \"$(cat utils/templates/etc/uwsgi/*/searxng.ini*)\""\ | grep "workers\|threads" Signed-off-by: Markus Heiser <markus.heiser@darmarit.de> --------- Signed-off-by: Markus Heiser <markus.heiser@darmarit.de> Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-11Merge pull request #2835 from BernieHuang2008/auto-copyPaul Braeuning
[feature] added a "copy" button in `search url` sidebar.
2023-11-10[build] /staticJinyuan Huang
2023-11-10add a "copy" button to the "search-url" sidebarJinyuan Huang
2023-11-03[translations] update from Weblatesearxng-bot
acdcdace8 - 2023-11-01 - Ivan Gabaldon <admin@inetol.net> 31a1602a9 - 2023-10-29 - return42 <markus.heiser@darmarit.de> a1d1070d3 - 2023-10-29 - return42 <markus.heiser@darmarit.de>
2023-11-03Bump selenium from 4.14.0 to 4.15.1dependabot[bot]
Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.14.0 to 4.15.1. - [Release notes](https://github.com/SeleniumHQ/Selenium/releases) - [Commits](https://github.com/SeleniumHQ/Selenium/commits) --- updated-dependencies: - dependency-name: selenium dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2023-11-03Bump linuxdoc from 20230827 to 20231020dependabot[bot]
Bumps [linuxdoc](https://github.com/return42/linuxdoc) from 20230827 to 20231020. - [Changelog](https://github.com/return42/linuxdoc/blob/master/CHANGELOG) - [Commits](https://github.com/return42/linuxdoc/commits) --- updated-dependencies: - dependency-name: linuxdoc dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
2023-11-01Revert "[fix] limit maximum page number of a search query to page 50." (#2979)Markus Heiser
This reverts commit 7e2e335dd1e06ea20496028abe58b3ad8b255662.
2023-11-01[mod] document server:public_instance & remove it out of the botdetectionMarkus Heiser
- the option server:public_instance lacks some documentation - the processing of this option belongs in the limiter and not in botdetection module Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01[mod] isolation of botdetection from the limiterMarkus Heiser
This patch was inspired by the discussion around PR-2882 [2]. The goals of this patch are: 1. Convert plugin searx.plugin.limiter to normal code [1] 2. isolation of botdetection from the limiter [2] 3. searx/{tools => botdetection}/config.py and drop searx.tools 4. in URL /config, 'limiter.enabled' is true only if the limiter is really enabled (Redis is available). This patch moves all the code that belongs to botdetection into namespace searx.botdetection and code that belongs to limiter is placed in namespace searx.limiter. Tthe limiter used to be a plugin at some point botdetection was added, it was not a plugin. The modularization of these two components was long overdue. With the clear modularization, the documentation could then also be organized according to the architecture. [1] https://github.com/searxng/searxng/pull/2882 [2] https://github.com/searxng/searxng/pull/2882#issuecomment-1741716891 To test: - check the app works without the limiter, check `/config` - check the app works with the limiter and with the token, check `/config` - make docs.live .. and read - http://0.0.0.0:8000/admin/searx.limiter.html - http://0.0.0.0:8000/src/searx.botdetection.html#botdetection Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-31Check `public_instance` in simple themesev
Fix #2975
2023-10-29[fix] limit maximum page number of a search query to page 50.Markus Heiser
To test this PR run a local instance and try to query page 51: http://127.0.0.1:8888/search?q=foo&pageno=51 A parameter exception will be raised: searx.exceptions.SearxParameterException: Invalid value "51" for parameter pageno And the client will receive a HTTP 400 (Bad request). Closes https://github.com/searxng/searxng/issues/2972 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-29Add support for Python 3.12Alexandre Flament
2023-10-29Update searx.data - update_engine_traits.pydalf
2023-10-29Bump babel from 2.13.0 to 2.13.1dependabot[bot]
Bumps [babel](https://github.com/python-babel/babel) from 2.13.0 to 2.13.1. - [Release notes](https://github.com/python-babel/babel/releases) - [Changelog](https://github.com/python-babel/babel/blob/master/CHANGES.rst) - [Commits](https://github.com/python-babel/babel/compare/v2.13.0...v2.13.1) --- updated-dependencies: - dependency-name: babel dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
2023-10-29Bump sphinx-tabs from 3.4.1 to 3.4.4dependabot[bot]
Bumps [sphinx-tabs](https://github.com/executablebooks/sphinx-tabs) from 3.4.1 to 3.4.4. - [Release notes](https://github.com/executablebooks/sphinx-tabs/releases) - [Changelog](https://github.com/executablebooks/sphinx-tabs/blob/master/CHANGELOG.md) - [Commits](https://github.com/executablebooks/sphinx-tabs/compare/v3.4.1...v3.4.4) --- updated-dependencies: - dependency-name: sphinx-tabs dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
2023-10-29Bump uvloop from 0.18.0 to 0.19.0dependabot[bot]
Bumps [uvloop](https://github.com/MagicStack/uvloop) from 0.18.0 to 0.19.0. - [Release notes](https://github.com/MagicStack/uvloop/releases) - [Commits](https://github.com/MagicStack/uvloop/compare/v0.18.0...v0.19.0) --- updated-dependencies: - dependency-name: uvloop dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2023-10-29Update searx.data - update_wikidata_units.pydalf
2023-10-29Update searx.data - update_firefox_version.pydalf
2023-10-29Update searx.data - update_currencies.pydalf
2023-10-29Update searx.data - update_engine_descriptions.pydalf
2023-10-29Update searx.data - update_ahmia_blacklist.pydalf
2023-10-27Bump pylint from 3.0.1 to 3.0.2dependabot[bot]
Bumps [pylint](https://github.com/pylint-dev/pylint) from 3.0.1 to 3.0.2. - [Release notes](https://github.com/pylint-dev/pylint/releases) - [Commits](https://github.com/pylint-dev/pylint/compare/v3.0.1...v3.0.2) --- updated-dependencies: - dependency-name: pylint dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
2023-10-27[translations] update from Weblatesearxng-bot
4e5e5db44 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr> e1a8d3508 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr> 84bddfb89 - 2023-10-26 - return42 <markus.heiser@darmarit.de> d67a4114d - 2023-10-26 - quenty_occitania <quentinantonin@free.fr> 62fe8e328 - 2023-10-26 - return42 <markus.heiser@darmarit.de> 6e37ab975 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr> 2cdab3247 - 2023-10-25 - SomeTr <SomeTr@users.noreply.translate.codeberg.org> cf7ea7234 - 2023-10-23 - clsty <celestial.y@outlook.com> 0ea313893 - 2023-10-23 - return42 <markus.heiser@darmarit.de> 22151e440 - 2023-10-23 - return42 <markus.heiser@darmarit.de> e4eaf42b6 - 2023-10-22 - clsty <celestial.y@outlook.com>
2023-10-22Bump uvloop from 0.17.0 to 0.18.0dependabot[bot]
Bumps [uvloop](https://github.com/MagicStack/uvloop) from 0.17.0 to 0.18.0. - [Release notes](https://github.com/MagicStack/uvloop/releases) - [Commits](https://github.com/MagicStack/uvloop/compare/v0.17.0...v0.18.0) --- updated-dependencies: - dependency-name: uvloop dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2023-10-22[fix] HTMLParser: undocumented not implemented methodMarkus Heiser
In python versions <py3.10 there is an issue with an undocumented method HTMLParser.error() [1][2] that was deprecated in Python 3.4 and removed in Python 3.5. To be compatible to higher versions (>=py3.10) an error method is implemented which throws an AssertionError exception like the higher Python versions do [3]. [1] https://github.com/python/cpython/issues/76025 [2] https://bugs.python.org/issue31844 [3] https://github.com/python/cpython/pull/8562 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-20[translations] update from Weblatesearxng-bot
2325f1583 - 2023-10-20 - return42 <markus.heiser@darmarit.de> 5090c6a8e - 2023-10-18 - return42 <markus.heiser@darmarit.de> 3a38219d8 - 2023-10-18 - return42 <markus.heiser@darmarit.de> 94a9f4164 - 2023-10-16 - return42 <markus.heiser@darmarit.de> bdbeb4b30 - 2023-10-16 - return42 <markus.heiser@darmarit.de> f9b483f48 - 2023-10-16 - return42 <markus.heiser@darmarit.de> 7f1ca1997 - 2023-10-16 - return42 <markus.heiser@darmarit.de> c5a701dc4 - 2023-10-14 - alexgabi <alexgabi@disroot.org>
2023-10-13[build] /staticMarkus Heiser
2023-10-13[fix] search.js: crash on homepage when setting form listenersBnyro
2023-10-13[fix] black --exclude option is a regular expressionMarkus Heiser
When ``searx/static/themes/simple/node_modules`` are installed the test from black runs into this path / Error:: $ make test TEST [yamllint] $YAMLLINT_FILES TEST [black] $BLACK_TARGETS --- searx/static/themes/simple/node_modules/flatted/python/test.py 2023-10-13 10:09:50.460026 +0000 +++ searx/static/themes/simple/node_modules/flatted/python/test.py 2023-10-13 10:10:04.974335 +0000 @@ -1,9 +1,11 @@ from flatted import stringify as _stringify, parse ... black --exclude option is not a comma separated list, its a regular expression / see: $ black --help ... --exclude TEXT A regular expression that matches files and directories that should be excluded on recursive searches ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-13Bump flask from 2.3.3 to 3.0.0dependabot[bot]
Bumps [flask](https://github.com/pallets/flask) from 2.3.3 to 3.0.0. - [Release notes](https://github.com/pallets/flask/releases) - [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst) - [Commits](https://github.com/pallets/flask/compare/2.3.3...3.0.0) --- updated-dependencies: - dependency-name: flask dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
2023-10-13fixing results parsing braveÉmilien (perso)
2023-10-13Bump flask-babel from 3.1.0 to 4.0.0dependabot[bot]
Bumps [flask-babel](https://github.com/python-babel/flask-babel) from 3.1.0 to 4.0.0. - [Release notes](https://github.com/python-babel/flask-babel/releases) - [Changelog](https://github.com/python-babel/flask-babel/blob/master/CHANGELOG) - [Commits](https://github.com/python-babel/flask-babel/compare/v3.1.0...v4.0.0) --- updated-dependencies: - dependency-name: flask-babel dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
2023-10-13Bump selenium from 4.13.0 to 4.14.0dependabot[bot]
Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.13.0 to 4.14.0. - [Release notes](https://github.com/SeleniumHQ/Selenium/releases) - [Commits](https://github.com/SeleniumHQ/Selenium/compare/selenium-4.13.0...selenium-4.14.0) --- updated-dependencies: - dependency-name: selenium dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2023-10-13[translations] update from Weblatesearxng-bot
74e401e68 - 2023-10-09 - return42 <markus.heiser@darmarit.de> 897dd8db1 - 2023-10-09 - return42 <markus.heiser@darmarit.de> 6ed046a90 - 2023-10-09 - tentsbet <remendne@pentrens.jp> 815ecb336 - 2023-10-09 - return42 <markus.heiser@darmarit.de> 65d9a0c2f - 2023-10-07 - return42 <markus.heiser@darmarit.de> 3ec249ef9 - 2023-10-07 - return42 <markus.heiser@darmarit.de> 53dc6c108 - 2023-10-07 - return42 <markus.heiser@darmarit.de>
2023-10-13[fix] hackernews keyerror problemHackurei
2023-10-12[fix] imgur - incorrect wikidata idHackurei
2023-10-12[fix] ddg-lite & ddg-extra: don't send empty vqd valueMarkus Heiser
DDG's bot detection is sensitive to the vqd value. For some search terms (such as extremely long search terms that are often sent by bots), no vqd value can be determined. If SearXNG cannot determine a vqd value, then no request should go out to DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting SearXNG's IP on a block list. Requests from IPs in this block list run into timeouts. Not sure, but it seems the block list is a sliding window: to get my IP rid from the bot list I had to cool down my IP for 1h (send no requests from that IP to DDG). Since such issues can't reproduce in a local instance I tested this patch 24h on my public SearXNG instance: There are still errors (rare), but the reliability is still 100%. Related: - https://github.com/searxng/searxng/pull/2922 - https://github.com/searxng/searxng/pull/2923 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-11readme typoUmut Ucak
2023-10-10[fix] ddg-lite vqd value: some search terms do not have a vqd valueMarkus Heiser
Some search terms do not have results and therefore no vqd value BTW: remove a leftover from 9197efa Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-10[fix] duckduckgo lite engine: set HTTP header 'Referer'Markus Heiser
We have had problems with this before, the bot protection from ddg-lite seems to have included this referer in the rating [1][2]. From reverse engineering: - The Referer ``https://google.com/`` was set in commt 257dc7d6c4 --> DDG lite does not like this referer anymore! - The 'Referer' header is only set on second and follow up pages but not on the first page - The vqd value is not needed on the first page, the ddg-lite client sets this value only on follow up pages / this can help to reduce the vqd requests from SearXNG. Related to 'Referer' header & ddg requests: [1] https://github.com/searxng/searxng/pull/2161 [2] https://github.com/searxng/searxng/pull/2081 Closes: https://github.com/searxng/searxng/issues/2796 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-09[mod] yacy: use official instance by default and fix crashesBnyro
2023-10-09[mod] add hotkeys option to settings.ymlAlex Balgavy
The change in the hotkey mechanism introduced in 317db5b04 does not allow configuration via `settings.yml`. This commit adds that functionality. Closes: #2898
2023-10-09[feat] implement hackernews engine - news.ycombinator.comHackurei
2023-10-09[fix] matrixrooms add proper MRS integrationAine
Related: - https://github.com/searxng/searxng/issues/2918
2023-10-09[feat] duckduckgo: support for videos and newsBnyro
2023-10-07[fix] kickass: crash when no resultsBnyro
2023-10-07[mod] piped: always show video length if availableBnyro
2023-10-06[feat] engine: implementation of mastodonBnyro
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-15 12:54:54 +0000