summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2022-08-29Merge pull request #1721 from searxng/update_data_update_wikidata_units.pyMarkus Heiser
Update searx.data - update_wikidata_units.py
2022-08-29Update searx.data - update_engine_descriptions.pydalf
2022-08-29Update searx.data - update_firefox_version.pydalf
2022-08-29Update searx.data - update_languages.pydalf
2022-08-29Update searx.data - update_wikidata_units.pydalf
2022-08-29Update searx.data - update_ahmia_blacklist.pydalf
2022-08-29Update searx.data - update_currencies.pydalf
2022-08-28Remove usage of SEARX environment variablesAlexandre FLAMENT
2022-08-28settings.yml: set default values for result_proxyAlexandre FLAMENT
* initialize result_proxy with searx/settings_defaults.py * allow result_proxy.key to be a string this commit supersedes #1522
2022-08-28Merge pull request #1706 from dalf/fix-autocomplete-postMarkus Heiser
Fix: autocomplete with the POST method: url encode the user query
2022-08-28Merge pull request #1707 from dalf/fix-external-bangMarkus Heiser
External bang: bug fix: URL encode the query so "!!g 1+1" works as intended
2022-08-27External bang: bug fix: URL encode the query so "!!g 1+1" works as intendedAlexandre FLAMENT
2022-08-27[build] /staticAlexandre FLAMENT
2022-08-27Theme: fix autocompletion with the POST methodAlexandre FLAMENT
With the POST method, autocomplete.js does not URL encode the values. For example "1+1" is sent as "1+1" which is read as "1 1" since space are URL encoded with a plus. There is no clean way to fix the bug since autocomplete.js seems abandoned. The commit monkey patches the ajax function of autocomplete.js Related to #1695
2022-08-27Merge pull request #1699 from liimee/eng-app-storeAlexandre Flament
add apple app store engine
2022-08-27Merge pull request #1700 from liimee/eng-ddmAlexandre Flament
add apple maps engine
2022-08-27remove thumbnail from resultsta
2022-08-27add poi's website and phone number, doesn't crash when there is no ↵ta
`displayMapRegion`, query the token on the first request
2022-08-26Merge pull request #1702 from tiekoetter/limiter-accept-encoding-handlingAlexandre Flament
[mod] limiter plugin: Accept-Encoding handling
2022-08-26[translations] update from Weblatesearxng-bot
3e034294 - 2022-08-26 - Markus Heiser <markus.heiser@darmarit.de> 46a4dfd3 - 2022-08-24 - Markus Heiser <markus.heiser@darmarit.de> d41463fd - 2022-08-24 - Markus Heiser <markus.heiser@darmarit.de> 338b6716 - 2022-08-22 - Markus Heiser <markus.heiser@darmarit.de> 0c9d7756 - 2022-08-22 - Markus Heiser <markus.heiser@darmarit.de> b422a480 - 2022-08-19 - Markus Heiser <markus.heiser@darmarit.de> 44c9caa0 - 2022-08-22 - Ricardo Simões <xmcorporation@gmail.com> a774721f - 2022-08-20 - Markus Heiser <markus.heiser@darmarit.de> d8a322d6 - 2022-08-22 - Markus Heiser <markus.heiser@darmarit.de>
2022-08-25[mod] limiter plugin: Accept-Encoding handlingLéon Tiekötter
Only raise "suspicious Accept-Encoding" when both "gzip" and "deflate" are missing from Accept-Encoding. Prevent Browsers which only implement one compression solution from being blocked by the limiter plugin. Example Browser which is currently blocked: Lynx Browser (https://lynx.invisible-island.net)
2022-08-25add apple maps engineta
2022-08-25Merge pull request #1688 from liimee/eng-9gagAlexandre Flament
Add 9gag engine
2022-08-24get the not cropped version of the thumbnail when the image height is not ↵ta
too important
2022-08-24add safesearch supportta
2022-08-24add developer info as authorta
2022-08-24add the apple app store engineta
The Apple App Store is the digital app distribution platform for iOS & iPadOS.
2022-08-24support playing videos directlyta
2022-08-23[fix] Internal server error after changing UI language to BGMarkus Heiser
A placeholder has been translated to BG, issue was added 8 month ago, when BG translation was added [1] msgid "Compute {functions} of the arguments" msgstr "Изчислете {функции} на аргументите" The incorrect translation has been corrected here in the message files and on weblate. [1] https://weblate.bubu1.eu/translate/searxng/searxng/bg/?&offset=49#history Closes: https://github.com/searxng/searxng/issues/1692 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-23add tags as suggestionsta
2022-08-22use `invalid-name` instead of `C0103` for pylintta
2022-08-22add 9gag engineta
9GAG is a social media website where users upload and share user-generated images and videos
2022-08-22don't raise error when nothing was foundta
2022-08-21fixed xpath selector for appropriate resultsM Asenov
2022-08-21Merge pull request #1661 from liimee/eng-twAlexandre Flament
Add twitter engine
2022-08-21Merge pull request #1666 from return42/harden-get_engine_localesMarkus Heiser
[fix] typo in get_engine_locale
2022-08-20[fix] engine duden - don't raise exception on empty result listMarkus Heiser
Duden expects a word in German, so with query "amazing" the site finds nothing and respons a 404: httpx.HTTPStatusError: Client error '404 Not Found' for url\ 'https://www.duden.de/suchen/dudenonline/amazing' [1] https://github.com/searxng/searxng/issues/1543#issuecomment-1193317054 Suggested-by: @allendema [1] Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-19Merge pull request #1677 from searxng/dependabot/pip/master/pygments-2.13.0Markus Heiser
Bump pygments from 2.12.0 to 2.13.0
2022-08-19[build] /staticMarkus Heiser
2022-08-19make pygments.lessMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-19[translations] update from Weblatesearxng-bot
2b94abf3 - 2022-08-13 - Markus Heiser <markus.heiser@darmarit.de> 249c92f8 - 2022-08-13 - gkkulik <gregorykkulik@gmail.com> a331870c - 2022-08-12 - Markus Heiser <markus.heiser@darmarit.de> 5aca8ddc - 2022-08-17 - Markus Heiser <markus.heiser@darmarit.de> 6e7d76a0 - 2022-08-18 - Markus Heiser <markus.heiser@darmarit.de> 2a49e5f0 - 2022-08-15 - Markus Heiser <markus.heiser@darmarit.de> 2d2cafa6 - 2022-08-18 - Content Card <weblate-bubu1@gabg.email> adcf97ed - 2022-08-15 - Markus Heiser <markus.heiser@darmarit.de>
2022-08-17add explanation of tokenta
2022-08-17add profile image to user resultsta
2022-08-17add thumbnail to results if availableta
2022-08-14[fix] get_engine_locale: better approximation of 'en' is 'en-US'Markus Heiser
Compared to `en-EN` the better approximation of 'en' is 'en-US'. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14[fix] typo in get_engine_localeMarkus Heiser
Due to a typo in get_engine_locale, a language selection like `!qw :de siemens` did not work. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14[fix] harden get_engine_locale: handle UnknownLocaleError exceptionsMarkus Heiser
When a user selects an unknown or invalid locale by using the search syntax: !qw siemens :de-TW Before this patch a UnknownLocaleError exception will be rasied: ``` Traceback (most recent call last): File "SearXNG/searx/search/processors/online.py", line 154, in search search_results = self._search_basic(query, params) File "SearXNG/searx/search/processors/online.py", line 128, in _search_basic self.engine.request(query, params) File "SearXNG/searx/engines/qwant.py", line 98, in request q_locale = get_engine_locale(params['language'], supported_languages, default='en_US') File "SearXNG/searx/locales.py", line 216, in get_engine_locale locale = babel.Locale.parse(searxng_locale, sep='-') File "SearXNG/local/py3/lib/python3.8/site-packages/babel/core.py", line 330, in parse raise UnknownLocaleError(input_id) ``` This patch implements a simple exception handling, since e.g. `de-TW` does not exists `de` will be used to get engines locale. On invalid terms like `xy-XY` the default will be returned. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14[mod] qwant - add safesearch optionMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/1640 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14[fix] qwant - API error::locale must be one ..Markus Heiser
The request function should not request a language (aka locale) that is not supported by qwant. Select a locale like zh-TW ends in qwant's API error: ERROR searx.engines.qwant news: exception : \ API error::locale must be one of the following values: \ en_gb, en_ie, en_us, en_ca, en_my, en_au, en_nz, de_de, de_ch, de_at, fr_fr, \ fr_be, fr_ch, fr_ca, fr_ad, fc_ca, co_fr, es_es, es_ar, es_cl, es_co, es_mx, \ es_pe, es_ad, ca_es, ca_ad, ca_fr, eu_es, eu_fr, it_it, it_ch, pt_pt, pt_ad, \ nl_be, nl_nl The existing searx.utils.match_language function is unsuitable for this purpose, it is replaced by function searx.locales.get_engine_locale that is based on the methods from the babel package. The quant's _fetch_supported_languages function has been revised to filter out languages 8aka locales) not supported by qwant. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14[mod] add locale.get_engine_locale to get predictable resultsMarkus Heiser
The match_language function sometimes returns incorrect results which is why a new function get_engine_locale is required. A bugfix of the match_language is not easily possible, because there is almost no documentation for it and already the call parameters are undefined. E.g. the function processes values like the ones from yahoo:: "yahoo": [ "ar", ... "zh_chs", "zh_cht" ] The get_engine_locale has been documented in detail, there is a clear description of the assumptions as well as the requirements and approximation rules (read doc-string for more details):: Argument ``engine_locales`` is a python dict that maps *SearXNG locales* to corresponding *engine locales*: <engine>: { # SearXNG string : engine-string 'ca-ES' : 'ca_ES', 'fr-BE' : 'fr_BE', 'fr-CA' : 'fr_CA', 'fr-CH' : 'fr_CH', 'fr' : 'fr_FR', ... 'pl-PL' : 'pl_PL', 'pt-PT' : 'pt_PT' } .. hint:: The *SearXNG locale* string has to be known by babel! In the following you will find a comparison: >>> import babel.languages >>> from searx.utils import match_language >>> from searx.locales import get_engine_locale Assume we have an engine that supports the follwoing locales: >>> lang_list = { ... "zh-CN": "zh_CN", ... "zh-HK": "zh_HK", ... "nl-BE": "nl_BE", ... "fr-CA": "fr_CA", ... } Assumption: A. When a user selects a language the results should be optimized according to the selected language. B. When user selects a language and a territory the results should be optimized with first priority on territory and second on language. ---- Example: (Assumption A.) A user selects region 'zh-TW' which should end in zh_HK hint: CN is 'Hans' and HK ('Hant') fits better to TW ('Hant') >>> get_engine_locale('zh-TW', lang_list) 'zh_HK' >>> lang_list[match_language('zh-TW', lang_list)] 'zh_CN' ---- Example: (Assumption A.) A user selects only the language 'zh' which should end in CN >>> get_engine_locale('zh', lang_list) 'zh_CN' >>> lang_list[match_language('zh', lang_list)] 'zh_CN' ---- Example: (Assumption B.) A user selects region 'fr-BE' which should end in nl-BE hint: priority should be on the territory the user selected. If the user prefers 'fr' he will select 'fr' without a region tag. >>> get_engine_locale('fr-BE', lang_list, default='unknown') 'nl_BE' >>> match_language('fr-BE', lang_list, fallback='unknown') 'fr-CA' ---- Example: (Assumption A.) A user selects only the language 'fr' which should end in fr_CA >>> get_engine_locale('fr', lang_list) 'fr_CA' >>> lang_list[match_language('fr', lang_list)] 'fr_CA' ---- The difference in priority on the territory is best shown with a engine that supports the following locales: >>> lang_list = { ... "fr-FR": "fr_FR", ... "fr-CA": "fr_CA", ... "en-GB": "en_GB", ... "nl-BE": "nl_BE", ... } ---- Example: (Assumption A.) A user selects only a language >>> get_engine_locale('en', lang_list) 'en_GB' >>> match_language('en', lang_list) 'en-GB' hint: the engine supports fr_FR and fr_CA since no territory is given, fr_FR takes priority .. >>> get_engine_locale('fr', lang_list) 'fr_FR' >>> lang_list[match_language('fr', lang_list)] 'fr_FR' ---- Example: (Assumption B.) A user selects region 'fr-BE' which should end in nl-BE >>> get_engine_locale('fr-BE', lang_list) 'nl_BE' >>> lang_list[match_language('fr-BE', lang_list)] 'fr_FR' ---- If the user selects a language and there are two locales like the following: >>> lang_list = { ... "fr-BE": "fr_BE", ... "fr-CH": "fr_CH", ... } >>> >>> get_engine_locale('fr', lang_list) 'fr_BE' >>> lang_list[match_language('fr', lang_list)] 'fr_BE' Looks like both functions return the same value, but match_language depends on the order of the dictionary (which is not predictable): >>> lang_list = { ... "fr-CH": "fr_CH", ... "fr-BE": "fr_BE", ... } >>> get_engine_locale('fr', lang_list) 'fr_BE' >>> lang_list[match_language('fr', lang_list)] 'fr_CH' >>> The get_engine_locale selects the locale by looking at the "population percent" and this percentage has an higher amount in BE (68.%) compared to CH (21%) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-21 10:33:56 +0000