summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2023-03-24[mod] Wikipedia: fetch engine traits (data_type: supported_languages)Markus Heiser
Implements a fetch_traits function for the Wikipedia engines. .. note:: Does not include migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] Google: fetch engine traits (data_type: supported_languages)Markus Heiser
Implements a fetch_traits function for the Google engines. .. note:: Does not include migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] DuckDuckGo: fetch engine traits (data_type: supported_languages)Markus Heiser
Implements a fetch_traits function for the DuckDuckGo engines. .. note:: Does not include migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] yahoo: fetch engine traits (data_type: traits_v1)Markus Heiser
Implements a fetch_traits function for the Yahoo engine. .. note:: Includes migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] qwant: fetch engine traits (data_type: traits_v1)Markus Heiser
Implements a fetch_traits function for the Qwant engines. .. note:: Includes migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] Dailymotion: fetch engine traits (data_type: supported_languages)Markus Heiser
Implements a fetch_traits function for the Dailymotion engine. .. note:: Does not include migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] Startpage: fetch engine traits (data_type: supported_languages)Markus Heiser
Implements a fetch_traits function for the Startpage engine. .. note:: Does not include migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] bing: fetch engine traits (data_type: supported_languages)Markus Heiser
Implements a fetch_traits function for the Bing engines. .. note:: Does not include migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] Peertube: re-engineered & upgrade to data_type: traits_v1Markus Heiser
- fetch_traits(): Fetch languages from peertube's search-index source code. [mod] Include migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object. [fix] old supported_languages_url is no longer valid since the sources has been moved to a different path. - fixed code to pass pylint - request(): complete re-implementation based on the API docs [1] - response(): complete re-implementation, adds serveral fields missed before - add source code documentation [1] https://docs.joinpeertube.org/api-rest-reference.html#tag/Search/operation/searchVideos Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] replace engines_languages.json by engines_traits.jsonMarkus Heiser
Implementations of the *traits* of the engines. Engine's traits are fetched from the origin engine and stored in a JSON file in the *data folder*. Most often traits are languages and region codes and their mapping from SearXNG's representation to the representation in the origin search engine. To load traits from the persistence:: searx.enginelib.traits.EngineTraitsMap.from_data() For new traits new properties can be added to the class:: searx.enginelib.traits.EngineTraits .. hint:: Implementation is downward compatible to the deprecated *supported_languages method* from the vintage implementation. The vintage code is tagged as *deprecated* an can be removed when all engines has been ported to the *traits method*. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[translations] update from Weblatesearxng-bot
abfec8f4 - 2023-03-23 - return42 <markus.heiser@darmarit.de> f02ea21c - 2023-03-23 - return42 <markus.heiser@darmarit.de> 3fc6c653 - 2023-03-20 - chenghui-lee <chlee9926@gmail.com> 342bbf46 - 2023-03-20 - return42 <markus.heiser@darmarit.de>
2023-03-21Pass black formatting testSolirs
2023-03-21WIKIDATA: Add description for resultsSolirs
2023-03-20Merge pull request #2266 from return42/shuffle-cipherMarkus Heiser
[mod] Shuffle httpx's default ciphers of a SSL context randomly.
2023-03-19Merge pull request #2238 from return42/fix-2027Markus Heiser
[fix] fix threshold in replace_auto_language
2023-03-19Merge pull request #2239 from return42/fix-eslintrcMarkus Heiser
[fix] remove duplicate key in simple theme ESLint configuration
2023-03-19[mod] Shuffle httpx's default ciphers of a SSL context randomly.Markus Heiser
From the analyse of @9Ninety [1] we know that DDG (and may be other engines / I have startpage in mind) does some kind of TLS fingerprint to block bots. This patch shuffles the default ciphers from httpx to avoid a cipher profile that is known to httpx (and blocked by DDG). [1] https://github.com/searxng/searxng/issues/2246#issuecomment-1467895556 ---- From `What Is TLS Fingerprint and How to Bypass It`_ > When implementing TLS fingerprinting, servers can't operate based on a > locked-in whitelist database of fingerprints. New fingerprints appear > when web clients or TLS libraries release new versions. So, they have to > live off a blocklist database instead. > ... > It's safe to leave the first three as is but shuffle the remaining ciphers > and you can bypass the TLS fingerprint check. .. _What Is TLS Fingerprint and How to Bypass It: https://www.zenrows.com/blog/what-is-tls-fingerprint#how-to-bypass-tls-fingerprinting Signed-off-by: Markus Heiser <markus.heiser@darmarit.de> Closes: https://github.com/searxng/searxng/issues/2246
2023-03-17Merge pull request #2257 from Solirs/fix_bad_escapeMarkus Heiser
re.escape() the query in highlight_content to prevent a server side error.
2023-03-17[fix] server side error: escape backslashes in the query highlight_contentSolirs
Any backslash escapes in the replacement are processed [1], backslashes should be escaped [2]. [1] https://docs.python.org/3/library/re.html#re.sub [2] https://docs.python.org/3/library/re.html#re.escape closes: - https://github.com/searxng/searxng/issues/2256 - https://github.com/searxng/searxng/issues/2250
2023-03-17[translations] update from Weblatesearxng-bot
32926a19 - 2023-03-15 - return42 <markus.heiser@darmarit.de> 7aabc876 - 2023-03-16 - Linerly <linerly@protonmail.com> c0ed00f5 - 2023-03-14 - SonoAX <giovanniilgiovo@gmail.com> 6cf287f6 - 2023-03-13 - RhysJones <proladrhys123@outlook.com> 8c4c5f83 - 2023-03-12 - Cavemanly <k.adel.2m@protonmail.com> dffe61fa - 2023-03-10 - return42 <markus.heiser@darmarit.de> c7736cac - 2023-03-10 - BalkanMadman <zurabid2016@gmail.com> e831b8e3 - 2023-03-10 - BalkanMadman <zurabid2016@gmail.com> ef3c60af - 2023-03-10 - return42 <markus.heiser@darmarit.de> c046a677 - 2023-03-07 - BalkanMadman <zurabid2016@gmail.com> 142041d6 - 2023-03-05 - return42 <markus.heiser@darmarit.de> 119b51df - 2023-03-05 - return42 <markus.heiser@darmarit.de>
2023-03-15rollback testAlexandre Flament
2023-03-15testAlexandre Flament
2023-03-15Merge pull request #2224 from searxng/update_data_update_currencies.pyMarkus Heiser
Update searx.data - update_currencies.py
2023-03-15Merge pull request #2222 from searxng/update_data_update_wikidata_units.pyMarkus Heiser
Update searx.data - update_wikidata_units.py
2023-03-05[fix] remove duplicate key in simple theme ESLint configurationMarkus Heiser
Partial merge of [PR-1736] [PR-1736] https://github.com/searxng/searxng/pull/1736 Suggested-by: @FunctionalHacker in [1] Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-05[fix] fix threshold in replace_auto_languageMarkus Heiser
[1] https://github.com/searxng/searxng/pull/2027#pullrequestreview-1322157677 [2] https://github.com/searxng/searxng/pull/1969#issuecomment-1345354529 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-03[translations] update from Weblatesearxng-bot
0d8ebfe1 - 2023-03-02 - AHOHNMYC <lqwh2h2cwa@protonmail.com> 1358dd6d - 2023-03-03 - mystery-z <07juwonc@kakao.com> 4d8c13db - 2023-03-01 - lhostfree951 <freeehost9191@gmail.com> 1ae581b6 - 2023-02-28 - tygyh <jonis9898@hotmail.com> 0003698f - 2023-02-28 - ewm <gnu.ewm@protonmail.com> 31c79617 - 2023-02-28 - gjveld <gjveld@gmail.com> 9015ec73 - 2023-02-28 - gallegonovato <fran-carro@hotmail.es> 03619a68 - 2023-02-25 - BalkanMadman <zurabid2016@gmail.com> fa90585b - 2023-02-25 - BalkanMadman <zurabid2016@gmail.com> c902c5e5 - 2023-02-26 - tentsbet <remendne@pentrens.jp>
2023-03-01Merge pull request #2220 from Solirs/gentoo_engine_timeoutAlexandre Flament
Increase timeout for gentoo wiki engine
2023-03-01Merge pull request #2227 from searxng/update_data_update_engine_descriptions.pyAlexandre Flament
Update searx.data - update_engine_descriptions.py
2023-03-01Merge pull request #2226 from searxng/update_data_update_ahmia_blacklist.pyAlexandre Flament
Update searx.data - update_ahmia_blacklist.py
2023-03-01Update searx.data - update_engine_descriptions.pydalf
2023-03-01Update searx.data - update_ahmia_blacklist.pydalf
2023-03-01Update searx.data - update_currencies.pydalf
2023-03-01Update searx.data - update_firefox_version.pydalf
2023-03-01Update searx.data - update_wikidata_units.pydalf
2023-02-28Increase timeout for gentoo wiki engineSolirs
2023-02-20Merge pull request #2027 from dalf/fix_2018Alexandre Flament
Add "auto" as a language.
2023-02-19[translations] update from Weblatesearxng-bot
8ff0fa33 - 2023-02-19 - return42 <markus.heiser@darmarit.de>
2023-02-19[doc] improved docs of implementations for automatic speech recognitionMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-18Merge pull request #2201 from return42/fix-2190Markus Heiser
[doc] slight improvements to the doc of the settings (base_url)
2023-02-17Add "Auto-detected" as a language.Alexandre Flament
When the user choose "Auto-detected", the choice remains on the following queries. The detected language is displayed. For example "Auto-detected (en)": * the next query language is going to be auto detected * for the current query, the detected language is English. This replace the autodetect_search_language plugin.
2023-02-17[fix] typo in searx/plugins/tor_check.pyMarkus Heiser
Related: https://github.com/searxng/searxng/pull/2189 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-17[doc] slight improvements to the doc of the settings (base_url)Markus Heiser
Closes: https://github.com/searxng/searxng/issues/2190 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-15Merge pull request #2188 from ahmad-alkadri/fix/petalsearchMarkus Heiser
Fix the petalsearch engine
2023-02-15Merge pull request #2192 from return42/fix-tineyeMarkus Heiser
[mod] disbale engine tineye by default
2023-02-14Fix petalsearch and remove petalsearch newsAhmad Alkadri
2023-02-14[fix] spelling: Tor, SearXNGAllan Nordhøy
2023-02-14[mod] disbale engine tineye by defaultMarkus Heiser
Tineye becomes active as soon as a https:// signature is found in the search term, but most of the time a reverse image search is not requested when a URL is specified, often the URL is just from a C&P. The frequent requests to tineye lead in the end to the SearXNG instance being blocked by tineye and the user seeing unexpected error messages. BTW: many maintainers have disabled this engine in their local SearXNG settings. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-10[fix] remove engine neeva from settings.ymlMarkus Heiser
Engine is broken and can't by used any longer as a simple XPath engine. @allendema tested a engines/neeva.py version using json from the dom, but without luck: There was some kind of captcha for pagination. [1] https://github.com/searxng/searxng/issues/2007#issuecomment-1426061698 Closes: https://github.com/searxng/searxng/issues/2007 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-10fix: typo in suggestionsLea