summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2022-08-14[mod] decouple qwant's categories from SearXNG's categoriesMarkus Heiser
By using new property `qwant_categ:` the category of qwant is no longer bound to the category of SearXNG. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14add twitter engineta
2022-08-13Merge pull request #1655 from return42/fix-opensearchMarkus Heiser
[fix] improve OpenSearch description
2022-08-13Merge pull request #1660 from liimee/eng-neevaLéon Tiekötter
Add neeva engine
2022-08-13Fix time range support and add soft_max_redirectsLéon Tiekötter
Add custom time_range_url and time_range_map Set soft_max_redirects = 2 to prevent "ErrorContext('searx/search/processors/online.py', 116, 'count_error(', None, '2 redirects, maximum: 0', ('200', 'OK', 'neeva.com')) True"
2022-08-13add neeva web engineta
Neeva is "the world's first ad-free, private search engine" and uses data from Apple, Bing, Yelp and "others". They claim to crawl "hundreds of millions" of URLs a day (https://twitter.com/Neeva/status/1536447373903335426).
2022-08-12[translations] update from Weblatesearxng-bot
f2997bfa - 2022-08-12 - Markus Heiser <markus.heiser@darmarit.de> eeca674f - 2022-08-10 - Edrean Ernst <edrean@allesbeste.com> 7478de6a - 2022-08-11 - Markus Heiser <markus.heiser@darmarit.de> c4fb9110 - 2022-08-07 - wordpure <wordlesspure@gmail.com> a5b432e2 - 2022-08-11 - Markus Heiser <markus.heiser@darmarit.de> eb01d415 - 2022-08-09 - Markus Heiser <markus.heiser@darmarit.de> f96eb06e - 2022-08-11 - Shopimisrel <shopisrael12@gmail.com> e7c79191 - 2022-08-08 - ajnasaboobacker <ajnasaboobacker@gmail.com> f4dbd424 - 2022-08-08 - ajnasaboobacker <ajnasaboobacker@gmail.com>
2022-08-11[fix] improve OpenSearch descriptionMarkus Heiser
Some HTTP-Clients do have issues with the ``opensearch.xml`` from SearXNG (related [1][2]) while other OpenSearch descriptions[3] (e.g. from qwant) work flawles. Inspired by the OpenSearch description from qwant and with informations from the specification[4] the ``opensearch.xml`` has been *improved*. - convert `<Url>` methods from lower case to upper case (`POST`|`GET`) - add `<moz:SearchForm>` and `xmlns:moz="http://www.mozilla.org/2006/browser/search/"` - add `<Query role="example" searchTerms="SearXNG" />` [4] OpenSearch description documents should include at least one Query element of `role="example"` that is expected to return search results. Search clients may use this example query to validate that the search engine is working properly. - modified `<LongName>` to SearXNG - modified `<Description>` the word 'hackable' scares uninitiated users and was removed - add the `type="image/png"` to `<Image>` Test can be done by:: make run Visit http://127.0.0.1:8888/ and add the search engine to your WEB-Browser / test with different WEB-Browser from desktop and Smartphones (are there any iOS user here, please test on Safari and Chrome). [1] https://app.element.io/#/room/#searxng:matrix.org/$xN_abdKhNqUlgXRBrb_9F3pqOxnSzGQ1TG0s0G9hQVw [2] https://github.com/searxng/searxng/issues/431 [3] https://developer.mozilla.org/en-US/docs/Web/OpenSearch [4] https://github.com/dewitt/opensearch/blob/master/opensearch-1-1-draft-6.md#the-query-element Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10Update searx.data - update_engine_descriptions.pyMarkus Heiser
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10add sourcehut engineJohan Planchon
2022-08-10Merge pull request #1648 from unixfox/google_mobile_ui_parameterMarkus Heiser
output format protobuf to HTML for google mobile
2022-08-10[fix] google - simplify XPath selectors to fetch more resultsMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10add lib.rs engineJohan Planchon
2022-08-10output format protobuf to HTML for google mobileÉmilien Devos
2022-08-10[mod] add deepl translation engineThomas Renard
This implements the Deepl Translation engine. It works nearly like lingva but directly to the deepl API. This api only needs a to-lang, from-lang is a fake by now. There is a free option to use [1]. [1] https://www.deepl.com/pro-api?cta=header-pro-api for registering a free account.
2022-08-10Revert PR #1633Brock Vojković
This reverts the changes made to the Google results XPath in PR #1633.
2022-08-09[fix] google engine: results XPathLéon Tiekötter
Seems google rolls out changes first on the `google.com` domain and later on the "language" domains. By example: yesterday [1] `google.com` did not work but `google.de` and `google.fr` did work, today they do not work any longer and this fix is needed on all domains. Closes: https://github.com/searxng/searxng/issues/1628 [1] https://github.com/searxng/searxng/issues/1628#issuecomment-1208191816
2022-08-08Merge pull request #1627 from allendema/add-marginaliaMarkus Heiser
[enh] Initial Marginalia.nu support (foss)
2022-08-08Merge pull request #1623 from return42/mod-yep.comMarkus Heiser
[mod] engine yep.com: show all 100 results yep.com has
2022-08-08[enh] initial Marginalia.nu support (foss)Allen
Currently it uses a public api_key `/public/` [1] The 'index' parameter selects the search index, corresponding to the drop down next to the search field in the main GUI. 0: popular 1: blogs 2: big_sites 3: default 4: experimental 'experimental' is more up to date and does not exclude other sites, which is the case with 'big sites' or 'blogs'. [1] https://api.marginalia.nu/ [2] https://git.marginalia.nu/marginalia/marginalia.nu [3] https://news.ycombinator.com/item?id=31536626 Closes: https://github.com/searxng/searxng/issues/1620
2022-08-07[fix] typo in uWSGI cache: searxcache --> searxngcacheMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-07add description and wikidata ID to wttr.in engineliimee
2022-08-07add wttr.in engineta
2022-08-06[mod] engine yep.com: show all 100 results yep.com hasMarkus Heiser
yep.com is still in beta, the api.yep.com does not have paging support. There is only a 'limit' argument with a maximum of 100 results. yep.com seems fast; there is nor need for a timeout of 12 sec. The API returns JSON nevertheless what the HTTP header is, the "show more" button on yep.com's web site does not set a special HTTP Accept header. FYI: The index does not support languages, the WEB UI does not offer a language selection of the results and the entire index seems in English. Closes: https://github.com/searxng/searxng/issues/1619 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-05[translations] update from Weblatesearxng-bot
acf8bd39 - 2022-08-05 - Markus Heiser <markus.heiser@darmarit.de> 4ad75b6e - 2022-08-04 - Markus Heiser <markus.heiser@darmarit.de> ee8cbee6 - 2022-07-31 - Markus Heiser <markus.heiser@darmarit.de> 87c19313 - 2022-08-01 - Academic tyro <y13593582403@gmail.com> cbe0de32 - 2022-07-30 - Markus Heiser <markus.heiser@darmarit.de> 45029a17 - 2022-08-04 - Markus Heiser <markus.heiser@darmarit.de> 6eec3795 - 2022-08-03 - Markus Heiser <markus.heiser@darmarit.de> f8d8f31f - 2022-07-29 - Markus Heiser <markus.heiser@darmarit.de> b3fb365f - 2022-07-29 - Markus Heiser <markus.heiser@darmarit.de> aaeabbc9 - 2022-08-03 - Lakatos Tamás <tomimost@gmail.com> 6c71c501 - 2022-08-03 - Markus Heiser <markus.heiser@darmarit.de> f7b5ba19 - 2022-08-01 - Markus Heiser <markus.heiser@darmarit.de> 850e7fa0 - 2022-08-04 - Mico Hautaluoma <m@mha.fi> 0cb696fc - 2022-07-31 - Markus Heiser <markus.heiser@darmarit.de> 04c3785f - 2022-08-02 - Markus Heiser <markus.heiser@darmarit.de> b500f2ad - 2022-08-01 - Edrean Ernst <edrean@allesbeste.com> 0b576b83 - 2022-08-01 - GooGuJiang <gu@gmoe.cc> 0adeb6e2 - 2022-08-01 - Edrean Ernst <edrean@allesbeste.com> 0b025f17 - 2022-07-31 - PRATYAY MUSTAFI <pratyaymustafi@gmail.com>
2022-08-04[wip] brave time range supportAllen
2022-08-01[mod] add 'Accept-Language' HTTP header to online processoresMarkus Heiser
Most engines that support languages (and regions) use the Accept-Language from the WEB browser to build a response that fits to the language (and region). - add new engine option: send_accept_language_header Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01[doc] add description of method EngineProcessor.get_params()Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-30[fix] pyright repported errorsAlexandre Flament
The errors make pyright usage useless since a new error won't be seen [1]. [1] https://github.com/searxng/searxng/pull/1569 ``` searx/compat.py:11:27 - error: Expression of type "Type[cached_property[_T@cached_property]]" cannot be assigned to declared type "Type[cached_property]" "Type[cached_property[_T@cached_property]]" is incompatible with "Type[cached_property]" Type "Type[cached_property[_T@cached_property]]" cannot be assigned to type "Type[cached_property]" (reportGeneralTypeIssues) searx/utils.py:69:36 - error: Expression of type "None" cannot be assigned to parameter of type "str" Type "None" cannot be assigned to type "str" (reportGeneralTypeIssues) searx/utils.py:573:85 - error: Expression of type "None" cannot be assigned to parameter of type "int" Type "None" cannot be assigned to type "int" (reportGeneralTypeIssues) searx/webapp.py:1306:22 - error: Argument of type "str" cannot be assigned to parameter "__a" of type "BytesPath" in function "join" Type "str" cannot be assigned to type "BytesPath" "str" is incompatible with "bytes" "str" is incompatible with protocol "PathLike[bytes]" "__fspath__" is not present (reportGeneralTypeIssues) searx/webapp.py:1306:68 - error: Argument of type "Literal['themes']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join" Type "Literal['themes']" cannot be assigned to type "BytesPath" "Literal['themes']" is incompatible with "bytes" "Literal['themes']" is incompatible with protocol "PathLike[bytes]" "__fspath__" is not present (reportGeneralTypeIssues) searx/webapp.py:1306:78 - error: Argument of type "str | Any | None" cannot be assigned to parameter "paths" of type "BytesPath" in function "join" Type "str | Any | None" cannot be assigned to type "BytesPath" Type "str" cannot be assigned to type "BytesPath" "str" is incompatible with "bytes" "str" is incompatible with protocol "PathLike[bytes]" "__fspath__" is not present (reportGeneralTypeIssues) searx/webapp.py:1306:85 - error: Argument of type "Literal['img']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join" Type "Literal['img']" cannot be assigned to type "BytesPath" "Literal['img']" is incompatible with "bytes" "Literal['img']" is incompatible with protocol "PathLike[bytes]" "__fspath__" is not present (reportGeneralTypeIssues) searx/engines/mongodb.py:8:6 - warning: Import "pymongo" could not be resolved (reportMissingImports) searx/engines/mysql_server.py:9:8 - warning: Import "mysql.connector" could not be resolved (reportMissingImports) searx/engines/postgresql.py:9:8 - warning: Import "psycopg2" could not be resolved from source (reportMissingModuleSource) searx/engines/xpath.py:187:28 - warning: "categories" is not defined (reportUndefinedVariable) searx/search/__init__.py:184:82 - warning: "flask" is not defined (reportUndefinedVariable) searx/search/checker/background.py:19:26 - error: Type of "schedule" is partially unknown Type of "schedule" is "(delay: Any, func: Any, *args: Any) -> Literal[True]" (reportUnknownVariableType) searx/shared/__init__.py:8:12 - warning: Import "uwsgi" could not be resolved (reportMissingImports) searx/shared/shared_uwsgi.py:5:8 - warning: Import "uwsgi" could not be resolved (reportMissingImports) ```
2022-07-30[utils/searxng.sh] implement new script to install SearXNGMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-29[translations] update from Weblatesearxng-bot
c0c9107c - 2022-07-27 - Sangha Lee <totoriato@gmail.com> 5b48bce6 - 2022-07-24 - Linerly <linerly@protonmail.com> 79669e65 - 2022-07-29 - Markus Heiser <markus.heiser@darmarit.de> 520e9284 - 2022-07-25 - Markus Heiser <markus.heiser@darmarit.de> 7cf52ff5 - 2022-07-25 - Markus Heiser <markus.heiser@darmarit.de> 9d3ebe72 - 2022-07-24 - Markus Heiser <markus.heiser@darmarit.de> 2d03c097 - 2022-07-24 - Markus Heiser <markus.heiser@darmarit.de> 388af012 - 2022-07-27 - Markus Heiser <markus.heiser@darmarit.de> a4bcf098 - 2022-07-25 - Miguel Silva <miguelcabeca.dev@gmail.com> 93fd0b72 - 2022-07-27 - Markus Heiser <markus.heiser@darmarit.de> 8f68b206 - 2022-07-26 - tents <remendne@pentrens.jp> 9007c99c - 2022-07-24 - Markus Heiser <markus.heiser@darmarit.de> aeec96f2 - 2022-07-26 - Matija Kromar <matija.kromar@gmail.com> 69084863 - 2022-07-25 - Markus Heiser <markus.heiser@darmarit.de> b48190ab - 2022-07-24 - alexfs2015 <alex04fs@gmail.com> b6bbc0a5 - 2022-07-23 - Markus Heiser <markus.heiser@darmarit.de> 1a503806 - 2022-07-29 - Markus Heiser <markus.heiser@darmarit.de> c960cb93 - 2022-07-27 - Markus Heiser <markus.heiser@darmarit.de> 8a2bd34b - 2022-07-25 - Markus Heiser <markus.heiser@darmarit.de> 1064cea0 - 2022-07-23 - LagManCZ <lagmen@post.cz> 67423045 - 2022-07-24 - alexfs2015 <alex04fs@gmail.com> 56c87fda - 2022-07-24 - Markus Heiser <markus.heiser@darmarit.de> 36a64f1c - 2022-07-24 - Ankit Gupta <guptaa.ankitt@gmail.com>
2022-07-29Merge pull request #1580 from searxng/update_data_update_engine_descriptions.pyMarkus Heiser
Update searx.data - update_engine_descriptions.py
2022-07-29Merge pull request #1579 from searxng/update_data_update_currencies.pyMarkus Heiser
Update searx.data - update_currencies.py
2022-07-29Merge pull request #1578 from searxng/update_data_update_firefox_version.pyMarkus Heiser
Update searx.data - update_firefox_version.py
2022-07-29Merge pull request #1576 from searxng/update_data_update_languages.pyMarkus Heiser
Update searx.data - update_languages.py
2022-07-29Update searx.data - update_engine_descriptions.pydalf
2022-07-29Update searx.data - update_currencies.pydalf
2022-07-29Update searx.data - update_firefox_version.pydalf
2022-07-29Update searx.data - update_ahmia_blacklist.pydalf
2022-07-29Update searx.data - update_languages.pydalf
2022-07-26Revert "Quick fix for google engine for EU countries"Markus Heiser
This reverts commit 747cf1a246df587aeb3b6b175c315ef0b9612dc4.
2022-07-26[fix] google engine: results XPathLéon Tiekötter
2022-07-25Quick fix for google engine for EU countriesÉmilien Devos
This revert part of the commit of https://github.com/searxng/searxng/commit/5fb2071cb2248c0f0ada7affb0c47f841ddbf102
2022-07-25[fix] demo_online.py - fixed typoMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-25[fix] google & youtube - set EU consent cookieEmilien Devos
This change the previous bypass method for Google consent using ``ucbcb=1`` (6face215b8) to accept the consent using ``CONSENT=YES+``. The youtube_noapi and google have a similar API, at least for the consent[1]. Get CONSENT cookie from google reguest:: curl -i "https://www.google.com/search?q=time&tbm=isch" \ -A "Mozilla/5.0 (X11; Linux i686; rv:102.0) Gecko/20100101 Firefox/102.0" \ | grep -i consent ... location: https://consent.google.com/m?continue=https://www.google.com/search?q%3Dtime%26tbm%3Disch&gl=DE&m=0&pc=irp&uxe=eomtm&hl=en-US&src=1 set-cookie: CONSENT=PENDING+936; expires=Wed, 24-Jul-2024 11:26:20 GMT; path=/; domain=.google.com; Secure ... PENDING & YES [2]: Google change the way for consent about YouTube cookies agreement in EU countries. Instead of showing a popup in the website, YouTube redirects the user to a new webpage at consent.youtube.com domain ... Fix for this is to put a cookie CONSENT with YES+ value for every YouTube request [1] https://github.com/iv-org/invidious/pull/2207 [2] https://github.com/TeamNewPipe/NewPipeExtractor/issues/592 Closes: https://github.com/searxng/searxng/issues/1432
2022-07-24[fix] sjp engine - convert enginename to a latin1 compliance nameMarkus Heiser
The engine name is not only a *name* its also a identifier that is used in logs, HTTP headers and more. Unicode characters in the name of an engine could cause various issues. Closes: https://github.com/searxng/searxng/issues/1544 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-24[fix] emojipedia - update XPath to be relativejames-still
2022-07-23[fix] engine tineye: handle 422 response of not supported img formatMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/1449 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-22[translations] update from Weblatesearxng-bot
cf6e9482 - 2022-07-19 - Linerly <linerly@protonmail.com> 918c1bfe - 2022-07-20 - Markus Heiser <markus.heiser@darmarit.de> 4e65ecf6 - 2022-07-21 - calb sepherus <calb.sepherus@protonmail.com> a54be8fe - 2022-07-19 - Markus Heiser <markus.heiser@darmarit.de> cad6cb2f - 2022-07-19 - Markus Heiser <markus.heiser@darmarit.de> a6bd1170 - 2022-07-19 - Markus Heiser <markus.heiser@darmarit.de> 9d0e8754 - 2022-07-19 - Markus Heiser <markus.heiser@darmarit.de>
2022-07-19[mod] add tor_check plugin - convenient tor checking trough searxngSolirs
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-21 23:42:22 +0000