summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2022-08-27add poi's website and phone number, doesn't crash when there is no ↵ta
`displayMapRegion`, query the token on the first request
2022-08-25add apple maps engineta
2022-08-10Update searx.data - update_engine_descriptions.pyMarkus Heiser
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10add sourcehut engineJohan Planchon
2022-08-10Merge pull request #1648 from unixfox/google_mobile_ui_parameterMarkus Heiser
output format protobuf to HTML for google mobile
2022-08-10[fix] google - simplify XPath selectors to fetch more resultsMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10add lib.rs engineJohan Planchon
2022-08-10output format protobuf to HTML for google mobileÉmilien Devos
2022-08-10Revert PR #1633Brock Vojković
This reverts the changes made to the Google results XPath in PR #1633.
2022-08-09[fix] google engine: results XPathLéon Tiekötter
Seems google rolls out changes first on the `google.com` domain and later on the "language" domains. By example: yesterday [1] `google.com` did not work but `google.de` and `google.fr` did work, today they do not work any longer and this fix is needed on all domains. Closes: https://github.com/searxng/searxng/issues/1628 [1] https://github.com/searxng/searxng/issues/1628#issuecomment-1208191816
2022-08-08Merge pull request #1627 from allendema/add-marginaliaMarkus Heiser
[enh] Initial Marginalia.nu support (foss)
2022-08-08Merge pull request #1623 from return42/mod-yep.comMarkus Heiser
[mod] engine yep.com: show all 100 results yep.com has
2022-08-08[enh] initial Marginalia.nu support (foss)Allen
Currently it uses a public api_key `/public/` [1] The 'index' parameter selects the search index, corresponding to the drop down next to the search field in the main GUI. 0: popular 1: blogs 2: big_sites 3: default 4: experimental 'experimental' is more up to date and does not exclude other sites, which is the case with 'big sites' or 'blogs'. [1] https://api.marginalia.nu/ [2] https://git.marginalia.nu/marginalia/marginalia.nu [3] https://news.ycombinator.com/item?id=31536626 Closes: https://github.com/searxng/searxng/issues/1620
2022-08-07[fix] typo in uWSGI cache: searxcache --> searxngcacheMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-06[mod] engine yep.com: show all 100 results yep.com hasMarkus Heiser
yep.com is still in beta, the api.yep.com does not have paging support. There is only a 'limit' argument with a maximum of 100 results. yep.com seems fast; there is nor need for a timeout of 12 sec. The API returns JSON nevertheless what the HTTP header is, the "show more" button on yep.com's web site does not set a special HTTP Accept header. FYI: The index does not support languages, the WEB UI does not offer a language selection of the results and the entire index seems in English. Closes: https://github.com/searxng/searxng/issues/1619 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-05[translations] update from Weblatesearxng-bot
acf8bd39 - 2022-08-05 - Markus Heiser <markus.heiser@darmarit.de> 4ad75b6e - 2022-08-04 - Markus Heiser <markus.heiser@darmarit.de> ee8cbee6 - 2022-07-31 - Markus Heiser <markus.heiser@darmarit.de> 87c19313 - 2022-08-01 - Academic tyro <y13593582403@gmail.com> cbe0de32 - 2022-07-30 - Markus Heiser <markus.heiser@darmarit.de> 45029a17 - 2022-08-04 - Markus Heiser <markus.heiser@darmarit.de> 6eec3795 - 2022-08-03 - Markus Heiser <markus.heiser@darmarit.de> f8d8f31f - 2022-07-29 - Markus Heiser <markus.heiser@darmarit.de> b3fb365f - 2022-07-29 - Markus Heiser <markus.heiser@darmarit.de> aaeabbc9 - 2022-08-03 - Lakatos Tamás <tomimost@gmail.com> 6c71c501 - 2022-08-03 - Markus Heiser <markus.heiser@darmarit.de> f7b5ba19 - 2022-08-01 - Markus Heiser <markus.heiser@darmarit.de> 850e7fa0 - 2022-08-04 - Mico Hautaluoma <m@mha.fi> 0cb696fc - 2022-07-31 - Markus Heiser <markus.heiser@darmarit.de> 04c3785f - 2022-08-02 - Markus Heiser <markus.heiser@darmarit.de> b500f2ad - 2022-08-01 - Edrean Ernst <edrean@allesbeste.com> 0b576b83 - 2022-08-01 - GooGuJiang <gu@gmoe.cc> 0adeb6e2 - 2022-08-01 - Edrean Ernst <edrean@allesbeste.com> 0b025f17 - 2022-07-31 - PRATYAY MUSTAFI <pratyaymustafi@gmail.com>
2022-08-04[wip] brave time range supportAllen
2022-08-01[mod] add 'Accept-Language' HTTP header to online processoresMarkus Heiser
Most engines that support languages (and regions) use the Accept-Language from the WEB browser to build a response that fits to the language (and region). - add new engine option: send_accept_language_header Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01[doc] add description of method EngineProcessor.get_params()Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-30[fix] pyright repported errorsAlexandre Flament
The errors make pyright usage useless since a new error won't be seen [1]. [1] https://github.com/searxng/searxng/pull/1569 ``` searx/compat.py:11:27 - error: Expression of type "Type[cached_property[_T@cached_property]]" cannot be assigned to declared type "Type[cached_property]" "Type[cached_property[_T@cached_property]]" is incompatible with "Type[cached_property]" Type "Type[cached_property[_T@cached_property]]" cannot be assigned to type "Type[cached_property]" (reportGeneralTypeIssues) searx/utils.py:69:36 - error: Expression of type "None" cannot be assigned to parameter of type "str" Type "None" cannot be assigned to type "str" (reportGeneralTypeIssues) searx/utils.py:573:85 - error: Expression of type "None" cannot be assigned to parameter of type "int" Type "None" cannot be assigned to type "int" (reportGeneralTypeIssues) searx/webapp.py:1306:22 - error: Argument of type "str" cannot be assigned to parameter "__a" of type "BytesPath" in function "join" Type "str" cannot be assigned to type "BytesPath" "str" is incompatible with "bytes" "str" is incompatible with protocol "PathLike[bytes]" "__fspath__" is not present (reportGeneralTypeIssues) searx/webapp.py:1306:68 - error: Argument of type "Literal['themes']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join" Type "Literal['themes']" cannot be assigned to type "BytesPath" "Literal['themes']" is incompatible with "bytes" "Literal['themes']" is incompatible with protocol "PathLike[bytes]" "__fspath__" is not present (reportGeneralTypeIssues) searx/webapp.py:1306:78 - error: Argument of type "str | Any | None" cannot be assigned to parameter "paths" of type "BytesPath" in function "join" Type "str | Any | None" cannot be assigned to type "BytesPath" Type "str" cannot be assigned to type "BytesPath" "str" is incompatible with "bytes" "str" is incompatible with protocol "PathLike[bytes]" "__fspath__" is not present (reportGeneralTypeIssues) searx/webapp.py:1306:85 - error: Argument of type "Literal['img']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join" Type "Literal['img']" cannot be assigned to type "BytesPath" "Literal['img']" is incompatible with "bytes" "Literal['img']" is incompatible with protocol "PathLike[bytes]" "__fspath__" is not present (reportGeneralTypeIssues) searx/engines/mongodb.py:8:6 - warning: Import "pymongo" could not be resolved (reportMissingImports) searx/engines/mysql_server.py:9:8 - warning: Import "mysql.connector" could not be resolved (reportMissingImports) searx/engines/postgresql.py:9:8 - warning: Import "psycopg2" could not be resolved from source (reportMissingModuleSource) searx/engines/xpath.py:187:28 - warning: "categories" is not defined (reportUndefinedVariable) searx/search/__init__.py:184:82 - warning: "flask" is not defined (reportUndefinedVariable) searx/search/checker/background.py:19:26 - error: Type of "schedule" is partially unknown Type of "schedule" is "(delay: Any, func: Any, *args: Any) -> Literal[True]" (reportUnknownVariableType) searx/shared/__init__.py:8:12 - warning: Import "uwsgi" could not be resolved (reportMissingImports) searx/shared/shared_uwsgi.py:5:8 - warning: Import "uwsgi" could not be resolved (reportMissingImports) ```
2022-07-30[utils/searxng.sh] implement new script to install SearXNGMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-29[translations] update from Weblatesearxng-bot
c0c9107c - 2022-07-27 - Sangha Lee <totoriato@gmail.com> 5b48bce6 - 2022-07-24 - Linerly <linerly@protonmail.com> 79669e65 - 2022-07-29 - Markus Heiser <markus.heiser@darmarit.de> 520e9284 - 2022-07-25 - Markus Heiser <markus.heiser@darmarit.de> 7cf52ff5 - 2022-07-25 - Markus Heiser <markus.heiser@darmarit.de> 9d3ebe72 - 2022-07-24 - Markus Heiser <markus.heiser@darmarit.de> 2d03c097 - 2022-07-24 - Markus Heiser <markus.heiser@darmarit.de> 388af012 - 2022-07-27 - Markus Heiser <markus.heiser@darmarit.de> a4bcf098 - 2022-07-25 - Miguel Silva <miguelcabeca.dev@gmail.com> 93fd0b72 - 2022-07-27 - Markus Heiser <markus.heiser@darmarit.de> 8f68b206 - 2022-07-26 - tents <remendne@pentrens.jp> 9007c99c - 2022-07-24 - Markus Heiser <markus.heiser@darmarit.de> aeec96f2 - 2022-07-26 - Matija Kromar <matija.kromar@gmail.com> 69084863 - 2022-07-25 - Markus Heiser <markus.heiser@darmarit.de> b48190ab - 2022-07-24 - alexfs2015 <alex04fs@gmail.com> b6bbc0a5 - 2022-07-23 - Markus Heiser <markus.heiser@darmarit.de> 1a503806 - 2022-07-29 - Markus Heiser <markus.heiser@darmarit.de> c960cb93 - 2022-07-27 - Markus Heiser <markus.heiser@darmarit.de> 8a2bd34b - 2022-07-25 - Markus Heiser <markus.heiser@darmarit.de> 1064cea0 - 2022-07-23 - LagManCZ <lagmen@post.cz> 67423045 - 2022-07-24 - alexfs2015 <alex04fs@gmail.com> 56c87fda - 2022-07-24 - Markus Heiser <markus.heiser@darmarit.de> 36a64f1c - 2022-07-24 - Ankit Gupta <guptaa.ankitt@gmail.com>
2022-07-29Merge pull request #1580 from searxng/update_data_update_engine_descriptions.pyMarkus Heiser
Update searx.data - update_engine_descriptions.py
2022-07-29Merge pull request #1579 from searxng/update_data_update_currencies.pyMarkus Heiser
Update searx.data - update_currencies.py
2022-07-29Merge pull request #1578 from searxng/update_data_update_firefox_version.pyMarkus Heiser
Update searx.data - update_firefox_version.py
2022-07-29Merge pull request #1576 from searxng/update_data_update_languages.pyMarkus Heiser
Update searx.data - update_languages.py
2022-07-29Update searx.data - update_engine_descriptions.pydalf
2022-07-29Update searx.data - update_currencies.pydalf
2022-07-29Update searx.data - update_firefox_version.pydalf
2022-07-29Update searx.data - update_ahmia_blacklist.pydalf
2022-07-29Update searx.data - update_languages.pydalf
2022-07-26Revert "Quick fix for google engine for EU countries"Markus Heiser
This reverts commit 747cf1a246df587aeb3b6b175c315ef0b9612dc4.
2022-07-26[fix] google engine: results XPathLéon Tiekötter
2022-07-25Quick fix for google engine for EU countriesÉmilien Devos
This revert part of the commit of https://github.com/searxng/searxng/commit/5fb2071cb2248c0f0ada7affb0c47f841ddbf102
2022-07-25[fix] demo_online.py - fixed typoMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-25[fix] google & youtube - set EU consent cookieEmilien Devos
This change the previous bypass method for Google consent using ``ucbcb=1`` (6face215b8) to accept the consent using ``CONSENT=YES+``. The youtube_noapi and google have a similar API, at least for the consent[1]. Get CONSENT cookie from google reguest:: curl -i "https://www.google.com/search?q=time&tbm=isch" \ -A "Mozilla/5.0 (X11; Linux i686; rv:102.0) Gecko/20100101 Firefox/102.0" \ | grep -i consent ... location: https://consent.google.com/m?continue=https://www.google.com/search?q%3Dtime%26tbm%3Disch&gl=DE&m=0&pc=irp&uxe=eomtm&hl=en-US&src=1 set-cookie: CONSENT=PENDING+936; expires=Wed, 24-Jul-2024 11:26:20 GMT; path=/; domain=.google.com; Secure ... PENDING & YES [2]: Google change the way for consent about YouTube cookies agreement in EU countries. Instead of showing a popup in the website, YouTube redirects the user to a new webpage at consent.youtube.com domain ... Fix for this is to put a cookie CONSENT with YES+ value for every YouTube request [1] https://github.com/iv-org/invidious/pull/2207 [2] https://github.com/TeamNewPipe/NewPipeExtractor/issues/592 Closes: https://github.com/searxng/searxng/issues/1432
2022-07-24[fix] sjp engine - convert enginename to a latin1 compliance nameMarkus Heiser
The engine name is not only a *name* its also a identifier that is used in logs, HTTP headers and more. Unicode characters in the name of an engine could cause various issues. Closes: https://github.com/searxng/searxng/issues/1544 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-24[fix] emojipedia - update XPath to be relativejames-still
2022-07-23[fix] engine tineye: handle 422 response of not supported img formatMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/1449 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-22[translations] update from Weblatesearxng-bot
cf6e9482 - 2022-07-19 - Linerly <linerly@protonmail.com> 918c1bfe - 2022-07-20 - Markus Heiser <markus.heiser@darmarit.de> 4e65ecf6 - 2022-07-21 - calb sepherus <calb.sepherus@protonmail.com> a54be8fe - 2022-07-19 - Markus Heiser <markus.heiser@darmarit.de> cad6cb2f - 2022-07-19 - Markus Heiser <markus.heiser@darmarit.de> a6bd1170 - 2022-07-19 - Markus Heiser <markus.heiser@darmarit.de> 9d0e8754 - 2022-07-19 - Markus Heiser <markus.heiser@darmarit.de>
2022-07-19[mod] add tor_check plugin - convenient tor checking trough searxngSolirs
2022-07-17[fix] preferences: missing option valueLéon Tiekötter
Fix missing option value "0".
2022-07-15Merge pull request #1512 from searxng/translations_updateMarkus Heiser
Update translations
2022-07-15Merge pull request #1475 from return42/EmojipediaMarkus Heiser
[mod] Add engine for Emojipedia
2022-07-15Update searx.data - update_engine_descriptions.pyMarkus Heiser
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-15[mod] Add engine for EmojipediaJay
Emojipedia is an emoji reference website which documents the meaning and common usage of emoji characters in the Unicode Standard. It is owned by Zedge since 2021. Emojipedia is a voting member of The Unicode Consortium.[1] Cherry picked from @james-still [2[3] and slightly modified to fit SearXNG's quality gates. [1] https://en.wikipedia.org/wiki/Emojipedia [2] https://github.com/james-still/searx/commit/2fc01eb20f8de5f9cac492dcdfb817a6f0636580 [3] https://github.com/searx/searx/pull/3278
2022-07-15[translations] update from Weblatesearxng-bot
e78584e1 - 2022-07-14 - Markus Heiser <markus.heiser@darmarit.de> eb3f2140 - 2022-07-14 - Markus Heiser <markus.heiser@darmarit.de> 9160b6d1 - 2022-07-14 - Markus Heiser <markus.heiser@darmarit.de> 18d569b8 - 2022-07-14 - Markus Heiser <markus.heiser@darmarit.de> c9137f9e - 2022-07-14 - Hachiki <ninonakano408@gmail.com> 14d8b61f - 2022-07-14 - Markus Heiser <markus.heiser@darmarit.de> c11e318d - 2022-07-09 - Linerly <linerly@protonmail.com> 4d53b3bb - 2022-07-12 - crazychicken1 <seymaomay1809@gmail.com> 613117bf - 2022-07-10 - Markus Heiser <markus.heiser@darmarit.de> e5e38305 - 2022-07-11 - Markus Heiser <markus.heiser@darmarit.de> 2bea37fa - 2022-07-10 - Markus Heiser <markus.heiser@darmarit.de> 5ab15881 - 2022-07-11 - Markus Heiser <markus.heiser@darmarit.de> 32794ad3 - 2022-07-11 - Markus Heiser <markus.heiser@darmarit.de> 830b01f9 - 2022-07-11 - Chris Capisce <christof1588@gmail.com> b4d431e5 - 2022-07-08 - John Doe <cryptiox@protonmail.com> c6d9841e - 2022-07-10 - tents <remendne@pentrens.jp> 68692656 - 2022-07-13 - Markus Heiser <markus.heiser@darmarit.de> 8cba6d36 - 2022-07-10 - Markus Heiser <markus.heiser@darmarit.de> fe457886 - 2022-07-08 - Markus Heiser <markus.heiser@darmarit.de> 95e7d403 - 2022-07-13 - Markus Heiser <markus.heiser@darmarit.de> f02673b1 - 2022-07-11 - Markus Heiser <markus.heiser@darmarit.de> 7d49be29 - 2022-07-10 - Markus Heiser <markus.heiser@darmarit.de> fbe6e4da - 2022-07-08 - Raúl Díaz <flan@chocoflan.net>
2022-07-10[mod] allow brand.issue_url to overwrite the step1 urlLéon Tiekötter
2022-07-10Merge pull request #1219 from dalf/follow_bing_redirectAlexandre Flament
bing.py: remove redirection links
2022-07-09bypass google consent with ucbcb=1Emilien Devos