summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2023-08-08[doc] fix some minor typos in the doc-strings of class EngineTraitsMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-07[fix] settings.yml: typo in engine name wikipecies -> wikispeciesMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-06[doc] engine bt4g: add documentation to docs/dev/engines/online/Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-06[feat] new engine: bt4g added & enabled and disable by default btdiggEmilien Devos
Disable btdigg because on most SearXNG instances, SearXNG is blocked by btdigg due to cloudflare too many requests. This impementation did not parse the HTML page because there is an API in XML (RSS). The RSS feed provides fewer data like amount of seeders/leechers and the files in the torrent file. It's a tradeoff for a "stable" engine as the XML from RSS content will change way less than the HTML page. Closes: https://github.com/searxng/searxng/issues/2553
2023-08-04[mod] settings.yml: enable engines from Wikimedia FoundationMarkus Heiser
The Wikimedia wikis [1] engines provide good answers and have short response times --> no reason to disable these enhgines by default. BTW: this patch adds a (sub-) category ``wikimedia`` for the engines [1]. [1] https://meta.wikimedia.org/wiki/Wikimedia_wikis Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-04[mod] engine: wikimedia - improve results, add addition settings & docMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-04[feat] new engine: wikispeciesBnyro
2023-08-04[translations] update from Weblatesearxng-bot
310daeb72 - 2023-08-03 - return42 <markus.heiser@darmarit.de> 01be8a264 - 2023-08-01 - return42 <markus.heiser@darmarit.de>
2023-08-03[doc] engine: YacyMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03add option to change yacy search modezutto
2023-08-03[fix] engine piped: 'invalid content'Markus Heiser
SearXNG does not allow a None value in the content field of a result item. If the key (shortDescription, uploaderName) in the JSON response from piped exists but is set to None, SearXNG ignores this result item:: DEBUG searx : result: invalid content: { .., 'content': None, ..} Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03[mod] engine piped: add paging supportMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03[mod] engine piped: split into two dedicated engiens for video & musicMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03[doc] engine piped: add documentation to docs/dev/engines/online/Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03[feat] engine: implementation of PipedBnyro
2023-07-29Update searx.data - update_engine_descriptions.pydalf
2023-07-29Update searx.data - update_wikidata_units.pydalf
2023-07-29Update searx.data - update_currencies.pydalf
2023-07-29Update searx.data - update_firefox_version.pydalf
2023-07-29Update searx.data - update_ahmia_blacklist.pydalf
2023-07-29[translations] update from Weblatesearxng-bot
ba4888c96 - 2023-07-26 - return42 <markus.heiser@darmarit.de> 6ec8a8a28 - 2023-07-22 - return42 <markus.heiser@darmarit.de> 0a7b701b3 - 2023-07-24 - artnay <jiri.gronroos@iki.fi> c0b34cbdb - 2023-07-23 - MonsoonFire <re1qnb5mq@mozmail.com> 37cbd41c2 - 2023-07-22 - return42 <markus.heiser@darmarit.de>
2023-07-22[fix] remove disabled: false from engine definitions in settings.ymlmrpaulblack
* setting disabled: false is not needed, since it is by default enabled
2023-07-22[translations] update from Weblatesearxng-bot
b7f1e9ae - 2023-07-17 - Hudobni Volk <hudobni.volk@tuta.io> 3c7c821e - 2023-07-16 - alextecplayz <alextec70@outlook.com> 0e305f84 - 2023-07-17 - return42 <markus.heiser@darmarit.de> 80745a22 - 2023-07-15 - tentsbet <remendne@pentrens.jp> afef0e2e - 2023-07-16 - Salif Mehmed <mail@salif.eu> 4a7687ac - 2023-07-14 - Ivan Gabaldon <admin@inetol.net>
2023-07-19[build] /staticmrpaulblack
2023-07-19fix "#backToTop" button always being clickableKiru
`pointer-events` never gets set to "none" when the button is hidden, allowing you to click the button. And your mouse further changes it's cursor to the pointer style.
2023-07-14[translations] update from Weblatesearxng-bot
01350cf1 - 2023-07-13 - return42 <markus.heiser@darmarit.de> 5f037a4d - 2023-07-12 - return42 <markus.heiser@darmarit.de> 820a78ad - 2023-07-12 - return42 <markus.heiser@darmarit.de> 73037743 - 2023-07-12 - return42 <markus.heiser@darmarit.de> e656795c - 2023-07-09 - Linerly <linerly@protonmail.com> 0ee18285 - 2023-07-08 - return42 <markus.heiser@darmarit.de> c087c7fb - 2023-07-08 - return42 <markus.heiser@darmarit.de> 6eb318c5 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 3b4a3d1f - 2023-07-08 - return42 <markus.heiser@darmarit.de> b3187499 - 2023-07-09 - return42 <markus.heiser@darmarit.de> c1226646 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 2356a402 - 2023-07-08 - return42 <markus.heiser@darmarit.de> c9a74b52 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 3d9f2938 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 68af8585 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 261a2a72 - 2023-07-08 - return42 <markus.heiser@darmarit.de> fcea15cf - 2023-07-08 - return42 <markus.heiser@darmarit.de> 7685385e - 2023-07-08 - return42 <markus.heiser@darmarit.de> ec0a3727 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 0130ddf7 - 2023-07-08 - return42 <markus.heiser@darmarit.de> b93f9609 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 4a5cdcb3 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 9cba3939 - 2023-07-08 - return42 <markus.heiser@darmarit.de> d973d937 - 2023-07-08 - return42 <markus.heiser@darmarit.de> ce076245 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 5c36ccab - 2023-07-08 - return42 <markus.heiser@darmarit.de> 226ff7d4 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 8148a9ed - 2023-07-08 - return42 <markus.heiser@darmarit.de> 840bc189 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 51ffc22e - 2023-07-08 - return42 <markus.heiser@darmarit.de> 394ec63e - 2023-07-08 - return42 <markus.heiser@darmarit.de> 428c16a8 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 218cf51e - 2023-07-08 - return42 <markus.heiser@darmarit.de> 70260934 - 2023-07-09 - ghose <correo@xmgz.eu> c6244c2b - 2023-07-08 - return42 <markus.heiser@darmarit.de> b92dc5c1 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 43917957 - 2023-07-08 - return42 <markus.heiser@darmarit.de> df1bf630 - 2023-07-08 - return42 <markus.heiser@darmarit.de> d1c00dff - 2023-07-08 - return42 <markus.heiser@darmarit.de> 0a6da54f - 2023-07-08 - return42 <markus.heiser@darmarit.de> 12377e28 - 2023-07-08 - return42 <markus.heiser@darmarit.de> b5b8ea78 - 2023-07-07 - gallegonovato <fran-carro@hotmail.es> ec31e65f - 2023-07-08 - return42 <markus.heiser@darmarit.de> 6c33b1fe - 2023-07-08 - return42 <markus.heiser@darmarit.de> 393d390c - 2023-07-08 - return42 <markus.heiser@darmarit.de> a4f6b353 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 0f8d6b6b - 2023-07-08 - return42 <markus.heiser@darmarit.de> 67f2fc96 - 2023-07-08 - Fjuro <ifjuro@proton.me> 5f2d3f02 - 2023-07-08 - return42 <markus.heiser@darmarit.de> 5ae2b8dc - 2023-07-08 - return42 <markus.heiser@darmarit.de> 0bd4fb1e - 2023-07-08 - return42 <markus.heiser@darmarit.de> ce768726 - 2023-07-08 - return42 <markus.heiser@darmarit.de> a22ae2f2 - 2023-07-08 - return42 <markus.heiser@darmarit.de> b5b8774f - 2023-07-08 - return42 <markus.heiser@darmarit.de>
2023-07-07[feat] engine: re-enables z-library (zlibrary-global.se)Paolo Basso
- re-enables z-library as the new domain zlibrary-global.se is now available from the open web. The announcement of the domain: https://www.reddit.com/r/zlibrary/comments/13whe08/mod_note_zlibraryglobalse_domain_is_officially/ It is an official domain, it requires to log in to the "personal" subdomain only to download files, but the search works. - changes the result template of zlibrary to paper.html, filling the appropriate fields - implements language filtering for zlibrary - implement zlibrary custom filters (engine traits) - refactor and document the zlibrary engine
2023-07-07[feat] enigine: add CrowdView forum search engineHackurei
2023-07-07[translations] update from Weblatesearxng-bot
152f2008 - 2023-07-05 - return42 <markus.heiser@darmarit.de> 9dbf6b22 - 2023-07-01 - return42 <markus.heiser@darmarit.de> 4ad4c00f - 2023-07-01 - Bananhylsa <thayer@hjemmeserver.net>
2023-07-01[doc] rearranges Settings & Engines docs for better readabilityMarkus Heiser
We have built up detailed documentation of the *settings* and the *engines* over the past few years. However, this documentation was still spread over various chapters and was difficult to navigate in its entirety. This patch rearranges the Settings & Engines documentation for better readability. To review new ordered docs:: make docs.clean docs.live Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-30[translations] update from Weblatesearxng-bot
2238e87b - 2023-06-28 - jenishngl <jenishngl+codeberg@gmail.com> c70d228a - 2023-06-24 - nogb <u8cn71wq@yogibo.anonaddy.me> 389c0c62 - 2023-06-24 - return42 <markus.heiser@darmarit.de> 656d9fcb - 2023-06-23 - return42 <markus.heiser@darmarit.de> a9c9b116 - 2023-06-25 - alma <alma@users.noreply.translate.codeberg.org> 528b845f - 2023-06-24 - nogb <u8cn71wq@yogibo.anonaddy.me> b8c50f23 - 2023-06-23 - return42 <markus.heiser@darmarit.de> 39f47c0f - 2023-06-23 - return42 <markus.heiser@darmarit.de> ae0aa811 - 2023-06-24 - Fjuro <ifjuro@proton.me> c8216259 - 2023-06-26 - lemonadeforlife <nahianlabiblimon44@gmail.com>
2023-06-29Update searx.data - update_engine_descriptions.pydalf
2023-06-29[fix] engine: Anna's Archive - grep results from '.js-scroll-hidden' elementsMarkus Heiser
The renderuing of the WEB page is very strange; except the firts position all other positions of Anna's result page are enclosed in SGML comments. These cooments are *uncommented* by some JS code, see query of the class '.js-scroll-hidden' in Anna's HTML template [1]. [1] https://annas-software.org/AnnaArchivist/annas-archive/-/blob/main/allthethings/templates/macros/md5_list.html Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-29[mod] engine: Anna's Archive - additionl settings (content, sort, ext)Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-29[mod] engine: Anna's Archive - fetch search arguments from search formMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-29[mod] engine: Anna's Archive - add language supportPaolo Basso
2023-06-29[feat] engine: implementation of Anna's ArchivePaolo Basso
Anna's Archive [1] is a free non-profit online shadow library metasearch engine providing access to a variety of book resources (also via IPFS), created by a team of anonymous archivists [2]. [1] https://annas-archive.org/ [2] https://annas-software.org/AnnaArchivist/annas-archive
2023-06-28[upd] make data.allMarkus Heiser
- ahmia_blacklist.txt - currencies.json - engine_descriptions.json - engine_traits.json - osm_keys_tags.json - useragents.json Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-28[fix] simple template: preferences - add missing icon_smal importMarkus Heiser
Related: https://github.com/searxng/searxng/commit/2149e88bdd64#r119535272 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-28[mod] engine torznab - refactor & option to hide linksPaolo Basso
- torznab engine using types and clearer code - torznab option to hide torrent and magnet links. - document the torznab engine - add myself to authors Closes: https://github.com/searxng/searxng/issues/1124 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-26[fix] Google API changedMarkus Heiser
It seems that Google is rolling out a modified WEB API [1][2]. In the past there was only the UI language in the `hl` argument but nowadays it seems a combination of the UI language and the "search region" is mixed in this argument and the `gl` argument has been removed. I'm very surprised that google is starting to mix the parameters of the UI with the parameters of the search index. This patch modifies the get_google_info(..) function. Beside Google-WEB this function is also used by other Google services, here are some examples to test region & language of .. - Google-WEB: `!go dragon boat :en-CA` - Google-News: `!gon dragon boat :en-CA` - Google-Videos: `!gov bmw :en-CA` - Goolge-Images `!goi bmw :en-CA` - [1] https://github.com/searxng/searxng/issues/2515#issuecomment-1606294635 - [2] https://github.com/searxng/searxng/issues/2515#issuecomment-1607150817 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-25[fix] engine & network issues / documentation and type annotationsMarkus Heiser
This patch fixes some quirks and issues related to the engines and the network. Each engine has its own network and this network was broken for the following engines[1]: - archlinux - bing - dailymotion - duckduckgo - google - peertube - startpage - wikipedia Since the files have been touched anyway, the type annotaions of the engine modules has also been completed so that error messages from the type checker are no longer reported. Related and (partial) fixed issue: - [1] https://github.com/searxng/searxng/issues/762#issuecomment-1605323861 - [2] https://github.com/searxng/searxng/issues/2513 - [3] https://github.com/searxng/searxng/issues/2515 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-23[translations] update from Weblatesearxng-bot
9512b92a - 2023-06-23 - Coccocoas_Helper <coccocoahelper@gmail.com> ca08c51e - 2023-06-23 - Coccocoas_Helper <coccocoahelper@gmail.com> 56ad4f21 - 2023-06-21 - return42 <markus.heiser@darmarit.de> 3ee419d6 - 2023-06-21 - return42 <markus.heiser@darmarit.de>
2023-06-19[fix] implement a JSONEncoder for the json formatMarkus Heiser
This patch implements a simple JSONEncoder just to fix #2502 / on the long term SearXNG needs a data schema for the result items and a json generator for the result list. Closes: https://github.com/searxng/searxng/issues/2505 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-19[mod] move some code from webapp module to webutils module (no functional ↵Markus Heiser
change) Over the years the webapp module became more and more a mess. To improve the modulaization a little this patch moves some implementations from the webapp module to webutils module. HINT: this patch brings non functional change Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-16[translations] update from Weblatesearxng-bot
98f61c70 - 2023-06-15 - alexgabi <alexgabi@disroot.org> a1679b93 - 2023-06-13 - return42 <markus.heiser@darmarit.de> ebd1d574 - 2023-06-13 - return42 <markus.heiser@darmarit.de> b28a1da3 - 2023-06-13 - return42 <markus.heiser@darmarit.de> 56409bf0 - 2023-06-11 - return42 <markus.heiser@darmarit.de> abc4916c - 2023-06-10 - return42 <markus.heiser@darmarit.de> b1900abe - 2023-06-10 - return42 <markus.heiser@darmarit.de> b48e84c4 - 2023-06-10 - return42 <markus.heiser@darmarit.de> bf395e32 - 2023-06-10 - return42 <markus.heiser@darmarit.de> c9c0a3c9 - 2023-06-10 - return42 <markus.heiser@darmarit.de> 3f50d31e - 2023-06-10 - return42 <markus.heiser@darmarit.de> 9da1c142 - 2023-06-09 - artnay <jiri.gronroos@iki.fi>
2023-06-09[translations] update from Weblatesearxng-bot
b40da1a3 - 2023-06-06 - return42 <markus.heiser@darmarit.de> 666ee7d4 - 2023-06-06 - return42 <markus.heiser@darmarit.de> 1e0e8ead - 2023-06-06 - return42 <markus.heiser@darmarit.de> 404b9937 - 2023-06-07 - Ivan Gabaldon <admin@inetol.net> a627f9a1 - 2023-06-04 - return42 <markus.heiser@darmarit.de> a234d2f8 - 2023-06-04 - gallegonovato <fran-carro@hotmail.es> cc41f9b5 - 2023-06-02 - return42 <markus.heiser@darmarit.de> 24651eac - 2023-06-02 - return42 <markus.heiser@darmarit.de> c37b0627 - 2023-06-02 - return42 <markus.heiser@darmarit.de> 9a435ea1 - 2023-06-02 - return42 <markus.heiser@darmarit.de> 40e0adad - 2023-06-02 - return42 <markus.heiser@darmarit.de> 6833b142 - 2023-06-02 - return42 <markus.heiser@darmarit.de> 00f397ad - 2023-06-02 - tentsbet <remendne@pentrens.jp> 7d3d4a97 - 2023-06-02 - return42 <markus.heiser@darmarit.de> f7d713a4 - 2023-06-02 - return42 <markus.heiser@darmarit.de> b1ec3160 - 2023-06-03 - ghose <correo@xmgz.eu> 04591a3a - 2023-06-02 - return42 <markus.heiser@darmarit.de> cb3ac67c - 2023-06-02 - return42 <markus.heiser@darmarit.de> fe81dbc7 - 2023-06-02 - return42 <markus.heiser@darmarit.de> 7882670f - 2023-06-02 - return42 <markus.heiser@darmarit.de> 38882f3b - 2023-06-02 - return42 <markus.heiser@darmarit.de> c6df5047 - 2023-06-02 - return42 <markus.heiser@darmarit.de> 6ca23c3b - 2023-06-02 - return42 <markus.heiser@darmarit.de> 72f1ee09 - 2023-06-02 - return42 <markus.heiser@darmarit.de>
2023-06-05[mod] tools.Config.get(): add missing type annotationsMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-05[mod] limiter: blocklist and passlist (ip_lists)Markus Heiser
A blocklist and a passlist can be configured in /etc/searxng/limiter.toml:: [botdetection.ip_lists] pass_ip = [ '51.15.252.168', # IPv4 of check.searx.space ] block_ip = [ '93.184.216.34', # IPv4 of example.org ] Closes: https://github.com/searxng/searxng/issues/2127 Closes: https://github.com/searxng/searxng/pull/2129 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-05[fix] engines: don't spam marginalia.nu with default settingsMarkus Heiser
The engine configuration of marginalia [2][3][4][5] spams marginalia.nu with requests from SearXNG instances [1]. It is not in the interest of SearXNG to disturb other FOSS projects, so the engine will be removed:: - name: marginalia engine: json_engine shortcut: mar categories: general paging: false # Key and license: https://www.marginalia.nu/marginalia-search/api/ # index: 0 popular, 1 blogs, 2 big_sites, 3 default, 4 experimental search_url: https://api.marginalia.nu/<insert your key here>/search/{query}?index=4&count=20 results_query: results url_query: url title_query: title content_query: description timeout: 1.5 disabled: true about: website: https://www.marginalia.nu/ official_api_documentation: https://api.marginalia.nu/ use_official_api: true require_api_key: true results: JSON [1] https://github.com/searxng/searxng/issues/1673 [2] https://github.com/searxng/searxng/pull/1627 [3] https://github.com/searxng/searxng/issues/1620 [4] https://news.ycombinator.com/item?id=35874640 [5] https://github.com/MarginaliaSearch/MarginaliaSearch/blob/d82a8584915c9d416921cc9f1c0637efedea664f/code/services-satellite/api-service/src/main/java/nu/marginalia/api/svc/ResponseCache.java#L12-L20 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>