summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2023-08-15[mod] improve seekr engines and add documentationMarkus Heiser
Tis patch adds some more fields to the result items and changed paging to the ``nextResultSet`` given in seekr's JSON response. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-15[feat] engine: implementation of seekr for news, images and videosBnyro
2023-08-10[feat] engine: implementation of German news, TagesschauBnyro
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10[mod] engine lemmy: increase thumbnail quality to align with themeBnyro
2023-08-10[mod] settings: remove lemmy from categ 'general' & enable by defaultMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10[mod] engine lemmy: add more info fields to the result itemsMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10[feat] engine: support for lemmy communities, posts, comments and usersBnyro
2023-08-10[mod] engine google_play: raise error on unsupported categoryBnyro
2023-08-10[mod] engine brave: raise error on unsupported categoryBnyro
2023-08-09[mod] remove discontinued petalsearch enginesallendema_searxng_pi
2023-08-08[mod] brave engines: add fetch_traits() / improve language supportMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-08[mod] implement brave (WEB) engine to replace XPath configurationMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-08[feat] engine: brave - support for newsBnyro
2023-08-08[feat] engine: brave - support for videosBnyro
2023-08-08[feat] engine: brave - support for imagesBnyro
2023-08-06[doc] engine bt4g: add documentation to docs/dev/engines/online/Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-06[feat] new engine: bt4g added & enabled and disable by default btdiggEmilien Devos
Disable btdigg because on most SearXNG instances, SearXNG is blocked by btdigg due to cloudflare too many requests. This impementation did not parse the HTML page because there is an API in XML (RSS). The RSS feed provides fewer data like amount of seeders/leechers and the files in the torrent file. It's a tradeoff for a "stable" engine as the XML from RSS content will change way less than the HTML page. Closes: https://github.com/searxng/searxng/issues/2553
2023-08-04[mod] engine: wikimedia - improve results, add addition settings & docMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-04[feat] new engine: wikispeciesBnyro
2023-08-03[doc] engine: YacyMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03add option to change yacy search modezutto
2023-08-03[fix] engine piped: 'invalid content'Markus Heiser
SearXNG does not allow a None value in the content field of a result item. If the key (shortDescription, uploaderName) in the JSON response from piped exists but is set to None, SearXNG ignores this result item:: DEBUG searx : result: invalid content: { .., 'content': None, ..} Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03[mod] engine piped: add paging supportMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03[mod] engine piped: split into two dedicated engiens for video & musicMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03[doc] engine piped: add documentation to docs/dev/engines/online/Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03[feat] engine: implementation of PipedBnyro
2023-07-07[feat] engine: re-enables z-library (zlibrary-global.se)Paolo Basso
- re-enables z-library as the new domain zlibrary-global.se is now available from the open web. The announcement of the domain: https://www.reddit.com/r/zlibrary/comments/13whe08/mod_note_zlibraryglobalse_domain_is_officially/ It is an official domain, it requires to log in to the "personal" subdomain only to download files, but the search works. - changes the result template of zlibrary to paper.html, filling the appropriate fields - implements language filtering for zlibrary - implement zlibrary custom filters (engine traits) - refactor and document the zlibrary engine
2023-07-01[doc] rearranges Settings & Engines docs for better readabilityMarkus Heiser
We have built up detailed documentation of the *settings* and the *engines* over the past few years. However, this documentation was still spread over various chapters and was difficult to navigate in its entirety. This patch rearranges the Settings & Engines documentation for better readability. To review new ordered docs:: make docs.clean docs.live Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-29[fix] engine: Anna's Archive - grep results from '.js-scroll-hidden' elementsMarkus Heiser
The renderuing of the WEB page is very strange; except the firts position all other positions of Anna's result page are enclosed in SGML comments. These cooments are *uncommented* by some JS code, see query of the class '.js-scroll-hidden' in Anna's HTML template [1]. [1] https://annas-software.org/AnnaArchivist/annas-archive/-/blob/main/allthethings/templates/macros/md5_list.html Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-29[mod] engine: Anna's Archive - additionl settings (content, sort, ext)Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-29[mod] engine: Anna's Archive - fetch search arguments from search formMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-29[mod] engine: Anna's Archive - add language supportPaolo Basso
2023-06-29[feat] engine: implementation of Anna's ArchivePaolo Basso
Anna's Archive [1] is a free non-profit online shadow library metasearch engine providing access to a variety of book resources (also via IPFS), created by a team of anonymous archivists [2]. [1] https://annas-archive.org/ [2] https://annas-software.org/AnnaArchivist/annas-archive
2023-06-28[mod] engine torznab - refactor & option to hide linksPaolo Basso
- torznab engine using types and clearer code - torznab option to hide torrent and magnet links. - document the torznab engine - add myself to authors Closes: https://github.com/searxng/searxng/issues/1124 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-26[fix] Google API changedMarkus Heiser
It seems that Google is rolling out a modified WEB API [1][2]. In the past there was only the UI language in the `hl` argument but nowadays it seems a combination of the UI language and the "search region" is mixed in this argument and the `gl` argument has been removed. I'm very surprised that google is starting to mix the parameters of the UI with the parameters of the search index. This patch modifies the get_google_info(..) function. Beside Google-WEB this function is also used by other Google services, here are some examples to test region & language of .. - Google-WEB: `!go dragon boat :en-CA` - Google-News: `!gon dragon boat :en-CA` - Google-Videos: `!gov bmw :en-CA` - Goolge-Images `!goi bmw :en-CA` - [1] https://github.com/searxng/searxng/issues/2515#issuecomment-1606294635 - [2] https://github.com/searxng/searxng/issues/2515#issuecomment-1607150817 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-25[fix] engine & network issues / documentation and type annotationsMarkus Heiser
This patch fixes some quirks and issues related to the engines and the network. Each engine has its own network and this network was broken for the following engines[1]: - archlinux - bing - dailymotion - duckduckgo - google - peertube - startpage - wikipedia Since the files have been touched anyway, the type annotaions of the engine modules has also been completed so that error messages from the type checker are no longer reported. Related and (partial) fixed issue: - [1] https://github.com/searxng/searxng/issues/762#issuecomment-1605323861 - [2] https://github.com/searxng/searxng/issues/2513 - [3] https://github.com/searxng/searxng/issues/2515 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-05-19use logger.warningpankaj
logger.warn() is depricated. logger.warning is already being used in some files.
2023-05-12[fix] engine ddg: minor change in the API of ddgMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/2419 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-17[fix] doc of locales.get_engine_locale() / zh-classical is missleadingMarkus Heiser
Wikipedia's zh-classical is not zh_Hant (see doc-string of engines.wikipedia). Fixed the example in the doc-string of locales.get_engine_locale() to 'zh_TW'. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-16[fix] engine: google play moviesMarkus Heiser
Closes: https://github.com/searxng/searxng/pull/1746 Closes: https://github.com/searxng/searxng/issues/1599 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-15[fix] searxng_extra/update/update_engine_descriptions.py (part 1)Markus Heiser
Follow up of #2269 The script to update the descriptions of the engines does no longer work since PR #2269 has been merged. searx/engines/wikipedia.py ========================== 1. There was a misusage of zh-classical.wikipedia.org: - `zh-classical` is dedicate to classical Chinese [1] which is not traditional Chinese [2]. - zh.wikipedia.org has LanguageConverter enabled [3] and is going to dynamically show simplified or traditional Chinese according to the HTTP Accept-Language header. 2. The update_engine_descriptions.py needs a list of all wikipedias. The implementation from #2269 included only a reduced list: - https://meta.wikimedia.org/wiki/Wikipedia_article_depth - https://meta.wikimedia.org/wiki/List_of_Wikipedias searxng_extra/update/update_engine_descriptions.py ================================================== Before PR #2269 there was a match_language() function that did an approximation using various methods. With PR #2269 there are only the types in the data model of the languages, which can be recognized by babel. The approximation methods, which are needed (only here) in the determination of the descriptions, must be replaced by other methods. [1] https://en.wikipedia.org/wiki/Classical_Chinese [2] https://en.wikipedia.org/wiki/Traditional_Chinese_characters [3] https://www.mediawiki.org/wiki/Writing_systems#LanguageConverter Closes: https://github.com/searxng/searxng/issues/2330 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-08[fix] Bing-WEB: use <span class='algoSlug_icon'> for the descriptionMarkus Heiser
On some result items from Bing-WEB the `<span class='algoSlug_icon'>` tag is the only tag that contains a description. The issue can be reproduced by [1]:: !bi vmware [1] https://github.com/searxng/searxng/issues/1764#issuecomment-1417990531 Reported-by: @AlyoshaVasilieva Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-07[mod] clarify the difference of the default category and subgroupingMarkus Heiser
This PR does no functional change it is just an attempt to make more clear in the code, what a default category is and what a subcategory is. The previous name 'others' leads to confusion with the **category 'other'**. If a engine is not assigned to a category, the default is assigned:: DEFAULT_CATEGORY = 'other' If an engine has only one category and this category is shown as tab in the user interface, this engine has no further subgrouping:: NO_SUBGROUPING = 'without further subgrouping' Related: - https://github.com/searxng/searxng/issues/1604 - https://github.com/searxng/searxng/pull/1545 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-06[fix] Gigablast.com has been erasedMarkus Heiser
[1] https://www.reddit.com/r/searchengines/comments/128wdcp/gigablastcom_has_been_erased/ Closes: https://github.com/searxng/searxng/issues/2321 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-03[fix] engine ddg: quote !bangs in a request send to ddgMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/392 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-02[fix] engine google-News: fix decoding of URLs (part 2)Markus Heiser
Follow up of 8de8070ed to fix the issue reported by AlyoshaVasilieva [1]. [1] https://github.com/searxng/searxng/issues/1959#issuecomment-1493300574 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-01[fix] engine google-News: fix decoding of URLsMarkus Heiser
Google-News returns internal links where the origin URL is encoded in a base64 (RFC 2045 aka URL-safe) string. Closes: https://github.com/searxng/searxng/issues/1959 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-31[fix] engine seznam: fix issues reported by black & pylintMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-31[fix] engine seznamVenca24
2023-03-30[fix] engine flickr: adapt to the new data model from flicker's responseMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/1879 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-24 06:43:09 +0000