summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2022-01-01[fix] bing engines: fetch_supported_languagesMarkus Heiser
The Request to and the Response from https://www.bing.com/account/general has been changed. [1] https://github.com/searxng/searxng/pull/672#discussion_r777104919 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-28[pylint] Bing (Videos) engineMarkus Heiser
Fix remarks from pylint and remove obsolete try/except block Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27[fix] issues reported by pylintMarkus Heiser
Fix pylint issues from commit (3d96a983) [format.python] initial formatting of the python code Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27[format.python] initial formatting of the python codeMarkus Heiser
This patch was generated by black [1]:: make format.python [1] https://github.com/psf/black Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27[format.python] disable py code formatting for some hunks of codeMarkus Heiser
Disable the python code formatting from python-black, where the readability of code suffers by formatting. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-21[doc] introduce about.language and sort engines by itMartin Fischer
2021-12-20Merge pull request #611 from return42/fix-bingMarkus Heiser
[fix] bing engine: fix paging support, show inital page.
2021-12-18[pylint] Reddit engineMarkus Heiser
Add Reddit engine to pylint process Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-18[fix] bing engine: fix paging support, show inital page.Markus Heiser
Follow up queries for the pages needed to be fixed. - Split search-term in one for initial query and one for following queries. - Set some headers in HTTP requests, bing needs for paging support. - IMO //div[@class="sa_cc"] does no longer match in a bing response. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-18[pylint] Bing (Web) engineMarkus Heiser
Fix remarks from pylint and improved code-style. In preparation for a bug-fix of the Bing (Web) engine I add this engine to the pylint-list. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-17[fix] engine bing-news: replace the http:// by https://Markus Heiser
BTW: add bing_news to the pylint process Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-12Merge pull request #587 from dalf/fix-gigablastMarkus Heiser
[fix] gigablast engine
2021-12-07Merge pull request #586 from dalf/remove-yggtorrentMarkus Heiser
[del] remove yggtorrent
2021-12-06[fix] gigablast engineAlexandre Flament
fetch extra params after 3000 seconds
2021-12-06[del] remove yggtorrentAlexandre Flament
yggtorrent is behind cloudflare now close #580
2021-12-06[fix] imdb: don't crash when there is no resultAlexandre Flament
2021-11-26[fix] google-videos engine: ignore news articlesMarkus Heiser
In the video search, google also sometimes includes news. E.g. in the DE language when you search for `!gov paris`, google adds an article from a german newspaper (FAZ), I assume these are sponsored link (not tagged advertisement?) Those links do not have an image / this patch ignores *video links* wqithout an image ID. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-26[fix] google video engine - rework of the HTML parserMarkus Heiser
The google video response has been changed slightly, a rework of the parser was needed. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-25[fix] google engine - suggestionMarkus Heiser
BTW: google no longer offers *spelling suggestions* Closes: https://github.com/searxng/searxng/issues/442 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-21[fix] google images: @href index 0 not foundMarkus Heiser
Sometimes there is no href in the `<a ..>` tag of a *link_node* [1]. [1] https://github.com/searxng/searxng/issues/532 Reported-by: @TheEssem Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-19[drop] engine digg - https://digg.com/api is no longer availableMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-17[fix] Qwant search query stringTom
Search string: "!qwant time" Resulting request URL: https://api.qwant.com/v3/search/web?q=q=time&count=10&offset=0&device=desktop&safesearch=1&locale=en_US Notice the double "q=" Resulting request URL after fix: https://api.qwant.com/v3/search/web?q=time&count=10&offset=0&device=desktop&safesearch=1&locale=en_US
2021-11-01[fix] make reddit only in social media category avail.MrPaulBlack
fix https://github.com/searxng/searxng/issues/470
2021-10-26[mod] microsoft academic: increase timeout to 6 secondsAlexandre Flament
also avoid a crash when there is no result close #433
2021-10-21[fix] yahoo engine - don't lump all search suggestions togetherMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/421 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-16[fix] engine - yahoo: rewrite and fix issuesMarkus Heiser
Languages are supported by mapping the language to a domain. If domain is not found in :py:obj:`lang2domain` URL ``<lang>.search.yahoo.com`` is used. BTW: fix issue reported at https://github.com/searx/searx/issues/3020 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-16[pylint] engines: yahoo fix several issues reported from pylintMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-14[fix] language param for qwantMrPaulBlack
2021-10-12[fix] qwant engine - only get results from categoriesNoémi Ványi
Reported-by: https://github.com/searx/searx/issues/3014 Cherry-picked: https://github.com/searx/searx/commit/3bcca43
2021-10-11[mod] engines - add zlibrary enginePaolo Basso
2021-10-07[fix] engine torznab - categories, before join convert int to strMarkus Heiser
BTW add init() function and replace SearxEngineAPIException by ValueError. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-07[fix] engine torznab - marginal issues reported from lintersMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-07[mod] engines - add torznab WebAPIPaolo Basso
2021-10-07[mod] set 'engine.supported_languages' from the origin python moduleMarkus Heiser
The key of the dictionary 'searx.data.ENGINES_LANGUAGES' is the *engine name* configured in settings.xml. When multiple engines are configured to use the same origin engine (e.g. `engine: google`):: - name: google engine: google use_mobile_ui: false ... - name: google italian engine: google use_mobile_ui: false language: it ... - name: google mobile ui engine: google shortcut: gomui use_mobile_ui: true There exists no entry for ENGINES_LANGUAGES[engine.name] (e.g. `name: google mobile ui` or `name: google italian`). This issue can be solved by recreate the ENGINES_LANGUAGES:: make data.languages But this is nothing an SearXNG admin would like to do when just configuring additional engines, since this just doubles entries in ENGINES_LANGUAGES and BTW: `make data.languages` has various external requirements which might be not installed or not available, on a production host. With this patch, if engine.name fails, ENGINES_LANGUAGES[engine.engine] is used to get the engine.supported_languages (e.g. `google` for the engine named `google mobile`). For an engine, when there is `language: ...` in the YAML settings, the engine supports only one language, in this case engine.supported_languages should contains this value defined in settings.yml (e.g. `it` for the engine named `google italian`). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de> Closes: https://github.com/searxng/searxng/issues/384
2021-10-05[mod] engines - IMDB: add thumbnailsAlexandre Flament
2021-10-03[mod] engines - add IMDB / Internet Movie DatabasePaul Alcock
Merged from @Guilvareux's commit [1] and slightly modfied / see [2]. [1] https://github.com/searx/searx/pull/2980/commits/f2f90071 [2] https://github.com/searx/searx/pull/2980
2021-10-01[mod] engine duckduckgo - update supported_languages_urlMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-01[mod] engine duckduckgo - use DuckDuckGo-LiteMarkus Heiser
Implement a scrapper for DuckDuckGo-Lite [1]. The existing DuckDuckGo [2] engine does not support paging. DuckDuckgo-Lite is much faster, less verbose and does have a paging option (reversed engineered from the input form of [1]). [1] https://lite.duckduckgo.com/lite [2] https://duckduckgo.com/ Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-29[fix] engine stackexchange - decode HTML entities in title & contentMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-28[mod] replace old stackoverflow engine by Stack Exchange API v2.3Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-28[mod] engines - add Stack Exchange API v2.3Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-25Merge pull request #333 from dalf/enh-engine-descriptionsAlexandre Flament
RFC: /preferences: display engine descriptions
2021-09-25[fix] openstreetmap engine: optmizer SPARQL queryAlexandre Flament
add hint:Query hint:optimizer "None". to the SPARQL query to keep the response time small. It tells the optimizer to follow the path from ?item to the different property values instead of the other way around. See https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/query_optimization#Property_paths
2021-09-24[fix] fix the about section of some enginesAlexandre Flament
2021-09-24[fix] openstreetmap engine: map "all" language to EnglishAlexandre Flament
2021-09-17[pylint] fix global-variable-not-assigned issuesMarkus Heiser
If there is no write access, there is no need for global. Remove global statement if there is no assignment. global-variable-not-assigned: Using global for names but no assignment is done Used when a variable is defined through the "global" statement but no assignment to this variable is done. In Pylint 2.11 the global-variable-not-assigned checker now catches global variables that are never reassigned in a local scope and catches (reassigned) functions [1][2] [1] https://pylint.pycqa.org/en/latest/whatsnew/2.11.html [2] https://github.com/PyCQA/pylint/issues/1375 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-14Merge pull request #297 from dalf/engine-logger-enhAlexandre Flament
debug mode: more readable logging
2021-09-13[fix] logger per engine: make .logger is always initializedAlexandre Flament
the openstreetmap engine imports code from the wikidata engine. before this commit, specific code make sure to copy the logger variable to the wikidata engine. with this commit searx.engines.load_engine makes sure the .logger is initialized. The implementation scans sys.modules for module name starting with searx.engines.
2021-09-11[mod] xpath engine: remove logging of the requested URLAlexandre Flament
2021-09-07[pylint] engines: drop no longer needed 'missing-function-docstring'Markus Heiser
Suggested-by: @dalf https://github.com/searxng/searxng/issues/102#issuecomment-914168470 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-20 02:55:15 +0000