summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2021-02-09[fix) fix apk_mirror engineAlexandre Flament
2021-02-08add support for Chinese variants in WikipediaMarc Abonce Seguin
2021-02-07[feat] recoll: paged json supportHermógenes Oliveira
2021-02-04Add Creative Commons search enginemrwormo
2021-02-01[mod] dynamically set language_support variableAlexandre Flament
The language_support variable is set to True by default, and set to False in only 5 engines. Except the documentation and the /config URL, this variable is not used. This commit remove the variable definition in the engines, and set value according to supported_languages length: False when the length is 0, True otherwise. Close #2485
2021-01-28[fix] google: avoid unnecessary SearxEngineXPathException errorsMarkus Heiser
Avoid SearxEngineXPathException errors when parsing non valid results:: .//div[@class="yuRUbf"]//a/@href index 0 not found Traceback (most recent call last): File "./searx/engines/google.py", line 274, in response url = eval_xpath_getindex(result, href_xpath, 0) File "./searx/searx/utils.py", line 608, in eval_xpath_getindex raise SearxEngineXPathException(xpath_spec, 'index ' + str(index) + ' not found') searx.exceptions.SearxEngineXPathException: .//div[@class="yuRUbf"]//a/@href index 0 not found Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-01-28[fix] normalize the language & region aspects of all google enginesMarkus Heiser
BTW: make the engines ready for search.checker: - replace eval_xpath by eval_xpath_getindex and eval_xpath_list - google_images: remove outer try/except block Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-01-24[fix] google-videos: parse values for 'length' & 'author'Markus Heiser
The 'video.html' template from the 'oscar' design supports replacement for *author* and *length*. Google-videos does not have an author, alternatively the publisher info from is used for the *author*. Hint: these replacements are not supported by the 'simple' design. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-01-24[fix] revise of the google-Video engineMarkus Heiser
This revise is based on the methods developed in the revise of the google engine (see commit 410c2f9). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-01-24[fix] google_news: avoid one HTTP redirect except for the English resultsAlexandre Flament
also add params['soft_max_redirects'] = 1 to avoid false error reporting in /stats/errors
2021-01-23[fix] google-news: query uses locale without country tagMarkus Heiser
Wthout country-region tag google will redirect to correct the contry tag [1]: SEARX_DEBUG=1 searx-checker -v "google news" ... https://news.google.com:443 "GET /search?q=computer&hl=en... HTTP/1.1" 302 0 https://news.google.com:443 "GET /search?q=computer&hl=en-US&.... HTTP/1.1" 200 None ... [1] https://github.com/searx/searx/pull/2483#issuecomment-765600849 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-01-22[fix] revise of the google-news engineMarkus Heiser
This revise is based on the methods developed in the revise of the google engine (see commit 410c2f9). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-01-16Merge pull request #2451 from mrwormo/invidious-engineAlexandre Flament
[Fix] Invidious Engine
2021-01-14[enh] engines: add about variableAlexandre Flament
move meta information from comment to the about variable so the preferences, the documentation can show these information
2021-01-14[fix] Invidious engine by enabling requests by randomly picking amongst ↵mrwormo
working instances
2020-12-20[fix] pylint: use "raise ... from ..."Alexandre Flament
2020-12-20[fix] Python 3.9: use html.unescape instead of HTMLParser.unescapeAlexandre Flament
2020-12-17[mod] dictzone, translated, currency_convert: use engine_type online_curency ↵Alexandre Flament
and online_dictionnary
2020-12-17[mod] split searx.search into different processorsAlexandre Flament
see searx.search.processors.abstract.EngineProcessor First the method searx call the get_params method. If the return value is not None, then the searx call the method search.
2020-12-16Fix the StartPage result title is showing the urllucky13820
Fix the issue 2395 where StartPage result title is showing the url. https://github.com/searx/searx/issues/2395
2020-12-14Merge pull request #2385 from joshu9h/patch-1Alexandre Flament
[Fix] Startpage
2020-12-13Merge pull request #2372 from dalf/remove-broken-enginesAlexandre Flament
[remove] remove searchcode_doc and twitter
2020-12-13[Fix] Startpagejoshu9h
2020-12-11Merge pull request #2358 from dalf/fix-commandAlexandre Flament
[fix] command engine: SearchQuery.query is str not bytes
2020-12-11[enh] add raise_for_httperrorAlexandre Flament
check HTTP response: * detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time. * otherwise raise HTTPError as before the check is done in poolrequests.py (was before in search.py). update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
2020-12-11Merge pull request #2376 from dalf/fix-mojeekAlexandre Flament
Fix mojeek
2020-12-11Merge pull request #2371 from dalf/mod-geniusAlexandre Flament
[mod) genious: return valid results even if contents are empty
2020-12-10[fix] xpath, mojeek: fix commit 58d72f26925d56e22330c54be03c3dcbee0c4135Alexandre Flament
before commit 58d72f2, category was not set in xpath.py, so searx/engines/__init__py was setting the category to ['general'] the commit 58d72f2 set the category to [] which is not replaced by searx/engines/__init__.py consequence: the mojeek engine is hidden in the preferences. this commit revert the xpath.py change. close #2368
2020-12-09display if an engine does not support httpsNoémi Ványi
Closes #302
2020-12-09[remove] remove searchcode_doc and twitterAlexandre Flament
* twitter: the API has changed. the engine needs to rewritten. * searchcode_doc: the API about documentation doesn't exist anymore.
2020-12-09[mod) genious: return valid results even if contents are emptyAlexandre Flament
2020-12-08Merge pull request #2359 from dalf/update-dudenAlexandre Flament
[mod] duden engine
2020-12-08Merge pull request #2366 from dalf/remove-seedpeerAlexandre Flament
[remove] seedpeer engine
2020-12-07[remove] seedpeer engineAlexandre Flament
the website is offline.
2020-12-07Merge pull request #2364 from dalf/fix-youtube-noapiAlexandre Flament
[fix] youtube_noapi engine
2020-12-07Merge pull request #2365 from dalf/fix-soundcloudAlexandre Flament
[fix] soundclound: accept result without content
2020-12-07Merge pull request #2361 from dalf/fix-1xAlexandre Flament
[fix] 1x engine
2020-12-07Merge pull request #2363 from dalf/fix-wikipedia-minorAlexandre Flament
[fix] wikipedia: minor fix: return no result instead of crash in some very few cases.
2020-12-07[fix] soundclound: accept result without contentAlexandre Flament
2020-12-07[fix] youtube_noapi engineAlexandre Flament
2020-12-07[fix] wikipedia: minor fix: return no result instead of crash in some very ↵Alexandre Flament
few cases. In few cases, the JSON results doesn't contains the key 'type'.
2020-12-07[fix] 1x engineAlexandre Flament
2020-12-07[fix] command engine: SearchQuery.query is str not bytesAlexandre Flament
see c225db45c8a4ab466bff049216f7e0189dc1b067
2020-12-07[mod] duden engineAlexandre Flament
* add params['soft_max_redirects'] = 1 (when there is spelling suggestion) * avoid try..except * use eval_xpath_* functions
2020-12-07Merge pull request #2356 from dalf/fix-dddAlexandre Flament
[fix] duckduckgo_definitions: fix relative image URL
2020-12-06Merge pull request #2352 from dalf/no_httpAlexandre Flament
Remove HTTP connections as much as possible
2020-12-06[fix] duckduckgo_definitions: fix relative image URLAlexandre Flament
ddg returns relative URL to https://duckduckgo.com/
2020-12-04Merge pull request #2354 from dalf/fix-wikipediaAlexandre Flament
[fix] wikipedia engine: don't raise an error when the query is not found
2020-12-04[fix] wikipedia engine: don't raise an error when the query is not foundAlexandre Flament
Add a new parameter "raise_for_status", set by default to True. When True, any HTTP status code >= 300 raise an exception ( #2332 ) When False, the engine can manage the HTTP status code by itself.
2020-12-04[fix] wikidata: fix crash when the item has no description at all and at ↵Alexandre Flament
least one URL.