| Age | Commit message (Collapse) | Author |
|
|
|
|
|
|
|
|
|
The language_support variable is set to True by default,
and set to False in only 5 engines.
Except the documentation and the /config URL, this variable is not used.
This commit remove the variable definition in the engines, and
set value according to supported_languages length: False when the length is 0,
True otherwise.
Close #2485
|
|
Avoid SearxEngineXPathException errors when parsing non valid results::
.//div[@class="yuRUbf"]//a/@href index 0 not found
Traceback (most recent call last):
File "./searx/engines/google.py", line 274, in response
url = eval_xpath_getindex(result, href_xpath, 0)
File "./searx/searx/utils.py", line 608, in eval_xpath_getindex
raise SearxEngineXPathException(xpath_spec, 'index ' + str(index) + ' not found')
searx.exceptions.SearxEngineXPathException: .//div[@class="yuRUbf"]//a/@href index 0 not found
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
|
|
BTW: make the engines ready for search.checker:
- replace eval_xpath by eval_xpath_getindex and eval_xpath_list
- google_images: remove outer try/except block
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
|
|
The 'video.html' template from the 'oscar' design supports replacement
for *author* and *length*. Google-videos does not have an author, alternatively
the publisher info from is used for the *author*.
Hint: these replacements are not supported by the 'simple' design.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
|
|
This revise is based on the methods developed in the revise of the google engine
(see commit 410c2f9).
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
|
|
also add
params['soft_max_redirects'] = 1
to avoid false error reporting in /stats/errors
|
|
Wthout country-region tag google will redirect to correct the contry tag [1]:
SEARX_DEBUG=1 searx-checker -v "google news"
...
https://news.google.com:443 "GET /search?q=computer&hl=en... HTTP/1.1" 302 0
https://news.google.com:443 "GET /search?q=computer&hl=en-US&.... HTTP/1.1" 200 None
...
[1] https://github.com/searx/searx/pull/2483#issuecomment-765600849
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
|
|
This revise is based on the methods developed in the revise of the google engine
(see commit 410c2f9).
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
|
|
[Fix] Invidious Engine
|
|
move meta information from comment to the about variable
so the preferences, the documentation can show these information
|
|
working instances
|
|
|
|
|
|
and online_dictionnary
|
|
see searx.search.processors.abstract.EngineProcessor
First the method searx call the get_params method.
If the return value is not None, then the searx call the method search.
|
|
Fix the issue 2395 where StartPage result title is showing the url. https://github.com/searx/searx/issues/2395
|
|
[Fix] Startpage
|
|
[remove] remove searchcode_doc and twitter
|
|
|
|
[fix] command engine: SearchQuery.query is str not bytes
|
|
check HTTP response:
* detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time.
* otherwise raise HTTPError as before
the check is done in poolrequests.py (was before in search.py).
update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
|
|
Fix mojeek
|
|
[mod) genious: return valid results even if contents are empty
|
|
before commit 58d72f2, category was not set in xpath.py,
so searx/engines/__init__py was setting the category to ['general']
the commit 58d72f2 set the category to [] which is not replaced by searx/engines/__init__.py
consequence: the mojeek engine is hidden in the preferences.
this commit revert the xpath.py change.
close #2368
|
|
Closes #302
|
|
* twitter: the API has changed. the engine needs to rewritten.
* searchcode_doc: the API about documentation doesn't exist anymore.
|
|
|
|
[mod] duden engine
|
|
[remove] seedpeer engine
|
|
the website is offline.
|
|
[fix] youtube_noapi engine
|
|
[fix] soundclound: accept result without content
|
|
[fix] 1x engine
|
|
[fix] wikipedia: minor fix: return no result instead of crash in some very few cases.
|
|
|
|
|
|
few cases.
In few cases, the JSON results doesn't contains the key 'type'.
|
|
|
|
see c225db45c8a4ab466bff049216f7e0189dc1b067
|
|
* add params['soft_max_redirects'] = 1 (when there is spelling suggestion)
* avoid try..except
* use eval_xpath_* functions
|
|
[fix] duckduckgo_definitions: fix relative image URL
|
|
Remove HTTP connections as much as possible
|
|
ddg returns relative URL to https://duckduckgo.com/
|
|
[fix] wikipedia engine: don't raise an error when the query is not found
|
|
Add a new parameter "raise_for_status", set by default to True.
When True, any HTTP status code >= 300 raise an exception ( #2332 )
When False, the engine can manage the HTTP status code by itself.
|
|
least one URL.
|