summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2021-03-14fix HTTP error in onion enginesMarc Abonce Seguin
regression from https://github.com/searx/searx/pull/2641 most onion websites only serve HTTP, so it must be enabled
2021-03-14Windows does not support SIGUSR1, so don't use it unconditionally.Rolf
2021-03-14[fix] remove unused import from yahoo-news engineMarkus Heiser
Signed-off-by: Markus Heiser <markus@darmarit.de>
2021-03-14[drop] Acgsou engine - www.acgsou.com no longer existsMarkus Heiser
- https://www.acgsou.com/ acgsou.com is redirected to 36dm.club - @rinpatch do not plan on maintaining the engine [1] [1] https://github.com/searx/searx/pull/1283#issuecomment-798783585 Signed-off-by: Markus Heiser <markus@darmarit.de>
2021-03-13Add Solr engineNoémi Ványi
2021-03-13Merge pull request #2346 from dalf/upgrade-oscarAlexandre Flament
[mod] oscar: upgrade dependencies
2021-03-12Merge pull request #2626 from mikeri/solidtorrentsAlexandre Flament
Add Solid Torrents engine
2021-03-12Merge pull request #2641 from dalf/disable_http_by_defaultAlexandre Flament
[mod] by default allow only HTTPS, not HTTP
2021-03-11[mod] oscar: update README.rstAlexandre Flament
2021-03-11[mod] oscar: get bootstrap and typeahead from NPMAlexandre Flament
2021-03-11[mod] oscar: get leaflet and jquery from NPMAlexandre Flament
easy to upgrade (package.json)
2021-03-10[mod] oscar: move compiled files to the src directoryAlexandre Flament
2021-03-10[mod] oscar: remove polyfills for Internet ExplorerAlexandre Flament
2021-03-10[mod] oscar: remove unused imagesAlexandre Flament
2021-03-10[mod] theme: remove require-2.1.15.min.jsAlexandre Flament
See https://github.com/requirejs/requirejs/issues/1816 requirejs loads one file: leaflet. This commit: * removes requirejs * load leaflet using <script src...> HTML tag in searx/templates/oscar/base.html
2021-03-10[mod] oscar: upgrade npm dependenciesAlexandre Flament
2021-03-09[fix] APKMirror engine - update xpath selectors and fix img_srcMarkus Heiser
BTW: make the code slightly more readable Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-03-08[fix] rewrite Yahoo-News engineMarkus Heiser
Many things have been changed since last review of this engine. This patch fix xpath selectors, implements suggestion and is a complete review / rewrite of the engine. Signed-off-by: Markus Heiser <markus@darmarit.de>
2021-03-08[mod] by default allow only HTTPS, not HTTPAlexandre Flament
Related to https://github.com/searx/searx/pull/2373
2021-03-07Add Solid Torrents engineMichael Ilsaas
2021-03-06[enh] add ability to send engine data to subsequent requestsAdam Tauber
2021-03-06Merge pull request #2631 from searx/update_data_update_languages.pyAlexandre Flament
Update searx.data - update_languages.py
2021-03-05[mod] don't dump traceback of SearxEngineResponseException on initMarkus Heiser
When initing engines a "SearxEngineResponseException" is logged very verbose, including full traceback information: ERROR:searx.engines:yggtorrent engine: Fail to initialize Traceback (most recent call last): File "share/searx/searx/engines/__init__.py", line 293, in engine_init init_fn(get_engine_from_settings(engine_name)) File "share/searx/searx/engines/yggtorrent.py", line 42, in init resp = http_get(url, allow_redirects=False) File "share/searx/searx/poolrequests.py", line 197, in get return request('get', url, **kwargs) File "share/searx/searx/poolrequests.py", line 190, in request raise_for_httperror(response) File "share/searx/searx/raise_for_httperror.py", line 60, in raise_for_httperror raise_for_captcha(resp) File "share/searx/searx/raise_for_httperror.py", line 43, in raise_for_captcha raise_for_cloudflare_captcha(resp) File "share/searx/searx/raise_for_httperror.py", line 30, in raise_for_cloudflare_captcha raise SearxEngineCaptchaException(message='Cloudflare CAPTCHA', suspended_time=3600 * 24 * 15) searx.exceptions.SearxEngineCaptchaException: Cloudflare CAPTCHA, suspended_time=1296000 For SearxEngineResponseException this is not needed. Those types of exceptions can be a normal use case. E.g. for CAPTCHA errors like shown in the example above. It should be enough to log a warning for such issues: WARNING:searx.engines:yggtorrent engine: Fail to initialize // Cloudflare CAPTCHA, suspended_time=1296000 closes: #2612 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-03-05Merge pull request #2632 from searx/update_data_update_wikidata_units.pyAlexandre Flament
Update searx.data - update_wikidata_units.py
2021-03-05Merge pull request #2630 from searx/update_data_update_ahmia_blacklist.pyAlexandre Flament
Update searx.data - update_ahmia_blacklist.py
2021-03-05Update searx.data - update_currencies.pydalf
2021-03-05Update searx.data - update_wikidata_units.pydalf
2021-03-05Update searx.data - update_languages.pydalf
2021-03-05Update searx.data - update_ahmia_blacklist.pydalf
2021-03-04Merge pull request #2593 from dalf/update-autocompleteAlexandre Flament
Update autocomplete
2021-03-01[enh] autocomplete refactoring, autocomplete on external bangsAlexandre Flament
2021-03-01[enh] google scholar - python implementation of the engineMarkus Heiser
The old xpath configuration for google scholar did not work and is replaced by a python implementation. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-03-01[fix] answers: don't crash when the query is an empty stringAlexandre Flament
2021-03-01Merge pull request #2608 from return42/unittest2Alexandre Flament
[py2to3] use unittest from py3, remove unittest2 from py2
2021-03-01Merge pull request #2604 from searx/update_data_firefox_versionAlexandre Flament
Update searx.data - firefox_version
2021-03-01Merge pull request #2602 from MarcAbonce/fix-bing-fetch-languagesAlexandre Flament
Fix fetch_languages for Bing
2021-03-01Add Freesound engine (#2596)GazoilKerozen
Add freesound engine with player. Co-authored-by: Gazoil <maildeguzel@gmail.com>
2021-02-28[py2to3] use unittest from py3, remove unittest2 from py2Markus Heiser
- unittest2 is a backport of the new features added to the unittest testing framework in Python 2.7 - unittest2 was only needed in py2 and can be dropped now Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-02-26Merge pull request #2605 from searx/update_data_currenciesAlexandre Flament
Update searx.data - currencies
2021-02-26Merge pull request #2606 from searx/update_data_wikidata_unitsAlexandre Flament
Update searx.data - wikidata_units
2021-02-26Update searx.data - ahmia_blacklistdalf
2021-02-26Update searx.data - wikidata_unitsdalf
2021-02-26Update searx.data - firefox_versiondalf
2021-02-26Update searx.data - currenciesdalf
2021-02-25remove articles number from engines_languages.jsonMarc Abonce Seguin
2021-02-25fix fetch_languages for bingMarc Abonce Seguin
Bing has a list of regions that it supports and some of these regions may have more than one possible language. In some cases, like Switzerland, these languages are always shown as options, so there is no issue. But in other cases, like Andorra, Bing will only show one language at the time, either the region's default or the request's language if the latter is supported by that region. For example, if the HTTP request is in French, Andorra will appear as fr-AD but if the same page is requested in any other language Andorra will appear as ca-AD. This is specially a problem when Bing assumes that the request is in English because it overrides enough language codes to make several major languages like Arabic dissappear from the languages.py file. To avoid that issue, I set the Accept-Language header to a language that's only supported in one region to hopefully avoid these overrides.
2021-02-24[mod] add utils/fetch_external_bangs.pyAlexandre Flament
Based on duckduckgo bangs Store bangs on a trie to allow autocomplete (not in this commit)
2021-02-23Merge pull request #2595 from dalf/update-wikidata-unitsAlexandre Flament
[mod] update wikidata_units.json and fetch_wikidata_units.py
2021-02-23[mod] update currencies.json and fetch_currencies.pyAlexandre Flament
use a sparql request on wikidata to get the list of currencies. currencies.json contains the translation for all supported searx languages. Supersede #993
2021-02-23[mod] update wikidata_units.json and fetch_wikidata_units.pyAlexandre Flament
The fetch_wikidata_units.py result won't change randomly. See comments in the script.