summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2020-12-10[fix] xpath, mojeek: fix commit 58d72f26925d56e22330c54be03c3dcbee0c4135Alexandre Flament
before commit 58d72f2, category was not set in xpath.py, so searx/engines/__init__py was setting the category to ['general'] the commit 58d72f2 set the category to [] which is not replaced by searx/engines/__init__.py consequence: the mojeek engine is hidden in the preferences. this commit revert the xpath.py change. close #2368
2020-12-09display if an engine does not support httpsNoémi Ványi
Closes #302
2020-12-08Merge pull request #2359 from dalf/update-dudenAlexandre Flament
[mod] duden engine
2020-12-08Merge pull request #2366 from dalf/remove-seedpeerAlexandre Flament
[remove] seedpeer engine
2020-12-07[remove] seedpeer engineAlexandre Flament
the website is offline.
2020-12-07Merge pull request #2364 from dalf/fix-youtube-noapiAlexandre Flament
[fix] youtube_noapi engine
2020-12-07Merge pull request #2365 from dalf/fix-soundcloudAlexandre Flament
[fix] soundclound: accept result without content
2020-12-07Merge pull request #2361 from dalf/fix-1xAlexandre Flament
[fix] 1x engine
2020-12-07Merge pull request #2363 from dalf/fix-wikipedia-minorAlexandre Flament
[fix] wikipedia: minor fix: return no result instead of crash in some very few cases.
2020-12-07[fix] soundclound: accept result without contentAlexandre Flament
2020-12-07[fix] youtube_noapi engineAlexandre Flament
2020-12-07[fix] wikipedia: minor fix: return no result instead of crash in some very ↵Alexandre Flament
few cases. In few cases, the JSON results doesn't contains the key 'type'.
2020-12-07[fix] 1x engineAlexandre Flament
2020-12-07[mod] duden engineAlexandre Flament
* add params['soft_max_redirects'] = 1 (when there is spelling suggestion) * avoid try..except * use eval_xpath_* functions
2020-12-07Merge pull request #2356 from dalf/fix-dddAlexandre Flament
[fix] duckduckgo_definitions: fix relative image URL
2020-12-06Merge pull request #2352 from dalf/no_httpAlexandre Flament
Remove HTTP connections as much as possible
2020-12-06[fix] duckduckgo_definitions: fix relative image URLAlexandre Flament
ddg returns relative URL to https://duckduckgo.com/
2020-12-04Merge pull request #2354 from dalf/fix-wikipediaAlexandre Flament
[fix] wikipedia engine: don't raise an error when the query is not found
2020-12-04[fix] wikipedia engine: don't raise an error when the query is not foundAlexandre Flament
Add a new parameter "raise_for_status", set by default to True. When True, any HTTP status code >= 300 raise an exception ( #2332 ) When False, the engine can manage the HTTP status code by itself.
2020-12-04[fix] wikidata: fix crash when the item has no description at all and at ↵Alexandre Flament
least one URL.
2020-12-04[fix] remove searx/engines/filecrop.py (dead code)Alexandre Flament
2020-12-03[mod] stackoverflow & yandex: detect CAPTCHA responseAlexandre Flament
2020-12-03[mod] various engines: use eval_xpath* functions and searx.exceptions.*Alexandre Flament
Engine list: ahmia, duckduckgo_images, elasticsearch, google, google_images, google_videos, youtube_api
2020-12-03[mod] xpath, 1337x, acgsou, apkmirror, archlinux, arxiv: use eval_xpath_* ↵Alexandre Flament
functions
2020-12-03[mod] bing_news: use eval_xpath_getindexAlexandre Flament
remove unused function searx.utils.list_get
2020-12-03[enh] record details exception per engineAlexandre Flament
add an new API /stats/errors
2020-12-02[refactor] digg - improve results and clean up source codeMarkus Heiser
- strip html tags and superfluous quotation marks from content - remove not needed cookie from request - remove superfluous imports Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02[mod] digg - pylint searx/engines/digg.pyMarkus Heiser
Eliminate redundant file names which are tested by test.pylint and ignored by test.pep8 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02[fix] digg - the ISO time stamp of published date has been changedMarkus Heiser
Error pattern:: Engines cannot retrieve results: digg (unexpected crash time data '2020-10-16T14:09:55Z' does not match format '%Y-%m-%d %H:%M:%S') Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-01[mod] pylint: numerous minor code fixesAlexandre Flament
2020-12-01[mod] wikidata: WDGeoAttribute class: doesn't change the method signature of ↵Alexandre Flament
get_str
2020-12-01[fix] /stats: report error percentage instead of error countAlexandre Flament
This bug exists since the PR https://github.com/searx/searx/pull/751
2020-11-30Add recoll engine (#2325)Noémi Ványi
recoll is a local search engine based on Xapian: http://www.lesbonscomptes.com/recoll/ By itself recoll does not offer web or API access, this can be achieved using recoll-webui: https://framagit.org/medoc92/recollwebui.git This engine uses a custom 'files' result template set `base_url` to the location where recoll-webui can be reached set `dl_prefix` to a location where the file hierarchy as indexed by recoll can be reached set `search_dir` to the part of the indexed file hierarchy to be searched, use an empty string to search the entire search domain
2020-11-27Photon API Link UpdateM. Efe Çetin
Via https://photon.komoot.io/
2020-11-20[enh] Add multiple outgoing proxiesAlexandre Flament
credits go to @bauruine see https://github.com/searx/searx/pull/1958
2020-11-14[refactor] deviantart - improve results and clean up source codeMarkus Heiser
Devian's request and response forms has been changed. - fixed title - fixed time_range_dict to 'popular-*-***' - use image from <noscript> if exists - drop obsolete "http to https, remove domain sharding" - use query URL https://www.deviantart.com/search/deviations?page=5&q=foo - add searx/engines/deviantart.py to pylint check (test.pylint) Error pattern:: There DEBUG:searx:result: invalid title: {'url': 'https://www.deviantart.com/ ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-11-14[mod] remove unused importAlexandre Flament
use from searx.engines.duckduckgo import _fetch_supported_languages, supported_languages_url # NOQA so it is possible to easily remove all unused import using autoflake: autoflake --in-place --recursive --remove-all-unused-imports searx tests
2020-11-14Merge pull request #2292 from kvch/elasticsearch-engineAlexandre Flament
New engine: Elasticsearch
2020-11-14Merge pull request #2289 from dalf/pylintAlexandre Flament
[mod] pylint: add extension-pkg-whitelist=lxml.etree
2020-11-10New engine: ElasticsearchNoémi Ványi
2020-11-03[mod] pylint: minor code change to allow pylint globallyAlexandre Flament
This commit is only a step, it doesn't fix all the issues reported by pylint
2020-11-03[fix] comamnd engine: fix importAlexandre Flament
2020-11-03[fix] scanr_structure engine: fix importAlexandre Flament
2020-10-28[mod] wikidata engine: use one SPARQL request instead of 2 HTTP requests.Alexandre Flament
2020-10-28[mod] duckduckgo_definitions: display only user friendly attributes / URLAlexandre Flament
various bug fixes
2020-10-25[enh] Add onions category with Ahmia, Not Evil and Torcha01200356
Xpath engine and results template changed to account for the fact that archive.org doesn't cache .onions, though some onion engines migth have their own cache. Disabled by default. Can be enabled by setting the SOCKS proxies to wherever Tor is listening and setting using_tor_proxy as True. Requires Tor and updating packages. To avoid manually adding the timeout on each engine, you can set extra_proxy_timeout to account for Tor's (or whatever proxy used) extra time.
2020-10-25Open Semantic Search EngineNicholas Kegler
2020-10-09Propagate error messages from YouTube APINoémi Ványi
2020-10-09Merge pull request #2255 from kvch/yacy-improvementsAdam Tauber
Add yacy improvements: HTTP digest auth, category checking
2020-10-09[fix] fix duckduckgo engineAlexandre Flament
- remove paging support: a "vqd" parameter is required between each request. This parameter is uniq for each request - update the URL (no redirect), use the POST method - language support: works if there is no more than request per minute, otherwise it is ignored !