summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2020-12-07[fix] 1x engineAlexandre Flament
2020-12-07[fix] command engine: SearchQuery.query is str not bytesAlexandre Flament
see c225db45c8a4ab466bff049216f7e0189dc1b067
2020-12-07[mod] duden engineAlexandre Flament
* add params['soft_max_redirects'] = 1 (when there is spelling suggestion) * avoid try..except * use eval_xpath_* functions
2020-12-07Merge pull request #2356 from dalf/fix-dddAlexandre Flament
[fix] duckduckgo_definitions: fix relative image URL
2020-12-06Merge pull request #2352 from dalf/no_httpAlexandre Flament
Remove HTTP connections as much as possible
2020-12-06[fix] duckduckgo_definitions: fix relative image URLAlexandre Flament
ddg returns relative URL to https://duckduckgo.com/
2020-12-04Merge pull request #2354 from dalf/fix-wikipediaAlexandre Flament
[fix] wikipedia engine: don't raise an error when the query is not found
2020-12-04[fix] wikipedia engine: don't raise an error when the query is not foundAlexandre Flament
Add a new parameter "raise_for_status", set by default to True. When True, any HTTP status code >= 300 raise an exception ( #2332 ) When False, the engine can manage the HTTP status code by itself.
2020-12-04[fix] wikidata: fix crash when the item has no description at all and at ↵Alexandre Flament
least one URL.
2020-12-04[fix] remove searx/engines/filecrop.py (dead code)Alexandre Flament
2020-12-03[mod] stackoverflow & yandex: detect CAPTCHA responseAlexandre Flament
2020-12-03[mod] various engines: use eval_xpath* functions and searx.exceptions.*Alexandre Flament
Engine list: ahmia, duckduckgo_images, elasticsearch, google, google_images, google_videos, youtube_api
2020-12-03[mod] xpath, 1337x, acgsou, apkmirror, archlinux, arxiv: use eval_xpath_* ↵Alexandre Flament
functions
2020-12-03[mod] bing_news: use eval_xpath_getindexAlexandre Flament
remove unused function searx.utils.list_get
2020-12-03[enh] record details exception per engineAlexandre Flament
add an new API /stats/errors
2020-12-02[refactor] digg - improve results and clean up source codeMarkus Heiser
- strip html tags and superfluous quotation marks from content - remove not needed cookie from request - remove superfluous imports Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02[mod] digg - pylint searx/engines/digg.pyMarkus Heiser
Eliminate redundant file names which are tested by test.pylint and ignored by test.pep8 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02[fix] digg - the ISO time stamp of published date has been changedMarkus Heiser
Error pattern:: Engines cannot retrieve results: digg (unexpected crash time data '2020-10-16T14:09:55Z' does not match format '%Y-%m-%d %H:%M:%S') Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-01[mod] pylint: numerous minor code fixesAlexandre Flament
2020-12-01[mod] wikidata: WDGeoAttribute class: doesn't change the method signature of ↵Alexandre Flament
get_str
2020-12-01[fix] /stats: report error percentage instead of error countAlexandre Flament
This bug exists since the PR https://github.com/searx/searx/pull/751
2020-11-30Add recoll engine (#2325)Noémi Ványi
recoll is a local search engine based on Xapian: http://www.lesbonscomptes.com/recoll/ By itself recoll does not offer web or API access, this can be achieved using recoll-webui: https://framagit.org/medoc92/recollwebui.git This engine uses a custom 'files' result template set `base_url` to the location where recoll-webui can be reached set `dl_prefix` to a location where the file hierarchy as indexed by recoll can be reached set `search_dir` to the part of the indexed file hierarchy to be searched, use an empty string to search the entire search domain
2020-11-27Photon API Link UpdateM. Efe Çetin
Via https://photon.komoot.io/
2020-11-20[enh] Add multiple outgoing proxiesAlexandre Flament
credits go to @bauruine see https://github.com/searx/searx/pull/1958
2020-11-14[refactor] deviantart - improve results and clean up source codeMarkus Heiser
Devian's request and response forms has been changed. - fixed title - fixed time_range_dict to 'popular-*-***' - use image from <noscript> if exists - drop obsolete "http to https, remove domain sharding" - use query URL https://www.deviantart.com/search/deviations?page=5&q=foo - add searx/engines/deviantart.py to pylint check (test.pylint) Error pattern:: There DEBUG:searx:result: invalid title: {'url': 'https://www.deviantart.com/ ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-11-14[mod] remove unused importAlexandre Flament
use from searx.engines.duckduckgo import _fetch_supported_languages, supported_languages_url # NOQA so it is possible to easily remove all unused import using autoflake: autoflake --in-place --recursive --remove-all-unused-imports searx tests
2020-11-14Merge pull request #2292 from kvch/elasticsearch-engineAlexandre Flament
New engine: Elasticsearch
2020-11-14Merge pull request #2289 from dalf/pylintAlexandre Flament
[mod] pylint: add extension-pkg-whitelist=lxml.etree
2020-11-10New engine: ElasticsearchNoémi Ványi
2020-11-03[mod] pylint: minor code change to allow pylint globallyAlexandre Flament
This commit is only a step, it doesn't fix all the issues reported by pylint
2020-11-03[fix] comamnd engine: fix importAlexandre Flament
2020-11-03[fix] scanr_structure engine: fix importAlexandre Flament
2020-10-28[mod] wikidata engine: use one SPARQL request instead of 2 HTTP requests.Alexandre Flament
2020-10-28[mod] duckduckgo_definitions: display only user friendly attributes / URLAlexandre Flament
various bug fixes
2020-10-25[enh] Add onions category with Ahmia, Not Evil and Torcha01200356
Xpath engine and results template changed to account for the fact that archive.org doesn't cache .onions, though some onion engines migth have their own cache. Disabled by default. Can be enabled by setting the SOCKS proxies to wherever Tor is listening and setting using_tor_proxy as True. Requires Tor and updating packages. To avoid manually adding the timeout on each engine, you can set extra_proxy_timeout to account for Tor's (or whatever proxy used) extra time.
2020-10-25Open Semantic Search EngineNicholas Kegler
2020-10-09Propagate error messages from YouTube APINoémi Ványi
2020-10-09Merge pull request #2255 from kvch/yacy-improvementsAdam Tauber
Add yacy improvements: HTTP digest auth, category checking
2020-10-09[fix] fix duckduckgo engineAlexandre Flament
- remove paging support: a "vqd" parameter is required between each request. This parameter is uniq for each request - update the URL (no redirect), use the POST method - language support: works if there is no more than request per minute, otherwise it is ignored !
2020-10-09Add yacy improvements: HTTP digest auth, category checkingNoémi Ványi
2020-10-08add ebay enginte to shopping categoryNoémi Ványi
2020-10-07[mod] Add searx.data moduleAlexandre Flament
Instead of loading the data/*.json in different location, load these files in the new searx.data module.
2020-10-06[fix] drop Python 2: use collections.abc.Iterable instead of ↵Alexandre Flament
collections.Iterable
2020-10-04Merge pull request #2241 from dalf/move-extract-text-and-urlAlexandre Flament
Move the extract_text and extract_url functions to searx.utils
2020-10-03[enh] Add SepiaSearch engine (#2227)Finn
supported_languages values: see https://framagit.org/framasoft/peertube/search-index/-/blob/master/client/src/views/Search.vue#L618-641
2020-10-02[mod] move extract_text, extract_url to searx.utilsAlexandre Flament
2020-10-01[fix] google engine - div classes has been renamed in HTML reultMarkus Heiser
Since 1. October 2020 google has changed the 'class' attribute of the HTML result page. Fix the xpath expressions and ignore <div class="g" ../> sections which do not match to title's xpath expression. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-09-28[fix] migration from github.com/asciimoo/searx to github.com/searx/searx : ↵Alexandre Flament
fix URLs
2020-09-22fetch google's search langs rather than ui langsMarc Abonce Seguin
2020-09-22fetch supported languages for startpage engineMarc Abonce Seguin