summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2022-01-10[fix] add default for "about" engine propertyMartin Fischer
Fixes #732.
2022-01-07[fix] ccengine engine - avoid unwanted redirectsMarkus Heiser
api.openverse.engineering is a little picky and wants to have a trailing slash in the path: /v1/images? -->/ v1/images/? otherwise it redirects, here is the debug log: DEBUG searx.network.openverse : HTTP Request: GET https://api.openverse.engineering/v1/images?&page=1&page_size=20&format=json&q=foo "HTTP/2 301 Moved Permanently" (text/html; charset=utf-8) DEBUG searx.network.openverse : HTTP Request: GET https://api.openverse.engineering/v1/images/?&page=1&page_size=20&format=json&q=foo "HTTP/2 200 OK" (application/json) WARNING searx.engines.openverse : ErrorContext('searx/search/processors/online.py', 105, 'count_error(', None, '1 redirects, maximum: 0', ('200', 'OK', 'api.openverse.engineering')) True Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-07[fix] Rename ccengine engine to openverseLéon Tiekötter
The CC engine was merged with WordPress and renamed to Openverse Source: https://wordpress.org/news/2021/05/welcome-to-openverse/
2022-01-07[fix] ccengine engineLéon Tiekötter
Change domain to api.openverse.engineering
2022-01-07Merge pull request #709 from return42/drop-etoolsMarkus Heiser
[fix] drop etools engine module
2022-01-07[fix] drop etools engine moduleMarkus Heiser
The implementation of the etools engine is poor. No date-range support, no language support and it is broken by a CAPTCHA. etools is a metasearch engine, the major search engines it supports (google, bing, wikipedia, Yahoo) are already available in SeaarXNG. While etools does support several engines we currently don't support directly, support for them should be added directly to SearXNG if there is demand. In practice: in SearXNG the worse etools results will be mixed with good results from other engines we have (as long as there is no captcha). At best case, what we win with etools is in e.g. results from de.ask.com in a query from a german request .. in all other cases worse results are bubble up in SearXNG's result list. [1] https://github.com/searxng/searxng/issues/696#issuecomment-1005855499 Closes: https://github.com/searxng/searxng/issues/696 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-07Merge pull request #708 from not-my-profile/pref-refactorMartin Fischer
Refactor `preferences`
2022-01-07Drop microsoft academic engineLéon Tiekötter
Microsoft academic was discontinued on 2021-12-31. Source: https://www.microsoft.com/en-us/research/project/academic/articles/microsoft-academic-to-expand-horizons-with-community-driven-approach/
2022-01-06[refactor] add type hints & remove Setting._post_initMartin Fischer
Previously the Setting classes used a horrible _post_init hack that prevented proper type checking.
2022-01-06Merge pull request #634 from not-my-profile/powered-byAlexandre Flament
Introduce `categories_as_tabs` & group engines in tabs
2022-01-05Merge pull request #679 from dalf/brand-searxngAlexandre Flament
searxng.org: update setup.py & settings.yml
2022-01-05[mod] introduce searx.engines.Engine for type hintingMartin Fischer
2022-01-05[mod] move group_engines_in_tab to searx.webutilsMartin Fischer
2022-01-05[enh] move dictionaries, Erowid & IMDb out of general categoryMartin Fischer
The general category is the category that is searched by default. From a privacy standpoint it doesn't make sense to send all general queries to specialized search engines that cannot deal with those queries anyway.
2022-01-05[enh] show categories not in any tab category in "Other" preferences tabMartin Fischer
Previously we didn't have a good place to put search engines that don't fit into any of the tab categories. This commit automatically puts search engines that don't belong to any tab category in an "other" category, that is only displayed in the user preferences (and not above search results).
2022-01-05[enh] add more categoriesMartin Fischer
2022-01-03[enh] introduce categories_as_tabsMartin Fischer
Previously all categories were displayed as search engine tabs. This commit changes that so that only the categories listed under categories_as_tabs in settings.yml are displayed. This lets us introduce more categories without cluttering up the UI. Categories not displayed as tabs can still be searched with !bangs.
2022-01-03[enh] settings.yml: allow granular overwrites for aboutMartin Fischer
2022-01-02Merge pull request #613 from return42/pylint-bing-imagesAlexandre Flament
[pylint] Bing (Images) engine
2022-01-02reference docs.searxng.orgAlexandre Flament
2022-01-01[fix] bing engines: fetch_supported_languagesMarkus Heiser
The Request to and the Response from https://www.bing.com/account/general has been changed. [1] https://github.com/searxng/searxng/pull/672#discussion_r777104919 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-28[pylint] Bing (Images) engineMarkus Heiser
Fix remarks from pylint and remove obsolete try/except block Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-28[pylint] Bing (Videos) engineMarkus Heiser
Fix remarks from pylint and remove obsolete try/except block Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27[fix] issues reported by pylintMarkus Heiser
Fix pylint issues from commit (3d96a983) [format.python] initial formatting of the python code Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27[format.python] initial formatting of the python codeMarkus Heiser
This patch was generated by black [1]:: make format.python [1] https://github.com/psf/black Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27[format.python] disable py code formatting for some hunks of codeMarkus Heiser
Disable the python code formatting from python-black, where the readability of code suffers by formatting. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-21[doc] introduce about.language and sort engines by itMartin Fischer
2021-12-20Merge pull request #611 from return42/fix-bingMarkus Heiser
[fix] bing engine: fix paging support, show inital page.
2021-12-18[pylint] Reddit engineMarkus Heiser
Add Reddit engine to pylint process Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-18[fix] bing engine: fix paging support, show inital page.Markus Heiser
Follow up queries for the pages needed to be fixed. - Split search-term in one for initial query and one for following queries. - Set some headers in HTTP requests, bing needs for paging support. - IMO //div[@class="sa_cc"] does no longer match in a bing response. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-18[pylint] Bing (Web) engineMarkus Heiser
Fix remarks from pylint and improved code-style. In preparation for a bug-fix of the Bing (Web) engine I add this engine to the pylint-list. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-17[fix] engine bing-news: replace the http:// by https://Markus Heiser
BTW: add bing_news to the pylint process Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-12Merge pull request #587 from dalf/fix-gigablastMarkus Heiser
[fix] gigablast engine
2021-12-07Merge pull request #586 from dalf/remove-yggtorrentMarkus Heiser
[del] remove yggtorrent
2021-12-06[fix] gigablast engineAlexandre Flament
fetch extra params after 3000 seconds
2021-12-06[del] remove yggtorrentAlexandre Flament
yggtorrent is behind cloudflare now close #580
2021-12-06[fix] imdb: don't crash when there is no resultAlexandre Flament
2021-11-26[fix] google-videos engine: ignore news articlesMarkus Heiser
In the video search, google also sometimes includes news. E.g. in the DE language when you search for `!gov paris`, google adds an article from a german newspaper (FAZ), I assume these are sponsored link (not tagged advertisement?) Those links do not have an image / this patch ignores *video links* wqithout an image ID. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-26[fix] google video engine - rework of the HTML parserMarkus Heiser
The google video response has been changed slightly, a rework of the parser was needed. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-25[fix] google engine - suggestionMarkus Heiser
BTW: google no longer offers *spelling suggestions* Closes: https://github.com/searxng/searxng/issues/442 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-21[fix] google images: @href index 0 not foundMarkus Heiser
Sometimes there is no href in the `<a ..>` tag of a *link_node* [1]. [1] https://github.com/searxng/searxng/issues/532 Reported-by: @TheEssem Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-19[drop] engine digg - https://digg.com/api is no longer availableMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-17[fix] Qwant search query stringTom
Search string: "!qwant time" Resulting request URL: https://api.qwant.com/v3/search/web?q=q=time&count=10&offset=0&device=desktop&safesearch=1&locale=en_US Notice the double "q=" Resulting request URL after fix: https://api.qwant.com/v3/search/web?q=time&count=10&offset=0&device=desktop&safesearch=1&locale=en_US
2021-11-01[fix] make reddit only in social media category avail.MrPaulBlack
fix https://github.com/searxng/searxng/issues/470
2021-10-26[mod] microsoft academic: increase timeout to 6 secondsAlexandre Flament
also avoid a crash when there is no result close #433
2021-10-21[fix] yahoo engine - don't lump all search suggestions togetherMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/421 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-16[fix] engine - yahoo: rewrite and fix issuesMarkus Heiser
Languages are supported by mapping the language to a domain. If domain is not found in :py:obj:`lang2domain` URL ``<lang>.search.yahoo.com`` is used. BTW: fix issue reported at https://github.com/searx/searx/issues/3020 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-16[pylint] engines: yahoo fix several issues reported from pylintMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-14[fix] language param for qwantMrPaulBlack
2021-10-12[fix] qwant engine - only get results from categoriesNoémi Ványi
Reported-by: https://github.com/searx/searx/issues/3014 Cherry-picked: https://github.com/searx/searx/commit/3bcca43