summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2022-06-18[fix] google play apps engine: implement engines/google_play_apps.pyta
2022-06-18Fix: use sys.modules.copy() to avoid RuntimeErrorAlexandre Flament
use sys.modules.copy() to avoid "RuntimeError: dictionary changed size during iteration" see https://github.com/python/cpython/issues/89516 and https://docs.python.org/3.10/library/sys.html#sys.modules close https://github.com/searxng/searxng/issues/1342
2022-06-12Merge pull request #1308 from allendema/add-yep-com-jsonAlexandre Flament
[enh] Add yep.com via json_engine
2022-06-11[enh] Initial no paging support for Yep.comAllen
Upstream example query: https://yep.com/web?q=test https://yep.com/about
2022-06-11Wikidata engine: ignore dummy entitiesAlexandre Flament
Close #641
2022-06-11Wikidata engine: minor change of the SPARQL requestAlexandre Flament
The engine can be slow especially when the query won't return any answer. See https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Manual/MWAPI#Find_articles_in_Wikipedia_speaking_about_cheese_and_see_which_Wikibase_items_they_correspond_to Related to #1290
2022-06-03[fix] prepare for pylint 2.14.0Markus Heiser
Remove issue reported by Pylint 2.14.0: - no-self-use: has been moved to optional extension [1] - The refactoring checker now also raises 'consider-using-generator' messages for max(), min() and sum(). [2] .pylintrc: - <option name>-hint has been removed since long, Pylint 2.14.0 raises an error on invalid options - bad-continuation and bad-whitespace have been removed [3] [1] https://pylint.pycqa.org/en/latest/whatsnew/2/2.14/summary.html#removed-checkers [2] https://pylint.pycqa.org/en/latest/whatsnew/2/2.14/full.html#what-s-new-in-pylint-2-14-0 [2] https://pylint.pycqa.org/en/latest/whatsnew/2/2.6/summary.html#summary-release-highlights Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-02[enh] Initial Petalsearch Images supportAllen
Upstream example query: https://petalsearch.com/search?query=test&channel=image&ps=50&pn=1&region=de-de&ss_mode=off&ss_type=normal Depending on locale it will internally use some/all results from other engines. See: https://seirdy.one/posts/2021/03/10/search-engines-with-own-indexes/#general-indexing-search-engines
2022-05-10Reflect the real world parameter from settings.ymlÉmilien Devos
2022-05-07[format.python] based on bugfix in 9ed626130Markus Heiser
2022-04-22[fix] FutureWarning from lxmlcapric98
Just in case if content is None, the original code will skip extract_text(), and just append the None value to 'content'. So just add allow_none=True, and this will return None without raising a ValueError in extract_text().
2022-04-17Merge pull request #1101 from allendema/pass-cookies-from-settingsAlexandre Flament
[enh] Allow passing headers/cookies from settings.yml
2022-04-17[fix[ Update only cookies/headersAllen
2022-04-17[lint] Remove whitespaceAllen
From GH GUI
2022-04-16[mod] Pass desired ebay domain in settings Allen
https://www.ebay.de https://www.ebay.com htttps://www.ebay.es etc
2022-04-16[enh] Allow passing headers/cookies from settings.ymlAllen
Example: - engine: xpath - search_url: example.org - headers: {'example_header': 'example_header'} - cookies: {'safesearch': 'off'}
2022-04-16Merge pull request #1071 from return42/fix-lang-dailymotionAlexandre Flament
[fix] dailymotion engine: filter by language & country
2022-04-16dailymotion: send valid value for the language parameterAlexandre Flament
2022-04-16[fix] dailymotion engine: filter by language & countryMarkus Heiser
- fix the issue of fetching more the 7000 *languages* - improve the request function and filter by language & country - implement time_range_support & safesearch - add more fields to the response from dailymotion (allow_embed, length) - better clean up of HTML tags in the 'content' field. This is more or less a complete rework based on the '/videos' API from [1]. This patch cleans up the language list in SearXNG that has been polluted by the ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been used. [1] https://developers.dailymotion.com/tools/ Closes: https://github.com/searxng/searxng/issues/1065 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-12change "Wolfram|Alpha" to "Wolfram Alpha" in search resultsJabster28
2022-04-09Merge pull request #1030 from austinhuang0131/masterAlexandre Flament
(feat) add jisho.org
2022-04-09jisho : code refactoringAlexandre Flament
2022-04-01(fix) satisfy the linter, and btw reduce timeoutAustin Huang
2022-04-01update jisho.py according to suggestionsAustin Huang
2022-03-31bing engine: _fetch_supported_languages: don't use the language code as a ↵Alexandre FLAMENT
country ref #1029
2022-03-31(feat) add jisho.orgAustin Huang
Closes #1016
2022-03-19fix startpage: update XPath in _fetch_supported_languagesAlexandre Flament
2022-03-07[fix] engine mediathekviewweb: replace http links by httpsMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-03-05[fix] engine: Semantic Scholar (Science) // rework & fixMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/939 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-21Merge pull request #913 from return42/add-artworkMarkus Heiser
[mod] add artwork to mixcloud & soundcloud engines
2022-02-21[mod] bandcamp & genius: in result set img_src instead thumbnailMarkus Heiser
Suggested-by: @dalf https://github.com/searxng/searxng/pull/900#issuecomment-1046009057 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-21[fix] genius: add player an avoid exceptional programmingMarkus Heiser
Add player: - The players are just playing 30sec from the title. Some of the player will be blocked because of a cross-origin request and some players will link to apple when you press the play button. Avoid exceptions and (and BTW improve results) - ERROR searx.engines.genius : list index out of range Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-20Merge pull request #910 from tiekoetter/fix-909Markus Heiser
[fix] google images engine: Fix 'scrap_img_by_id' function
2022-02-19[mod] add artwork to mixcloud & soundcloud enginesMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-19[fix] google images engine: Fix 'scrap_img_by_id' functionMarkus Heiser
The 'scrap_img_by_id' function didn't return any longer anything useful. This fix allows the google images engine to present the full source image instead of only the thumbnail. The function scrap_img_by_id() is rpelaced by a fully rewrite to parse image URLs by a regular expression. The new function parse_urls_img_from_js(dom) returns a mapping of data-id to image URL. Closes: https://github.com/searxng/searxng/issues/909 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-19Merge pull request #900 from return42/fix-883Alexandre Flament
[fix] bandcamp: fix itemtype (album|track) and exceptions
2022-02-19[mod] mediathekviewweb engine: add iframe_src and use videos templateMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-18[fix] bandcamp: fix itemtype (album|track) and exceptionsMarkus Heiser
BTW: polish implementation and show tracklist for albums Closes: https://github.com/searxng/searxng/issues/883 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-18[mod] templates: rename field for <iframe> URL to iframe_srcMarkus Heiser
Rename result field data_src to iframe_src Suggested-by: @dalf https://github.com/searxng/searxng/pull/882#issuecomment-1037997402 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-13[mod] result_templates/default.html replace embedded HTML by data_src audio_srcMarkus Heiser
Embedded HTML breaks SearXNG architecture. To modularize, HTML is generated in the templates (oscar & simple) and result parameter 'embedded' is replaced by 'data_src' (and 'audio_src'), an URL for embedded content (<iframe>). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-13[mod] result_templates/videos.html: replace embedded HTML by data_srcMarkus Heiser
Embedded HTML breaks SearXNG architecture. To modularize, HTML is generated in the templates (oscar & simple) and result parameter 'embedded' is replaced by 'data_src', an URL for embedded content (<iframe>). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-09Update the XPath for fetching the Google resultsÉmilien Devos
2022-02-07[fix] openstreatmap: load thumbnail from uploads.wikimedia.orgMarkus Heiser
Openstreatmap images are now loaded from uploads.wikimedia.org instead of commons.wikimedia.org to prevent redirects. With `image_proxy` enabled images from commons.wikimedia.org cant be loaded since they are redirected. We already discussed this issue [875] and @tiekoetter fixed this issue in PR [878]. Related-to: - [875] https://github.com/searxng/searxng/issues/875 - [878] https://github.com/searxng/searxng/pull/878 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-07[pylint] searx/engines/wikidata.py (no functional change)Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-07[fix] wikidata: URL decoding and file extension handlingLéon Tiekötter
Add '.png' to the second img_src_name if it has the extension '.svg'. Use urllib.parse.unquote for URL decoding.
2022-02-06[fix] wikidata engine: select image with higher (not lower) priorityMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-06wikidata: load thumbnail instead of full imageLéon Tiekötter
2022-02-06[fix] wikidata info box imagesLéon Tiekötter
Wikidata info box images are now loaded from uploads.wikimedia.org instead of commons.wikimedia.org to prevent redirects Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04[pylint] engines/invidious.pyMarkus Heiser
Fix remarks from pylint and remove usless comments Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04[fix] invidious engine: store random base_url in paramMarkus Heiser
Two different threads ( = two different user queries) can call the request function in a row and then the response function. The namespace will be same since this is the same engine. To keep exactly the same value ``base_url`` must be stored in params and then retrieve using ``resp.search_params["base_url"]``. Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#discussion_r799324861 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-20 10:02:46 +0000