summaryrefslogtreecommitdiff
path: root/searx/settings.yml
AgeCommit message (Collapse)Author
2023-06-05[fix] engines: don't spam marginalia.nu with default settingsMarkus Heiser
The engine configuration of marginalia [2][3][4][5] spams marginalia.nu with requests from SearXNG instances [1]. It is not in the interest of SearXNG to disturb other FOSS projects, so the engine will be removed:: - name: marginalia engine: json_engine shortcut: mar categories: general paging: false # Key and license: https://www.marginalia.nu/marginalia-search/api/ # index: 0 popular, 1 blogs, 2 big_sites, 3 default, 4 experimental search_url: https://api.marginalia.nu/<insert your key here>/search/{query}?index=4&count=20 results_query: results url_query: url title_query: title content_query: description timeout: 1.5 disabled: true about: website: https://www.marginalia.nu/ official_api_documentation: https://api.marginalia.nu/ use_official_api: true require_api_key: true results: JSON [1] https://github.com/searxng/searxng/issues/1673 [2] https://github.com/searxng/searxng/pull/1627 [3] https://github.com/searxng/searxng/issues/1620 [4] https://news.ycombinator.com/item?id=35874640 [5] https://github.com/MarginaliaSearch/MarginaliaSearch/blob/d82a8584915c9d416921cc9f1c0637efedea664f/code/services-satellite/api-service/src/main/java/nu/marginalia/api/svc/ResponseCache.java#L12-L20 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-05-15[mod] donation_url: disable by defaultMarkus Heiser
SearXNG's donation campaign has been ended. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-25Merge pull request #2347 from return42/mod-lang-detectionMarkus Heiser
If language recognition fails use the Accept-Language
2023-04-16[fix] engine: google play moviesMarkus Heiser
Closes: https://github.com/searxng/searxng/pull/1746 Closes: https://github.com/searxng/searxng/issues/1599 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-15[mod] settings.yml: enable language detection by default_lang (auto)Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-06[fix] Gigablast.com has been erasedMarkus Heiser
[1] https://www.reddit.com/r/searchengines/comments/128wdcp/gigablastcom_has_been_erased/ Closes: https://github.com/searxng/searxng/issues/2321 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-29[fix] engine gigablast: add &userid=<User ID>&code=<Feed Code>Markus Heiser
Gigablast's API does block unauthorized request[1]. [1] https://gigablast.com/searchfeed.html Closes: https://github.com/searxng/searxng/issues/1454 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] Google: reversed engineered & upgrade to data_type: traits_v1Markus Heiser
Partial reverse engineering of the Google engines including a improved language and region handling based on the engine.traits_v1 data. When ever possible the implementations of the Google engines try to make use of the async REST APIs. The get_lang_info() has been generalized to a get_google_info() function / especially the region handling has been improved by adding the cr parameter. searx/data/engine_traits.json Add data type "traits_v1" generated by the fetch_traits() functions from: - Google (WEB), - Google images, - Google news, - Google scholar and - Google videos and remove data from obsolete data type "supported_languages". A traits.custom type that maps region codes to *supported_domains* is fetched from https://www.google.com/supported_domains searx/autocomplete.py: Reversed engineered autocomplete from Google WEB. Supports Google's languages and subdomains. The old API suggestqueries.google.com/complete has been replaced by the async REST API: https://{subdomain}/complete/search?{args} searx/engines/google.py Reverse engineering and extensive testing .. - fetch_traits(): Fetch languages & regions from Google properties. - always use the async REST API (formally known as 'use_mobile_ui') - use *supported_domains* from traits - improved the result list by fetching './/div[@data-content-feature]' and parsing the type of the various *content features* --> thumbnails are added searx/engines/google_images.py Reverse engineering and extensive testing .. - fetch_traits(): Fetch languages & regions from Google properties. - use *supported_domains* from traits - if exists, freshness_date is added to the result - issue 1864: result list has been improved a lot (due to the new cr parameter) searx/engines/google_news.py Reverse engineering and extensive testing .. - fetch_traits(): Fetch languages & regions from Google properties. *supported_domains* is not needed but a ceid list has been added. - different region handling compared to Google WEB - fixed for various languages & regions (due to the new ceid parameter) / avoid CONSENT page - Google News do no longer support time range - result list has been fixed: XPath of pub_date and pub_origin searx/engines/google_videos.py - fetch_traits(): Fetch languages & regions from Google properties. - use *supported_domains* from traits - add paging support - implement a async request ('asearch': 'arc' & 'async': 'use_ac:true,_fmt:html') - simplified code (thanks to '_fmt:html' request) - issue 1359: fixed xpath of video length data searx/engines/google_scholar.py - fetch_traits(): Fetch languages & regions from Google properties. - use *supported_domains* from traits - request(): include patents & citations - response(): fixed CAPTCHA detection (Scholar has its own CATCHA manager) - hardening XPath to iterate over results - fixed XPath of pub_type (has been change from gs_ct1 to gs_cgt2 class) - issue 1769 fixed: new request implementation is no longer incompatible Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24[mod] Peertube: re-engineered & upgrade to data_type: traits_v1Markus Heiser
- fetch_traits(): Fetch languages from peertube's search-index source code. [mod] Include migration of the request methode from 'supported_languages' to 'traits' (EngineTraits) object. [fix] old supported_languages_url is no longer valid since the sources has been moved to a different path. - fixed code to pass pylint - request(): complete re-implementation based on the API docs [1] - response(): complete re-implementation, adds serveral fields missed before - add source code documentation [1] https://docs.joinpeertube.org/api-rest-reference.html#tag/Search/operation/searchVideos Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-28Increase timeout for gentoo wiki engineSolirs
2023-02-17[doc] slight improvements to the doc of the settings (base_url)Markus Heiser
Closes: https://github.com/searxng/searxng/issues/2190 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-15Merge pull request #2188 from ahmad-alkadri/fix/petalsearchMarkus Heiser
Fix the petalsearch engine
2023-02-14Fix petalsearch and remove petalsearch newsAhmad Alkadri
2023-02-14[mod] disbale engine tineye by defaultMarkus Heiser
Tineye becomes active as soon as a https:// signature is found in the search term, but most of the time a reverse image search is not requested when a URL is specified, often the URL is just from a C&P. The frequent requests to tineye lead in the end to the SearXNG instance being blocked by tineye and the user seeing unexpected error messages. BTW: many maintainers have disabled this engine in their local SearXNG settings. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-10[fix] remove engine neeva from settings.ymlMarkus Heiser
Engine is broken and can't by used any longer as a simple XPath engine. @allendema tested a engines/neeva.py version using json from the dom, but without luck: There was some kind of captcha for pagination. [1] https://github.com/searxng/searxng/issues/2007#issuecomment-1426061698 Closes: https://github.com/searxng/searxng/issues/2007 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-10[mod] engine wiby: add paginationwibyweb
Suggested by: @wibyweb in searx https://github.com/searx/searx/pull/3465 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-01-28search.suspended_time settings: bug fixesAlexandre Flament
* fix type in settings.yml: replace suspend_times by suspended_times * always use delay defined in settings.yml: * HTTP status 402 and 403: read the value from settings.yml instead of using the hardcoded value of 1 day. * startpage engine: CAPTCHA suspend the engine for one day instead of one week
2023-01-15Merge pull request #2100 from nexryai/masterAlexandre Flament
Add goo engine
2023-01-15Add search.suspended_times settingsLéon Tiekötter
Make suspended_time changeable in settings.yml Allow different values to be set for different exceptions. Co-authored-by: Alexandre Flament <alex@al-f.net>
2023-01-12Add goo enginenexryai
2023-01-09[fix] Mojeek Xpath showing suggestions and searches + add lang supportMilad-Laly
2022-12-11[mod] improve 'Autodetect search language' pluginMarkus Heiser
- Add documentation to the plugin - Harmonize FastText language model with SearXNG's language model Reosurces:: import fasttext # --> +10 MB fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB Suggested-by: @dalf - To speed up and simplify the deployment use fasttext-wheel instead of fasttext - Building numpy on the Alpine Linux of docker-images takes ages --> install py3-numpy from Alpines package manager (apk) - Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu libc) --> patch Dockerfile and build from fastetxt: sed -i s/fasttext-wheel/fasttext/ requirements.txt Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-10[mod] new plugin: Autodetect search languageArtikusHG
2022-11-10[fix] disabling zlibrary due to z-lib.org domain seizureRyan Draga
2022-11-07Merge pull request #1882 from fehho/metacpanAlexandre Flament
Add MetaCPAN engine
2022-11-07Add MetaCPAN enginefehho
2022-11-05Initialize Redis in searx/webapp.pyAlexandre FLAMENT
settings.yml: * The default URL was unix:///usr/local/searxng-redis/run/redis.sock?db=0 * The default URL is now "false" The default URL makes the log difficult to deal with: if the admin didn't install a Redis instance, the logs record a false error. It worked before because SearXNG initialized the Redis connection when the limiter started. In this commit, SearXNG initializes Redis in searx/webapp.py so various components can use Redis without taking care of the initialization step.
2022-10-14searx.network: add "verify" option to the networksAlexandre Flament
Each network can define a verify option: * false to disable certificate verification * a path to existing certificate. SearXNG uses SSL_CERT_FILE and SSL_CERT_DIR when they are defined see https://www.python-httpx.org/environment_variables/#ssl_cert_file
2022-09-30Merge branch 'searxng:master' into masterMohamed Elashri
2022-09-27[fix] typos / reported by @kianmeng in searx PR-3366Markus Heiser
[PR-3366] https://github.com/searx/searx/pull/3366 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24correct sci-hub links/ add `.ru` and remove other 3rd party domains.Mohamed Elashri
2022-09-24[fix] typo in crossref settings: disable --> disabledMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-23[mod] science category: various update of about PR 1705Alexandre Flament
2022-09-23Science category: update the enginesAlexandre FLAMENT
* use the paper.html template * fetch more data from the engines * add crossref.py
2022-09-23Merge pull request #1728 from liimee/eng-ddwAlexandre Flament
add duckduckgo weather engine
2022-09-23Merge pull request #1624 from liimee/eng-wttrAlexandre Flament
Add wttr.in engine
2022-09-18Brave engine: fix BrotliDecoderDecompressStream errorAlexandre FLAMENT
2022-09-09add yandex to autocomplete backends settingsLencoDigitexer
2022-09-04[mod] option 'ui: cache_url:' to configure internet cache or archiveMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-04xpath engine: change raise_for_httperror to no_result_for_http_statusAlexandre FLAMENT
no_result_for_http_status contains a list of HTTP status. These HTTP status are seen an empty result list. In other cases an exception is thrown as usual. Previously raise_for_httperror were ignoring all HTTP error, which make defective engines invisible in the stats.
2022-09-04[fix] engine woxikon.de - don't raise exception on empty result listMarkus Heiser
Woxikon expects a word in German, so with query "foo" the site finds nothing and respons a 404: httpx.HTTPStatusError: Client error '404 Not Found' \ for url 'https://synonyme.woxikon.de/synonyme/foo.php' [1] https://github.com/searxng/searxng/issues/1543#issuecomment-1193317054 Closes: https://github.com/searxng/searxng/issues/1543 Suggested-by: @allendema [1] Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-02Merge pull request #1647 from return42/deepl-engineMarkus Heiser
[mod] add deepl translation engine
2022-08-31Disable brave by defaultÉmilien Devos
Brave is too unstable and will often not work by default. As seen in many issues: https://github.com/searxng/searxng/issues?q=is%3Aissue++sort%3Aupdated-desc+brave+label%3Abug+
2022-08-31add duckduckgo weather engineta
2022-08-28settings.yml: set default values for result_proxyAlexandre FLAMENT
* initialize result_proxy with searx/settings_defaults.py * allow result_proxy.key to be a string this commit supersedes #1522
2022-08-27Merge pull request #1699 from liimee/eng-app-storeAlexandre Flament
add apple app store engine
2022-08-27Merge pull request #1700 from liimee/eng-ddmAlexandre Flament
add apple maps engine
2022-08-25add apple maps engineta
2022-08-24add the apple app store engineta
The Apple App Store is the digital app distribution platform for iOS & iPadOS.
2022-08-22add 9gag engineta
9GAG is a social media website where users upload and share user-generated images and videos