summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2023-02-10[mod] make python code pylint 2.16.1 compliantMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-03[fix-2146] set different HTTP Referer header to DuckDuckGo requestsMarkus Heiser
For what ever reasons, ddg-lite don't like the Referer https://lite.duckduckgo.com/ In an interactive session in the WEB browser the the Reverer has exactly this value, but ddg-lite don't like this value when the request is build up by SearXNG. The new value is: https://google.com/ What fakes a user comes from a google link. Related: https://github.com/searxng/searxng/pull/2081 Closes: https://github.com/searxng/searxng/issues/2146 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-01-29Merge pull request #2132 from dalf/update_pr_1967Alexandre Flament
search.suspended_time settings: bug fixes
2023-01-29wikipedia engine: update _fetch_supported_languagesAlexandre Flament
the layout https://meta.wikimedia.org/wiki/List_of_Wikipedias has changed
2023-01-29peertube engine: update _fetch_supported_languagesAlexandre Flament
There is now an API to get the list of supported languages https://docs.joinpeertube.org/api-rest-reference.html#tag/Video/operation/getLanguages
2023-01-28search.suspended_time settings: bug fixesAlexandre Flament
* fix type in settings.yml: replace suspend_times by suspended_times * always use delay defined in settings.yml: * HTTP status 402 and 403: read the value from settings.yml instead of using the hardcoded value of 1 day. * startpage engine: CAPTCHA suspend the engine for one day instead of one week
2023-01-09[fix] bing: parsing result; check to see if the element contains linksAhmad Alkadri
This patch is to hardening the parsing of the bing response: 1. To fix [2087] check if the selected result item contains a link, otherwise skip result item and continue in the result loop. Increment the result pointer when a result has been added / the enumerate that counts for skipped items is no longer valid when result items are skipped. To test the bugfix use: ``!bi :all cerbot`` 2. Limit the XPath selection of result items to direct children nodes (list items ``li``) of the ordered list (``ol``). To test the selector use: ``!bi :en pontiac aztek wiki`` .. in the result list you should find the wikipedia entry on top, compare [2068] [2087] https://github.com/searxng/searxng/issues/2087 [2068] https://github.com/searxng/searxng/issues/2068
2023-01-08[fix] Bing-Web engine: XPath to get the wikipedia resultahmad-alkadri
Modify the XPath selector to get the wikipedia result plus small fixes. About result content: especially with the Wikipedia result, we'd get several paragraph elements, only the first paragraph would be taken and displayed on the search result
2023-01-06Add HTTP Referer header to DuckDuckGo requestsRudis Muiznieks
closes #2080
2022-12-22Fix: add trailing slash to duckduckgo urlRudis Muiznieks
Close #1854
2022-12-04Fix: don't crash when engine or name is missing in settings.ymlAlexandre Flament
SearXNG crashes if the engine or name fields are missing. With this commit, the app displays an error in the log and keeps loading. Close #1951
2022-11-11Switch back to protobuf for raw HTMLÉmilien Devos
2022-11-11Fix Google search engine.ngosang
- Fix broken links. Resolves #1794 - Fix missing results. Resolves #1829
2022-11-07Merge pull request #1882 from fehho/metacpanAlexandre Flament
Add MetaCPAN engine
2022-11-07Add MetaCPAN enginefehho
2022-10-20Fix floating point format in DDG weather humidityVasilis Gerakaris
Fixes #1836
2022-10-14[fix] startpage engineAlexandre FLAMENT
2022-09-28Merge pull request #1814 from return42/fix-typosAlexandre Flament
[fix] typos / reported by @kianmeng in searx PR-3366
2022-09-28Merge pull request #1810 from return42/fix-1809Alexandre Flament
[fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str'
2022-09-27[fix] typos / reported by @kianmeng in searx PR-3366Markus Heiser
[PR-3366] https://github.com/searx/searx/pull/3366 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-25[fix] doc of the paper.html template (isbn, issn)Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-25[fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str'Markus Heiser
- fix issue reported #1809 - filter out `None` value from issn and isbn list - add comments (from publicationName) - add publisher Closes: https://github.com/searxng/searxng/issues/1809 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24[mod] core.ac.uk: add cetgory 'scientific publications'Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24[mod] core.ac.uk: try multiple ways to get urlAlexandre Flament
If the url is not found, using: * the DOI * the downloadUrl * the ARK id
2022-09-24[mod] core.ac.uk: use paper.html templateMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24[fix] ERROR searx.engines.core.ac.uk: list index out of rangeMarkus Heiser
Some result items from core.ac.uk do not have an URL:: Traceback (most recent call last): File "searx/search/processors/online.py", line 154, in search search_results = self._search_basic(query, params) File "searx/search/processors/online.py", line 142, in _search_basic return self.engine.response(response) File "SearXNG/searx/engines/core.py", line 73, in response 'url': source['urls'][0].replace('http://', 'https://', 1), Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-23[mod] science category: various update of about PR 1705Alexandre Flament
2022-09-23Science category: update the enginesAlexandre FLAMENT
* use the paper.html template * fetch more data from the engines * add crossref.py
2022-09-23Merge pull request #1728 from liimee/eng-ddwAlexandre Flament
add duckduckgo weather engine
2022-09-23Merge pull request #1624 from liimee/eng-wttrAlexandre Flament
Add wttr.in engine
2022-09-21Merge pull request #1792 from unixfox/google-images-internal-apiAlexandre Flament
use the internal API for google images
2022-09-21[mod] google-images: slightly improvements of the engineMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-20use the internal API for google imagesEmilien Devos
2022-09-20[fix] google-news: origin result does not have a content areaMarkus Heiser
The google news are in a rework, the content area of a news item has been removed. Closes: https://github.com/searxng/searxng/issues/1790 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-18[fix] and improve docs generated from source code.Markus Heiser
Fix:: searx/locales.py:docstring of searx.locales.get_engine_locale:17: \ WARNING: Definition list ends without a blank line; unexpected unindent. Improvement: don't show default values in the generated documentation whe it is more a mess than a usefull information (`:meta hide-value:`). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-04xpath engine: change raise_for_httperror to no_result_for_http_statusAlexandre FLAMENT
no_result_for_http_status contains a list of HTTP status. These HTTP status are seen an empty result list. In other cases an exception is thrown as usual. Previously raise_for_httperror were ignoring all HTTP error, which make defective engines invisible in the stats.
2022-09-04[fix] engine woxikon.de - don't raise exception on empty result listMarkus Heiser
Woxikon expects a word in German, so with query "foo" the site finds nothing and respons a 404: httpx.HTTPStatusError: Client error '404 Not Found' \ for url 'https://synonyme.woxikon.de/synonyme/foo.php' [1] https://github.com/searxng/searxng/issues/1543#issuecomment-1193317054 Closes: https://github.com/searxng/searxng/issues/1543 Suggested-by: @allendema [1] Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-02Merge pull request #1647 from return42/deepl-engineMarkus Heiser
[mod] add deepl translation engine
2022-08-31simplify infobox resultta
2022-08-31add duckduckgo weather engineta
2022-08-27Merge pull request #1699 from liimee/eng-app-storeAlexandre Flament
add apple app store engine
2022-08-27Merge pull request #1700 from liimee/eng-ddmAlexandre Flament
add apple maps engine
2022-08-27remove thumbnail from resultsta
2022-08-27add poi's website and phone number, doesn't crash when there is no ↵ta
`displayMapRegion`, query the token on the first request
2022-08-25add apple maps engineta
2022-08-24get the not cropped version of the thumbnail when the image height is not ↵ta
too important
2022-08-24add safesearch supportta
2022-08-24add developer info as authorta
2022-08-24add the apple app store engineta
The Apple App Store is the digital app distribution platform for iOS & iPadOS.
2022-08-24support playing videos directlyta