summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2021-07-13[fix] drop engine dogpileMarkus Heiser
The engine was added in commit a4b07460 but now it shows new issues [1]. In the 90'th of the last century, dogpile had its own WEB index, but nowadays it is a meta-search engine [2] Powered by technology, Dogpile returns all the best results from leading search engines including Google and Yahoo! Using dogpile as an engine in SearXNG needs more investigation, a XPath solution like we have is not enough. It is questionable whether it still makes sense to investigate more into a meta-search engine with a ReCAPTCHA in front. With this patch the dogpile engine is removed [1] https://github.com/searxng/searxng/issues/202 [2] https://www.dogpile.com/support/aboutus Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-07-11[drop] engine torrentz: torrentz2.eu and torrentz2.is are offlineMarkus Heiser
[1] https://torrentfreak.com/torrentz2-eu-domain-suspended-by-registry-on-public-prosecutors-order-200628/ Suggested-by: @rasos https://github.com/searx/searx/issues/1875#issuecomment-877755872 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-07-10Fix google imagesÉmilien Devos
Proposed fix in https://github.com/searx/searx/pull/2115#issuecomment-876716010
2021-07-03[enh] add gpodder.net (JSON)Allen
Engine just for Podcasts. An API which returns Podcasts and their Info like: website, author etc. Upstream query example: https://gpodder.net/search.json?q=linux
2021-07-03[yamllint] fix some warning issues reported by yamllintMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-07-03[enh] add woxikon.de synonyme (Xpath)Allen
Added synonyme.woxikon.de using the xpath engine. Adds a site which returns word synonyms although just in German. Depending on the query not all synonyms are shown because of not the best xpath selection. But should do the job just fine. Upstream example query: https://synonyme.woxikon.de/synonyme/test.php
2021-07-03Merge pull request #196 from return42/fix-braveMarkus Heiser
[fix] brave engine: shows descriptions with their correct URLs
2021-07-03[fix] brave engine: shows descriptions with their correct URLsMarkus Heiser
BTW add about section to the YAML configuration It now shows descriptions with their correct URLs when there are videos in the search results, pulling content_xpath from snippet-description instead of snippet-content. Suggested-by: @eagle-dogtooth https://github.com/searx/searx/issues/2857#issuecomment-869119968 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-07-03Merge pull request #178 from return42/whaleslide.comMarkus Heiser
[enh] Add WhaleSlide engine (JSON)
2021-07-03[pylint] prepare for pylint v2.9.3 / fix some (new) pylint issuesMarkus Heiser
Upgrade from pylint v2.8.3 to 2.9.3 raise some new issues:: searx/search/checker/__main__.py:37:26: R1732: Consider using 'with' for resource-allocating operations (consider-using-with) searx/search/checker/__main__.py:38:26: R1732: Consider using 'with' for resource-allocating operations (consider-using-with) searx/search/processors/__init__.py:20:0: R0402: Use 'from searx import engines' instead (consider-using-from-import) searx/preferences.py:182:19: C0207: Use data.split('-', maxsplit=1)[0] instead (use-maxsplit-arg) searx/preferences.py:506:15: R1733: Unnecessary dictionary index lookup, use 'user_setting' instead (unnecessary-dict-index-lookup) searx/webapp.py:436:0: C0206: Consider iterating with .items() (consider-using-dict-items) searx/webapp.py:950:4: C0206: Consider iterating with .items() (consider-using-dict-items) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-07-01Merge pull request #185 from searxng/update_data_update_external_bangs.pyAlexandre Flament
Update searx.data - update_external_bangs.py
2021-07-01Merge pull request #186 from searxng/update_data_update_wikidata_units.pyAlexandre Flament
Update searx.data - update_wikidata_units.py
2021-07-01Merge pull request #187 from searxng/update_data_update_ahmia_blacklist.pyAlexandre Flament
Update searx.data - update_ahmia_blacklist.py
2021-07-01Update searx.data - update_ahmia_blacklist.pydalf
2021-07-01Update searx.data - update_firefox_version.pydalf
2021-07-01Update searx.data - update_wikidata_units.pydalf
2021-07-01Update searx.data - update_external_bangs.pydalf
2021-06-28Merge pull request #174 from searxng/static_scriptAlexandre Flament
[mod] add make targets to manage the build files in the /searx/static directory
2021-06-28[build] /staticAlexandre Flament
2021-06-28[mod] themes: remove banner generated by gruntMarkus Heiser
The banner is useless and responsible for unwanted diff. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-28Merge pull request #179 from return42/braveAlexandre Flament
[enh] add Brave-Search engine (XPath)
2021-06-26[fix] decoding of saved preferences in the URLMarkus Heiser
To compress saved preferences in the URL was introduced in 5f758b2d3 and slightly fixed in 8f4401462. But the main fail was not fixed; The decompress function returns a binary string and this binary should first be decoded to a string before it is passed to urllib.parse_qs. BTW: revert the hot-fix from 5973491 Related-to: https://github.com/searxng/searxng/issues/166 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-26[enh] add Brave-Search engine (XPath)Markus Heiser
Add https://search.brave.com which was requested by @kaonashi696 [1]. This patch was suggested by @eagle-dogtooth [2]. [1] https://github.com/searx/searx/issues/2857 [2] https://github.com/searx/searx/issues/2857#issuecomment-867199241 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-26[enh] Add WhaleSlide engine (JSON)Allen
Add WhaleSlide engine [1] / merged from [2] [1] https://whaleslide.com [2] https://github.com/searx/searx/pull/2861
2021-06-26Set use_mobile_ui to false for Google engineÉmilien Devos
2021-06-24[emacs] .dir-locals.el: add setup for js-modeMarkus Heiser
- move jshint option from gruntfile to .jshintrc - remove trailing-whitespace from gruntfile and - add jshint esversion: 6 - .dir-locals.el add locals for js-mode to use JSHint from the simple theme Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-24[stylelint] disable role 'no-descending-specificity'Markus Heiser
This patch disables role 'no-descending-specificity'. IMO it is better to have this rule active (see below [1]), but it is hard to rewrite the less files to pass this rule, so for the first I chose to disable this rule. --- Source order is important in CSS, and when two selectors have the same specificity, the one that occurs last will take priority. However, the situation is different when one of the selectors has a higher specificity. In that case, source order does not matter: the selector with higher specificity will win out even if it comes first. The clashes of these two mechanisms for prioritization, source order and specificity, can cause some confusion when reading stylesheets. If a selector with higher specificity comes before the selector it overrides, we have to think harder to understand it, because it violates the source order expectation. Stylesheets are most legible when overriding selectors always come after the selectors they override. That way both mechanisms, source order and specificity, work together nicely. This rule enforces that practice as best it can, reporting fewer errors than it should. It cannot catch every actual overriding selector, but it can catch certain common mistakes. [1] https://stylelint.io/user-guide/rules/list/no-descending-specificity/ Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-24[stylelint] simple theme: fix some errors reported by stylelintMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-24[fix] simple theme: use stylint to fix common lint errorsMarkus Heiser
This fix was autogenerated by:: npx stylelint -f unix --fix 'searx/static/themes/simple/src/less/**/*.less' Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-24[mod] add stylelint process to target themes.simpleMarkus Heiser
Before build, do lint the LESS files using stylelint [1]. The configuration 'stylelint-config-standard' [2] is added to the root of the simple theme [3]. [1] https://stylelint.io/ [2] https://github.com/stylelint/stylelint-config-standard [3] https://stylelint.io/user-guide/configure Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-22Merge pull request #157 from searxng/mod_static_buildAlexandre Flament
static build: move generated files to searx/static/themes/*/src/generated
2021-06-22[themes] ignore packages-lock.jsonAlexandre Flament
2021-06-22Static buildAlexandre Flament
2021-06-22[mod] simple theme: include fontsAlexandre Flament
"npm run webfont" to build the fonts directory. It requires fontforge and ttfautohint distro packages. partial revert of commit 7137d2893f33e9158e8563a21d9586119d175269
2021-06-22[mod] make themes.all update pygments*.lessAlexandre Flament
Add a searx/static/themes/*/src/generated empty folder
2021-06-22[fix] UnicodeEncodeError for preferences ULRMarkus Heiser
Closes: https://github.com/searxng/searxng/issues/166 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-21[docs] add documentation from the sources of the google enginesMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-21[fix] google answers: normalize space of the answers.Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-21[mod] google engine: reduce mobile UI parameters to what is neededMarkus Heiser
Reverse engineering shows that not all of the parameters used by google's mobile UI (aka "more results" button) are needed [1]. [1] https://github.com/searxng/searxng/pull/160#issuecomment-865013625 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-21[mod] google: add "use_mobile_ui" parameter to use mobile endpoint.Alexandre Flament
disable by default, it has to be enabled in settings.yml related to #159
2021-06-21[mod] simple theme: normalize.css becomes a packages.json dependencyAlexandre Flament
2021-06-18[fix] google news - send CONSENT Cookie to not be redirectedMarkus Heiser
In the EU there exists a "General Data Protection Regulation" [1] aka GDPR (BTW: very user friendly!) which requires consent to tracking. To get the consent from the user, google-news requests are redirected to confirm and get a CONSENT Cookie from https://consent.google.de/s?continue=... This patch adds a CONSENT Cookie to the google-news request to avoid redirection. The behavior of the CONTENTS cookies over all google engines seems similar but the pattern is not yet fully clear to me, here are some random samples from my analysis .. Using common google search from different domains:: google.com: CONSENT=YES+cb.{{date}}-14-p0.de+FX+816 google.de: CONSENT=YES+cb.{{date}}-14-p0.de+FX+333 google.fr: CONSENT=YES+srp.gws-{{date}}-0-RC2.fr+FX+826 When searching about videos (google-videos):: google.es: CONSENT=YES+srp.gws-{{date}}-0-RC2.es+FX+076 google.de: CONSENT=YES+srp.gws-{{date}}-0-RC2.de+FX+171 Google news has only one domain for all languages:: news.google.com: CONSENT=YES+cb.{{date}}-14-p0.de+FX+816 Using google-scholar search from different domains:: scholar.google.de: CONSENT=YES+cb.{{date}}-14-p0.de+FX+333 scholar.google.fr: does not use such a cookie / did not ask the user scholar.google.es: does not use such a cookie / did not ask the user Interim summary: Pattern is unclear and I won't apply the CONSENT cookie to all google engines. More experience is need before we generalize the CONSENT cookies over all google engines. Related: - e9a6ab401 [fix] youtube - send CONSENT Cookie to not be redirected - https://github.com/benbusby/whoogle-search/issues/311 - https://github.com/benbusby/whoogle-search/issues/243 [1] https://en.wikipedia.org/wiki/General_Data_Protection_Regulation Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-18[fix] google-news engine - KeyError: 'hl in requestMarkus Heiser
Since we added - 1c67b6aec [enh] google engine: supports "default language" there is a KeyError: 'hl in request,error pattern:: ERROR:searx.searx.search.processor.online:engine google news : exception : 'hl' Traceback (most recent call last): File "searx/search/processors/online.py", line 144, in search search_results = self._search_basic(query, params) File "searx/search/processors/online.py", line 118, in _search_basic self.engine.request(query, params) File "searx/engines/google_news.py", line 97, in request if lang_info['hl'] == 'en': KeyError: 'hl' Closes: https://github.com/searxng/searxng/issues/154 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-17[mod] oscar theme: /preferences : HTML detail order match visual tabsAlexandre Flament
First details about the general tab, then detail about UI tab, etc... No functionnal change
2021-06-17[mod] oscar theme /preferences: reorganize the preferencesAlexandre Flament
close #115
2021-06-17Merge pull request #151 from searxng/mod_oscarAlexandre Flament
make themes: 2 node_modules directories instead of 3
2021-06-16[fix] typo in a searx/settings.ymlMarkus Heiser
remove the erroneously leading underline Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-16[mod] make node.clean: call the "clean" script from the packages.jsonAlexandre Flament
The dependencies and build process are described in the gruntfiles.js and packages.json files. It makes sense to move the clean up to these files too.
2021-06-16[mod] remove common grunt installAlexandre Flament
Before this commit, there are 3 node_modules directory: * one in . * two others in ./searx/statics/themes/* This is no desirable: * it declares the npm depdenencies in the shell script. * dependabot can't updates theses dependencies. * this is a not standard way to build a package (two different locations for the dependencies). With this commit and the PR #150 there is one unique node_modules directory per theme.
2021-06-16Static buildAlexandre Flament
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-17 06:57:23 +0000