summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-06-22[themes] ignore packages-lock.jsonAlexandre Flament
2021-06-22Static buildAlexandre Flament
2021-06-22[mod] simple theme: include fontsAlexandre Flament
"npm run webfont" to build the fonts directory. It requires fontforge and ttfautohint distro packages. partial revert of commit 7137d2893f33e9158e8563a21d9586119d175269
2021-06-22[mod] make themes.all update pygments*.lessAlexandre Flament
Add a searx/static/themes/*/src/generated empty folder
2021-06-21[mod] simple theme: normalize.css becomes a packages.json dependencyAlexandre Flament
2021-06-20Merge pull request #158 from return42/fix-node.cleanAlexandre Flament
[fix] node.clean - ignore npm dependencies when npm is not installed
2021-06-19[fix] node.clean - ignore npm dependencies when npm is not installedMarkus Heiser
error pattern:: $ make clean CLEAN pyenv PYENV [virtualenv] drop local/py3 CLEAN docs -- build/docs dist/docs CLEAN locally installed npm dependencies ./manage: line 318: npm: command not found ERROR: node.clean exit with error (127) make: *** [Makefile:90: node.clean] Error 127 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-18Merge pull request #156 from return42/fix-google-newsAlexandre Flament
Fix google news
2021-06-18[fix] google news - send CONSENT Cookie to not be redirectedMarkus Heiser
In the EU there exists a "General Data Protection Regulation" [1] aka GDPR (BTW: very user friendly!) which requires consent to tracking. To get the consent from the user, google-news requests are redirected to confirm and get a CONSENT Cookie from https://consent.google.de/s?continue=... This patch adds a CONSENT Cookie to the google-news request to avoid redirection. The behavior of the CONTENTS cookies over all google engines seems similar but the pattern is not yet fully clear to me, here are some random samples from my analysis .. Using common google search from different domains:: google.com: CONSENT=YES+cb.{{date}}-14-p0.de+FX+816 google.de: CONSENT=YES+cb.{{date}}-14-p0.de+FX+333 google.fr: CONSENT=YES+srp.gws-{{date}}-0-RC2.fr+FX+826 When searching about videos (google-videos):: google.es: CONSENT=YES+srp.gws-{{date}}-0-RC2.es+FX+076 google.de: CONSENT=YES+srp.gws-{{date}}-0-RC2.de+FX+171 Google news has only one domain for all languages:: news.google.com: CONSENT=YES+cb.{{date}}-14-p0.de+FX+816 Using google-scholar search from different domains:: scholar.google.de: CONSENT=YES+cb.{{date}}-14-p0.de+FX+333 scholar.google.fr: does not use such a cookie / did not ask the user scholar.google.es: does not use such a cookie / did not ask the user Interim summary: Pattern is unclear and I won't apply the CONSENT cookie to all google engines. More experience is need before we generalize the CONSENT cookies over all google engines. Related: - e9a6ab401 [fix] youtube - send CONSENT Cookie to not be redirected - https://github.com/benbusby/whoogle-search/issues/311 - https://github.com/benbusby/whoogle-search/issues/243 [1] https://en.wikipedia.org/wiki/General_Data_Protection_Regulation Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-18[fix] google-news engine - KeyError: 'hl in requestMarkus Heiser
Since we added - 1c67b6aec [enh] google engine: supports "default language" there is a KeyError: 'hl in request,error pattern:: ERROR:searx.searx.search.processor.online:engine google news : exception : 'hl' Traceback (most recent call last): File "searx/search/processors/online.py", line 144, in search search_results = self._search_basic(query, params) File "searx/search/processors/online.py", line 118, in _search_basic self.engine.request(query, params) File "searx/engines/google_news.py", line 97, in request if lang_info['hl'] == 'en': KeyError: 'hl' Closes: https://github.com/searxng/searxng/issues/154 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-18Merge pull request #153 from searxng/dependabot/pip/master/sphinx-tabs-3.1.0Markus Heiser
Bump sphinx-tabs from 3.0.0 to 3.1.0
2021-06-18Bump sphinx-tabs from 3.0.0 to 3.1.0dependabot[bot]
Bumps [sphinx-tabs](https://github.com/executablebooks/sphinx-tabs) from 3.0.0 to 3.1.0. - [Release notes](https://github.com/executablebooks/sphinx-tabs/releases) - [Changelog](https://github.com/executablebooks/sphinx-tabs/blob/master/CHANGELOG.md) - [Commits](https://github.com/executablebooks/sphinx-tabs/compare/v3.0.0...v3.1.0) --- updated-dependencies: - dependency-name: sphinx-tabs dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2021-06-17Merge pull request #136 from searxng/issue-115Markus Heiser
/preferences: use simple layout for the oscar theme (Issue 115)
2021-06-17[mod] oscar theme: /preferences : HTML detail order match visual tabsAlexandre Flament
First details about the general tab, then detail about UI tab, etc... No functionnal change
2021-06-17[mod] oscar theme /preferences: reorganize the preferencesAlexandre Flament
close #115
2021-06-17Merge pull request #151 from searxng/mod_oscarAlexandre Flament
make themes: 2 node_modules directories instead of 3
2021-06-17[enh] ./manage node.env - check build tools firstMarkus Heiser
The node.env build environment require npm, ttfautohint and fontforge installed in the OS. These tools can be installed by:: sudo -H ./utils/searx.sh install buildhost If one of the tools is not installed, the script node.env stops with a appropriate message. BTW: We ignore CentOS-7 as developer & build platform Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-16Merge pull request #152 from return42/fix-typoAlexandre Flament
[fix] typo in a searx/settings.yml
2021-06-16[fix] typo in a searx/settings.ymlMarkus Heiser
remove the erroneously leading underline Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-16[mod] make node.clean: call the "clean" script from the packages.jsonAlexandre Flament
The dependencies and build process are described in the gruntfiles.js and packages.json files. It makes sense to move the clean up to these files too.
2021-06-16[mod] remove common grunt installAlexandre Flament
Before this commit, there are 3 node_modules directory: * one in . * two others in ./searx/statics/themes/* This is no desirable: * it declares the npm depdenencies in the shell script. * dependabot can't updates theses dependencies. * this is a not standard way to build a package (two different locations for the dependencies). With this commit and the PR #150 there is one unique node_modules directory per theme.
2021-06-16Merge pull request #149 from return42/doc-install-plgAlexandre Flament
[doc] admin manual - describe installation of external plugins
2021-06-16Static buildAlexandre Flament
2021-06-16[mod] simple theme: remove src/less/ion.lessAlexandre Flament
This file is generated by webfont. * It is now generated as searx/static/themes/simple/ion.less * It is generated before the .less compilation. * .gitignore includes this file Add two new package depedencies: fontforge ttfautohint See utils/searx.sh
2021-06-16[mod] simple theme: autocomplete-js becomes a packages.json dependencyAlexandre Flament
Update to version 2.7.1
2021-06-16[mod] simple theme: leaflet becomes a packages.json dependencyAlexandre Flament
the build of the themes updates: * js/leaflet.js ( was leaflet/leaflet.js ) * css/leaflet.css ( was leaflet/leaflet.css ) * css/images ( was leaflet/images )
2021-06-16[mod] simple theme: move magnet.svg to src/fontsAlexandre Flament
see https://github.com/searx/searx/pull/1109
2021-06-16[mod] simple theme: move source files to the src directoryAlexandre Flament
2021-06-16Static buildAlexandre Flament
2021-06-16[mod] simple theme: update dependenciesAlexandre Flament
2021-06-15[doc] admin manual - describe installation of external pluginsMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-15Merge pull request #146 from return42/ddg-definitionsMarkus Heiser
[pylint] searx/engines/duckduckgo_definitions.py
2021-06-15Merge pull request #148 from return42/fix-yamllintMarkus Heiser
[fix] test.yamllint - fixed typo
2021-06-15[fix] test.yamllint - fixed typoMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-14[pylint] searx/engines/duckduckgo_definitions.pyMarkus Heiser
BTW: normalize indentations Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-14Merge pull request #145 from return42/fix-mortyMarkus Heiser
[fix] utils/morty.sh - PUBLIC_URL_MORTY is based on PUBLIC_URL
2021-06-13[fix] utils/morty.sh - PUBLIC_URL_MORTY is based on PUBLIC_URLMarkus Heiser
The public URL of the searx instance: PUBLIC_URL="https://mydomain.xy/searx" The default is SEARX_URL which is taken from ./utils/brand.env. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-13Merge pull request #139 from return42/refactor-webappMarkus Heiser
[coding-style] searx/webapp.py - normalize indentations
2021-06-13Merge pull request #144 from return42/fix-yamllintAlexandre Flament
[yamllint] ./utils/templates/etc/searx/*.yml
2021-06-12[yamllint] ./utils/templates/etc/searx/*.ymlMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-11Merge pull request #134 from searxng/google-default-languageAlexandre Flament
[enh] google engine: supports "default language"
2021-06-11Merge pull request #143 from return42/emacsMarkus Heiser
[emacs] clean up .dir-locals.el file
2021-06-11[emacs] clean up .dir-locals.el fileMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-11[fix] log messages from: google- images, news, scholar, videosMarkus Heiser
- HTTP header Accept-Language --> lang_info['headers']['Accept-Language'] - remove obsolete query_url log messages which is already logged by httpx._client:HTTP request Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-11[mod] google - get_lang_info add documentataion & commentsMarkus Heiser
BTW: remove obsolete log messages from google engine Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-10[enh] google engine: supports "default language"Alexandre Flament
Same behaviour behaviour than Whoogle [1]. Only the google engine with the "Default language" choice "(all)"" is changed by this patch. When searching for a locate place, the result are in the expect language, without missing results [2]: > When a language is not specified, the language interpretation is left up to > Google to decide how the search results should be delivered. The query parameters are copied from Whoogle. With the ``all`` language: - add parameter ``source=lnt`` - don't use parameter ``lr`` - don't add a ``Accept-Language`` HTTP header. The new signature of function ``get_lang_info()`` is: lang_info = get_lang_info(params, lang_list, custom_aliases, supported_any_language) Argument ``supported_any_language`` is True for google.py and False for the other google engines. With this patch the function now returns: - query parameters: ``lang_info['params']`` - HTTP headers: ``lang_info['headers']`` - and as before this patch: - ``lang_info['subdomain']`` - ``lang_info['country']`` - ``lang_info['language']`` [1] https://github.com/benbusby/whoogle-search [2] https://github.com/benbusby/whoogle-search/releases/tag/v0.5.4
2021-06-10[coding-style] searx/webapp.py - normalize indentationsMarkus Heiser
No functional change! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-10Merge pull request #90 from searxng/enh-osm-engineAlexandre Flament
[enh] improve openstreetmap engine
2021-06-10[static] make themes.all - based on commit 12af3b39Markus Heiser
Based on commit 12af3b39 this patch is generated by:: make themes.all Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-06-10Merge pull request #135 from searxng/refactor-webappAlexandre Flament
Refactor webapp