summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2020-11-14[refactor] deviantart - improve results and clean up source codeMarkus Heiser
Devian's request and response forms has been changed. - fixed title - fixed time_range_dict to 'popular-*-***' - use image from <noscript> if exists - drop obsolete "http to https, remove domain sharding" - use query URL https://www.deviantart.com/search/deviations?page=5&q=foo - add searx/engines/deviantart.py to pylint check (test.pylint) Error pattern:: There DEBUG:searx:result: invalid title: {'url': 'https://www.deviantart.com/ ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-11-14[mod] remove unused importAlexandre Flament
use from searx.engines.duckduckgo import _fetch_supported_languages, supported_languages_url # NOQA so it is possible to easily remove all unused import using autoflake: autoflake --in-place --recursive --remove-all-unused-imports searx tests
2020-11-14Merge pull request #2292 from kvch/elasticsearch-engineAlexandre Flament
New engine: Elasticsearch
2020-11-14Merge pull request #2289 from dalf/pylintAlexandre Flament
[mod] pylint: add extension-pkg-whitelist=lxml.etree
2020-11-10New engine: ElasticsearchNoémi Ványi
2020-11-03[mod] pylint: minor code change to allow pylint globallyAlexandre Flament
This commit is only a step, it doesn't fix all the issues reported by pylint
2020-11-03[fix] comamnd engine: fix importAlexandre Flament
2020-11-03[fix] scanr_structure engine: fix importAlexandre Flament
2020-10-28[mod] wikidata engine: use one SPARQL request instead of 2 HTTP requests.Alexandre Flament
2020-10-28[mod] duckduckgo_definitions: display only user friendly attributes / URLAlexandre Flament
various bug fixes
2020-10-25[enh] Add onions category with Ahmia, Not Evil and Torcha01200356
Xpath engine and results template changed to account for the fact that archive.org doesn't cache .onions, though some onion engines migth have their own cache. Disabled by default. Can be enabled by setting the SOCKS proxies to wherever Tor is listening and setting using_tor_proxy as True. Requires Tor and updating packages. To avoid manually adding the timeout on each engine, you can set extra_proxy_timeout to account for Tor's (or whatever proxy used) extra time.
2020-10-25Open Semantic Search EngineNicholas Kegler
2020-10-09Propagate error messages from YouTube APINoémi Ványi
2020-10-09Merge pull request #2255 from kvch/yacy-improvementsAdam Tauber
Add yacy improvements: HTTP digest auth, category checking
2020-10-09[fix] fix duckduckgo engineAlexandre Flament
- remove paging support: a "vqd" parameter is required between each request. This parameter is uniq for each request - update the URL (no redirect), use the POST method - language support: works if there is no more than request per minute, otherwise it is ignored !
2020-10-09Add yacy improvements: HTTP digest auth, category checkingNoémi Ványi
2020-10-08add ebay enginte to shopping categoryNoémi Ványi
2020-10-07[mod] Add searx.data moduleAlexandre Flament
Instead of loading the data/*.json in different location, load these files in the new searx.data module.
2020-10-06[fix] drop Python 2: use collections.abc.Iterable instead of ↵Alexandre Flament
collections.Iterable
2020-10-04Merge pull request #2241 from dalf/move-extract-text-and-urlAlexandre Flament
Move the extract_text and extract_url functions to searx.utils
2020-10-03[enh] Add SepiaSearch engine (#2227)Finn
supported_languages values: see https://framagit.org/framasoft/peertube/search-index/-/blob/master/client/src/views/Search.vue#L618-641
2020-10-02[mod] move extract_text, extract_url to searx.utilsAlexandre Flament
2020-10-01[fix] google engine - div classes has been renamed in HTML reultMarkus Heiser
Since 1. October 2020 google has changed the 'class' attribute of the HTML result page. Fix the xpath expressions and ignore <div class="g" ../> sections which do not match to title's xpath expression. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-09-28[fix] migration from github.com/asciimoo/searx to github.com/searx/searx : ↵Alexandre Flament
fix URLs
2020-09-22fetch google's search langs rather than ui langsMarc Abonce Seguin
2020-09-22fetch supported languages for startpage engineMarc Abonce Seguin
2020-09-22add language names in qwant's fetch languages functionMarc Abonce Seguin
2020-09-10Drop Python 2 (4/n): SearchQuery.query is a str instead of bytesDalf
2020-09-10Drop Python 2 (1/n): remove unicode string and url_utilsDalf
2020-09-10use Wikipedia's REST v1 APIMarc Abonce Seguin
2020-09-08[enh] Add command line engines: git grep, find, etc. (#2128)Noémi Ványi
A new "base" engine called command is introduced. It is the foundation for all command line engines for now. You can use this engine to create your own command line engine. Add some engines (commented out to make sure no one enables anything accidentally): * git grep: This engine lets you grep in the searx repo. * locate: If locate is installed and initialized, you can search on the FS. * find: You can find files with a specific name from where you started searx. * pattern search in files: This engine utilizes the command fgrep. * regex search in files: This engine runs `grep` to find a file based on its contents.
2020-09-07[enh] stop searx when an engine raise an SyntaxError exception (#2177)Alexandre Flament
and some other exceptions: * KeyboardInterrupt * SystemExit * RuntimeError * SystemError * ImportError: an engine with an unmet dependency will stop everything.
2020-08-31Revert "[enh] test: load each engine to check for syntax errors"Alexandre Flament
This reverts commit 4fb3ed2c6335b68f6b28ebc68d5d22f2fd621648.
2020-08-31Merge pull request #2160 from dalf/test_load_engineAdam Tauber
[enh] test: load each engine to check for syntax errors
2020-08-31[fix] skip uncomplete image results - closes #1496Adam Tauber
2020-08-28[enh] test: load each engine to check for syntax errorsDalf
2020-08-27only return one url per "type" in Wikidata (#2151)Marc Abonce Seguin
i.e. only one official website, one Twitter, etc.
2020-08-18[enh] add yggtorrent engine (#2135)Émilien Devos
2020-08-10[fix] piratebay engine date and pep8 indentationEmilien Devos
2020-08-10[fix] piratebay engineEmilien Devos
2020-08-10Merge pull request #2116 from mikeri/invidiousresAdam Tauber
Include author and video length in Invidious results
2020-08-08Fix google images 'get image' button bug from issue #2103 (#2115)Vlad
Closes #2103
2020-08-08add peertube engine (#2109)Michael Ilsaas
2020-08-02include length in invidious resultsMichael Ilsaas
2020-08-02include author in invidious resultsMichael Ilsaas
2020-07-26fix Wikipedia's paragraph extractionMarc Abonce Seguin
2020-07-26Update torrentz2 URL from .eu to .isMichael Ilsaas
2020-07-23Fix relative urls that do not start with '/'xywei
2020-07-12fix python 3 supportGaspard d'Hautefeuille
2020-07-08[fix] pep8Adam Tauber