0
0
mirror of https://github.com/neon-mmd/websurfx.git synced 2024-12-22 20:38:22 -05:00
Commit Graph

294 Commits

Author SHA1 Message Date
Siddharth Tiwari
5b4864424a
perf: Compression for the page responses of the search engine (#472) 2023-12-31 12:57:50 +03:00
ddotthomas
4f4cb220cc fix: changed dereferencing 2023-12-30 22:18:15 -07:00
ddotthomas
286bcf1bd3 fix: added a config parse backup 2023-12-30 22:12:43 -07:00
ddotthomas
bfeb81270c fix: modify cache key with engines used for search 2023-12-30 19:19:22 -07:00
neon_arch
61393ba7c4
Merge branch 'rolling' into FIX/468_pagination-for-the-upstream-search-engines-not-working 2023-12-30 13:17:44 +03:00
neon_arch
7d42c84aaf 🚑️ fix(engine): fix the pagination code for startpage engine (#468) 2023-12-30 13:07:18 +03:00
neon_arch
72da32383e 🚑️ fix(engine): fix the pagination code for searx engine (#468) 2023-12-30 13:06:57 +03:00
neon_arch
2bdddaf928 🚑️ fix(engine): fix the pagination code for librex engine (#468) 2023-12-30 13:06:35 +03:00
neon_arch
0dd25aacb6 🚑️ fix(engine): fix the pagination code for duckduckgo engine (#468) 2023-12-30 13:05:04 +03:00
alamin655
7f84c6346d
Merge branch 'rolling' into CHORE/461_display-the-user-provided-settings-from-the-config-or-the-ui-in-the-settings-page 2023-12-30 12:23:47 +05:30
ddotthomas
d073aa247a
♻️ refactor: start tracking page numbers from 0 instead of 1 in the backend (#467)
Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
2023-12-29 21:20:38 +03:00
Jann Marc Villablanca
9f23a1c70b
feat(engine): mojeek for the search engine (#464)
* 🧑‍💻 fix: add closing curly brace in the nix build step

*  feat: add code to provide search results from `mojeek` engine

---------

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2023-12-29 19:21:06 +03:00
neon_arch
d8943709c7 🚨 chore: make cargo format checks happy (#461) 2023-12-28 21:08:42 +03:00
neon_arch
93afb6b8c9
Merge branch 'rolling' into CHORE/461_display-the-user-provided-settings-from-the-config-or-the-ui-in-the-settings-page 2023-12-28 21:04:21 +03:00
neon_arch
40138572be 🚨 chore: make clippy checks happy (#461) 2023-12-28 20:15:38 +03:00
neon_arch
26aa345f06 🚸 chore: pass the safe_search_level & upstream_search_engines as a hashmap in the settings view function (#461) 2023-12-28 19:58:18 +03:00
neon_arch
b7a23f1826 🚸 chore: add code to display saved settings from the config on the settings page (#461) 2023-12-28 19:54:47 +03:00
maokwen
9f5213cf42
🐛 fix: explicit content-type header for the search page response (#458) 2023-12-28 07:05:21 +03:00
maokwen
43357493d5
🐛 fix: explicit Content-Type header for HTTP response (#457) 2023-12-27 11:24:44 +03:00
alamin655
22d0ff789e
Merge branch 'rolling' into CHORE/432_duckduckgo-engine-code-according-to-the-new-html-changes 2023-12-13 18:55:42 +05:30
neon_arch
582f8aee5b 👽️ chore: update the search result selectors in accordance with the html changes (#432) 2023-12-12 21:57:59 +03:00
neon_arch
b00f76627b
Merge branch 'rolling' into FEAT/424_reduce-animations-effects-support-for-the-themes 2023-12-12 15:24:42 +03:00
neon_arch
19081b72c0 feat: provide a new settings option to change or disable animations (#424) 2023-12-12 15:06:27 +03:00
neon_arch
1a2a833597 feat: pass the new animation config option (#424) 2023-12-12 15:04:44 +03:00
neon_arch
7206e7d6a1 feat: provide a condition based handling to only import the animation when the config option has a value (#424) 2023-12-11 21:17:23 +03:00
neon_arch
76419a7353 feat: provide code to parse the new config option (#424) 2023-12-11 21:10:28 +03:00
neon_arch
1c5a317c4d feat: add a new field animation to the struct style (#424) 2023-12-11 12:27:29 +03:00
alamin655
2c985b8db5
Merge branch 'rolling' into fix-useless-use-of-format! 2023-12-11 09:17:15 +05:30
Diogo Canut
c6ae86dbb4 Fix: useless use of format! (cargo clippy warning) 2023-12-10 21:34:10 -03:00
Diogo Canut
15b0505b96 Provide a more resilient and reliable searx instance 2023-12-10 21:24:17 -03:00
aocosmic
397a805ffd
💄 Improved visual fidelity for the simple theme (#426)
* lazyload search result text with css content-visibility

* typo, lightning-fast is grammatically correct

* revamped logo to look more modern

* added class to control how new logo looks and behaves

* added class to control how new logo looks and behaves

* Replace old websurfx logo in readme file

* major visual revamp

* removed logo files and switched to inline svg

* added `--logo-color` to make svg logo colorscheme adaptive

* Update public/static/themes/simple.css

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* [CodeFactor] Apply fixes

* chores: fix duplicate footer selector and remove unknown pseudo-class

* chores: remove missed  duplicate footer selector

* chores: pass formatter check by deleting empty line at 18

---------

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: alamin655 <mdalamin655@outlook.com>
Co-authored-by: codefactor-io <support@codefactor.io>
2023-12-09 17:34:17 +03:00
alamin655
c02006c297
LibreX for the search engine (#429)
*  feat(engine): provide librex search engine (#318)

*  feat(engine): provide librex search engine (#318)

*  feat(engine): provide librex search engine (#318)

* 🔖 chore(release): bump the app version (#318)

* 🔖 chore(release): bump the app version (#318)

*  feat(engine): provide librex search engine (#318)

*  feat(engine): provide librex search engine (#429)

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

*  feat(engine): provide librex search engine (#429)

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

*  feat(engine): provide librex search engine (#429)

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

*  feat(engine): provide librex search engine (#429)

*  feat(engine): provide librex search engine (#429)

*  feat(engine): provide librex search engine (#429)

*  feat(engine): provide librex search engine (#429)

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

---------

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
2023-12-09 14:25:28 +03:00
Ananth
1143846ca6
💡 Module comment text to better describe the module code (#428)
* better description

* 🔖 chore(release): bump the app version (#428)

* 🔖 chore(release): bump the app version (#428)

---------

Co-authored-by: alamin655 <mdalamin655@outlook.com>
2023-12-08 17:35:22 +03:00
alamin655
b68e06c883
Merge branch 'rolling' into FEAT/314_startpage-for-the-search-engine 2023-12-06 08:11:40 +05:30
neon_arch
e1e426c517 feat(engine): provide startpage search engine (#314) 2023-12-05 20:47:28 +03:00
aocosmic
fb2b6608fe
💄websurfx logo redesign for better understandability (#418)
* lazyload search result text with css content-visibility

* typo, lightning-fast is grammatically correct

* revamped logo to look more modern

* added class to control how new logo looks and behaves

* added class to control how new logo looks and behaves

---------

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
2023-12-05 15:29:44 +03:00
Ashwin Vinod
5a8d61f231
Config option to customize the cache invalidation/expiry time (#403) 2023-11-30 15:09:17 +03:00
Ashwin Vinod
e704c26ed3
♻️ Refactor cache system (#399)
* ♻️ Refactor cache system

* 🐛 Fix cache not getting set

This patch also makes it that cookies are eagerly evaluated. This is
done to figure out the safe search level set by the user. The
performance hit wouldn't be much of a deal as the cookie is a small
json string

* 🔖 chore: bump the app version (#399)

* 🔖 chore: bump the app version (#399)

---------

Co-authored-by: alamin655 <mdalamin655@outlook.com>
2023-11-28 09:17:35 +03:00
aocosmic
90f010359d
📝 typo in footer (#398)
* lazyload search result text with css content-visibility

* typo, lightning-fast is grammatically correct

---------

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
2023-11-27 17:59:41 +03:00
víctor
5e2669b6de
♻️ Clean some code, fix bug (#396)
* ♻️ Improve src/handler

Removes unnecessary submoduling & adjusts some weird code

* ♻️ Cleaner code

* 🐛 Fixed issue where code would overflow if page=0
2023-11-27 09:45:28 +03:00
alamin655
abc59b2858
🧹 chore: make clippy happy (#386) 2023-11-20 21:38:20 +05:30
alamin655
d28cbb96a1
Merge branch 'rolling' into rolling 2023-11-20 21:12:47 +05:30
alamin655
fc830c4683
Update redis_cacher.rs 2023-11-20 21:09:27 +05:30
alamin655
ae9fa5b388
Merge branch 'rolling' into PERF/384_optimize-the-performance-of-fetching-results-in-the-websurfx-search-engine-backend 2023-11-20 21:03:12 +05:30
mergify[bot]
e1a837f6b0
Merge branch 'rolling' into rolling 2023-11-20 15:30:55 +00:00
neon_arch
fe74f2eef7 ♻️ refactor: code to take prebuilt client to request search results (#384) 2023-11-20 15:30:00 +03:00
neon_arch
b42adaa5a3 ️ perf: rewrite the code by using a constant storing a prebuilt client globally for each thread (#384) 2023-11-20 15:27:49 +03:00
S Dheeraj
89542072c8
Updated redis_cacher.rs 2023-11-20 08:53:30 +05:30
S Dheeraj
dc5fa842c0 #385 issue resolved
replaced md5 hashing algorithm with sha-256 hashing algorithm
2023-11-19 22:09:34 +05:30
neon_arch
03d649b97b 🔥 chore: remove the debug macro from the code (#302) 2023-11-18 21:51:21 +03:00
neon_arch
eee2f110b8 🚨 chore: make cargo clippy linter happy (#302) 2023-11-18 21:50:37 +03:00
neon_arch
c39d9ff0b0 ♻️ refactor: rewrite the parsing of the upstream search engines option (#302) 2023-11-18 21:46:36 +03:00
neon_arch
686e26ad6d ⚰️ chore: remove the serialize & deserialize traits on the struct (#302) 2023-11-18 21:43:28 +03:00
neon_arch
5c60d733cd ♻️ refactor: remove the code to pass the query data into the SearchResults struct (#302) 2023-11-18 21:41:08 +03:00
neon_arch
141ae26066 ♻️ refactor: remove the code to add the query & style in the SearchResults struct & also remove the associated fields from the struct (#302) 2023-11-18 21:38:02 +03:00
neon_arch
ca1c72c3dc ♻️ refactor: remove handlebar related code & add the templates module (#302) 2023-11-18 21:27:49 +03:00
neon_arch
c1a5b7086a 💡 chore: add documentation to the code (#302) 2023-11-18 21:23:22 +03:00
neon_arch
38ba4bd6cb ♻️ refactor(routes): serve the new maud file for search page and remove unwanted functions and pass values to the maud html template directly (#302) 2023-11-17 22:16:17 +03:00
neon_arch
64c4d2c23a ♻️ refactor(routes): serve new the maud files instead of handlebars files (#302) 2023-11-17 22:12:25 +03:00
neon_arch
0ec89146c8 ♻️ refactor(maud): rewrite the frontend code with maud html framework (#302) 2023-11-17 22:10:06 +03:00
neon_arch
3742893c19 ♻️ refactor: reimplement the random delay code without the rand crate (#380) 2023-11-08 19:09:50 +03:00
jkaczmarkiewicz
27bc52c008
Brave for the search engine (#335)
* feat: implement brave engine

* refactor: correct indentations in stylelint config

* docs: add dummy config option to config.lua

* feat: implement safe_search_level in brave engine

* refactor: move var to format

* fix: make strict search above level 1
2023-10-16 20:25:15 +03:00
Aditya Phasu
fc3b416970
🔧 remove unnecessary clone call (#333) 2023-10-15 01:07:59 +03:00
Uday Sagar
405d00612f
🔧 Restricts the visibility of the user-agent helper module (#331) 2023-10-14 22:14:28 +03:00
Zsombor Gegesy
f56002dca6 Rename the error to NoSuchEngineFound and add the name of missing engine to it 2023-10-08 22:30:42 +02:00
Zsombor Gegesy
8ed4c9e206 Propagate errors upward, if an engine can't be initialized 2023-10-07 10:31:58 +02:00
Zsombor Gegesy
32abacb4c3 Fix missing doc errors 2023-10-07 00:33:44 +02:00
Zsombor Gegesy
57c73d38c8 Refactor the search result parsing 2023-10-07 00:33:44 +02:00
Zsombor Gegesy
75a77d25f0 Create separate search_result_parser 2023-10-07 00:33:44 +02:00
neon_arch
3d489208db 🧹 chore: make github actions happy (#227) 2023-09-23 15:03:48 +03:00
alamin655
017036ed00
Merge branch 'rolling' into feat-inform-user-when-no-engines-are-selected 2023-09-23 17:12:58 +05:30
neon_arch
173c6ba821 feat: add code to handle aggregation when no engines are selected (#227) 2023-09-23 12:50:36 +03:00
neon_arch
b428cedd7a feat: add new check value for no engine selected (#227) 2023-09-23 12:48:01 +03:00
neon_arch
72fec47892 feat: implement code to fetch results based on parameters, cookies & config (#210) 2023-09-22 19:54:26 +03:00
neon_arch
d2e482251e feat: add the safe search field in the Cookie struct (#210) 2023-09-22 19:53:34 +03:00
neon_arch
5c8cbee5d9 feat: implement code to pass safe search option in the json results (#210) 2023-09-22 19:51:10 +03:00
neon_arch
d33129c4c9 🧹 chore: make clippy happy (#244) 2023-09-17 19:56:48 +03:00
neon_arch
fcfd112e59 🛠️ fix: improve the documentation & move code in the correct files (#244) 2023-09-17 12:51:32 +03:00
neon_arch
8c239e2313 🛠️ fix: make the redis_url option only available on redis-cache feature (#244) 2023-09-17 12:50:25 +03:00
neon_arch
578c7bcf77 🛠️ fix: improve the documentation for the code (#244) 2023-09-17 12:48:11 +03:00
neon_arch
03384d4e04 🛠️ fix: implement hybrid caching and improve documentation (#244) 2023-09-17 12:47:02 +03:00
Zsombor Gegesy
e69126c5ea Fix git rebase problems, and the failing doctest 2023-09-15 23:25:17 +02:00
Zsombor Gegesy
1e7805cf42 Rename features, make the memory-cache the default 2023-09-15 23:21:19 +02:00
Zsombor Gegesy
76795c43cc Make the cache types compile time feature flags too, and make it more configurable! 2023-09-15 23:21:19 +02:00
Zsombor Gegesy
320f5f4720 Remove unnecessary clones 2023-09-15 23:21:19 +02:00
Zsombor Gegesy
519ebe0fd8 Instead of caching jsons, we can cache the original structure 2023-09-15 23:21:19 +02:00
Zsombor Gegesy
996ff84c5b Cache refactor - add an in-memory cache, so redis is not needed 2023-09-15 23:21:19 +02:00
neon_arch
ca4447fcdf Merge branch 'rolling' into reorganize-code-and-restructure-the-codebase 2023-09-13 18:31:37 +03:00
neon_arch
c60fdb8366 🧹 chore: make github actions happy (#205) 2023-09-12 18:53:32 +03:00
neon_arch
1a222217c4 🧹 chore: make github actions happy (#205) 2023-09-12 17:59:33 +03:00
neon_arch
fb231de416
Merge branch 'rolling' into change-document-style-with-linter-warnings 2023-09-12 17:49:46 +03:00
neon_arch
b9d651c378 🧹 chore: make github actions happy (#203) 2023-09-11 20:16:42 +03:00
alamin655
8e56ac8ba2
Update parser.rs 2023-09-11 12:05:13 +05:30
alamin655
0132a63e6f
Apply suggestions from code review 2023-09-11 11:58:31 +05:30
alamin655
3c1aaf63f8
Update src/config/parser.rs 2023-09-11 11:56:12 +05:30
alamin655
531611f077
Update src/config/parser.rs 2023-09-11 11:54:21 +05:30
alamin655
70a5a2463b
Update src/config/parser.rs 2023-09-11 11:46:56 +05:30
alamin655
2790eefba8
Merge branch 'rolling' into feat-rate-limiter-for-websurfx 2023-09-11 11:40:10 +05:30
neon_arch
12bfc5276a 🧹 chore: make clippy happy (#201) 2023-09-10 18:56:54 +03:00
neon_arch
ac4e29a93f 🧹 chore: make github actions happy (#201) 2023-09-10 18:41:24 +03:00