0
0
mirror of https://github.com/neon-mmd/websurfx.git synced 2024-11-26 15:58:21 -05:00
Commit Graph

208 Commits

Author SHA1 Message Date
Ashwin Vinod
5a8d61f231
Config option to customize the cache invalidation/expiry time (#403) 2023-11-30 15:09:17 +03:00
Ashwin Vinod
e704c26ed3
♻️ Refactor cache system (#399)
* ♻️ Refactor cache system

* 🐛 Fix cache not getting set

This patch also makes it that cookies are eagerly evaluated. This is
done to figure out the safe search level set by the user. The
performance hit wouldn't be much of a deal as the cookie is a small
json string

* 🔖 chore: bump the app version (#399)

* 🔖 chore: bump the app version (#399)

---------

Co-authored-by: alamin655 <mdalamin655@outlook.com>
2023-11-28 09:17:35 +03:00
aocosmic
90f010359d
📝 typo in footer (#398)
* lazyload search result text with css content-visibility

* typo, lightning-fast is grammatically correct

---------

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
2023-11-27 17:59:41 +03:00
víctor
5e2669b6de
♻️ Clean some code, fix bug (#396)
* ♻️ Improve src/handler

Removes unnecessary submoduling & adjusts some weird code

* ♻️ Cleaner code

* 🐛 Fixed issue where code would overflow if page=0
2023-11-27 09:45:28 +03:00
alamin655
abc59b2858
🧹 chore: make clippy happy (#386) 2023-11-20 21:38:20 +05:30
alamin655
d28cbb96a1
Merge branch 'rolling' into rolling 2023-11-20 21:12:47 +05:30
alamin655
fc830c4683
Update redis_cacher.rs 2023-11-20 21:09:27 +05:30
alamin655
ae9fa5b388
Merge branch 'rolling' into PERF/384_optimize-the-performance-of-fetching-results-in-the-websurfx-search-engine-backend 2023-11-20 21:03:12 +05:30
mergify[bot]
e1a837f6b0
Merge branch 'rolling' into rolling 2023-11-20 15:30:55 +00:00
neon_arch
fe74f2eef7 ♻️ refactor: code to take prebuilt client to request search results (#384) 2023-11-20 15:30:00 +03:00
neon_arch
b42adaa5a3 ️ perf: rewrite the code by using a constant storing a prebuilt client globally for each thread (#384) 2023-11-20 15:27:49 +03:00
S Dheeraj
89542072c8
Updated redis_cacher.rs 2023-11-20 08:53:30 +05:30
S Dheeraj
dc5fa842c0 #385 issue resolved
replaced md5 hashing algorithm with sha-256 hashing algorithm
2023-11-19 22:09:34 +05:30
neon_arch
03d649b97b 🔥 chore: remove the debug macro from the code (#302) 2023-11-18 21:51:21 +03:00
neon_arch
eee2f110b8 🚨 chore: make cargo clippy linter happy (#302) 2023-11-18 21:50:37 +03:00
neon_arch
c39d9ff0b0 ♻️ refactor: rewrite the parsing of the upstream search engines option (#302) 2023-11-18 21:46:36 +03:00
neon_arch
686e26ad6d ⚰️ chore: remove the serialize & deserialize traits on the struct (#302) 2023-11-18 21:43:28 +03:00
neon_arch
5c60d733cd ♻️ refactor: remove the code to pass the query data into the SearchResults struct (#302) 2023-11-18 21:41:08 +03:00
neon_arch
141ae26066 ♻️ refactor: remove the code to add the query & style in the SearchResults struct & also remove the associated fields from the struct (#302) 2023-11-18 21:38:02 +03:00
neon_arch
ca1c72c3dc ♻️ refactor: remove handlebar related code & add the templates module (#302) 2023-11-18 21:27:49 +03:00
neon_arch
c1a5b7086a 💡 chore: add documentation to the code (#302) 2023-11-18 21:23:22 +03:00
neon_arch
38ba4bd6cb ♻️ refactor(routes): serve the new maud file for search page and remove unwanted functions and pass values to the maud html template directly (#302) 2023-11-17 22:16:17 +03:00
neon_arch
64c4d2c23a ♻️ refactor(routes): serve new the maud files instead of handlebars files (#302) 2023-11-17 22:12:25 +03:00
neon_arch
0ec89146c8 ♻️ refactor(maud): rewrite the frontend code with maud html framework (#302) 2023-11-17 22:10:06 +03:00
neon_arch
3742893c19 ♻️ refactor: reimplement the random delay code without the rand crate (#380) 2023-11-08 19:09:50 +03:00
jkaczmarkiewicz
27bc52c008
Brave for the search engine (#335)
* feat: implement brave engine

* refactor: correct indentations in stylelint config

* docs: add dummy config option to config.lua

* feat: implement safe_search_level in brave engine

* refactor: move var to format

* fix: make strict search above level 1
2023-10-16 20:25:15 +03:00
Aditya Phasu
fc3b416970
🔧 remove unnecessary clone call (#333) 2023-10-15 01:07:59 +03:00
Uday Sagar
405d00612f
🔧 Restricts the visibility of the user-agent helper module (#331) 2023-10-14 22:14:28 +03:00
Zsombor Gegesy
f56002dca6 Rename the error to NoSuchEngineFound and add the name of missing engine to it 2023-10-08 22:30:42 +02:00
Zsombor Gegesy
8ed4c9e206 Propagate errors upward, if an engine can't be initialized 2023-10-07 10:31:58 +02:00
Zsombor Gegesy
32abacb4c3 Fix missing doc errors 2023-10-07 00:33:44 +02:00
Zsombor Gegesy
57c73d38c8 Refactor the search result parsing 2023-10-07 00:33:44 +02:00
Zsombor Gegesy
75a77d25f0 Create separate search_result_parser 2023-10-07 00:33:44 +02:00
neon_arch
3d489208db 🧹 chore: make github actions happy (#227) 2023-09-23 15:03:48 +03:00
alamin655
017036ed00
Merge branch 'rolling' into feat-inform-user-when-no-engines-are-selected 2023-09-23 17:12:58 +05:30
neon_arch
173c6ba821 feat: add code to handle aggregation when no engines are selected (#227) 2023-09-23 12:50:36 +03:00
neon_arch
b428cedd7a feat: add new check value for no engine selected (#227) 2023-09-23 12:48:01 +03:00
neon_arch
72fec47892 feat: implement code to fetch results based on parameters, cookies & config (#210) 2023-09-22 19:54:26 +03:00
neon_arch
d2e482251e feat: add the safe search field in the Cookie struct (#210) 2023-09-22 19:53:34 +03:00
neon_arch
5c8cbee5d9 feat: implement code to pass safe search option in the json results (#210) 2023-09-22 19:51:10 +03:00
neon_arch
d33129c4c9 🧹 chore: make clippy happy (#244) 2023-09-17 19:56:48 +03:00
neon_arch
fcfd112e59 🛠️ fix: improve the documentation & move code in the correct files (#244) 2023-09-17 12:51:32 +03:00
neon_arch
8c239e2313 🛠️ fix: make the redis_url option only available on redis-cache feature (#244) 2023-09-17 12:50:25 +03:00
neon_arch
578c7bcf77 🛠️ fix: improve the documentation for the code (#244) 2023-09-17 12:48:11 +03:00
neon_arch
03384d4e04 🛠️ fix: implement hybrid caching and improve documentation (#244) 2023-09-17 12:47:02 +03:00
Zsombor Gegesy
e69126c5ea Fix git rebase problems, and the failing doctest 2023-09-15 23:25:17 +02:00
Zsombor Gegesy
1e7805cf42 Rename features, make the memory-cache the default 2023-09-15 23:21:19 +02:00
Zsombor Gegesy
76795c43cc Make the cache types compile time feature flags too, and make it more configurable! 2023-09-15 23:21:19 +02:00
Zsombor Gegesy
320f5f4720 Remove unnecessary clones 2023-09-15 23:21:19 +02:00
Zsombor Gegesy
519ebe0fd8 Instead of caching jsons, we can cache the original structure 2023-09-15 23:21:19 +02:00