0
0
mirror of https://github.com/neon-mmd/websurfx.git synced 2024-11-25 07:28:22 -05:00
Commit Graph

137 Commits

Author SHA1 Message Date
neon_arch
12bfc5276a 🧹 chore: make clippy happy (#201) 2023-09-10 18:56:54 +03:00
neon_arch
ac4e29a93f 🧹 chore: make github actions happy (#201) 2023-09-10 18:41:24 +03:00
alamin655
60b2fcc27a
Merge branch 'rolling' into feat-disallow-user-to-search-via-lists 2023-09-10 20:51:10 +05:30
neon_arch
82a78e3b42
Merge branch 'rolling' into optimize-and-make-code-idiomatic 2023-09-10 18:11:12 +03:00
neon_arch
8dfe2e1b2d
Merge branch 'rolling' into optimize-and-make-code-idiomatic-3 2023-09-10 17:58:28 +03:00
neon_arch
3f73e85455 🧹 chore: make rustfmt happy (#201) 2023-09-02 19:07:23 +03:00
neon_arch
05c3e6cc12 feat: implement new search parameter safe_search & code to disallow
users when safe_search is set to 4 (#201)
2023-09-02 17:50:06 +03:00
neon_arch
410257c276 feat: implement new fields, traits and functions (#201) 2023-09-02 17:48:27 +03:00
neon_arch
f4c496c02c feat: implement default trait for style struct (#201) 2023-09-02 17:46:32 +03:00
neon_arch
cbad560139 feat: pass new safe search option in the results function in the
trait (#201)
2023-09-02 17:45:17 +03:00
neon_arch
6fa45ecb12 feat: pass the config option into the results function (#201) 2023-09-02 17:44:05 +03:00
neon_arch
37e650eb8a feat: add code to parse the new config option (#201) 2023-09-02 17:42:55 +03:00
neon_arch
d6463f0872 feat: add condition to filter results only when safe_search level is
set to 3 or above (#201)
2023-09-02 17:38:46 +03:00
neon_arch
a799af3125 🧹 chore: add fixes to code & make rustfmt & clippy happy (#180)(#178) 2023-08-30 18:09:58 +03:00
neon_arch
4c298ce18c ⚙️ refactor: add code to initialize redis cache struct only once (#180)(#178) 2023-08-29 20:15:06 +03:00
neon_arch
7b1f93b232 ⚙️ refactor: add compress middleware to reduce memory usage (#180)(#178) 2023-08-29 20:12:15 +03:00
neon_arch
1de52decd3 ⚙️ refactor: add clone trait to RedisCache struct (#180)(#178) 2023-08-29 20:10:32 +03:00
neon_arch
028463bb36 ⚙️ refactor: replace jemalloc with mimalloc (#178)(#180) 2023-08-29 20:07:28 +03:00
neon_arch
fceacdb916 🧹 chore: make cargo format happy (#180)(#178) 2023-08-27 21:17:21 +03:00
neon_arch
fd6cb46f87 ⚙️ refactor: replace string type to &str type (#180)(#178) 2023-08-27 21:07:57 +03:00
neon_arch
b2c72bdfc3 ⚙️ refactor: replace pass by value with pass by reference (#180)(#178) 2023-08-27 21:06:25 +03:00
neon_arch
13ce420642 ⚙️ refactor: add several minor optimizations (#180)(#178) 2023-08-27 21:04:41 +03:00
neon_arch
2885f23ec9 ⚙️ refactor: replace vecs with smallvecs for smaller data sizes & replace to_strings with to_owned (#180)(#178) 2023-08-27 21:02:23 +03:00
neon_arch
2a68081ae2 ⚙️ refactor: remove deprecated intoreport functions & add minor optimizations (#180)(#178) 2023-08-27 21:00:22 +03:00
neon_arch
f5f0488954 ⚙️ refactor: add several optimizations to the engine code (#180)(#178) 2023-08-27 20:59:08 +03:00
neon_arch
4ccd0486e7 ⚙️ refactor: replace oncecell with oncelock from std library (#180)(#178) 2023-08-27 20:57:33 +03:00
neon_arch
7b33744c9d ⚙️ refactor: implement default trait for Style struct (#180)(#178) 2023-08-27 20:56:29 +03:00
neon_arch
e4476aae28 ⚙️ refactor: replace rlua with mlua code implementation (#180)(#178) 2023-08-27 20:55:34 +03:00
neon_arch
5f1a43976f ⚙️ refactor: add error.rs module (#180)(#178) 2023-08-27 20:53:55 +03:00
neon_arch
01d8c7ae4c ⚙️ refactor: add new pooling error type for pooling code (#180)(#178) 2023-08-27 20:52:16 +03:00
neon_arch
db93c31603 ⚙️ refactor: implement async pooling for redis connections (#180)(#178) 2023-08-27 20:50:42 +03:00
neon_arch
4afc0d16f0 ⚙️ refactor: add dhat profiler configuration with feat flag (#180)(#178) 2023-08-27 20:46:19 +03:00
xffxff
c3a7c917f6 make format happy 2023-08-24 09:50:19 +08:00
xffxff
23ff24bdf3 add a test to check if the regex wildcard .* matches any character 2023-08-24 09:46:01 +08:00
xffxff
a2fc10ca39 add a test for invalid regex 2023-08-24 09:36:08 +08:00
xffxff
4280545e8c add a test for non-existent file 2023-08-24 09:32:22 +08:00
xffxff
5c0397c456 add some comments to filter_with_lists and add a basic test 2023-08-24 09:29:08 +08:00
zhou fan
2f1fa00f87
Merge branch 'rolling' into feat-error-box-for-engine-errors 2023-08-24 08:16:32 +08:00
zhou fan
575a7f95ba
Merge branch 'rolling' into feat-error-box-for-engine-errors 2023-08-24 08:02:03 +08:00
neon_arch
44216e4d4c feat: optimise search results filtering code (#163) 2023-08-23 13:11:09 +03:00
neon_arch
9c71c9f617 🧹 chore: make rustfmt happy 2023-08-22 19:29:13 +03:00
neon_arch
b17057471b feat: rename functions (#163) 2023-08-22 19:22:37 +03:00
neon_arch
09227d8c93 feat: move implementation of config file path to reduce duplication (#163) 2023-08-22 19:20:29 +03:00
neon_arch
fda6c3a9be feat: rename public_paths to paths (#163) 2023-08-22 19:18:43 +03:00
neon_arch
4f28711218 feat: add code to filter aggregated search results using lists (#163) 2023-08-22 19:16:37 +03:00
Milim
87e230d731 fix debug level not being set properly 2023-08-19 09:09:09 +02:00
Milim
21403d0a48 fix dumb rustfmt version and bump dependency versions 2023-08-18 22:04:34 +02:00
Milim
5aca5c0d0d Improve aggregation
Adds the EngineHandler struct
Removes vulnerability where an attacker could send requests cookies with fake engine names and crash the server.
Merged RawSearchResult and SearchResult, as they were functionally identical.
2023-08-18 10:43:53 +02:00
Milim
15dfda6ea9 Improve Aggregation function & config parser
Refactor aggregation function
Rename visiting_url to url, as they are always the same (see upstream engine scalping).
Refactor parsing function to be more readable.
2023-08-17 22:48:20 +02:00
Milim
af3b1cb308 Use non-blocking sleep function
std:🧵:sleep blocks the entire thread and thus also forces all other current requests to be halted.
2023-08-17 21:45:48 +02:00