0
0
mirror of https://github.com/neon-mmd/websurfx.git synced 2024-11-22 14:08:23 -05:00
Commit Graph

30 Commits

Author SHA1 Message Date
Milim
5aca5c0d0d Improve aggregation
Adds the EngineHandler struct
Removes vulnerability where an attacker could send requests cookies with fake engine names and crash the server.
Merged RawSearchResult and SearchResult, as they were functionally identical.
2023-08-18 10:43:53 +02:00
Milim
15dfda6ea9 Improve Aggregation function & config parser
Refactor aggregation function
Rename visiting_url to url, as they are always the same (see upstream engine scalping).
Refactor parsing function to be more readable.
2023-08-17 22:48:20 +02:00
neon_arch
a8b6a9bce2
Merge branch 'rolling' into patch-searx-results-on-first-page 2023-07-31 13:57:34 +03:00
neon_arch
a8791deb13 🛠️ fix: add & improve code to handle page handling in searx & duckduckgo 2023-07-30 20:14:40 +03:00
neon_arch
9cb582a10d feat: improve code documentation 2023-07-30 17:08:47 +03:00
neon_arch
25d6af0251 🧹 chore: reformat code to make rustfmt happy 2023-07-30 16:58:19 +03:00
neon_arch
2d47e8d730 feat: provide the functionality to use the new config option 2023-07-30 10:53:48 +03:00
neon_arch
74e4fc6169 Merge branch 'rolling' into improve-async-multithreading 2023-07-15 19:50:31 +03:00
neon_arch
94ef62eec9 feat: add documentation to code 2023-07-15 13:36:46 +03:00
neon_arch
9ee516e9b1 feat: fix code for clippy suggestions 2023-07-14 21:18:26 +03:00
neon_arch
27247baf0c feat: define common behaviour for all engines 2023-07-14 17:17:05 +03:00
neon_arch
c223fed394 feat: remove the time crate import 2023-07-14 17:16:13 +03:00
neon_arch
f9b9e87a0e feat: rewrite code by implementing common engine trait SearchEngine 2023-07-11 19:42:17 +03:00
neon_arch
b72af01e0e feat: implement common engine trait 2023-07-11 19:41:34 +03:00
Milim
440216871d Rename Things, refactor some code
BREAKING: renames `binding_ip_addr` to `binding_ip` and `redis_connection_url` to `redis_url`.

Renames a lot of internals as well, but they are to many to mention.
2023-07-03 19:30:25 +02:00
Milim
dbe5b533d6 fix spelling 2023-06-29 19:40:49 +02:00
xffxff
ebb9e9ee2b make format happy 2023-06-15 06:48:37 +08:00
zhou fan
b6faa09750
Update src/engines/engine_models.rs
Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
2023-06-15 06:28:21 +08:00
xffxff
9a4cf949e4 improve error handling by using error-stack crate 2023-06-14 21:23:00 +08:00
neon_arch
c2280b7349 chore: add source and an appropriate message to different error variants 2023-06-04 11:56:07 +03:00
neon_arch
4460730ca6 chore: make clippy github action happy 2023-06-01 12:21:45 +03:00
neon_arch
5962cca294 chore: provide a better and more standardized way to handle engine errors 2023-05-31 19:54:51 +03:00
neon_arch
019b3322e7 chore: add enum to handle different reqwest errors & add timeout to requests 2023-05-16 12:22:00 +03:00
neon_arch
0502a8f551 improve code to evade bot detection and closes #8 2023-05-08 11:47:50 +03:00
neon_arch
c5c1684cc1 optimise code for large scale server use and closes #7 2023-05-07 21:18:19 +03:00
neon_arch
c170de8194 add code to evade ip blocking, improve pagination code and fix documentation 2023-05-02 11:58:21 +03:00
neon_arch
fc69acea8f Improving source code documentation. 2023-04-27 17:53:28 +03:00
neon_arch
ed13a16ec5 updating and improving README.org 2023-04-27 16:06:59 +03:00
neon_arch
f94ac503e2 Refactoring code and separating code into files for better maintainability 2023-04-25 16:30:04 +03:00
neon_arch
15fc415301 initial commit 2023-04-22 14:35:07 +03:00