* ♻️ refactor: initialize & store the config & cache structs as a constant (#486)
- initializes & stores the config & cache structs as a static constant.
- Pass the config & cache structs as a static reference to all the
functions handling their respective route.
* ⚡ perf: replace hashmaps with vectors for fetching & aggregating results (#486)
- replace hashmaps with vectors for fetching, collecting & aggregating results as it tends to be contigous & cache efficient data structure.
- refactor & redesign algorithms for fetching & aggregating results
centered around vectors in aggregate function.
* ➕ build: add the future crate (#486)
* ⚡ perf: use `futureunordered` for collecting results fetched from the tokio spawn tasks (#486)
- using the `futureunordered` instead of vector for collecting results
reduces the time it takes to fetch the results as the results do not
need to come in specific order so any result that gets fetched first
gets collected in the `futureunordered` type.
Co-authored-by: Spencerjibz <spencernajib2@gmail.com>
* ⚡ perf: initialize new async connections parallely using tokio spawn tasks (#486)
* ⚡ perf: initialize redis pipeline struct once with the default size of 3 (#486)
* ⚡ perf: reduce branch predictions by reducing conditional code branches (#486)
* ✅ test(unit): provide unit test for the `get_safesearch_level` function (#486)
* ⚡ perf: reduce clones & use index based loop to improve search results filtering performance (#486)
* 🚨 fix(clippy): make clippy/format checks happy (#486)
* 🚨 fix(build): make the cargo build check happy (#486)
* ⚡ perf: reduce the amount of clones, to_owneds & to_strings (#486)
* ⚡ perf: use async crates & methods & make functions async (#486)
* 🔖 chore(release): bump the app version (#486)
---------
Co-authored-by: Spencerjibz <spencernajib2@gmail.com>
fix: add closing curly brace
- accidentally removed from previous PR. i hope i did not ruin some
build
* feat: implement mojeek engine
* Merge branch 'rolling' into FEAT_316_bing_search_engine
* ✨ feat: implement bing engine
* Fix: include cookie string to header_map
* Fix: include <strong> tags from upstream search
* Merge branch 'rolling' into FEAT_316_bing_search_engine
Co-authored-by: neon-mmd <132049916+neon-mmd@users.noreply.github.com>
Adds the EngineHandler struct
Removes vulnerability where an attacker could send requests cookies with fake engine names and crash the server.
Merged RawSearchResult and SearchResult, as they were functionally identical.
Refactor aggregation function
Rename visiting_url to url, as they are always the same (see upstream engine scalping).
Refactor parsing function to be more readable.
BREAKING: renames `binding_ip_addr` to `binding_ip` and `redis_connection_url` to `redis_url`.
Renames a lot of internals as well, but they are to many to mention.
