Skip to content

[Feature] Add web search context support to GPT plugin #5732

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
vstakhov merged 10 commits into from
Nov 7, 2025
Merged

[Feature] Add web search context support to GPT plugin #5732

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
f21e5c7
[Feature] Add web search context support to GPT plugin
vstakhov Nov 5, 2025
7144579
[Fix] Fix llm_search_context to follow Rspamd idioms
vstakhov Nov 5, 2025
97082fb
[Fix] Refactor llm_search_context to use lua_cache module
vstakhov Nov 5, 2025
aa85f73
[Feature] Add task:get_cta_urls() API for proper CTA domain extraction
vstakhov Nov 6, 2025
c6d0ee6
[Rework] Move CTA processing into dedicated module
vstakhov Nov 6, 2025
d7d214d
[Rework] Prioritize CTA URLs in redirector and Lua helpers
vstakhov Nov 6, 2025
24e4b2a
[Feature] Add url:get_hash() method for efficient URL deduplication
vstakhov Nov 7, 2025
25e17f1
[Minor] Update cache key prefix to match module name
vstakhov Nov 7, 2025
4889a81
[Fix] Skip HTML_DISPLAYED URLs in CTA detection
vstakhov Nov 7, 2025
ba0c4ca
[Rework] Refactor extract_specific_urls to prevent DoS and use hash-b…
vstakhov Nov 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .overcommit.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,8 @@
#
# Uncomment the following lines to make the configuration take effect.

concurrency: 1

PreCommit:
TrailingWhitespace:
enabled: true
Expand Down
14 changes: 14 additions & 0 deletions conf/modules.d/gpt.conf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,6 +55,20 @@ gpt {
# Be sure to enable module after you specify the API key
enabled = false;

# Optional web search context (disabled by default)
# Extracts domains from email URLs and queries a search API for context
search_context = {
enabled = false; # Enable web search context
#search_url = "https://leta.mullvad.net/search/__data.json"; # Search API endpoint
#search_engine = "brave"; # Search engine (brave, google, etc.)
#max_domains = 3; # Maximum domains to search
#max_results_per_query = 3; # Maximum results per domain
#timeout = 5; # HTTP timeout in seconds
#cache_ttl = 3600; # Cache TTL in seconds (1 hour)
#cache_key_prefix = "gpt_search"; # Redis cache key prefix
#as_system = true; # Inject as system message
};

# Include dynamic conf for the rule
.include(try=true,priority=5) "${DBDIR}/dynamic/gpt.conf"
.include(try=true,priority=1,duplicate=merge) "$LOCAL_CONFDIR/local.d/gpt.conf"
Expand Down
Loading