gnome-jarvis/vendor/agent-harness/agent-workspace/skills/browser/SKILL.md

name, description

name	description
browser	Drive the headed Jarvis Chromium window. This is the only web tool. Use it to search, open pages, click, and type. Do not use web_search, web_fetch, or computer-use for websites.

Browser

browser is the only way to the public web. web_search, google_search, fetch_page, web_fetch, wiki_search, hn_search, and code_search are removed. Do not call them. Do not use cu_observe, cu_click, curl, or wget for websites.

Chrome runs on this computer. After a navigate or snapshot, read the page text and decide the next click. If Groq is enabled, that thinking step uses Groq. The crawl itself stays local.

browser actions

Call with action plus the fields for that action. Snapshot refs are strings like "1".

action	Fields	Result
navigate	url (public http or https)	Opens the page and returns a snapshot plus readable text
snapshot	none	Current url, title, numbered refs, page text
click	ref from the last snapshot (or selector / text)	Clicks, then a fresh snapshot
type	ref + text; optional submit true	Fills the field; submit presses Enter
press	key (Enter, Tab, Escape, Control+l, …)	Key, then a snapshot
scroll	dy pixels (optional dx)	Scrolls, then a snapshot
wait	ms (optional text to wait for)	Waits, then a snapshot

Private, loopback, and metadata hosts are blocked before Chromium starts.

Search

Do not call a search tool. Navigate to a public search url, then click a result:

• Web: https://duckduckgo.com/?q=QUERY or https://www.google.com/search?q=QUERY
• Wikipedia: https://en.wikipedia.org/w/index.php?search=QUERY
• Hacker News: https://hn.algolia.com/?q=QUERY
• GitHub: https://github.com/search?q=QUERY&type=repositories
• This computer's public IP: https://ifconfig.me/ip

Loop

1. navigate or snapshot so you have fresh refs and page text.
2. Pick the ref whose name matches the control (Accept, Next, email, search box, a result title).
3. click or type with that ref.
4. Read the new snapshot. Refs from earlier snapshots are stale.
5. Repeat until the page text answers the question, then speak the answer. Do not keep searching the same query.

Cookie walls and challenges

• Cookie banner: snapshot, then click the Accept / Agree / I understand ref.
• challenge: true or a Cloudflare / “just a moment” page: tell the user to finish the prompt in the visible Jarvis browser window. Do not guess. Then snapshot again.
• Login that needs a password: stop and ask the user. Never type credentials unless they just provided them for this site.

Do not

• Speak refs, selectors, or tool JSON.
• Call web_search, web_fetch, fetch_page, or any other search tool.
• Use computer-use tools on the Chromium window.
• Keep searching the same query instead of opening a hit.