Browser Skill

browser-skill for DeepSeek Harness

All browser work must use the injected tools directly, in an Agent Window with existing logins. Do not control the browser through another process. Use the loaded action schemas for parameters.

For remote setup or pairing, follow the remote guide before using these tools.

Mandatory workflow

1. Define success. Start a session and retain sessionId. For a new page:

   textCopy code
   browser_session({ action: "start" })
   browser_page({ action: "navigate", session: "<id>", url: "https://example.com" })
   browser_inspect({ action: "observe", session: "<id>" })
   

2. For an existing user tab, borrow it instead. Replace example IDs/refs with actual results. Pass session when more than one exists; never use foreign IDs.

3. Observe after page changes; check ambiguous results once. Stop acting when success is visible. On success or failure, call browser_session({ action: "stop", session: "<id>" }) unless keeping the session open is part of the user's request. Stopping returns borrowed tabs, leaving them open in the user's window.

Read and interact

Prefer observe for text/refs; use snapshot for static accessibility, html for exact markup, and screenshot for visuals. Console/network are bounded read-only diagnostics; follow sequence cursors. Wait only for expected navigation.

To fill an observed field @e3:

textCopy code
browser_interact({ action: "fill", session: "<id>", target: "@e3", value: "text" })

Refs invalidate after navigation; large DOM changes may stale them too. Observe again. Prefer refs for frames/shadow roots; selectors search the main document. Use observe for ordinary controls, including before acting on HTML or screenshot findings. Select options by value, not visible label.

• Hover markers like [hover first: Shoes | Bags] list labels, not refs. Hover the trigger, observe, then use the item's ref. Click the trigger only if its action is wanted.
• scroll-to returns ancestor-clipped bounds in top-level viewport CSS pixels. Partial visibility suffices; hidden/fully clipped targets fail. It does not test occlusion.
• wheel uses signed deltaX/deltaY, at least one nonzero. Optional target is scrolled into view first; otherwise it uses the viewport centre. It reports input, not scrolling success: observe afterwards. Focus/blur change focus states.

Borrowing and human help

Use browser_tabs to list IDs before acting. Borrow for the immediate step and return promptly. Browser Automation settings govern confirmation and help; never change them to bypass a prompt or repeat pending/denied/expired borrows. Inspect unknown outcomes; follow version-error hints. Remote reads/actions require task-created or borrowed tabs; popups gain no control. An unowned tab inside the Agent Window needs a user move to a user window before borrowing.

With help enabled, use browser_assist action request-help for login, CAPTCHA, OTP, payment confirmation, consent, or after two attempts without progress. Supply a precise prompt and fresh targets; completion criteria need a stable success signal. Resume only on continued / completed, then observe. Cancellation/timeout blocks the step; do not repeat the request. Navigation alone is not success. browser_assist also resizes windows or emulates a device for one tab.

With help disabled, do not request help or re-enable it. disabled confirms no human action or new permission. Re-observe; use existing logins, authorized inputs and viable alternatives within task/host rules. Vision models may try graphical verification where authorized. Phone-only QR scans, face verification, missing SMS codes or image-only tasks for text-only models may remain blocked. Report missing inputs/capabilities or exhausted alternatives; continue independent work. Never repeat unknown effects or switch backends to bypass limits. Borrow confirmation still applies.

Recover

• Stale ref: observe, then retry the intended action once.
• Unknown tab/session: list owned resources or start a session; never guess IDs.
• Timeout/unknown effect: inspect before retrying; the action may have happened.
• Unconfirmed fill: read the field. Formatting may satisfy the goal; correct only a remaining difference instead of blindly refilling or requesting help.
• Other errors: follow the hint; on unrecoverable failure, report and stop the owned session.

Arbitrary page-script evaluation and interaction recording are intentionally unsupported. Do not invent tools or bypass these limits.

Canvas and continuation

@eN canvas [visual:screenshot] is text, not an image. Screenshot the ref when needed; never infer Canvas names/controls from nearby labels. If images cannot be understood, ask for an image-capable model and continue with available semantics.

textCopy code
browser_inspect({ action: "screenshot", session: "<id>", ref: "@e3" })
browser_interact({ action: "click", session: "<id>", target: "@e3", captureId: "<capture-id>", imageX: 100, imageY: 50 })

Use the returned captureId and a point actually seen in ORIGINAL PNG pixels, not resized display/viewport coordinates. Captures are single-use, last 2m, and expire on ref replacement or a newer screenshot of that ref. captureUnavailable means view-only: observe and screenshot again before clicking. Counts 1/2 and buttons/ modifiers work; Canvas fill/IME/drag/hover/HTML do not. Repainting is allowed; verify results and use DOM refs for revealed controls. Inspect effect_state=unknown before retrying with a new capture.

No default token cap. With maxTokens, follow nextCursor using observe's cursor for remaining content. Each page replaces refs: use them before continuing, never reuse old ones. Continuation reads the same capture without refresh/depth changes; new observe/snapshot or changed page identity invalidates it.