Agent-JAE/packages/web-ui/example/server
JAE a2227c7659
Some checks failed
CI / build-check-test (push) Has been cancelled
feat: browser use - element extraction + index-based clicking for text models
- tool-server.mjs: extractElements() scrapes all interactive elements with coordinates
- tool-server.mjs: formatElements() returns numbered list for LLM to read
- tool-server.mjs: click/type now support {index: N} for element-based interaction
- tool-server.mjs: new /api/browser/elements and /api/browser/keypress endpoints
- browser-tool.ts: updated schema with index, key params and elements/keypress actions
- browser-tool.ts: elementsText included in every LLM response so model can see the page
- browser-tool.ts: detailed workflow instructions in tool description
- Enables text-only models (Llama 3.3 etc) to navigate and interact with web pages
2026-03-27 23:17:24 +00:00
..
tool-server.mjs feat: browser use - element extraction + index-based clicking for text models 2026-03-27 23:17:24 +00:00