opção

Executa testes adversariais de interface do usuário em um navegador real usando a CLI do browse, analisando as diferenças do Git para testar apenas as áreas alteradas ou explorando o aplicativo por completo para identificar bugs na funcionalidade, acessibilidade, layout responsivo e experiência do usuário.

...Expandir tudo
0
Tempo atualizado 29 de Setembro de 2026

Teste de interface do usuário — Competência em testes de interface do usuário com abordagem agentica

Teste alterações na interface do usuário em um navegador real. Sua tarefa é tentar encontrar falhas, não confirmar se tudo funciona.

Três fluxos de trabalho:

  • Orientado por diff — analise um git diff, teste apenas o que mudou
  • Exploratório — navegue pelo aplicativo, encontre bugs que o desenvolvedor não tenha previsto
  • Paralelo — distribua grupos de testes independentes por vários navegadores do Browserbase

Como funcionam os testes

O agente principal coordena — ele planeja a estratégia de teste, delega tarefas aos subagentes e consolida os resultados. Os subagentes realizam os testes reais no navegador.

Planejamento: várias perspectivas, depois execute uma vez

Você DEVE concluir todas as três rodadas de planejamento por conta própria e gerar os resultados antes de iniciar qualquer subagente. O planejamento ocorre em sua própria resposta — ele NÃO é delegado aos subagentes. Não pule diretamente para a execução.

Rodada 1 — Funcional: Quais são os principais fluxos do usuário? O que deve funcionar? Descreva cada teste da seguinte forma: ação → resultado esperado.

Rodada 2 — Adversária: releia a Rodada 1. O que você deixou passar? Pense em: diferentes tipos/funções de usuários, caminhos de erro, estados vazios, condições de corrida, entradas extremas (vazias, enormes, caracteres especiais, cliques rápidos).

Rodada 3 — Lacunas de cobertura: releia as Rodadas 1 e 2. E quanto a: acessibilidade (axe-core, somente teclado), janelas de visualização em dispositivos móveis, erros de console, consistência visual com o restante do aplicativo?

Eliminar duplicatas: Junte todas as três rodadas em uma única lista numerada de testes. Remova as sobreposições. Atribua cada teste a um grupo (por exemplo, Grupo A, Grupo B).

Em seguida, execute uma única vez — inicie um subagente por grupo. Cada subagente recebe sua lista específica de testes a serem executados, nada mais. Os subagentes não exploram nem planejam — eles executam os testes atribuídos e relatam os resultados.

Apresente as três rodadas, o plano unificado e as atribuições de grupos em sua resposta antes de chamar qualquer ferramenta do Agent.

Princípios para a divisão do trabalho

  • Os subagentes executam os testes atribuídos, não realizam exploração aberta. O agente principal entrega a cada subagente uma lista numerada específica de testes. Os subagentes não planejam, não exploram nem decidem o que testar — eles executam a lista e param.
  • O gargalo é o agente mais lento — divida o trabalho para que nenhum agente tenha uma parcela desproporcional. Muitos agentes pequenos > poucos grandes.
  • Dimensionem o esforço de acordo com a alteração — a correção de um único componente não precisa de muitos agentes nem de muitas etapas. Um redesenho de página inteira, sim. Deixem que o escopo da diferença (diff) determine o plano.
  • Não interrompa prematuramente em caso de falhas — encontre o máximo possível de bugs dentro dos testes atribuídos.

Atribuindo um limite de etapas aos subagentes

O agente principal DEVE incluir um limite explícito de etapas de navegação em cada prompt dos subagentes. Os subagentes não se autolimitam — eles continuarão executando até a conclusão, a menos que seja indicado o contrário.

Como orientação geral: ~25 etapas para algumas verificações específicas, ~40 para uma página completa com testes funcionais + adversariais + de acessibilidade, ~75 para várias páginas ou uma categoria ampla. Ajuste com base no que os testes atribuídos realmente exigem — esses são pontos de partida, não regras.

Como orientação aproximada: cerca de 25 etapas para algumas verificações específicas, cerca de 40 para uma página completa com testes funcionais, adversariais e de acessibilidade, cerca de 75 para várias páginas ou uma categoria ampla. Ajuste com base no que os testes atribuídos realmente exigem — esses são pontos de partida, não regras.

Cada prompt do subagente deve incluir:

You have a budget of N browse steps (each `browse` command = 1 step). Count your steps as you go. When you reach N, stop immediately and report:
- STEP_PASS/STEP_FAIL for every test you completed
- STEP_SKIP||budget reached for every test you didn't get to

Do not retry or continue after hitting the budget.
Run only these tests: [numbered list from the merged plan]
Do not explore beyond the assigned tests.
Do NOT generate an HTML report or write any files. Return only step markers and your findings as text.

O agente principal NÃO deve executar browse os comandos por conta própria (exceto para verificar se o servidor de desenvolvimento está ativo). Todos os testes ocorrem nos subagentes.

Quando um subagente atinge seu limite, o agente principal aceita os resultados parciais como estão. Não execute novamente nem tente novamente o subagente. Inclua os testes OMITIDOS no relatório final para que o desenvolvedor saiba o que não foi coberto.

Relatórios

Cada subagente envia um relatório com:

Tests: 8 | Passed: 5 | Failed: 2 | Skipped: 1 | Pages visited: 2

O agente principal consolida tudo em um relatório final com:

Tests: 20 | Passed: 14 | Failed: 4 | Skipped: 2 | Agents: 3 | Pass rate: 70%

Não relate “etapas utilizadas” — as contagens de comandos de navegação são detalhes de implementação, não uma métrica significativa para os revisores.

Filosofia de teste

Você é um testador adversário. Seu objetivo é encontrar bugs, não provar que tudo está correto.

  • Tente quebrar todos os recursos que você testar. Não se limite a verificar “o botão existe?” — clique nele duas vezes rapidamente, envie formulários vazios, cole 500 caracteres, pressione Escape no meio do fluxo.
  • Teste o que o desenvolvedor não pensou. Estados vazios, recuperação de erros, navegação apenas pelo teclado, estouro na versão móvel.
  • Toda afirmação deve ser baseada em evidências. Compare instantâneos do antes e depois. Verifique elementos específicos por referência. Nunca relate “APROVADO” sem evidências concretas da árvore de acessibilidade ou de uma verificação determinística.
  • Relate falhas com detalhes suficientes para que possam ser reproduzidas. Inclua a ação exata, o que você esperava, o que obteve e uma sugestão de correção.

Protocolo de Asserção

Cada etapa de teste DEVE produzir uma asserção estruturada. Não escreva comentários livres do tipo “isso parece bom”.

Marcadores de etapa

Para cada etapa de teste, emita exatamente um marcador:

STEP_PASS||

ou

STEP_FAIL|| → |
  • step-id: um identificador curto como homepage-cta, form-validation-error, modal-cancel
  • evidence: o que você observou que comprova que a etapa foi aprovada (referência ao elemento, conteúdo de texto, URL, resultado da avaliação)
  • expected → actual: o que você esperava versus o que obteve
  • screenshot-path: caminho para a captura de tela salva (apenas em caso de falhas — veja “Captura de tela” abaixo)

Captura de captura de tela para falhas

Toda STEP_FAIL DEVE vir acompanhada de uma captura de tela para que o desenvolvedor possa ver visualmente o que deu errado.

Quando uma etapa de teste falhar:

# 1. Take a screenshot immediately after observing the failure
browse screenshot --path .context/ui-test-screenshots/.png

# If --path is not supported, take the screenshot and save manually:
browse screenshot
# The browse CLI will output the screenshot path — move/copy it:
cp /tmp/browse-screenshot-*.png .context/ui-test-screenshots/.png

Configure o diretório de capturas de tela no início de qualquer execução de teste:

mkdir -p .context/ui-test-screenshots

Regras:

  • Nome do arquivo = id-da-etapa (por exemplo, double-submit.png, axe-audit.png, modal-focus-trap.png)
  • Armazene em .context/ui-test-screenshots/ — este diretório é ignorado pelo Git e está acessível ao desenvolvedor e a outros agentes
  • Para execuções paralelas, inclua o nome da sessão: -.png (por exemplo, signup-double-submit.png)
  • Faça a captura de tela no momento da falha — capture o estado com falha, não após a recuperação
  • Para bugs visuais ou de layout, faça também uma captura de tela da linha de base (estado funcional) para comparação: -baseline.png

Como verificar (em ordem de rigor)

  1. Verificação determinística (mais robusta) — browse eval retorna dados estruturados que você pode inspecionar. Exemplos: contagem de violações do axe-core, document.title, valor do campo de formulário, matriz de erros do console, contagem de elementos.
  2. Correspondência de elemento no instantâneo — um elemento específico com uma função e um texto específicos existe na árvore de acessibilidade. Verifique por referência: @0-12 button "Save". Um elemento ou existe na árvore ou não existe.
  3. Comparação antes/depois — instantâneo antes da ação, ação, instantâneo depois. Verifique se a árvore mudou da maneira esperada (elemento apareceu, desapareceu, texto mudou).
  4. Captura de tela + avaliação visual (método menos confiável) — apenas para propriedades puramente visuais (cor, espaçamento, layout) que a árvore de acessibilidade não consegue capturar. Sempre especifique o que exatamente você está avaliando.

Padrão de comparação antes/depois

Este é o ciclo central de verificação. Use-o para cada interação:

# 1. BEFORE: capture state
browse snapshot
# Record: what elements exist, their text, their refs

# 2. ACT: perform the interaction
browse click @0-12

# 3. AFTER: capture new state
browse snapshot
# Compare: what changed? What appeared? What disappeared?

# 4. ASSERT: emit marker based on comparison
# If dialog appeared: STEP_PASS|modal-open|dialog "Confirm" appeared at @0-20
# If nothing changed:
browse screenshot --path .context/ui-test-screenshots/modal-open.png
# STEP_FAIL|modal-open|expected dialog to appear → snapshot unchanged|.context/ui-test-screenshots/modal-open.png

Configuração

which browse || npm install -g browse

Evite o cansaço de permissões

Essa habilidade executa muitos browse comandos (instantâneos, cliques, avaliações). Para evitar ter que aprovar cada um deles, adicione browse aos seus comandos permitidos:

Adicione ambos os padrões ao .claude/settings.json (nível do projeto) ou ~/.claude/settings.json (nível do usuário):

{
  "permissions": {
    "allow": [
      "Bash(browse:*)",
      "Bash(BROWSE_SESSION=*)"
    ]
  }
}

O primeiro padrão abrange browse . O segundo abrange sessões paralelas (BROWSE_SESSION=signup browse open ...). Ambos são necessários para evitar solicitações de aprovação.

Seleção de modo

Destino Modo Comando Autenticação
localhost / 127.0.0.1 Local browse open --local Não é necessário (navegador local isolado e limpo por padrão)
Site implantado/de teste Remoto browse open --remote Credenciais do Browserbase; use contextos onde for compatível

Regra: Se a URL de destino contiver localhost ou 127.0.0.1, passe --local no primeiro browse open.

Modo local (padrão para localhost)

browse open http://localhost:3000 --local

browse open ... --local usa um navegador local isolado e limpo por padrão, o que é ideal para execuções de controle de qualidade (QA) reproduzíveis no localhost.

Use variantes do modo local somente quando necessário:

  • browse open --auto-connect — detecte automaticamente um Chrome local existente que possa ser depurado. Use isso apenas quando o teste precisar explicitamente de login, cookies ou estado locais existentes.
  • browse open --cdp — conectar-se a um alvo CDP específico (conexão explícita ao navegador local).

Modo remoto (sites implantados via sincronização de cookies)

# Step 1: Sync cookies from local Chrome to Browserbase
node .claude/skills/cookie-sync/scripts/cookie-sync.mjs --domains your-app.com
# Output: Context ID: ctx_abc123

# Step 2: Open in remote mode with the synced context
SESSION_JSON="$(browse cloud sessions create --context-id ctx_abc123 --persist --keep-alive)"
SESSION_ID="$(echo "$SESSION_JSON" | jq -r .id)"
CONNECT_URL="$(echo "$SESSION_JSON" | jq -r .connectUrl)"

browse open https://staging.your-app.com --cdp "$CONNECT_URL"
browse snapshot
# ... run tests ...
browse stop
browse cloud sessions update "$SESSION_ID" --status REQUEST_RELEASE

Sinalizadores de sincronização de cookies: --domains, --context, --verified, --proxy "City,ST,US"

Fluxo de trabalho A: Testes orientados por diferenças

Fase 1: Analisar as diferenças

git diff --name-only HEAD~1          # or: git diff --name-only / git diff --name-only main...HEAD
git diff HEAD~1 --             # read actual changes

Categorizar os arquivos alterados:

Padrão do arquivo Impacto na interface do usuário O que testar
*.tsx, *.jsx, *.vue, *.svelte Componente Renderização, interação, estado, casos extremos
pages/**, app/**, src/routes/** Rota/página Navegação, carregamento da página, conteúdo, tratamento de erros 404
*.css, *.scss, *.module.css Estilo Aparência visual (captura de tela), responsividade
*form*, *input*, *field* Formulário Validação, envio, campo vazio, campo longo, caracteres especiais
*modal*, *dialog*, *dropdown* Interatividade Abrir/fechar, sair, armadilha de foco, cancelar x confirmar
*nav*, *menu*, *header* Navegação Links, estados ativos, roteamento, navegação por teclado
Apenas arquivos que não sejam da interface do usuário Nenhum Ignorar — relatar “nenhum teste de interface do usuário necessário”

Fase 2: Mapeamento de arquivos para URLs

Detectar framework: cat package.json | grep -E '"(next|react|vue|nuxt|svelte|@sveltejs|angular|vite)"'

Framework Porta padrão Arquivo → Padrão de URL
Roteador de aplicativos Next.js 3000 app/dashboard/page.tsx → /dashboard
Roteador de páginas do Next.js 3000 pages/about.tsx → /about
Vite 5.173 Verificar configuração do roteador
Nuxt 3000 pages/index.vue → /
SvelteKit 5173 src/routes/+page.svelte → /
Angular 4.200 Verificar o módulo de roteamento

Fase 3: Certifique-se de que o código correto esteja sendo executado

Antes de testar, verifique se o servidor de desenvolvimento está servindo o código do diff — e não de um branch desatualizado.

Se estiver testando um PR ou um branch específico:

# Check what branch is currently checked out
git branch --show-current

# If it's not the PR branch, switch to it
git fetch origin  && git checkout 

# Install deps — the lockfile may differ between branches
yarn install  # or npm install / pnpm install

Se o servidor de desenvolvimento já estivesse em execução em um branch diferente, reinicie-o após o checkout.

Encontre um servidor de desenvolvimento em execução:

for port in 3000 3001 5173 4200 8080 8000 5000; do
  s=$(curl -s -o /dev/null -w "%{http_code}" "http://localhost:$port" 2>/dev/null)
  if [ "$s" != "000" ]; then echo "Dev server on port $port (HTTP $s)"; fi
done

Se não for encontrado nada: peça ao usuário para iniciar seu servidor de desenvolvimento.

Verifique se ele realmente é renderizado: Após browse open + browse snapshot, verifique se a árvore de acessibilidade contém conteúdo real da página (navegação, títulos, elementos interativos) — e não apenas uma sobreposição de erro ou um corpo vazio. Os servidores de desenvolvimento do Next.js podem retornar um código de status HTTP 200 mesmo exibindo uma caixa de diálogo de erro de compilação em tela cheia. Se o snapshot estiver vazio ou dominado por uma caixa de diálogo de erro, o servidor está com problema — corrija a compilação antes de testar.

Fase 4: Gerar plano de teste

Para cada área alterada, planeje tanto os testes de caso normal quanto os adversariais:

Test Plan (based on git diff)
=============================
Changed: src/components/SignupForm.tsx (added email validation)

1. [happy] Valid email submits successfully
   URL: http://localhost:3000/signup
   Steps: fill valid email → submit → verify success message appears

2. [adversarial] Invalid email shows error
   Steps: fill "not-an-email" → submit → verify error message appears

3. [adversarial] Empty form submission
   Steps: click submit without filling anything → verify error, no crash

4. [adversarial] XSS in email field
   Steps: fill "" → submit → verify sanitized/rejected

5. [adversarial] Rapid double-submit
   Steps: click submit twice quickly → verify no duplicate submission

6. [adversarial] Keyboard-only flow
   Steps: Tab to email → type → Tab to submit → Enter → verify success

Fase 5: Executar testes

browse stop 2>/dev/null
mkdir -p .context/ui-test-screenshots
# localhost/default QA → clean, reproducible local run
browse open http://localhost:3000 --local

Para cada teste, siga o padrão “antes/depois”:

# Navigate
browse open http://localhost:3000/path --local
browse wait load

# BEFORE snapshot
browse snapshot
# Note the current state: elements, refs, text

# ACT
browse click @0-ref
# or: browse fill "selector" "value"
# or: browse type "text"
# or: browse press Enter

# AFTER snapshot
browse snapshot
# Compare against BEFORE: what changed?

# ASSERT with marker
# STEP_PASS|step-id|evidence  OR  STEP_FAIL|step-id|expected → actual

Fase 6: Relatar os resultados

## UI Test Results

### STEP_PASS|valid-email-submit|status "Thanks!" appeared at @0-42 after submit
- URL: http://localhost:3000/signup
- Before: form with email input @0-3, submit button @0-7
- Action: filled "[email protected]", clicked @0-7
- After: form replaced by status element with "Thanks! We'll be in touch."

### STEP_FAIL|double-submit|expected single submission → form submitted twice|.context/ui-test-screenshots/double-submit.png
- URL: http://localhost:3000/signup
- Before: form with submit button @0-7
- Action: clicked @0-7 twice rapidly
- After: two success toasts appeared, suggesting duplicate submission
- Screenshot: .context/ui-test-screenshots/double-submit.png
- Suggestion: disable submit button after first click, or debounce the handler

---
**Summary: 4/6 passed, 2 failed**
Failed: double-submit, xss-sanitization

Screenshots saved to `.context/ui-test-screenshots/` — open any failed step's screenshot to see the broken state.

Sempre browse stop ao concluir.

Fase 7: Gerar relatório em HTML

Após produzir o relatório em texto, gere um relatório HTML independente que um revisor possa abrir em um navegador. O relatório incorpora capturas de tela diretamente no texto (base64), de modo que funciona como um único arquivo — sem dependências externas.

Por que: Relatórios de texto são bons para a conversa com o agente, mas os revisores (gerentes de projeto, designers, outros engenheiros) querem um recurso visual que possam abrir, examinar e compartilhar. Capturas de tela incorporadas tornam as falhas imediatamente evidentes.

Como gerar

  1. Leia o modelo HTML em references/report-template.html
  2. Crie o relatório substituindo os placeholders do modelo pelos dados reais de teste:
Espaço reservado Valor
{{TITLE}} Título do relatório para </code> tag (e.g., "UI Test: PR #1234 — OAuth Settings")</td> </tr> <tr> <td><code>{{TITLE_HTML}}</code></td> <td>Report title for the visible <code><h1></code>. If a PR URL is available, wrap the PR reference in an <code><a></code> tag so it's clickable (e.g., <code>UI Test: <a href="https://github.com/org/repo/pull/1234">PR #1234</a> — OAuth Settings</code>). If no URL, use plain text same as <code>{{TITLE}}</code>.</td> </tr> <tr> <td><code>{{META}}</code></td> <td>One-line context: date, app URL, user, branch</td> </tr> <tr> <td><code>{{TOTAL_TESTS}}</code></td> <td>Total STEP_PASS + STEP_FAIL count</td> </tr> <tr> <td><code>{{AGENT_COUNT}}</code></td> <td>Number of sub-agents that ran</td> </tr> <tr> <td><code>{{PASS_COUNT}}</code></td> <td>Number of STEP_PASS</td> </tr> <tr> <td><code>{{FAIL_COUNT}}</code></td> <td>Number of STEP_FAIL</td> </tr> <tr> <td><code>{{PASS_RATE}}</code></td> <td>Integer percentage (e.g., "92")</td> </tr> <tr> <td><code>{{RATE_CLASS}}</code></td> <td><code>good</code> (≥90%), <code>warn</code> (70–89%), <code>bad</code> (<70%)</td> </tr> <tr> <td><code>{{FAILURES_SECTION}}</code></td> <td>HTML for failed test cards (see below)</td> </tr> <tr> <td><code>{{PASSES_SECTION}}</code></td> <td>HTML for passed test cards (see below)</td> </tr> </tbody></table> <ol start="3"> <li>For each test result, generate a <code><details></code> card. Failed tests should be <strong>open by default</strong> so reviewers see them immediately:</li> </ol> <pre><code class="language-html"><!-- Failed test card (open by default) --> <div class="section"> <h2>Failures <span class="count">{{FAIL_COUNT}}</span></h2> <details class="test-card fail" open> <summary> <span class="badge fail">FAIL</span> <span class="step-id">step-id-here</span> <span class="evidence">expected → actual</span> </summary> <div class="body"> <dl> <dt>URL</dt><dd>http://localhost:3000/path</dd> <dt>Action</dt><dd>What was done</dd> <dt>Expected</dt><dd>What should have happened</dd> <dt>Actual</dt><dd>What happened instead</dd> </dl> <div class="suggestion">Fix: description of suggested fix</div> <div class="screenshot"> <img src="data:image/png;base64,..." alt="Captura de tela da falha"> <div class="caption">step-id.png — captured at moment of failure</div> </div> </div> </details> </div> <!-- Passed test card (collapsed by default) --> <div class="section"> <h2>Passed <span class="count">{{PASS_COUNT}}</span></h2> <details class="test-card pass"> <summary> <span class="badge pass">PASS</span> <span class="step-id">step-id-here</span> <span class="evidence">evidence summary</span> </summary> <div class="body"> <dl> <dt>URL</dt><dd>http://localhost:3000/path</dd> <dt>Evidence</dt><dd>What was observed</dd> </dl> </div> </details> </div> </code></pre> <ol start="4"> <li><strong>Embed screenshots as base64</strong> so the HTML is fully self-contained:</li> </ol> <pre><code class="language-bash"># Convert screenshot to base64 data URI base64 -i .context/<span class="notranslate">ui-test</span>-screenshots/step-id.png | tr -d '\n' # Use as: src="data:image/png;base64,<output>" </code></pre> <p>Read each screenshot file referenced in STEP_FAIL markers, base64-encode it, and embed it as an <code><img src="data:image/png;base64,..."></code> in the corresponding test card. For STEP_PASS, only embed a screenshot if one was explicitly taken (e.g., baseline screenshots).</p> <ol start="5"> <li>Write the final HTML to <code>.context/<span class="notranslate">ui-test</span>-report.html</code>:</li> </ol> <pre><code class="language-bash"># Write the generated HTML cat > .context/<span class="notranslate">ui-test</span>-report.html << 'REPORT_EOF' <!DOCTYPE html> ...generated report... REPORT_EOF # Open it for the reviewer open .context/<span class="notranslate">ui-test</span>-report.html # macOS # xdg-open .context/<span class="notranslate">ui-test</span>-report.html # Linux </code></pre> <ol start="6"> <li>Tell the user: <code>Report saved to .context/<span class="notranslate">ui-test</span>-report.html</code> and offer to open it.</li> </ol> <p><strong>Rules:</strong></p> <ul> <li>Failures section comes before passes — reviewers care about what's broken first</li> <li>Failed cards are <code>open</code> by default; passed cards are collapsed</li> <li>Every STEP_FAIL card MUST have an embedded screenshot — if the screenshot file is missing, note it in the card</li> <li>Include the suggestion/fix in each failure card if one was provided</li> <li>The report must work offline — no CDN links, no external assets</li> <li>Keep the HTML under 5MB — if screenshots push it over, reduce image quality or skip baseline screenshots for passes</li> </ul> <h2>Adversarial Test Patterns</h2> <p>Apply these to every interactive element you test. Read references/adversarial-patterns.md for the full pattern library (forms, modals, navigation, error states, keyboard accessibility).</p> <h2>Deterministic Checks</h2> <p>These produce structured data, not judgment calls. Use them as the strongest form of assertion.</p> <table> <thead> <tr> <th>Check</th> <th>What it catches</th> <th>Assertion</th> </tr> </thead> <tbody><tr> <td>axe-core</td> <td>WCAG violations</td> <td><code>violations.length === 0</code></td> </tr> <tr> <td>Console errors</td> <td>Runtime exceptions, failed requests</td> <td>empty error array</td> </tr> <tr> <td>Broken images</td> <td>Missing/failed image loads</td> <td>no images with <code>naturalWidth === 0</code></td> </tr> <tr> <td>Form labels</td> <td>Inputs without accessible labels</td> <td>every input has <code>hasLabel: true</code></td> </tr> </tbody></table> <p>For the exact <code>browse eval</code> recipes, read references/browser-recipes.md.</p> <h2>Workflow B: Exploratory Testing</h2> <p>No diff, no plan — just open the app and try to break it. Use this when the user says "test my app", "find bugs", or "QA this site."</p> <h3>Approach</h3> <ol> <li><strong>Discover the app</strong> — read <code>package.json</code> to detect the framework, then open the root URL and snapshot to see what's there</li> <li><strong>Navigate everything</strong> — click through nav links, visit every reachable page, note what exists</li> <li><strong>Test what you find</strong> — for each page, apply the adversarial patterns below (forms, modals, navigation, keyboard, error states)</li> <li><strong>Run deterministic checks</strong> — axe-core, console errors, broken images, form labels on every page</li> <li><strong>Report findings</strong> — use STEP_PASS/STEP_FAIL markers, include reproduction steps for failures</li> </ol> <p>Don't try to be systematic about coverage. Just explore like a user would, but with the intent to break things. The agent is good at this — let it roam.</p> <h3>Tips for exploratory runs</h3> <ul> <li>Start with the homepage, then follow the navigation naturally</li> <li>Try the 404 page (<code>/does-not-exist</code>) — is it custom or default?</li> <li>Look for empty states (pages with no data)</li> <li>Test forms with garbage input before valid input</li> <li>Check mobile viewport (375px) on every page — does it overflow?</li> <li>If the app has auth, use cookie-sync first</li> </ul> <h2>Workflow C: Parallel Testing</h2> <p>Run independent test groups concurrently using named <code>browse</code> sessions (<code>BROWSE_SESSION=<name></code>). Each session gets its own browser. Works with both local and remote mode.</p> <p>Use when testing multiple pages or categories and you want faster wall clock time.</p> <p>Read references/parallel-testing.md for the full workflow: session setup, agent fan-out, cookie-sync for auth, and result merging.</p> <h2>Design Consistency</h2> <p>Check whether changed UI matches the rest of the app visually. Read references/design-consistency.md when doing visual or design checks.</p> <h2>Test Categories</h2> <table> <thead> <tr> <th>Category</th> <th>How</th> <th>Assertion type</th> </tr> </thead> <tbody><tr> <td>Accessibility</td> <td>axe-core + keyboard nav</td> <td>Deterministic (violation count)</td> </tr> <tr> <td>Visual Quality</td> <td>Screenshot + heuristic evaluation</td> <td>Visual judgment (weakest — note specifics)</td> </tr> <tr> <td>Responsive</td> <td>Viewport sweep + screenshots</td> <td>Visual + deterministic (overflow check)</td> </tr> <tr> <td>Console Health</td> <td>Console capture eval</td> <td>Deterministic (error count)</td> </tr> <tr> <td>UX Heuristics</td> <td>Snapshot + Laws of UX + Nielsen's</td> <td>Structured judgment (cite specific heuristic)</td> </tr> <tr> <td>Error States</td> <td>Navigate to empty/error states</td> <td>Before/after comparison</td> </tr> <tr> <td>Data Display</td> <td>Snapshot on tables/dashboards</td> <td>Element match (column count, formatting)</td> </tr> <tr> <td>Design Consistency</td> <td>Screenshot baseline + changed page comparison</td> <td>Visual judgment (cite specific property)</td> </tr> <tr> <td>Exploratory</td> <td>Free navigation + adversarial testing</td> <td>Before/after + judgment</td> </tr> </tbody></table> <p>Reference guides (load on demand):</p> <ul> <li><strong>Adversarial patterns</strong> — references/adversarial-patterns.md — load when testing forms, modals, navigation, or keyboard a11y</li> <li><strong>Browser recipes</strong> — references/browser-recipes.md — load when running deterministic checks (axe-core, console, images, form labels)</li> <li><strong>Exploratory testing</strong> — references/exploratory-testing.md — load for Workflow B (no diff, open exploration)</li> <li><strong>UX heuristics</strong> — references/ux-heuristics.md — load when evaluating UX quality or citing specific heuristics</li> <li><strong>Design system</strong> — references/design-system.example.md — template for users to customize</li> <li><strong>Design consistency</strong> — references/design-consistency.md — load when doing visual consistency checks</li> <li><strong>Parallel testing</strong> — references/parallel-testing.md — load for Workflow C (concurrent sessions)</li> <li><strong>Report template</strong> — references/report-template.html — HTML template for Phase 7 report generation</li> </ul> <p>For worked examples with exact commands, read EXAMPLES.md if you need to see the assertion protocol in action.</p> <h2>Best Practices</h2> <ol> <li><strong>Be adversarial</strong> — try to break things, don't just confirm they work</li> <li><strong>Every assertion needs evidence</strong> — snapshot ref, eval result, or before/after diff</li> <li><strong>Before/after for every interaction</strong> — snapshot, act, snapshot, compare</li> <li><strong>Screenshot every failure</strong> — <code>browse screenshot</code> immediately on STEP_FAIL, save to <code>.context/<span class="notranslate">ui-test</span>-screenshots/<step-id>.png</code></li> <li><strong>Deterministic checks first</strong> — axe-core, console errors, form labels before visual judgment</li> <li><strong>For localhost, start with clean local mode</strong> — pass <code>--local</code> on the first <code>browse open</code> for reproducible runs; use <code>--auto-connect</code> only when existing local state is required</li> <li><strong>Always <code>browse stop</code> when done</strong> — for parallel runs, stop every named session</li> <li><strong>Report failures with reproduction steps</strong> — action, expected, actual, screenshot path, suggestion</li> <li><strong>Parallelize independent tests</strong> — use Workflow C with named sessions when testing multiple pages or categories on a deployed site</li> </ol> <h2>Troubleshooting</h2> <ul> <li><strong>"No active page"</strong>: <code>browse stop</code>, retry. For zombies: <code>pkill -f "browse.*daemon"</code></li> <li><strong>Dev server not responding</strong>: <code>curl http://localhost:<port></code> — ask user to start it</li> <li><strong><code>browse eval</code> with <code>await</code> fails</strong>: Use <code>.then()</code> instead — <code>browse eval</code> doesn't support top-level await</li> <li><strong>Element ref not found</strong>: <code>browse snapshot</code> again — refs change on page update</li> <li><strong>Blank snapshot</strong>: <code>browse wait load</code> or <code>browse wait selector ".expected"</code> before snapshotting</li> <li><strong>SPA deep links 404</strong>: Navigate to <code>/</code> first, then click through</li> <li><strong>Remote auth fails</strong>: Re-run cookie-sync with <code>--context <id></code>, try <code>--verified</code></li> <li><strong>Parallel session conflicts</strong>: Ensure every <code>browse</code> command uses <code>BROWSE_SESSION=<name></code> — without it, commands go to the default session</li> <li><strong>Session not stopping</strong>: <code>BROWSE_SESSION=<name> browse stop</code>. For zombies: <code>pkill -f "browse.*<name>.*daemon"</code></li> </ul>
Ver no GitHub
---
name: ui-test
description: Runs adversarial UI tests in a real browser using the browse CLI, analyzing git diffs to test only changed areas or exploring the full app to find bugs in functionality, accessibility, responsive layout, and UX.
license: MIT
---

# UI Test — Agentic UI Testing Skill

Test UI changes in a real browser. Your job is to **try to break things**, not confirm they work.

Three workflows:
- **Diff-driven** — analyze a git diff, test only what changed
- **Exploratory** — navigate the app, find bugs the developer didn't think about
- **Parallel** — fan out independent test groups across multiple Browserbase browsers

## How Testing Works

The main agent **coordinates** — it plans test strategy, delegates to sub-agents, and merges results. Sub-agents do the actual browser testing.

### Planning: multiple angles, then execute once

**You MUST complete all three planning rounds yourself and output them before launching any sub-agents.** Planning happens in your own response — it is NOT delegated to sub-agents. Do not skip ahead to execution.

**Round 1 — Functional:** What are the core user flows? What should work? Write out each test as: action → expected result.

**Round 2 — Adversarial:** Re-read Round 1. What did you miss? Think about: different user types/roles, error paths, empty states, race conditions, edge inputs (empty, huge, special chars, rapid clicks).

**Round 3 — Coverage gaps:** Re-read Rounds 1–2. What about: accessibility (axe-core, keyboard-only), mobile viewports, console errors, visual consistency with the rest of the app?

**Deduplicate:** Merge all three rounds into one numbered list of tests. Remove overlaps. Assign each test to a group (e.g. Group A, Group B).

**Then execute once** — launch one sub-agent per group. Each sub-agent receives its specific list of tests to run, nothing more. Sub-agents do not explore or plan — they execute assigned tests and report results.

Output the three rounds, the merged plan, and the group assignments in your response before calling any Agent tool.

### Principles for splitting work

- **Sub-agents run assigned tests, not open exploration.** The main agent hands each sub-agent a specific numbered list of tests. Sub-agents do not plan, explore, or decide what to test — they execute the list and stop.
- **The bottleneck is the slowest agent** — split work so no single agent has a disproportionate share. Many small agents > few large ones.
- **Size the effort to the change** — a single component fix doesn't need many agents or many steps. A full-page redesign does. Let the scope of the diff drive the plan.
- **No early stopping on failures** — find as many bugs as possible within the assigned tests.

### Giving sub-agents a step budget

**The main agent MUST include an explicit browse step limit in every sub-agent prompt.** Sub-agents do not self-limit — they will run until done unless told otherwise.

As a rough heuristic: ~25 steps for a few targeted checks, ~40 for a full page with functional + adversarial + a11y, ~75 for multiple pages or a broad category. **Adjust based on what the assigned tests actually require** — these are starting points, not rules.

As a rough heuristic: ~25 steps for a few targeted checks, ~40 for a full page with functional + adversarial + a11y, ~75 for multiple pages or a broad category. **Adjust based on what the assigned tests actually require** — these are starting points, not rules.

Every sub-agent prompt must include:
```
You have a budget of N browse steps (each `browse` command = 1 step). Count your steps as you go. When you reach N, stop immediately and report:
- STEP_PASS/STEP_FAIL for every test you completed
- STEP_SKIP|<test-id>|budget reached for every test you didn't get to

Do not retry or continue after hitting the budget.
Run only these tests: [numbered list from the merged plan]
Do not explore beyond the assigned tests.
Do NOT generate an HTML report or write any files. Return only step markers and your findings as text.
```

The main agent should NOT run `browse` commands itself (except to verify the dev server is up). All testing happens in sub-agents.

**When a sub-agent hits its budget, the main agent accepts the partial results as-is.** Do not re-run or retry the sub-agent. Include SKIPPED tests in the final report so the developer knows what wasn't covered.

### Reporting

**Every sub-agent reports back with:**
```
Tests: 8 | Passed: 5 | Failed: 2 | Skipped: 1 | Pages visited: 2
```

**The main agent merges into a final report with:**
```
Tests: 20 | Passed: 14 | Failed: 4 | Skipped: 2 | Agents: 3 | Pass rate: 70%
```

Do not report "steps used" — browse command counts are implementation plumbing, not a meaningful metric for reviewers.

## Testing Philosophy

**You are an adversarial tester.** Your goal is to find bugs, not prove correctness.

- **Try to break every feature you test.** Don't just check "does the button exist?" — click it twice rapidly, submit empty forms, paste 500 characters, press Escape mid-flow.
- **Test what the developer didn't think about.** Empty states, error recovery, keyboard-only navigation, mobile overflow.
- **Every assertion must be evidence-based.** Compare before/after snapshots. Check specific elements by ref. Never report PASS without concrete evidence from the accessibility tree or a deterministic check.
- **Report failures with enough detail to reproduce.** Include the exact action, what you expected, what you got, and a suggested fix.

## Assertion Protocol

Every test step MUST produce a structured assertion. Do not write freeform "this looks good."

### Step markers

For each test step, emit exactly one marker:

```
STEP_PASS|<step-id>|<evidence>
```
or
```
STEP_FAIL|<step-id>|<expected> → <actual>|<screenshot-path>
```

- `step-id`: short identifier like `homepage-cta`, `form-validation-error`, `modal-cancel`
- `evidence`: what you observed that proves the step passed (element ref, text content, URL, eval result)
- `expected → actual`: what you expected vs what you got
- `screenshot-path`: path to the saved screenshot (failures only — see Screenshot Capture below)

### Screenshot Capture for Failures

**Every STEP_FAIL MUST have an accompanying screenshot** so the developer can see what went wrong visually.

When a test step fails:

```bash
# 1. Take a screenshot immediately after observing the failure
browse screenshot --path .context/ui-test-screenshots/<step-id>.png

# If --path is not supported, take the screenshot and save manually:
browse screenshot
# The browse CLI will output the screenshot path — move/copy it:
cp /tmp/browse-screenshot-*.png .context/ui-test-screenshots/<step-id>.png
```

Setup the screenshot directory at the start of any test run:

```bash
mkdir -p .context/ui-test-screenshots
```

**Rules:**
- File name = step-id (e.g., `double-submit.png`, `axe-audit.png`, `modal-focus-trap.png`)
- Store in `.context/ui-test-screenshots/` — this directory is gitignored and accessible to the developer and other agents
- For parallel runs, include the session name: `<session>-<step-id>.png` (e.g., `signup-double-submit.png`)
- Take the screenshot at the moment of failure — capture the broken state, not after recovery
- For visual/layout bugs, also screenshot the baseline (working state) for comparison: `<step-id>-baseline.png`

### How to verify (in order of rigor)

1. **Deterministic check** (strongest) — `browse eval` returns structured data you can inspect. Examples: axe-core violation count, `document.title`, form field value, console error array, element count.
2. **Snapshot element match** — a specific element with a specific role and text exists in the accessibility tree. Check by ref: `@0-12 button "Save"`. An element either exists in the tree or it doesn't.
3. **Before/after comparison** — snapshot before action, act, snapshot after. Verify the tree changed in the expected way (element appeared, disappeared, text changed).
4. **Screenshot + visual judgment** (weakest) — only for visual-only properties (color, spacing, layout) that the accessibility tree cannot capture. Always accompany with what specifically you're evaluating.

### Before/after comparison pattern

This is the core verification loop. Use it for every interaction:

```bash
# 1. BEFORE: capture state
browse snapshot
# Record: what elements exist, their text, their refs

# 2. ACT: perform the interaction
browse click @0-12

# 3. AFTER: capture new state
browse snapshot
# Compare: what changed? What appeared? What disappeared?

# 4. ASSERT: emit marker based on comparison
# If dialog appeared: STEP_PASS|modal-open|dialog "Confirm" appeared at @0-20
# If nothing changed:
browse screenshot --path .context/ui-test-screenshots/modal-open.png
# STEP_FAIL|modal-open|expected dialog to appear → snapshot unchanged|.context/ui-test-screenshots/modal-open.png
```

## Setup

```bash
which browse || npm install -g browse
```

### Avoid permission fatigue

This skill runs many `browse` commands (snapshots, clicks, evals). To avoid approving each one, add `browse` to your allowed commands:

Add both patterns to `.claude/settings.json` (project-level) or `~/.claude/settings.json` (user-level):
```json
{
  "permissions": {
    "allow": [
      "Bash(browse:*)",
      "Bash(BROWSE_SESSION=*)"
    ]
  }
}
```

The first pattern covers plain `browse` commands. The second covers parallel sessions (`BROWSE_SESSION=signup browse open ...`). Both are needed to avoid approval prompts.

## Mode Selection

| Target | Mode | Command | Auth |
|--------|------|---------|------|
| `localhost` / `127.0.0.1` | Local | `browse open <url> --local` | None needed (clean isolated local browser by default) |
| Deployed/staging site | Remote | `browse open <url> --remote` | Browserbase credentials; use contexts where supported |

**Rule: If the target URL contains `localhost` or `127.0.0.1`, pass `--local` on the first `browse open`.**

### Local Mode (default for localhost)

```bash
browse open http://localhost:3000 --local
```

`browse open ... --local` uses a clean isolated local browser by default, which is best for reproducible localhost QA runs.

Use local-mode variants only when needed:

- `browse open <url> --auto-connect` — auto-discover an existing debuggable local Chrome. Use this only when the test explicitly needs existing local login/cookies/state.
- `browse open <url> --cdp <port|url>` — attach to a specific CDP target (explicit local browser attach).

### Remote Mode (deployed sites via cookie-sync)

```bash
# Step 1: Sync cookies from local Chrome to Browserbase
node .claude/skills/cookie-sync/scripts/cookie-sync.mjs --domains your-app.com
# Output: Context ID: ctx_abc123

# Step 2: Open in remote mode with the synced context
SESSION_JSON="$(browse cloud sessions create --context-id ctx_abc123 --persist --keep-alive)"
SESSION_ID="$(echo "$SESSION_JSON" | jq -r .id)"
CONNECT_URL="$(echo "$SESSION_JSON" | jq -r .connectUrl)"

browse open https://staging.your-app.com --cdp "$CONNECT_URL"
browse snapshot
# ... run tests ...
browse stop
browse cloud sessions update "$SESSION_ID" --status REQUEST_RELEASE
```

Cookie-sync flags: `--domains`, `--context`, `--verified`, `--proxy "City,ST,US"`

## Workflow A: Diff-Driven Testing

### Phase 1: Analyze the diff

```bash
git diff --name-only HEAD~1          # or: git diff --name-only / git diff --name-only main...HEAD
git diff HEAD~1 -- <file>            # read actual changes
```

Categorize changed files:

| File pattern | UI impact | What to test |
|-------------|-----------|--------------|
| `*.tsx`, `*.jsx`, `*.vue`, `*.svelte` | Component | Render, interaction, state, edge cases |
| `pages/**`, `app/**`, `src/routes/**` | Route/page | Navigation, page load, content, 404 handling |
| `*.css`, `*.scss`, `*.module.css` | Style | Visual appearance (screenshot), responsive |
| `*form*`, `*input*`, `*field*` | Form | Validation, submission, empty input, long input, special chars |
| `*modal*`, `*dialog*`, `*dropdown*` | Interactive | Open/close, escape, focus trap, cancel vs confirm |
| `*nav*`, `*menu*`, `*header*` | Navigation | Links, active states, routing, keyboard nav |
| Non-UI files only | None | Skip — report "no UI tests needed" |

### Phase 2: Map files to URLs

Detect framework: `cat package.json | grep -E '"(next|react|vue|nuxt|svelte|@sveltejs|angular|vite)"'`

| Framework | Default port | File → URL pattern |
|-----------|-------------|-----|
| Next.js App Router | 3000 | `app/dashboard/page.tsx` → `/dashboard` |
| Next.js Pages Router | 3000 | `pages/about.tsx` → `/about` |
| Vite | 5173 | Check router config |
| Nuxt | 3000 | `pages/index.vue` → `/` |
| SvelteKit | 5173 | `src/routes/+page.svelte` → `/` |
| Angular | 4200 | Check routing module |

### Phase 3: Ensure the right code is running

Before testing, verify the dev server is serving the code from the diff — not a stale branch.

**If testing a PR or specific branch:**
```bash
# Check what branch is currently checked out
git branch --show-current

# If it's not the PR branch, switch to it
git fetch origin <branch> && git checkout <branch>

# Install deps — the lockfile may differ between branches
yarn install  # or npm install / pnpm install
```

If the dev server was already running on a different branch, restart it after checkout.

**Find a running dev server:**
```bash
for port in 3000 3001 5173 4200 8080 8000 5000; do
  s=$(curl -s -o /dev/null -w "%{http_code}" "http://localhost:$port" 2>/dev/null)
  if [ "$s" != "000" ]; then echo "Dev server on port $port (HTTP $s)"; fi
done
```

If nothing found: tell the user to start their dev server.

**Verify it actually renders:**
After `browse open` + `browse snapshot`, check that the accessibility tree contains real page content (navigation, headings, interactive elements) — not just an error overlay or empty body. Next.js dev servers can return HTTP 200 while showing a full-screen build error dialog. If the snapshot is empty or dominated by an error dialog, the server is broken — fix the build before testing.

### Phase 4: Generate test plan

For each changed area, plan **both happy path AND adversarial tests**:

```
Test Plan (based on git diff)
=============================
Changed: src/components/SignupForm.tsx (added email validation)

1. [happy] Valid email submits successfully
   URL: http://localhost:3000/signup
   Steps: fill valid email → submit → verify success message appears

2. [adversarial] Invalid email shows error
   Steps: fill "not-an-email" → submit → verify error message appears

3. [adversarial] Empty form submission
   Steps: click submit without filling anything → verify error, no crash

4. [adversarial] XSS in email field
   Steps: fill "<script>alert(1)</script>" → submit → verify sanitized/rejected

5. [adversarial] Rapid double-submit
   Steps: click submit twice quickly → verify no duplicate submission

6. [adversarial] Keyboard-only flow
   Steps: Tab to email → type → Tab to submit → Enter → verify success
```

### Phase 5: Execute tests

```bash
browse stop 2>/dev/null
mkdir -p .context/ui-test-screenshots
# localhost/default QA → clean, reproducible local run
browse open http://localhost:3000 --local
```

For each test, follow the **before/after pattern**:

```bash
# Navigate
browse open http://localhost:3000/path --local
browse wait load

# BEFORE snapshot
browse snapshot
# Note the current state: elements, refs, text

# ACT
browse click @0-ref
# or: browse fill "selector" "value"
# or: browse type "text"
# or: browse press Enter

# AFTER snapshot
browse snapshot
# Compare against BEFORE: what changed?

# ASSERT with marker
# STEP_PASS|step-id|evidence  OR  STEP_FAIL|step-id|expected → actual
```

### Phase 6: Report results

```
## UI Test Results

### STEP_PASS|valid-email-submit|status "Thanks!" appeared at @0-42 after submit
- URL: http://localhost:3000/signup
- Before: form with email input @0-3, submit button @0-7
- Action: filled "[email protected]", clicked @0-7
- After: form replaced by status element with "Thanks! We'll be in touch."

### STEP_FAIL|double-submit|expected single submission → form submitted twice|.context/ui-test-screenshots/double-submit.png
- URL: http://localhost:3000/signup
- Before: form with submit button @0-7
- Action: clicked @0-7 twice rapidly
- After: two success toasts appeared, suggesting duplicate submission
- Screenshot: .context/ui-test-screenshots/double-submit.png
- Suggestion: disable submit button after first click, or debounce the handler

---
**Summary: 4/6 passed, 2 failed**
Failed: double-submit, xss-sanitization

Screenshots saved to `.context/ui-test-screenshots/` — open any failed step's screenshot to see the broken state.
```

Always `browse stop` when done.

### Phase 7: Generate HTML report

After producing the text report, generate a standalone HTML report that a reviewer can open in a browser. The report embeds screenshots inline (base64) so it works as a single file — no external dependencies.

**Why:** Text reports are good for the agent conversation, but reviewers (PMs, designers, other engineers) want a visual artifact they can open, scan, and share. Screenshots inline make failures immediately obvious.

#### How to generate

1. Read the HTML template at [references/report-template.html](references/report-template.html)
2. Build the report by replacing the template placeholders with actual test data:

| Placeholder | Value |
|-------------|-------|
| `{{TITLE}}` | Report title for `<title>` tag (e.g., "UI Test: PR #1234 — OAuth Settings") |
| `{{TITLE_HTML}}` | Report title for the visible `<h1>`. If a PR URL is available, wrap the PR reference in an `<a>` tag so it's clickable (e.g., `UI Test: <a href="https://github.com/org/repo/pull/1234">PR #1234</a> — OAuth Settings`). If no URL, use plain text same as `{{TITLE}}`. |
| `{{META}}` | One-line context: date, app URL, user, branch |
| `{{TOTAL_TESTS}}` | Total STEP_PASS + STEP_FAIL count |
| `{{AGENT_COUNT}}` | Number of sub-agents that ran |
| `{{PASS_COUNT}}` | Number of STEP_PASS |
| `{{FAIL_COUNT}}` | Number of STEP_FAIL |
| `{{PASS_RATE}}` | Integer percentage (e.g., "92") |
| `{{RATE_CLASS}}` | `good` (≥90%), `warn` (70–89%), `bad` (<70%) |
| `{{FAILURES_SECTION}}` | HTML for failed test cards (see below) |
| `{{PASSES_SECTION}}` | HTML for passed test cards (see below) |

3. For each test result, generate a `<details>` card. Failed tests should be **open by default** so reviewers see them immediately:

```html
<!-- Failed test card (open by default) -->
<div class="section">
  <h2>Failures <span class="count">{{FAIL_COUNT}}</span></h2>
  <details class="test-card fail" open>
    <summary>
      <span class="badge fail">FAIL</span>
      <span class="step-id">step-id-here</span>
      <span class="evidence">expected → actual</span>
    </summary>
    <div class="body">
      <dl>
        <dt>URL</dt><dd>http://localhost:3000/path</dd>
        <dt>Action</dt><dd>What was done</dd>
        <dt>Expected</dt><dd>What should have happened</dd>
        <dt>Actual</dt><dd>What happened instead</dd>
      </dl>
      <div class="suggestion">Fix: description of suggested fix</div>
      <div class="screenshot">
        <img src="data:image/png;base64,..." alt="Screenshot of failure">
        <div class="caption">step-id.png — captured at moment of failure</div>
      </div>
    </div>
  </details>
</div>

<!-- Passed test card (collapsed by default) -->
<div class="section">
  <h2>Passed <span class="count">{{PASS_COUNT}}</span></h2>
  <details class="test-card pass">
    <summary>
      <span class="badge pass">PASS</span>
      <span class="step-id">step-id-here</span>
      <span class="evidence">evidence summary</span>
    </summary>
    <div class="body">
      <dl>
        <dt>URL</dt><dd>http://localhost:3000/path</dd>
        <dt>Evidence</dt><dd>What was observed</dd>
      </dl>
    </div>
  </details>
</div>
```

4. **Embed screenshots as base64** so the HTML is fully self-contained:

```bash
# Convert screenshot to base64 data URI
base64 -i .context/ui-test-screenshots/step-id.png | tr -d '\n'
# Use as: src="data:image/png;base64,<output>"
```

Read each screenshot file referenced in STEP_FAIL markers, base64-encode it, and embed it as an `<img src="data:image/png;base64,...">` in the corresponding test card. For STEP_PASS, only embed a screenshot if one was explicitly taken (e.g., baseline screenshots).

5. Write the final HTML to `.context/ui-test-report.html`:

```bash
# Write the generated HTML
cat > .context/ui-test-report.html << 'REPORT_EOF'
<!DOCTYPE html>
...generated report...
REPORT_EOF

# Open it for the reviewer
open .context/ui-test-report.html  # macOS
# xdg-open .context/ui-test-report.html  # Linux
```

6. Tell the user: `Report saved to .context/ui-test-report.html` and offer to open it.

**Rules:**
- Failures section comes before passes — reviewers care about what's broken first
- Failed cards are `open` by default; passed cards are collapsed
- Every STEP_FAIL card MUST have an embedded screenshot — if the screenshot file is missing, note it in the card
- Include the suggestion/fix in each failure card if one was provided
- The report must work offline — no CDN links, no external assets
- Keep the HTML under 5MB — if screenshots push it over, reduce image quality or skip baseline screenshots for passes

## Adversarial Test Patterns

Apply these to every interactive element you test. Read [references/adversarial-patterns.md](references/adversarial-patterns.md) for the full pattern library (forms, modals, navigation, error states, keyboard accessibility).

## Deterministic Checks

These produce structured data, not judgment calls. Use them as the strongest form of assertion.

| Check | What it catches | Assertion |
|-------|----------------|-----------|
| axe-core | WCAG violations | `violations.length === 0` |
| Console errors | Runtime exceptions, failed requests | empty error array |
| Broken images | Missing/failed image loads | no images with `naturalWidth === 0` |
| Form labels | Inputs without accessible labels | every input has `hasLabel: true` |

For the exact `browse eval` recipes, read [references/browser-recipes.md](references/browser-recipes.md).

## Workflow B: Exploratory Testing

No diff, no plan — just open the app and try to break it. Use this when the user says "test my app", "find bugs", or "QA this site."

### Approach

1. **Discover the app** — read `package.json` to detect the framework, then open the root URL and snapshot to see what's there
2. **Navigate everything** — click through nav links, visit every reachable page, note what exists
3. **Test what you find** — for each page, apply the adversarial patterns below (forms, modals, navigation, keyboard, error states)
4. **Run deterministic checks** — axe-core, console errors, broken images, form labels on every page
5. **Report findings** — use STEP_PASS/STEP_FAIL markers, include reproduction steps for failures

Don't try to be systematic about coverage. Just explore like a user would, but with the intent to break things. The agent is good at this — let it roam.

### Tips for exploratory runs

- Start with the homepage, then follow the navigation naturally
- Try the 404 page (`/does-not-exist`) — is it custom or default?
- Look for empty states (pages with no data)
- Test forms with garbage input before valid input
- Check mobile viewport (375px) on every page — does it overflow?
- If the app has auth, use cookie-sync first

## Workflow C: Parallel Testing

Run independent test groups concurrently using named `browse` sessions (`BROWSE_SESSION=<name>`). Each session gets its own browser. Works with both local and remote mode.

Use when testing multiple pages or categories and you want faster wall clock time.

Read [references/parallel-testing.md](references/parallel-testing.md) for the full workflow: session setup, agent fan-out, cookie-sync for auth, and result merging.

## Design Consistency

Check whether changed UI matches the rest of the app visually. Read [references/design-consistency.md](references/design-consistency.md) when doing visual or design checks.

## Test Categories

| Category | How | Assertion type |
|----------|-----|---------------|
| Accessibility | axe-core + keyboard nav | Deterministic (violation count) |
| Visual Quality | Screenshot + heuristic evaluation | Visual judgment (weakest — note specifics) |
| Responsive | Viewport sweep + screenshots | Visual + deterministic (overflow check) |
| Console Health | Console capture eval | Deterministic (error count) |
| UX Heuristics | Snapshot + Laws of UX + Nielsen's | Structured judgment (cite specific heuristic) |
| Error States | Navigate to empty/error states | Before/after comparison |
| Data Display | Snapshot on tables/dashboards | Element match (column count, formatting) |
| Design Consistency | Screenshot baseline + changed page comparison | Visual judgment (cite specific property) |
| Exploratory | Free navigation + adversarial testing | Before/after + judgment |

Reference guides (load on demand):
- **Adversarial patterns** — [references/adversarial-patterns.md](references/adversarial-patterns.md) — load when testing forms, modals, navigation, or keyboard a11y
- **Browser recipes** — [references/browser-recipes.md](references/browser-recipes.md) — load when running deterministic checks (axe-core, console, images, form labels)
- **Exploratory testing** — [references/exploratory-testing.md](references/exploratory-testing.md) — load for Workflow B (no diff, open exploration)
- **UX heuristics** — [references/ux-heuristics.md](references/ux-heuristics.md) — load when evaluating UX quality or citing specific heuristics
- **Design system** — [references/design-system.example.md](references/design-system.example.md) — template for users to customize
- **Design consistency** — [references/design-consistency.md](references/design-consistency.md) — load when doing visual consistency checks
- **Parallel testing** — [references/parallel-testing.md](references/parallel-testing.md) — load for Workflow C (concurrent sessions)
- **Report template** — [references/report-template.html](references/report-template.html) — HTML template for Phase 7 report generation

For worked examples with exact commands, read [EXAMPLES.md](EXAMPLES.md) if you need to see the assertion protocol in action.

## Best Practices

1. **Be adversarial** — try to break things, don't just confirm they work
2. **Every assertion needs evidence** — snapshot ref, eval result, or before/after diff
3. **Before/after for every interaction** — snapshot, act, snapshot, compare
4. **Screenshot every failure** — `browse screenshot` immediately on STEP_FAIL, save to `.context/ui-test-screenshots/<step-id>.png`
5. **Deterministic checks first** — axe-core, console errors, form labels before visual judgment
6. **For localhost, start with clean local mode** — pass `--local` on the first `browse open` for reproducible runs; use `--auto-connect` only when existing local state is required
7. **Always `browse stop` when done** — for parallel runs, stop every named session
8. **Report failures with reproduction steps** — action, expected, actual, screenshot path, suggestion
9. **Parallelize independent tests** — use Workflow C with named sessions when testing multiple pages or categories on a deployed site

## Troubleshooting

- **"No active page"**: `browse stop`, retry. For zombies: `pkill -f "browse.*daemon"`
- **Dev server not responding**: `curl http://localhost:<port>` — ask user to start it
- **`browse eval` with `await` fails**: Use `.then()` instead — `browse eval` doesn't support top-level await
- **Element ref not found**: `browse snapshot` again — refs change on page update
- **Blank snapshot**: `browse wait load` or `browse wait selector ".expected"` before snapshotting
- **SPA deep links 404**: Navigate to `/` first, then click through
- **Remote auth fails**: Re-run cookie-sync with `--context <id>`, try `--verified`
- **Parallel session conflicts**: Ensure every `browse` command uses `BROWSE_SESSION=<name>` — without it, commands go to the default session
- **Session not stopping**: `BROWSE_SESSION=<name> browse stop`. For zombies: `pkill -f "browse.*<name>.*daemon"`

Instalar ui-test

Baixe e descompacte os arquivos de habilidades no diretório .claude/skills/.

Baixar ZIP

Clone o repositório e copie os arquivos da habilidade para o seu projeto.

git clone https://github.com/browserbase/skills/tree/main/skills/ui-test # Copy SKILL.md to your .claude/skills/ directory

Copiar Copiar
Configuração rápida: Copie a pasta da habilidade para .claude/skills/ O Claude detectará e utilizará automaticamente a habilidade
Repositório browserbase/skills

Habilidades relacionadas

github-code-search
Tempo atualizado 29 de Junho de 2026
drizzle-orm
Tempo atualizado 29 de Junho de 2026
prisma-client-api
Tempo atualizado 29 de Junho de 2026
clickhouse-io
Tempo atualizado 29 de Junho de 2026
OR