docs(developer-index): document the web: id prefix - #218
Conversation
Search API replies to `/v2/search/developer` include a fifth id prefix — `web:` — for open web pages returned alongside the four curated kinds (`doc:`, `issue:`, `pull_request:`, `readme:`). The skill enumerated only the curated four, so an agent following the "scope last" guidance and satisfying the "quote and cite" rule could mistake a `web:` result for a curated primary source. Add `web:` to the enumerated prefix list, mark it as an open web page rather than a curated artifact, and note that the way to keep only curated results is to pass `types=["doc","issue","pull_request","readme"]` (`types=["web"]` is rejected with a 400). Fixes firecrawl#213
There was a problem hiding this comment.
All reported issues were addressed across 1 file
Reply with feedback, questions, or to request a fix.
Fix all with cubic | Re-trigger cubic
Address cubic review on firecrawl#218: the earlier line 17 change said passing `types=["doc","issue","pull_request","readme"]` "keeps only curated results", but the Filters section right below still described the same enumeration as the default — the workaround read as redundant. Update the Filters `types` bullet to state plainly that when `types` is unset the response also carries `web:` results, and that passing an explicit list is the only way to exclude them. Keeps the section consistent with the new line 17 note and with the reported behaviour in firecrawl#213.
|
Thanks @cubic-dev-ai — you're right, the workaround read as redundant against the existing 'Defaults to all four' line. Pushed c8e383d which updates the Filters |
@gaurav-init Looks right. The Filters bullet now says plainly that an unset One tiny nit while we're here, only if you want it: the Filters bullet still starts with "which of Both changes shipped in c8e383d are consistent and resolve the redundancy I flagged. No further action needed. Tip: get faster answers by chatting with cubic’s review copilot in the review UI |
There was a problem hiding this comment.
0 issues found across 1 file (changes from recent commits).
Confidence score: 5/5
- Automated review surfaced no issues in the provided summaries.
- No files require special attention.
Shadow auto-approve: would auto-approve. Docs-only update to the developer-search skill: adds the web: id prefix and the curated-types workaround, with no code or behavior changes. The change is bounded and clearly beneficial.
Re-trigger cubic
Summary
/v2/search/developerreturns a fifthidprefix,web:, alongside the four curated kinds documented in the skill. Unscoped queries can return a majority ofweb:results, which don't come from the index. Following the skill's existing "scope last, not first" guidance and satisfying its "quote the passage, cite the url" rule then treats an open web page as a curated primary source.This updates the enumerated prefix list in
skills/firecrawl-developer-index/SKILL.mdto mentionweb:, describe it as an open web page rather than a curated artifact, and note the workaround (passtypes=["doc","issue","pull_request","readme"]to keep only curated results;types=["web"]is rejected with a 400).Minimal single-line edit — no changes to principles, filters, or examples.
Related
Fixes #213
Test plan
pnpm format:check— cleanpnpm type-check— cleanpnpm test— 426 passed / 7 skipped, no regressionsSummary by cubic
Documents the
web:id prefix that/v2/search/developerreturns alongside the four curated index kinds. The skill previously listed onlydoc:,issue:,pull_request:, andreadme:, so an agent following the "scope last" guidance could cite an open web page as if it were a curated primary source. The update marksweb:results as open web pages and clarifies in the Filters section that unsettypesreturns them too — passingtypes=["doc","issue","pull_request","readme"]is the only way to exclude them, whiletypes=["web"]alone is rejected with a 400.Fixes #213.
Written for commit c8e383d. Summary will update on new commits.