You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
just-scrape crawl <url> -f markdown # or html, json, etc.
156
-
just-scrape crawl <url> -m direct+stealth
157
+
just-scrape crawl <url> -m js --stealth
157
158
```
158
159
159
160
### Fetch Modes
160
161
161
-
Use `-m / --mode` on `extract`, `search`, `scrape`, `markdownify`, and `crawl` to choose how pages are fetched. The legacy `--stealth`boolean is replaced by the mode enum below.
162
+
Use `-m / --mode` on `scrape`, `markdownify`, and `crawl` to choose how pages are fetched. Add `--stealth`to enable anti-bot bypass.
162
163
163
164
| Mode | Description |
164
165
|---|---|
165
166
|`auto`| Automatic selection (default) |
166
167
|`fast`| Fastest, no JS rendering |
167
168
|`js`| Full JS rendering |
168
-
|`direct+stealth`| Direct fetch with anti-bot bypass |
169
-
|`js+stealth`| JS rendering with anti-bot bypass |
169
+
170
+
<Note>
171
+
On `extract`, `--mode` sets the **HTML processing mode** (`normal`, `reader`, `prune`) instead. Use `--stealth` separately for anti-bot bypass.
172
+
</Note>
173
+
174
+
### Monitor
175
+
176
+
Create and manage page-change monitors that track changes on a URL at a set interval.
0 commit comments