Skip to content

Feat/tui generation speed - #728

Closed
sovf4717 wants to merge 2 commits into
cecli-dev:mainfrom
sovf4717:feat/tui-generation-speed
Closed

sovf4717 wants to merge 2 commits into
cecli-dev:mainfrom
sovf4717:feat/tui-generation-speed

Conversation

@sovf4717

Copy link
Copy Markdown
image

dwash96 added a commit that referenced this pull request Nov 1, 2026
@dwash96

dwash96 commented Nov 1, 2026 •

Copy link
Copy Markdown
Collaborator

Going to handle this one with:
c3bca4a

and the --show-speed environment variable with format:
1.28s ↑ 7.8k ◇ 0.27s ↓ 296

So time to first token, prefill speed, response generation time and decode t/s

@dwash96 dwash96 closed this Nov 1, 2026
@dwash96 dwash96 mentioned this pull request Nov 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants