Skip to content

feat(examples): add runnable integration benchmarks, CONTRIBUTING guide, and roofline docs - #8

Merged
Prajwal7-2002 merged 1 commit into
mainfrom
feat/examples-and-servebench-integration
Oct 26, 2026
Merged

Prajwal7-2002 merged 1 commit into
mainfrom
feat/examples-and-servebench-integration

Conversation

@Prajwal7-2002

Copy link
Copy Markdown
Owner

Summary

  • Runnable Example Scripts:
    • \examples/01_quant_linear_inference.py: Drop-in QuantLinear replacement, bit-packing memory footprint, and recursive transformer conversion with float \lm_head\ preservation.
    • \examples/02_advanced_calibration.py: SmoothQuant continuous mathematical invariance verification, AWQ Frobenius grid search, and GPTQ second-order Hessian error compensation with 1.48x error reduction.
    • \examples/03_servebench_roofline_eval.py: Hardware roofline modeling on consumer GPUs (RTX 3050, T4), demonstrating autoregressive decode arithmetic intensity = 2 / \text{bytes_per_param}$ and .4%$ DRAM bandwidth traffic reduction under INT4.
  • Contributing Guide:
    • Added \CONTRIBUTING.md\ covering \uv\ development setup, invariant testing protocols, zero compiled C++/CUDA principles, and pull request conventions.
  • Documentation Polish:
    • Updated \README.md\ with PyPI installation instructions, test suite metrics (47 tests, 95% coverage), and references to examples and contribution guidelines.

@Prajwal7-2002
Prajwal7-2002 merged commit 24701f5 into main Oct 26, 2026
7 checks passed
@Prajwal7-2002
Prajwal7-2002 deleted the feat/examples-and-servebench-integration branch October 26, 2026 19:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant