Skip to content

Project Structure

Wiki Keeper (Grok Bot) edited this page Oct 15, 2026 · 4 revisions

Project Structure

Wiki hero

engram-parser/
├── src/
│   ├── lib.rs                 # re-exports (checkpoint, analysis::moe, gguf, …)
│   ├── error.rs               # ParserError, ParseLimitKind, HostSizeField
│   ├── checkpoint/            # format-independent Checkpoint API
│   │   ├── mod.rs             # Checkpoint trait, Catalog
│   │   ├── types.rs           # TensorInfo, TensorDType, TensorShape, …
│   │   ├── open.rs            # open_checkpoint, AnyCheckpoint, detect
│   │   ├── gguf.rs            # GgufBackend / GgufMmapBackend
│   │   └── safetensors.rs     # SafetensorsBackend / SafetensorsMmapBackend
│   ├── analysis/
│   │   ├── mod.rs
│   │   └── moe/               # canonical MoE analysis
│   │       ├── mod.rs
│   │       ├── expert.rs      # MoeExpertWeights, RawTensor
│   │       └── extract.rs     # list_experts, extract_expert
│   ├── moe/mod.rs             # compat re-exports → analysis::moe
│   ├── gguf/
│   │   ├── mod.rs             # load_gguf, parse_bytes (+ mmap / with_limits)
│   │   ├── cursor.rs          # LE streaming reads, KV skip
│   │   ├── layout.rs          # GgufLayout, GgufMetadata, directory invariants
│   │   ├── limits.rs          # ParseLimits
│   │   ├── tensor.rs          # Tensor, DType, f16 helper
│   │   ├── dequant.rs         # packed dequant: Q8_0 / Q5_K / Q6_K / IQ3_M
│   │   └── map.rs             # load_gguf_mmap (--features mmap)
│   └── safetensors/           # --features safetensors (upstream safetensors 0.8)
│       ├── mod.rs
│       ├── checkpoint.rs      # open_safetensors_checkpoint, payload reads
│       ├── map.rs             # mmap payloads (--features mmap)
│       ├── discovery.rs
│       ├── json.rs
│       ├── manifest.rs
│       ├── paths.rs
│       └── validate.rs
├── tests/
│   ├── checkpoint_api.rs
│   ├── checkpoint_parity_matrix.rs
│   ├── gguf_smoke.rs
│   ├── gguf_limits.rs
│   ├── gguf_directory_invariants.rs
│   ├── golden_dequant.rs
│   ├── mmap_gguf.rs
│   ├── nonregular_inputs.rs
│   ├── public_api_surface.rs
│   ├── real_gguf.rs
│   ├── safetensors_smoke.rs
│   ├── safetensors_payload.rs
│   ├── safetensors_mmap.rs
│   └── fixtures/golden/ …
├── examples/
│   ├── inspect_gguf.rs
│   ├── inspect_checkpoint.rs
│   └── checkpoint_smoke.rs    # requires mmap + safetensors
├── .github/workflows/
│   ├── ci.yml
│   ├── release.yml
│   └── security.yml
├── .qlty/qlty.toml
├── rust-toolchain.toml        # channel 1.99.0
├── Cargo.toml                 # MSRV 1.97.1; optional memmap2 + safetensors
└── README.md

Crate metadata

Field Value
name engram-parser
version 0.3.0
edition 2024
rust-version (MSRV) 1.97.1
toolchain pin 1.99.0
default dependencies none
optional dependencies memmap2 (mmap), upstream safetensors 0.8 (safetensors)
features mmap, safetensors (default = [])
release opt-level=3, LTO, codegen-units=1
package include source, examples, README, CHANGELOG, licenses (tests/docs/CI excluded from crates.io package)

Standalone [workspace] so parent workspaces do not absorb the crate.


Last updated: October 14, 2026 Updated by: Wiki Keeper (Grok Bot) Package tip reference: dbc46cf (main)

Clone this wiki locally