You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
### Summary
when building to doc.rs it seems to be unable to find the
docs/katex.html, so I moved it within the bintensors directory.
```
...
[INFO] [stderr] warning: target filter specified, but no targets matched; this is a no-op
[INFO] [stderr] Documenting bintensors v0.0.1-alpha.2 (/opt/rustwide/workdir)
[INFO] [stderr] error: error reading `../docs/katex.html`: No such file or directory (os error 2)
...
```
bintensors is a high-performance binary tensor serialization
32
-
format designed to be faster than safetensors by eliminating
33
-
JSON metadata overhead. Instead of using JSON for metadata storage,
34
-
bintensors employs a compact binary header, reducing parsing time and improving I/O efficiency.
35
-
The format begins with an 8-byte unsigned integer (u64), indicating the size of the binary header.
36
-
This header contains essential tensor metadata, including the data type (dtype),
37
-
the shape of the tensor stored as a length-prefixed list,
38
-
and data offsets specifying where each tensor's raw values are stored within the file.
39
-
An index map is also included for named tensor lookups. With its efficient structure,
40
-
bintensors provides a fast and lightweight alternative for serializing and deserializing large models,
41
-
making it ideal for machine learning, scientific computing, and other high-performance applications.
42
-
"""
30
+
description = "bintensors is a high-performance binary tensor serialization format designed to be faster than safetensors by eliminating JSON metadata overhead."
0 commit comments