Search results

Mask while decoding in <code>_sample_top_p</code>

Status: Open.

#16 In hkproj/pytorch-llama;

· ovshake opened on Jan 26, 2025

causal attention mask

Status: Open.

#15 In hkproj/pytorch-llama;

· itera-del opened on Dec 23, 2024

Some questions about your source code

Status: Open.

#14 In hkproj/pytorch-llama;

· shawnnjupt opened on Dec 13, 2024

No need to use forward method?

Status: Open.

#11 In hkproj/pytorch-llama;

· nkkbr opened on Jun 18, 2024

Can I turn off KV cache?

Status: Open.

#10 In hkproj/pytorch-llama;

· purejomo opened on May 25, 2024

Error in rotary matrix multiplication formula of slide 25

Status: Open.

#9 In hkproj/pytorch-llama;

· sanzgadea opened on Apr 23, 2024

what is minimal computer can be used for only inference

Status: Open.

#6 In hkproj/pytorch-llama;

· Sandy4321 opened on Jan 22, 2024

will it work on windows OS with only CPU?

Status: Open.

#5 In hkproj/pytorch-llama;

· Sandy4321 opened on Jan 21, 2024