mirror of
https://github.com/deepseek-ai/DeepSeek-V3.git
synced 2025-02-22 13:48:56 -05:00
Fix incorrect comment in linear function regarding weight.element_size()
This commit is contained in:
parent
2f7b80eece
commit
4e570a99a7
@ -143,8 +143,8 @@ def linear(x: torch.Tensor, weight: torch.Tensor, bias: Optional[torch.Tensor] =
|
||||
quantization-aware computations depending on the input parameters.
|
||||
|
||||
Notes:
|
||||
- If `weight` is quantized (e.g., `element_size() == 1`), a dequantized version
|
||||
is used for computation.
|
||||
- If `weight` is in a higher precision format (e.g., float32 or bfloat16), then `element_size() > 1`, and the original
|
||||
weight tensor is used for computation.
|
||||
- If `gemm_impl == "bf16"`, dequantization and a `bf16` GEMM operation are applied.
|
||||
- For other cases, the function applies quantization to `x` and uses `fp8_gemm` for computation.
|
||||
"""
|
||||
|
Loading…
Reference in New Issue
Block a user