deepseekmirror/DeepSeek-V3
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-V3.git synced 2025-02-22 05:38:59 -05:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Fix Linear Layer Bias Initialization

Browse Source
This commit is contained in:
XxAlonexX 2025-02-04 10:38:45 +05:30
parent b5d872ead0
commit 6a30b43249
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
inference/model.py
View File

@ -185,7 +185,7 @@ class Linear(nn.Module):
else:
self.register_parameter("scale", None)
if bias:
self.bias = nn.Parameter(torch.empty(self.part_out_features))
self.bias = nn.Parameter(torch.empty(out_features))
else:
self.register_parameter("bias", None)