 v0xie
|
07805cbeee
fix: AttributeError when attempting to reshape rescale by org_module weight
|
hai 1 ano |
 Kohaku-Blueleaf
|
c4afdb7895
For no constraint
|
hai 1 ano |
|
Kohaku-Blueleaf
|
64179c3221
Update network_oft.py
|
hai 1 ano |
|
Kohaku-Blueleaf
|
591470d86d
linting
|
hai 1 ano |
|
Kohaku-Blueleaf
|
a5436a3ac0
Update network_oft.py
|
hai 1 ano |
|
Kohaku-Blueleaf
|
4eb949625c
prevent undefined variable
|
hai 1 ano |
|
Kohaku-Blueleaf
|
5a8dd0c549
Fix rescale
|
hai 1 ano |
|
Kohaku-Blueleaf
|
90441294db
Add rescale mechanism
|
hai 1 ano |
|
v0xie
|
613b0d9548
doc: add boft comment
|
hai 1 ano |
|
v0xie
|
325eaeb584
fix: get boft params from weight shape
|
hai 1 ano |
|
v0xie
|
2f1073dc6e
style: fix lint
|
hai 1 ano |
|
v0xie
|
a4668a16b6
fix: calculate butterfly factor
|
hai 1 ano |
|
v0xie
|
9588721197
feat: support LyCORIS BOFT
|
hai 1 ano |
|
v0xie
|
fd383140cf
fix: wrong devices for eye and constraint
|
hai 1 ano |
|
Kohaku-Blueleaf
|
f8f38c7c28
Fix dtype casting for OFT module
|
hai 1 ano |
|
Kohaku-Blueleaf
|
3772a82a70
better naming and correct order for device.
|
hai 1 ano |
|
Kohaku-Blueleaf
|
8fc67f3851
remove debug print
|
hai 1 ano |
|
Kohaku-Blueleaf
|
265bc26c21
Use self.scale instead of custom finalize
|
hai 1 ano |
|
Kohaku-Blueleaf
|
735c9e8059
Fix network_oft
|
hai 1 ano |
|
v0xie
|
eb667e715a
feat: LyCORIS/kohya OFT network support
|
hai 1 ano |
|
v0xie
|
d6d0b22e66
fix: ignore calc_scale() for COFT which has very small alpha
|
hai 1 ano |
|
v0xie
|
bbf00a96af
refactor: remove unused function
|
hai 1 ano |
|
v0xie
|
329c8bacce
refactor: use same updown for both kohya OFT and LyCORIS diag-oft
|
hai 1 ano |
|
v0xie
|
f6c8201e56
refactor: move factorization to lyco_helpers, separate calc_updown for kohya and kb
|
hai 1 ano |
|
v0xie
|
fe1967a4c4
skip multihead attn for now
|
hai 1 ano |
|
v0xie
|
d727ddfccd
no idea what i'm doing, trying to support both type of OFT, kblueleaf diag_oft has MultiheadAttn which kohya's doesn't?, attempt create new module based off network_lora.py, errors about tensor dim mismatch
|
hai 1 ano |
|
v0xie
|
a2fad6ee05
test implementation based on kohaku diag-oft implementation
|
hai 1 ano |
|
v0xie
|
6523edb8a4
style: conform style
|
hai 1 ano |
|
v0xie
|
3b8515d2c9
fix: multiplier applied twice in finalize_updown
|
hai 1 ano |
|
v0xie
|
4a50c9638c
refactor: remove used OFT functions
|
hai 1 ano |
