LoRA and Weight Decay (2023)

LoRA doesn’t approximate a solution to full-finetuning; it solves a different (albeit similar) optimization problem
31 points by jxmorris12 157 days ago irhum.github.io 0 comments
Summary not yet generated for this article.

Comments (0 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open