Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
Hello I came across the term Act Order
Hello I came across the term Act Order
Inactive
0
Follow
m
martinkozle
last year
Β·
Hello, I came across the term "Act Order (desc_act)" here
https://huggingface.co/TheBloke/vicuna-7B-v1.3-GPTQ
in context of quantisation. I couldn't find any info on what that is. Does anybody happen to know what it means?
m
1 comment
Share
Open in Discord
m
martinkozle
last year
To partially answer my question with extra info that I found. I found the parameter in the GPTQ-for-LLaMa repo, with the description
Whether to apply the activation order GPTQ heuristic
(
https://github.com/qwopqwop200/GPTQ-for-LLaMa/blob/59cabb9a46db093f0fced4fe8329a3eb14e0a481/neox.py#L382
)
And I found the bit of code where it is used
https://github.com/qwopqwop200/GPTQ-for-LLaMa/blob/59cabb9a46db093f0fced4fe8329a3eb14e0a481/gptq.py#L150C4-L150C4
.
Other than that it makes the quantized model better, I couldn't find any more detailed information on why.
Add a reply
Sign up and join the conversation on Discord
Join on Discord