FoamoftheSea
/

pvt_v2_b2

FoamoftheSea commited on Dec 28, 2023

Commit

cac2a9d

1 Parent(s): b1c474c

Update config.json

Switched from "attn_reduce" to "linear_attention" param

Files changed (1) hide show

config.json CHANGED Viewed

@@ -14,7 +14,7 @@
     "PvtV2ForImageClassification"
   ],
   "attention_probs_dropout_prob": 0.0,
-  "attn_reduce": "SR",
   "depths": [
     3,
     4,

     "PvtV2ForImageClassification"
   ],
   "attention_probs_dropout_prob": 0.0,
+  "linear_attention": false,
   "depths": [
     3,
     4,