rrivera1849 commited on
Commit
47450e4
·
1 Parent(s): 3d020a8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -45,6 +45,10 @@ print(tokenized_text["attention_mask"].size()) # torch.Size([3, 16, 32])
45
 
46
  out = model(**tokenized_text)
47
  print(out.size()) # torch.Size([3, 512])
 
 
 
 
48
  ```
49
 
50
  ## Citing & Authors
 
45
 
46
  out = model(**tokenized_text)
47
  print(out.size()) # torch.Size([3, 512])
48
+
49
+ # to get the Transformer attentions:
50
+ out, attentions = model(**tokenized_text, output_attentions=True)
51
+ print(attentions[0].size()) # torch.Size([48, 12, 32, 32])
52
  ```
53
 
54
  ## Citing & Authors