AhmedSSabir commited on
Commit
056145f
1 Parent(s): f9e5c52

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -1,8 +1,9 @@
1
 
2
  # Visual Semantic with BERT-CNN
3
 
4
- This model can be used to assign an object-to-caption semantic relatedness score, which is valuable for (1) caption diverse re-ranking (this work),
5
- and (2) (as an application) generating soft labels for filtering image-to-caption when scraping text-to-captions from the internet (e,g., Instagram).
 
6
 
7
 
8
  To take advantage of the overlapping between the visual context and the caption, and to extract global information from each visual (i.e., object, scene, etc) we use BERT as an embedding layer followed by a shallow CNN (tri-gram kernel) (Kim, 2014).
 
1
 
2
  # Visual Semantic with BERT-CNN
3
 
4
+ This model can be used to assign an object-to-caption semantic relatedness score, which is valuable for (1) caption diverse re-ranking (this work),
5
+ and (2) (as an application)
6
+ generating soft labels for filtering out the related/non-related image-to-post when scraping images from the internet (e.g. Instagram).
7
 
8
 
9
  To take advantage of the overlapping between the visual context and the caption, and to extract global information from each visual (i.e., object, scene, etc) we use BERT as an embedding layer followed by a shallow CNN (tri-gram kernel) (Kim, 2014).