VISOR-GPT / train /models /rnn /bilstm_config.json
szukevin's picture
upload
7900c16
raw
history blame
243 Bytes
{
"emb_size": 512,
"hidden_size": 1536,
"layers_num": 2,
"dropout": 0.1,
"max_seq_length": 1024,
"data_processor": "bilm",
"embedding": ["word"],
"remove_embedding_layernorm": true,
"encoder": "bilstm",
"target": ["bilm"]
}