BiLSTM_Classifier 中的输入/输出/循环丢失层以及它们如何影响模型和预测答案

【问题标题】：input/output/recurrent dropout layers in BiLSTM_Classifier and how they affect the model and predictionBiLSTM_Classifier 中的输入/输出/循环丢失层以及它们如何影响模型和预测
【发布时间】：2021-05-18 03:07:26
【问题描述】：

我想对 BiLSTM_Classifier 中的输入/输出/循环丢失层以及它们如何影响模型和预测有一些了解/信息。

# Output drop out
model_out_dp = Sequential()
model_out_dp.add(Embedding(vocab_size, embedding_dim, input_length=maxlen,weights=[embedding_matrix],trainable=False))
model_out_dp.add(Bidirectional(LSTM(64)))
model_out_dp.add(Dropout(0.5))
model_out_dp.add(Dense(8, activation='softmax'))

# input drop out
model_input_dp = Sequential()
model_input_dp.add(Embedding(vocab_size, embedding_dim, input_length=maxlen,weights=[embedding_matrix],trainable=False))
model_input_dp.add(Bidirectional(LSTM(64,dropout=0.5)))
model_input_dp.add(Dense(8, activation='softmax'))

# recurrent drop out
model_rec_dp = Sequential()
model_rec_dp.add(Embedding(vocab_size, embedding_dim, input_length=maxlen,weights=[embedding_matrix],trainable=False))
model_rec_dp.add(Bidirectional(LSTM(64,recurrent_dropout=0.5)))
model_rec_dp.add(Dense(8, activation='softmax'))

【问题讨论】：

标签： python tensorflow nlp lstm dropout

【解决方案1】：

首先，我们根据规则将“S”和“A”分成组——我们为每个 S 分配一个唯一的“组”，后跟任意数量（包括无）的 As。我们还按顺序对每个组中的元素进行编号

df['group'] = (df['First']=='S').cumsum()
df['el'] = df.groupby('group').cumcount()

看起来像这样：

    First    Second                                               group    el
--  -------  -------------------------------------------------  -------  ----
 0  S        Keeping the Secret of Genetic Testing                    1     0
 1  S        What is genetic risk ?                                   2     0
 2  S        Genetic risk refers more to your chance of inh...        3     0
 3  A        3 4|||Rloc-||||||REQUIRED|||-NONE-|||0                   3     1
 4  S        People get certain disease because of genetic ...        4     0
 5  A        1 2|||Wci|||develop|||REQUIRED|||-NONE-|||0              4     1
 6  A        3 4|||Nn|||diseases|||REQUIRED|||-NONE-|||0              4     2
 7  S        How much a genetic change tells us about your ...        5     0
 8  S        If your genetic results indicate that you have...        6     0
 9  A        8 8|||ArtOrDet|||the|||REQUIRED|||-NONE-|||0             6     1

现在我们将多索引设置为'group'和'el'，然后将unstack'el'设置为标题

df.set_index(['group','el'])['Second'].unstack(level=1)

看起来像

  group  0                                                  1                                             2
-------  -------------------------------------------------  --------------------------------------------  -------------------------------------------
      1  Keeping the Secret of Genetic Testing              nan                                           nan
      2  What is genetic risk ?                             nan                                           nan
      3  Genetic risk refers more to your chance of inh...  3 4|||Rloc-||||||REQUIRED|||-NONE-|||0        nan
      4  People get certain disease because of genetic ...  1 2|||Wci|||develop|||REQUIRED|||-NONE-|||0   3 4|||Nn|||diseases|||REQUIRED|||-NONE-|||0
      5  How much a genetic change tells us about your ...  nan                                           nan
      6  If your genetic results indicate that you have...  8 8|||ArtOrDet|||the|||REQUIRED|||-NONE-|||0  nan

这看起来几乎是您想要的，除了列的名称，您可以根据需要使用 .rename(columns = {...}) 更改，如果您想用 0 替换 NaN，则可以使用 .fillna(0) 进行更改

【讨论】：