require the Network to remember info arbitrarily long
-> continue to remember or forget it -> a switch
more complex, but the crux is the same: gate looks at input and decide to remember or forget
decide the input to influence the memory
hidden state is not exactly the memory itself, it's the function of the memory.
straightforward
high level
why separate the memory and hidden layer???
and input gate + forget gate = 1
GRU is even better than LSTM in some cases, and more follow the rationale of the original idea
网友评论