![](https://img.haomeiwen.com/i11683600/6f440ebaf820a530.png)
![](https://img.haomeiwen.com/i11683600/31947837a2915b6b.png)
![](https://img.haomeiwen.com/i11683600/2c5384029e34f2ac.png)
![](https://img.haomeiwen.com/i11683600/c977c9fbe3c5002d.png)
![](https://img.haomeiwen.com/i11683600/b4ddee3f4302dc07.png)
![](https://img.haomeiwen.com/i11683600/d37c595b53d24f32.png)
![](https://img.haomeiwen.com/i11683600/519927eaeac123b4.png)
![](https://img.haomeiwen.com/i11683600/0a24b6e0e58c6ebe.png)
![](https://img.haomeiwen.com/i11683600/4b3732e1789f257d.png)
![](https://img.haomeiwen.com/i11683600/46fd3d512a33fd3c.png)
![](https://img.haomeiwen.com/i11683600/210bd6dc7a7df2f7.png)
![](https://img.haomeiwen.com/i11683600/f2e1c8cd39f0d44f.png)
![](https://img.haomeiwen.com/i11683600/bb82a2317018bc48.png)
https://math.stackexchange.com/questions/2639577/why-is-the-gradient-of-this-expectation-intractable
![](https://img.haomeiwen.com/i11683600/025447b53aff2e4b.png)
![](https://img.haomeiwen.com/i11683600/7c5d482ce505ace7.png)
![](https://img.haomeiwen.com/i11683600/75ae8ed5c9d89ebe.png)
![](https://img.haomeiwen.com/i11683600/64a49d9eaacc1bc2.png)
![](https://img.haomeiwen.com/i11683600/1e340126a440868f.png)
![](https://img.haomeiwen.com/i11683600/21b629fbf8ab0b07.png)
![](https://img.haomeiwen.com/i11683600/6e2fbf61bb6b34e6.png)
![](https://img.haomeiwen.com/i11683600/414510695d5a6c05.png)
![](https://img.haomeiwen.com/i11683600/af862abaf7adaac9.png)
![](https://img.haomeiwen.com/i11683600/3f04471b78e34b9f.png)
![](https://img.haomeiwen.com/i11683600/0e474058dc6aa9fc.png)
![](https://img.haomeiwen.com/i11683600/c9b64fcd28fb9b61.png)
computational efficiency -> low resolution to high resolution
![](https://img.haomeiwen.com/i11683600/eb93f29d6fab4af6.png)
![](https://img.haomeiwen.com/i11683600/1fe8d173ac4037fd.png)
this hard attention -> a lot applications!!! -> improve efficiency
but still need RNN -> may be slow
efficiency depends on the case
high resolution input -> fast by this method
![](https://img.haomeiwen.com/i11683600/a5b397d0f77a8631.png)
![](https://img.haomeiwen.com/i11683600/d809248fc687723e.png)
网友评论