Gaussian Models

Gaussian Models

作者: 水豚2号 | 来源:发表于2020-03-06 14:14 被阅读0次

Basic Knowledge

Normal Distribution / Multivariate Gaussian
$\mathcal N(x|\mu, \sigma) = ······$
Eigenvalue Decomposition
Estimate MLE for $\mu, \sigma$
Same $\mu, \sigma$ , Gaussian Distribution has Maximum Entropy
Joint Gaussian Distribution

Interpolation

$x_{i} = f(t_{i}), t_{i} \in [0, T]$
Data points: total $D$ , observed $N$
Suppose we can fit the data, then using smoothness assumption $x_{j} = \frac{1}{2} (x_{j-1} + x_{j+1}) + \epsilon_{j}$ , we get $LX=\epsilon, X=L^{-1}\epsilon$
$X \sim N(0, \sigma^{2}(L^{T}L)^{-1})$

Noise-free Observation

Partition $X$ to $[X_{1}, X_{2}]$ , $L$ to $[L_{1}, L_{2}]$ , where $X_{2}$ are $N$ observed noise-free observations. If observations are not adjacent data points, we can adjust $X$ along with $L$
Then, $X_{1} \sim N(0, \sigma^{2}(L_{1}^{T}L_{1})^{-1}), X_{2} \sim N(0, \sigma^{2}(L_{2}^{T}L_{2})^{-1})$
Use formula, get conditional distribution, aka., $X_{1}|X_{2}$ 's distribution $f_{(D-N) * 1}$ (unknown data's distribution)
Generate $f(t)$

Noisy Observation

Observed $N$ noisy data $y_{i} = x_{i} + \eta_{i}$
Use selection matrix $A$ , such that $Y_{D*1}=A_{D*D} * X_{D*1}+\eta$
Now, $X \sim N(0, \sigma^{2}(L^{T}L)^{-1}), Y|X \sim N(AX, a^{2}I)$
Use theorem, get posterior distribution, aka., $X|Y$ 's distribution $f_{D*1}$ (whole data's distribution)
Generate $f(t)$

相关文章

网友评论

本文标题：Gaussian Models

本文链接：https://www.haomeiwen.com/subject/mypqrhtx.html

延伸阅读

深度阅读

您也可以注册成为美文阅读网的作者，发表您的原创作品、分享您的心情！

栏目导航

热点阅读

关于我们|服务条款|联系我们|Gaussian Models|投稿指南|网站地图|RSS订阅|排版工具|手机版

提供经典美文摘抄,优美散文欣赏,现代诗歌精选,短篇小说,心情随笔,表白情书范文,故事会在线阅读欣赏

Copyright © 2014-2023 Haomeiwen.com All Rights Reserved. 好美文阅读网版权所有

备案信息：桂公网安备 45052102000051号 · 桂ICP备13007215号-3

本站所收录作品、热点评论等信息部分来源互联网，目的只是为了系统归纳学习和传递资讯

所有作品版权归原创作者所有，与本站立场无关，如不慎侵犯了你的权益，请联系我们告知，我们将做删除处理！