Optimization Notes

作者: QIAN丶AN | 来源:发表于2016-08-30 13:04 被阅读0次

2016/8/30

学习ADMM（Alternating Direction Method of Multiplers）

ADMM是一个旨在将对偶上升法的可分解性和乘子法的上界收敛属性融合在一起的算法。

2016/9/23

矩阵求导示例：

Y = A * X --> DY/DX = A'

Y = X * A --> DY/DX = A

Y = A' * X * B --> DY/DX = A * B'

Y = A' * X' * B --> DY/DX = B * A'

dX'/dX = I

d(AX)'/dX = A'

dY/dX' = (dY'/dX)'

d(UV')/dX = (dU/dX)V' + U(dV'/dX)

d(U'V)/dX = (dU'/dX)V + (dV'/dX)U'

d(X'A)/dX = (dX'/dX)A + (dA/dX)X' = IA + 0X' = A

d(AX)/dX' = (d(X'A')/dX)' = (A')' = A

d(X'AX)/dX = (dX'/dX)AX + (d(AX)'/dX)X = AX + A'X

Optimization Notes
2016/8/30 学习ADMM（Alternating Direction Method of Multiple...
2. Add Two Numbers
Optimization~~~
The Optimization of the Adaboost
The Optimization of the Adaboost 1.对于Adaboost error funct...
#5 Optimization
优化的目的是通过最小化损失函数，找到合适的权重W，使得分类效果最佳。优化策略有如下几种Random Search...
sqlmap Optimization
--predict-output 根据检测方法，将返回值和统计表中的内容相比对，从而缩小检测范围，提高检测效率统...
submodular optimization
https://www.zhihu.com/question/34720027
Web Optimization
Web前端开发常用的优化技巧汇总 @(2018/06/20) 减少HTTP请求的次数页面中每发送一次HTTP请求...
Consensus Optimization
Consensus Optimization 假设我们有如下具有项优化目标的凸优化问题：比如，我们需要用数据去拟...
Optimization for Communications
下载地址：Optimization for Communications and Networks[www.rej...
Optimization algorithm
Mini-batch gradient descent 题目都整完了，，笔记日后慢慢补，任务在身，得快点学完好做事