w***g
发帖数: 5958 | 1 上过machine learning theory的课，不过都忘了。要是看SVM本身的话，其实很intuit
ive的，跟复杂的VC dimension好像扯不上什么关系。 |
h***i
发帖数: 3844 | 2 不知道对否
1. by law of large number, empirical risk will converge to theoretic risk
this is why we like to minimize empirical risk. called ERM
2. but inf of empirical risk will not always converge to inf of theoretic
risk. so
1 is not good enough.
3. under some constrain for example, uniform converge condition, inf of
empirical risk will converge to inf of theoretic risk.
4. Glivenko-Cantelli theorem.
5. VC theorem(a generalization of GC theorem), the famous inequality,
theoretic risk <=empirical ri
【在 w***g 的大作中提到】
: 上过machine learning theory的课，不过都忘了。要是看SVM本身的话，其实很intuit
: ive的，跟复杂的VC dimension好像扯不上什么关系。
|
N**D
发帖数: 10322 | 3 separable SVM is obained by minimizing an upper bound on the expected risk
of a linear classifier, which depends on VC dimension, which is upper
bounded by a quantitty depends on margin, which is again inverse
proportional to ||w||^2 (if the margin is measured using Euclidean norm).
The slack variable is a technique to handle non-separable case.
intuit
【在 w***g 的大作中提到】
: 上过machine learning theory的课，不过都忘了。要是看SVM本身的话，其实很intuit
: ive的，跟复杂的VC dimension好像扯不上什么关系。
|
p*********w
发帖数: 606 | 4 我一个手指头按住一个从句，两只手都用完了，一句话还没读完。
【在 N**D 的大作中提到】
: separable SVM is obained by minimizing an upper bound on the expected risk
: of a linear classifier, which depends on VC dimension, which is upper
: bounded by a quantitty depends on margin, which is again inverse
: proportional to ||w||^2 (if the margin is measured using Euclidean norm).
: The slack variable is a technique to handle non-separable case.
:
: intuit
|
N**D
发帖数: 10322 | 5 还好，有些learning theory的定理要半页加至少一个两行长的公式
【在 p*********w 的大作中提到】
: 我一个手指头按住一个从句，两只手都用完了，一句话还没读完。
|
h***i
发帖数: 3844 | 6 idea没那么复杂，
math的定理，搞一堆 condition,写得繁琐罢了
【在 N**D 的大作中提到】
: 还好，有些learning theory的定理要半页加至少一个两行长的公式
|
d*****l
发帖数: 8441 | 7 不对啊？总共才三个从句啊。
你刚排完地雷回来？
【在 p*********w 的大作中提到】
: 我一个手指头按住一个从句，两只手都用完了，一句话还没读完。
|
x****w
发帖数: 119 | 8 哈哈！强~~
【在 p*********w 的大作中提到】
: 我一个手指头按住一个从句，两只手都用完了，一句话还没读完。
|
