由买买提看人间百态

boards

本页内容为未名空间相应帖子的节选和存档,一周内的贴子最多显示50字,超过一周显示500字 访问原贴
Mathematics版 - Relation between information and entropy
相关主题
求文章 Correction to “entropy and maximal spacings for random partitions”请问Information matrix的意义?
请教一个概率问题函数近似的metric
求文章,请帮忙请教一个关于entropy number的问题
a question about optimization来个问题。
文献求助跪求文章
a question about entropy是谁发了一共3篇文章就得了菲尔兹奖?
请教:表征数据集中度的统计量~~An expectation problem
关于最大熵的问题[合集] An expectation problem
相关话题的讨论汇总
话题: entropy话题: relation话题: between话题: isn
进入Mathematics版参与讨论
1 (共1页)
n***s
发帖数: 1257
1
【 以下文字转载自 Music 讨论区 】
发信人: novas (novas), 信区: Music
标 题: Re: 翻唱Beyond《海阔天空》- 学粤语搅拌版
发信站: BBS 未名空间站 (Thu Feb 23 19:29:11 2012, 美东)
I guess I didn't learn entropy well. Isn't it that the bigger the entropy
of
something is, the more information the thing carries?
N***m
发帖数: 4460
2
should be the opposite

【在 n***s 的大作中提到】
: 【 以下文字转载自 Music 讨论区 】
: 发信人: novas (novas), 信区: Music
: 标 题: Re: 翻唱Beyond《海阔天空》- 学粤语搅拌版
: 发信站: BBS 未名空间站 (Thu Feb 23 19:29:11 2012, 美东)
: I guess I didn't learn entropy well. Isn't it that the bigger the entropy
: of
: something is, the more information the thing carries?

n***s
发帖数: 1257
3
Thanks! Do you mean opposite to mine or to his? Or simply put, who is
correct, I or he?

【在 N***m 的大作中提到】
: should be the opposite
D***r
发帖数: 7511
4
For a list of words {S1, S2,...Sn}
Suppose their probabilities are {P1, P2...Pn}
Entropy: H=sum(-Pi*log(Pi))
When P1=P2=...=Pn, the entropy reaches the maximum.
Such a text would have the maximal information.

【在 n***s 的大作中提到】
: Thanks! Do you mean opposite to mine or to his? Or simply put, who is
: correct, I or he?

1 (共1页)
进入Mathematics版参与讨论
相关主题
[合集] An expectation problem文献求助
help on an optimization problema question about entropy
谁见过类似的dynamic programming (or combinatorial optimization)问题?请教:表征数据集中度的统计量~~
choose k points with maximum pairwise distances关于最大熵的问题
求文章 Correction to “entropy and maximal spacings for random partitions”请问Information matrix的意义?
请教一个概率问题函数近似的metric
求文章,请帮忙请教一个关于entropy number的问题
a question about optimization来个问题。
相关话题的讨论汇总
话题: entropy话题: relation话题: between话题: isn