Skip to content

Commit 96f190f

Browse files
committed
Fix: Minor edits in condi-entropy1
1 parent e57bac3 commit 96f190f

1 file changed

Lines changed: 6 additions & 10 deletions

File tree

โ€Ž_posts/2019-04-29-license.mdโ€Ž

Lines changed: 6 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -61,9 +61,7 @@ $$
6161
์ด์ œ ์œ„ ์ˆ˜์‹์—์„œ $X$๋งŒ์ด ์œ ์ผํ•œ ๋ณ€์ˆ˜์ด๋‹ค. ๊ทธ๋Ÿฌ๋ฏ€๋กœ ์œ„ ์ˆ˜์‹์„ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ๋‚˜ํƒ€๋‚ผ ์ˆ˜ ์žˆ๋‹ค.
6262

6363
$$
64-
6564
= \sum_{x} p_{X|Y}(x|y) \log \frac{1}{p_{X|Y}(x|y)}
66-
6765
$$
6866

6967
๋งŒ์•ฝ ์šฐ๋ฆฌ๊ฐ€ ํŠน์ • ์กฐ๊ฑด $y$์— ๋Œ€ํ•œ ๋ชจ๋“  ๊ฐ€๋Šฅํ•œ ์กฐ๊ฑด๋ถ€ ์—”ํŠธ๋กœํ”ผ๋ฅผ ํ•ฉํ•˜๋ฉด, $Y$์— ์ฃผ์–ด์ง„ $X$์˜ ์ „์ฒด ์กฐ๊ฑด๋ถ€ ์—”ํŠธ๋กœํ”ผ๋ฅผ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ๋‚˜ํƒ€๋‚ผ ์ˆ˜ ์žˆ๋‹ค
@@ -75,9 +73,7 @@ $$
7573
์ด์ œ ์—”ํŠธ๋กœํ”ผ $H(X)$์™€ $H(Y|X)$๋ฅผ ๊ณ ๋ คํ•ด๋ณด์ž. $H(X)$๋Š” $X$์— ๋Œ€ํ•œ ์ •๋ณด์ด๊ณ , $H(Y|X)$๋Š” $X$์˜ ์ •๋ณด๊ฐ€ ์ฃผ์–ด์กŒ์„ ๋•Œ $H(X,Y)$์—์„œ์˜ '๋‚จ์€'์ •๋ณด์ด๋‹ค. ๋”ฐ๋ผ์„œ ์šฐ๋ฆฌ๋Š” $H(X) + H(Y|X) = H(X,Y)$๋ผ๊ณ  ๊ธฐ๋Œ€ํ•  ์ˆ˜ ์žˆ๊ณ  ์•„๋ž˜์™€ ๊ฐ™์ด ์ฆ๋ช…๊ฐ€๋Šฅํ•˜๋‹ค.
7674

7775
$$
78-
\mathbb{E}\Big[ \log \frac{1}{p_X(X)} \Big]
79-
+ \mathbb{E}\Big[ \log \frac{1}{p_{Y|X}(Y|X)} \Big]
80-
= \mathbb{E}\Big[ \log \frac{1}{p_X(X) p_{Y|X}(Y|X)} \Big]
76+
\mathbb{E}\Big[ \log \frac{1}{p_X(X)} \Big]+ \mathbb{E}\Big[ \log \frac{1}{p_{Y|X}(Y|X)} \Big]= \mathbb{E}\Big[ \log \frac{1}{p_X(X) p_{Y|X}(Y|X)} \Big]
8177
$$
8278

8379
$$
@@ -107,19 +103,19 @@ $\mathbb{E}\Big[ \log \frac{1}{p_{Y2|Y1}(Y2|Y1)} \Big]$์„ ๊ตฌํ•˜๋ฉด ๋œ๋‹ค.
107103

108104
2.
109105

110-
$p_(Y4=0|Y1=0) = 3/4$
106+
$p_{}(Y4=0|Y1=0) = 3/4$
111107

112-
$p_(Y4=1|Y1=0) = 1/4$
108+
$p_{}(Y4=1|Y1=0) = 1/4$
113109

114-
$p_(Y4=0|Y1=1) = 1/4$
110+
$p_{}(Y4=0|Y1=1) = 1/4$
115111

116-
$p_(Y4=1|Y1=1) = 3/4$
112+
$p_{}(Y4=1|Y1=1) = 3/4$
117113

118114
๋ฅผ ์ด์šฉํ•˜๋ฉด $H(Y4|Y1=0)$์€ $3/4\log4/3+1/4\log4$์ด๊ณ 
119115

120116
$H(Y4|Y1=1)$์€ $3/4\log4/3+1/4\log4$์ด๋‹ค.
121117

122-
๋”ฐ๋ผ์„œ $H(Y4|Y1)$์€ $1/2*3/4\log4/3+1/4\log4$+$1/2*3/4\log4/3+1/4\log4$์ด๋‹ค.
118+
๋”ฐ๋ผ์„œ $H(Y4|Y1)$์€ ($1/2$)($3/4\log4/3+1/4\log4$)+($1/2$) ($3/4\log4/3+1/4\log4$)์ด๋‹ค.
123119

124120
์ด๋ฅผ $H(Y4)=1$์™€ ๋น„๊ตํ•ด๋ณด๋ฉด ๋” ์ž‘์€ ๊ฒƒ์„ ์•Œ ์ˆ˜ ์žˆ๋‹ค.
125121

0 commit comments

Comments
ย (0)