¾ðÊó ¤ÎÊѹ¹ÅÀ
#contents *¾ðÊó¤È¤Ï²¿¤« [#g65f0e03] ¾ðÊó¤ÏÃΤ餻¤ë¤³¤È¡£ÃΤ餵¤ì¤ë¤³¤È¡£ÃΤ餻¡£Ãμ±¡£ **¾ðÊó¤Îµ¡Ç½ [#s3a71d4f] ÅÁã¡¢½èÍý¡¢À©¸æ **¾ðÊó¤Î·ÁÂÖ [#o0f40310] ²»À¼¡¢Ê¸»ú¡¢²èÁü¡ÊÀŻ߲衢ư²è¡Ë **¾ðÊó¤Î²ÁÃÍ [#x559da3b] ¾ðÊó¤Ï£±¤Ä¤Îºâ¤Ç¤¢¤ë¡£ ¾ðÊó¤ò»ý¤Ã¤Æ¤¤¤ë¤«¤¤¤Ê¤¤¤«¤Ç¡¢¤½¤Î¿Í¤Î¹ÔÆ°¤Ï¤«¤ï¤ë¤¯¤é¤¤ ͸ú¤ËƯ¤¯¤Î¤«¤È¤¤¤¦Í¸úÀ¡Ê²ÁÃÍ¡Ë *C.E.¥·¥ã¥Î¥ó¤Ë¤è¤ëÄêµÁ [#uc8da217] ¾ðÊó¤È¤Ï¡Öµ¯¤³¤ê¤¦¤ë»ö¾Ý¤¬¤¤¤¯¤Ä¤«¹Í¤¨¤é¤ì¡¢¤½¤Î¤¦¤Á¤Î¤É¤ì¤¬¼ÂºÝ¤Ëµ¯¤³¤ë¤Î¤«¤¬ÉÔ³ÎÄê¤Ç¤¢¤ë¤È¤¡¢¤½¤ÎÉÔ³ÎÄêÀ¤ò¸º¾¯¤µ¤»¤ë¤â¤Î¡× *²ÃÆ£²í¿Í¶µ¼ø¤Ë¤è¤ë¡Ö¾ðÊó¡× [#gcab0960] **Æü¾ïŪ¤Ê°ÕÌ£ [#o7496ce9] -ƻϩ¾ðÊó -¸Ä¿Í¾ðÊó -¼ÁŪ³µÇ°¡ÊÆâÍƤ¬È¼¤¦)¢ª¡Ö°ÕÌ£ÏÀ¡×¤ÎÂÐ¾Ý **ÀìÌçŪ¤Ê°ÕÌ£ [#wb10e468] -¥Ó¥Ã¥È(bit)¡¢¥Ð¥¤¥È(byte) -ÎÌŪ³µÇ°¡Ê̵ÆâÍÆ¡Ë¢ª¡Ö¾ðÊóÍýÏÀ¡×¤ÎÂÐ¾Ý **¾ðÊó¤Î¼ÁŪ¦ÌÌ [#w7ee779a] -¡Ö¼ÁŪ¾ðÊó¡×¢ª&color(red){¼Á};¡Ê¿¿¡¦µ¶¡Ë¢ª°ÕÌ£ÏÀ ¡Ö¤¢¤ë»ö¼Â¤ä½ÐÍè»ö¤Ë¤Ä¤¤¤Æ¤ÎÃ챤ä¥Ë¥å¡¼¥¹¤ÎÅÁã¡× communication of the knowledge or 'news' of some fact or occurrence(OED) -¾ðÊó¤Î¡Ö¼Á¡×¤ò·è¤á¤ë¸° -¡Ö¥Ë¥å¡¼¥¹¡×²ÁÃÍ ¢ª¤Ä¤Þ¤ê¡¢¡Ö&color(red){°Õ³°À};¡×¤¬°ÕÌ£¤Î¾ÇÅÀ **¾ðÊó¤ÎÎÌŪ¦ÌÌ [#bebef651] -¡ÖÎÌŪ¾ðÊó¡×¢ª&color(red){ÎÌ};¡Ê¥Ó¥Ã¥È¡Ë¢ª¾ðÊóÍýÏÀ --¡ÖÂåÂØ¿®¹æ¤òÇÓ½ü¤¹¤ë¸Â¤ê¤Ë¤ª¤¤¤Æ¡×¾ðÊó¤ÎÎ̤Ϸè¤Þ¤ë >e.g ¡Ö»ä¤Ï¡¢¥«¡¦¡¦¡¦¤Ç¤¹¡×¡Ê²ñ¼Ò°÷¡©²ð¸îÊ¡»ã»Î¡©²Î¼ê¡©¡Ë ¥«¥¤¡¦¡¦¡¦¡Ê²ñ¼Ò°÷¡©²ð¸îÊ¡»ã»Î¡©¡Ë ¥«¥¤¥·¥ã¡¦¡¦¡Ê²ñ¼Ò°÷¡©¡Ë ¥«¥¤¥·¥ã¥¤¥ó¡¦¡¦¡Ê²ñ¼Ò°÷¡Ë -¾ðÊó¤Î¡ÖÎ̡פò·è¤á¤ë¸° --¡ÖÇÓ½ü¤¹¤ëÂåÂØ¿®¹æ¤Î¿ô¡×¡¢¡Ö½Ð¸½³ÎΩ¡× ¢ª¤Ä¤Þ¤ê¡¢¡Ö°Õ³°À¡×¤Î¼ÜÅÙ **¾ðÊóÍýÏÀ¡Ê£±¡Ë [#x85b5ea3] -¾ðÊóÎ̡ʵ¡Ë =³ÎΨ¡Ê£ð¡Ë¤ÎµÕ¿ô¢ª°Õ³°À I = 1/p -ÇÓ½ü¤¹¤ëÂåÂØ¿®¹æ¤¬Â¿ ¡¡¡¡¡¡¢ ½Ð¸½³ÎΨ¤¬&color(red){¾®}; ¡¡¡¡¡¡¢ ¾ðÊóÎÌ&color(red){Âç}; **£²¿Ê¥³¡¼¥É [#i27bc589] -¡Ö£²¿Ê²½¡×(binarization) --¥¢¥ë¥Õ¥¡¥Ù¥Ã¥È¤ä¿ô»ú¤ò2¿Ê¥³¡¼¥É¤ËÁªÂò¤¹¤ë¤³¤È --ÁªÂò²ó¿ô¡¡C= 1 2 3 4 5 6 7 8 ... --¿®¹æ¤Î¿ô¡¡N= 2 4 8 16 32 64 128 256... ¢ªC = N¤ÎÂпô¡¡¡Ê¤Ä¤Þ¤ê¡¢C=¡¡log2 N) ¤È¤³¤í¤Ç¡¢N = 1/p (¿®¹æ¤Î¿ô =³ÎΨ¤ÎµÕ¿ô) ¤æ¤¨¤Ë¡¢C = log2 1/p ¢ª¡Ö¾ðÊóÃÍ¡×¡Ê¥Ó¥Ã¥È¡Ë **¾ðÊóÍýÏÀ¡Ê£²¡Ë [#k5875bd6] -£±¡Ö¥Ó¥Ã¥È¡×bit (binary digit) ¡¡¢ªN=2 (¤Ä¤Þ¤ê¡¢0¤«1¤Î£²¤Ä¤Î¿®¹æ¡Ë¤Î¾ì¹ç¤Î¾ðÊóÃÍ ¡¡¡¡¡¡¡¡¡¡C=log2 2 =1 -bps(bits per second) **¾ðÊóÍýÏÀ¡Ê£³¡Ë [#pfe9813f] -£±¡Ö¥Ð¥¤¥È¡×byte(by eight) = 8¥Ó¥Ã¥È --£±¥Ð¥¤¥È¤Ç£²^8 (=256)¼ïÎà¤Î¿®¹æ¤ò°·¤¨¤ë --ASCII (American Standard Code for Information Interchange) ¢ª£·¥Ó¥Ã¥È¤Ç2^7(=128)¼ïÎà¤Î¥í¡¼¥Þ»ú¡¢¿ô»ú¡¢µ¹æ¤òɽ¸½ --¥³¥ó¥Ô¥å¡¼¥¿¡¡¢ª£±Ê¸»ú¤ò£±¥Ð¥¤¥È¡Ê£¸¥Ó¥Ã¥È¡Ë¤Çɽ¸½¤Ç¤¤ë¤Î¤Ç¡¢2^8 (=256)¼ïÎà¤Îµ¹æ¤ò°·¤¨¤ë --ASCII°Ê³°¤Î128ʸ»úʬ¤Î³ÈÄ¥Îΰ袪ÆüËܤǤϥ«¥Êʸ»ú --¤µ¤é´Á»ú(7000ʸ»ú°Ê¾å¡Ë¤òɽ¸½¤¹¤ë¤¿¤á **Åù³ÎΨ¤Î¥³¡¼¥É [#q8bf8f62] ***Îã¡ËÊõ¤¯¤¸¤ÎÅöÁªÈÖ¹æ [#s82186ad] -¥á¥Ã¥»¡¼¥¸¤ÎŤµm¡¡¢ª£··å -¿®¹æ¤Î¿ôN ¢ª¡¡0-9¤Î¿ô»ú(10¸Ä¡Ë -Ǥ°Õ¤Î¿®¹æ¤Î³ÎΨ¤ÎµÕ¿ô ¢ª1/p = N =10 -Ǥ°Õ¤Îµ¹æ¤Î¾ðÊóÃÍ ¢ªlog2N = log2 10 -¥á¥Ã¥»¡¼¥¸¤ÎÁ´¾ðÊóÃÍ ¢ªm¡¦log2 N **ÉÔÅù³ÎΨ¤Î¥³¡¼¥É [#j7fb812d] -¥Æ¥¯¥¹¥È¡¡T¡¡=aaaabbcd --Ǥ°Õ¤Î¸ÄÊÌ¿®¹æ¤Î³ÎΨ ¢ªp= ÀäÂÐÉÑÅÙ¡à¿®¹æ¤ÎÁí¿ô ¡¡p= 4/8,2/8,1/8,1/8 --Ǥ°Õ¤Î¸ÄÊÌ¿®¹æ¤Î¾ðÊóÃÍ I = log2 1/p =1,2,3,3(bits) -¥Æ¥¹¥¯¥È¡ÊT)¤Î¹ç·×¾ðÊóÎÌ¡ÊI) =(¸ÄÊÌ¿®¹æ¤Î¾ðÊóÃÍI)*(ÀäÂÐÉÑÅÙH)¤ÎÁíÏ I = ¦²I¡ßH =1*4+2*2 +3*1 +3*1 =14(bits) -¥Æ¥¯¥¹¥È¡ÊT)¤ÎÊ¿¶Ñ¾ðÊóÎÌ¡¡¡áI ¡àM(¿®¹æ¿ô)=14/8 ¢ª¦²I*p **¾ðÊóÄÌ¿®¤ÎÍýÏÀ [#l566b017] -m¼ïÎà¤Î¿®¹æ¥¿¥¤¥×¤«¤é¤Ê¤ë¥Æ¥¯¥¹¥È¡ÊT)¤Ë¤ª¤¤¤Æ Iave = ¦²pI (I = log2 1/p =log2 p^-1 = -log2 p¤ËÃÖ¤´¹¤¨¤ë¤È) Iave =¡¡-¦²plog2 p ¡Ö&color(red){¥·¥ã¥Î¥ó¡õ¥¦¥£¡¼¥Ð¡¼¤Î¾ðÊóÍýÏÀ};¡× |
ÂÀ× ¥é¥ó¥À¥à¥ê¥ó¥¯ |