{"id":8437,"date":"2026-05-19T16:09:44","date_gmt":"2026-05-19T07:09:44","guid":{"rendered":"https:\/\/since2020.jp\/media\/?p=8437"},"modified":"2026-05-19T16:09:44","modified_gmt":"2026-05-19T07:09:44","slug":"introduction-to-feature-selection","status":"publish","type":"post","link":"https:\/\/since2020.jp\/media\/introduction-to-feature-selection\/","title":{"rendered":"\u7279\u5fb4\u91cf\u9078\u629e\u5165\u9580"},"content":{"rendered":"\n<p>\u6a5f\u68b0\u5b66\u7fd2\u30e2\u30c7\u30eb\u306e\u6027\u80fd\u306f\u3001\u3069\u306e\u7279\u5fb4\u91cf\uff08\u8aac\u660e\u5909\u6570\uff09\u3092\u4f7f\u3046\u304b\u3067\u5927\u304d\u304f\u5de6\u53f3\u3055\u308c\u307e\u3059\u3002\u672c\u8a18\u4e8b\u3067\u306f \u7279\u5fb4\u91cf\u9078\u629e\uff08feature selection\uff09 \u306e\u5168\u4f53\u50cf\u3092\u6574\u7406\u3057\u3001\u5206\u985e\u30bf\u30b9\u30af\u3092\u984c\u6750\u306b scikit-learn \u3092\u7528\u3044\u305f\u5b9f\u88c5\u4f8b\u3082\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u7279\u5fb4\u91cf\u9078\u629e\u3068\u306f<\/h2>\n\n\n\n<p>\u7279\u5fb4\u91cf\u9078\u629e\u306f\u3001\u4e0e\u3048\u3089\u308c\u305f\u5019\u88dc\u7279\u5fb4\u91cf\u96c6\u5408 <math data-latex=\"X=\\{x_1,\\dots,x_p\\}\"><semantics><mrow><mi>X<\/mi><mo>=<\/mo><mo form=\"prefix\" stretchy=\"false\">{<\/mo><msub><mi>x<\/mi><mn>1<\/mn><\/msub><mo separator=\"true\">,<\/mo><mo>\u2026<\/mo><mo separator=\"true\">,<\/mo><msub><mi>x<\/mi><mi>p<\/mi><\/msub><mo form=\"postfix\" stretchy=\"false\">}<\/mo><\/mrow><annotation encoding=\"application\/x-tex\">X=\\{x_1,\\dots,x_p\\}<\/annotation><\/semantics><\/math> \u304b\u3089\u3001\u76ee\u7684\u5909\u6570 <math data-latex=\"y\"><semantics><mi>y<\/mi><annotation encoding=\"application\/x-tex\">y<\/annotation><\/semantics><\/math> \u306e\u4e88\u6e2c\u3084\u8aac\u660e\u306b\u6709\u7528\u306a\u7279\u5fb4\u91cf\u306e\u90e8\u5206\u96c6\u5408 <math data-latex=\"S\\subseteq X\"><semantics><mrow><mi>S<\/mi><mo>\u2286<\/mo><mi>X<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">S\\subseteq X<\/annotation><\/semantics><\/math> \u3092\u9078\u3076\u554f\u984c\u3067\u3059\u3002\u3053\u3046\u3057\u305f\u30b7\u30f3\u30d7\u30eb\u306a\u30e2\u30c7\u30eb\u3092\u76ee\u6307\u3059\u767a\u60f3\u306f\u3001\u300c\u3042\u308b\u4e8b\u67c4\u3092\u8aac\u660e\u3059\u308b\u305f\u3081\u306b\u306f\u3001\u5fc5\u8981\u4ee5\u4e0a\u306b\u591a\u304f\u306e\u4eee\u5b9a\u3092\u3059\u308b\u3079\u304d\u3067\u306f\u306a\u3044\u300d\u3068\u3044\u3046\u30aa\u30c3\u30ab\u30e0\u306e\u5243\u5200\u306e\u539f\u5247\u306b\u57fa\u3065\u3044\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u76ee\u7684\u306f\u5927\u304d\u304f\u6b21\u306e4\u3064\u306b\u6574\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6c4e\u5316\u6027\u80fd\u306e\u5411\u4e0a<\/strong>\uff1a\u30ce\u30a4\u30ba\u7684\u306a\u7279\u5fb4\u91cf\u3092\u9664\u304f\u3053\u3068\u3067\u904e\u5b66\u7fd2\u3092\u6291\u3048\u308b<\/li>\n\n\n\n<li><strong>\u8a08\u7b97\u91cf\u306e\u524a\u6e1b<\/strong>\uff1a\u5b66\u7fd2\u3084\u63a8\u8ad6\u3092\u8efd\u304f\u3059\u308b<\/li>\n\n\n\n<li><strong>\u89e3\u91c8\u6027\u306e\u5411\u4e0a<\/strong>\uff1a\u91cd\u8981\u306a\u7279\u5fb4\u91cf\u304c\u4f55\u304b\u3092\u7406\u89e3\u3057\u3084\u3059\u304f\u3059\u308b<\/li>\n\n\n\n<li><strong>\u6b21\u5143\u306e\u546a\u3044\u306e\u7de9\u548c<\/strong>\uff1a\u5b66\u7fd2\u306b\u5fc5\u8981\u306a\u30c7\u30fc\u30bf\u91cf(\u30b5\u30f3\u30d7\u30eb\u6570)\u306e\u5897\u52a0\u3092\u6291\u3048\u3089\u308c\u308b<\/li>\n<\/ul>\n\n\n\n<p>\u7279\u5fb4\u91cf\u9078\u629e\u624b\u6cd5\u306f\u3001\u7279\u5fb4\u91cf\u306e\u8a55\u4fa1\u30fb\u9078\u629e\u306e\u89b3\u70b9\u304b\u3089\u5927\u304d\u304f <strong>\u30d5\u30a3\u30eb\u30bf\u6cd5 \/ \u30e9\u30c3\u30d1\u30fc\u6cd5 \/ \u7d44\u307f\u8fbc\u307f\u6cd5<\/strong> \u306e3\u3064\u306b\u5206\u985e\u3067\u304d\u307e\u3059\u3002\uff08\u3053\u306e\u307b\u304b\u3001\u5404\u624b\u6cd5\u3092\u7d44\u307f\u5408\u308f\u305b\u3066\u7cbe\u5ea6\u3068\u9ad8\u901f\u6027\u3092\u4e21\u7acb\u3059\u308b\u30cf\u30a4\u30d6\u30ea\u30c3\u30c9\u6cd5\u3082\u5b58\u5728\u3057\u307e\u3059\u3002\uff09<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u30d5\u30a3\u30eb\u30bf\u6cd5\uff08Filter Method\uff09<\/h2>\n\n\n\n<p><strong>\u30d5\u30a3\u30eb\u30bf\u6cd5<\/strong>\u306f\u3001\u30e2\u30c7\u30eb\u306b\u4f9d\u5b58\u305b\u305a\u306b\u7279\u5fb4\u91cf\u3092\u8a55\u4fa1\u30fb\u9078\u629e\u3059\u308b\u624b\u6cd5\u3067\u3059\u3002\u5177\u4f53\u7684\u306b\u306f\u3001\u7d71\u8a08\u7684\u6307\u6a19\u3092\u7528\u3044\u3066\u5404\u7279\u5fb4\u91cf\u306e\u30b9\u30b3\u30a2\u3092\u8a08\u7b97\u3057\u3001\u7279\u5fb4\u91cf\u30e9\u30f3\u30ad\u30f3\u30b0\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002\u305d\u306e\u3046\u3048\u3067\u3001\u4e0a\u4f4d <math data-latex=\"k\"><semantics><mi>k<\/mi><annotation encoding=\"application\/x-tex\">k<\/annotation><\/semantics><\/math> \u500b\u3060\u3051\u3092\u6b8b\u3057\u305f\u308a\u3001\u3042\u3089\u304b\u3058\u3081\u6c7a\u3081\u305f\u95be\u5024\u3092\u4e0b\u56de\u308b\u3082\u306e\u3092\u9664\u5916\u3057\u305f\u308a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u4e3b\u306a\u8a55\u4fa1\u89b3\u70b9\u306f\u6b21\u306e3\u3064\u3067\u3059\u3002<br><strong>\u2460\u95a2\u9023\u6027\uff08Relevance\uff09<\/strong>\uff1a\u76ee\u7684\u5909\u6570\u3068\u306e\u95a2\u9023\u304c\u5f37\u3044\u7279\u5fb4\u91cf\u307b\u3069\u6709\u7528<br><strong>\u2461\u5197\u9577\u6027\uff08Redundancy\uff09<\/strong>\uff1a\u4ed6\u306e\u7279\u5fb4\u91cf\u3068\u985e\u4f3c\u3057\u3066\u3044\u308b\u5834\u5408\u306f\u3069\u3061\u3089\u304b\u3092\u9664\u5916<br><strong>\u2462\u5b89\u5b9a\u6027\uff08Stability\uff09<\/strong>\uff1a\u5206\u6563\u304c\u6975\u7aef\u306b\u5c0f\u3055\u3044\u306a\u3069\u3001\u60c5\u5831\u91cf\u304c\u4e4f\u3057\u3044\u7279\u5fb4\u91cf\u306f\u9664\u5916<\/p>\n\n\n\n<p>\u5177\u4f53\u7684\u306a\u8a55\u4fa1\u65b9\u6cd5\u306b\u306f\u3001\u4ee5\u4e0b\u306e\u3088\u3046\u306a\u3082\u306e\u304c\u3042\u308a\u307e\u3059\u3002\u3069\u306e\u8a55\u4fa1\u65b9\u6cd5\u3092\u9078\u3076\u3079\u304d\u304b\u306f\u3001\u8aac\u660e\u5909\u6570\u3068\u76ee\u7684\u5909\u6570\u306e\u95a2\u4fc2\u3084\u30c7\u30fc\u30bf\u306e\u7a2e\u985e\u306b\u3088\u3063\u3066\u5909\u308f\u308a\u307e\u3059\u3002\u7dda\u5f62\u95a2\u4fc2\u304c\u3042\u308b\u304b\u3001\u96e2\u6563\u5024 or \u9023\u7d9a\u5024\u304b\u3001\u6b63\u898f\u5206\u5e03\u3092\u4eee\u5b9a\u3067\u304d\u308b\u304b\u306a\u3069\u3092\u78ba\u8a8d\u3059\u308b\u5fc5\u8981\u304c\u51fa\u3066\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p><strong>\u30fb\u76f8\u95a2\u4fc2\u6570<br>\u30fb\u5206\u6563<br>\u30fb\u76f8\u4e92\u60c5\u5831\u91cf<br>\u30fbANOVA<br>\u30fb\u30ab\u30a4\u4e8c\u4e57\u691c\u5b9a<\/strong><\/p>\n\n\n\n<p>\u57fa\u672c\u7684\u306b\u306f\u4e0a\u8a18\u306e\u3088\u3046\u306a\u8a55\u4fa1\u6307\u6a19\u3092\u5358\u72ec\u3067\u4f7f\u3063\u3066\u5404\u7279\u5fb4\u91cf\u306e\u30b9\u30b3\u30a2\u3092\u7b97\u51fa\u3057\u307e\u3059\u3002\u305f\u3060\u3057\u3001\u3088\u308a\u767a\u5c55\u3057\u305f\u624b\u6cd5\u3068\u3057\u3066 <strong>mRMR<\/strong> \u3084 <strong>Relief<\/strong> \u306a\u3069\u304c\u5b58\u5728\u3057\u307e\u3059\u3002<strong>mRMR<\/strong> \u306f\u76ee\u7684\u5909\u6570\u3068\u306e\u95a2\u9023\u6027\u3092\u9ad8\u3081\u3064\u3064\u3001\u7279\u5fb4\u91cf\u540c\u58eb\u306e\u5197\u9577\u6027\u3092\u6291\u3048\u308b\u3088\u3046\u306b\u7279\u5fb4\u91cf\u3092\u9078\u3073\u307e\u3059\u3002<strong>Relief<\/strong> \u306f\u8fd1\u508d\uff08\u4f3c\u305f\u30b5\u30f3\u30d7\u30eb\uff09\u540c\u58eb\u3092\u6bd4\u8f03\u3057\u3001\u30af\u30e9\u30b9\u304c\u5909\u308f\u308b\u3068\u5024\u3082\u5909\u308f\u308a\u3084\u3059\u3044\u7279\u5fb4\u91cf\u3092\u9ad8\u304f\u8a55\u4fa1\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p><strong>\u30e1\u30ea\u30c3\u30c8<\/strong><br>\u30fb\u9ad8\u901f\u3067\u30b7\u30f3\u30d7\u30eb<br>\u30fb\u30e2\u30c7\u30eb\u3092\u9078\u3070\u305a\u4f7f\u3048\u308b<\/p>\n\n\n\n<p><strong>\u30c7\u30e1\u30ea\u30c3\u30c8<\/strong><br>\u30fb\u7279\u5fb4\u91cf\u540c\u58eb\u306e\u76f8\u4e92\u4f5c\u7528\u3084\u3001\u30e2\u30c7\u30eb\u56fa\u6709\u306e\u9069\u5408\u6027\u3092\u76f4\u63a5\u53cd\u6620\u3057\u306b\u304f\u3044<br>\u30fb\u95be\u5024\uff08\u3069\u306e\u30b9\u30b3\u30a2\u4ee5\u4e0a\u3092\u6b8b\u3059\u304b\u3001\u4f55\u500b\u6b8b\u3059\u304b\uff09\u306e\u8a2d\u5b9a\u304c\u96e3\u3057\u3044\u3053\u3068\u304c\u3042\u308b<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u30e9\u30c3\u30d1\u30fc\u6cd5\uff08Wrapper Method\uff09<\/h2>\n\n\n\n<p><strong>\u30e9\u30c3\u30d1\u30fc\u6cd5<\/strong>\u306f\u3001\u5b9f\u969b\u306b\u6a5f\u68b0\u5b66\u7fd2\u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u7279\u5fb4\u91cf\u306e\u90e8\u5206\u96c6\u5408\u3092\u8a55\u4fa1\u3059\u308b\u624b\u6cd5\u3067\u3059\u3002\u3064\u307e\u308a\u3001\u30e9\u30c3\u30d1\u30fc\u6cd5\u3067\u306f\u6700\u9069\u306a\u7279\u5fb4\u91cf\u306e\u96c6\u5408\u3092\u6c7a\u5b9a\u3059\u308b\u307e\u3067\u306b\u30e2\u30c7\u30eb\u306e\u5b66\u7fd2\u3068\u7279\u5fb4\u91cf\u306e\u8a55\u4fa1\u3092\u4f55\u5ea6\u304b\u7e70\u308a\u8fd4\u3059\u3053\u3068\u304c\u5fc5\u8981\u3067\u3059\u3002\u4f8b\u3048\u3070\u3001\u5168\u63a2\u7d22\u3092\u4f8b\u306b\u51fa\u3059\u3068\u3001\u5168\u3066\u306e\u7279\u5fb4\u91cf\u304cA,B,C\u306e3\u3064\u3067\u3042\u308b\u3068\u304d\u3001<math data-latex=\"2^3 - 1\"><semantics><mrow><msup><mn>2<\/mn><mn>3<\/mn><\/msup><mo>\u2212<\/mo><mn>1<\/mn><\/mrow><annotation encoding=\"application\/x-tex\">2^3 &#8211; 1<\/annotation><\/semantics><\/math>\u56de\u306e\u5b66\u7fd2\u304c\u5fc5\u8981\u306b\u306a\u308a\u307e\u3059\u3002\uff08\u4e00\u822c\u306b\u7279\u5fb4\u91cf\u6570\u304c <math data-latex=\"n\"><semantics><mi>n<\/mi><annotation encoding=\"application\/x-tex\">n<\/annotation><\/semantics><\/math> \u306a\u3089<math data-latex=\"2^n-1\"><semantics><mrow><msup><mn>2<\/mn><mi>n<\/mi><\/msup><mo>\u2212<\/mo><mn>1<\/mn><\/mrow><annotation encoding=\"application\/x-tex\">2^n-1<\/annotation><\/semantics><\/math>\u56de\uff09<\/p>\n\n\n\n<p>\u90e8\u5206\u96c6\u5408\u3092\u63a2\u7d22\u3059\u308b\u65b9\u6cd5\u306e\u4ee3\u8868\u4f8b\u3068\u3057\u3066\u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u3082\u306e\u304c\u3042\u308a\u307e\u3059\u3002<br><strong>\u30fb\u9010\u6b21\u524d\u9032\u9078\u629e\u6cd5\uff08SFS\uff09<br>\u30fb\u9010\u6b21\u5f8c\u9000\u9078\u629e\u6cd5\uff08SBS\uff09<br>\u30fb\u518d\u5e30\u7684\u7279\u5fb4\u524a\u6e1b\uff08RFE\uff09<br>\u30fb\u907a\u4f1d\u7684\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u306a\u3069\u306e\u9032\u5316\u8a08\u7b97<\/strong><\/p>\n\n\n\n<p><strong>\u30e1\u30ea\u30c3\u30c8<\/strong><br>\u30fb\u30e2\u30c7\u30eb\u306e\u6027\u80fd\u306b\u76f4\u7d50\u3059\u308b\u7279\u5fb4\u91cf\u96c6\u5408\u3092\u9078\u3073\u3084\u3059\u3044<br>\u30fb\u7279\u5fb4\u91cf\u540c\u58eb\u306e\u76f8\u4e92\u4f5c\u7528\u3092\u9078\u629e\u306b\u9593\u63a5\u7684\u306b\u53d6\u308a\u8fbc\u3081\u308b<\/p>\n\n\n\n<p><strong>\u30c7\u30e1\u30ea\u30c3\u30c8<\/strong><br>\u30fb\u8a08\u7b97\u30b3\u30b9\u30c8\u304c\u9ad8\u3044\uff08\u7279\u5fb4\u91cf\u96c6\u5408\u306e\u8a55\u4fa1\u6bce\u306b\u30e2\u30c7\u30eb\u5b66\u7fd2\u304c\u5fc5\u8981\uff09<br>\u30fb\u3042\u308b\u30e2\u30c7\u30eb\u306b\u4f9d\u5b58\u3057\u305f\u7279\u5fb4\u91cf\u96c6\u5408\u3057\u304b\u7372\u5f97\u3067\u304d\u306a\u3044<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u7d44\u307f\u8fbc\u307f\u6cd5\uff08Embedded Method\uff09<\/h2>\n\n\n\n<p><strong>\u7d44\u307f\u8fbc\u307f\u6cd5<\/strong>\u306f\u3001\u30e2\u30c7\u30eb\u306e\u5b66\u7fd2\u30d7\u30ed\u30bb\u30b9\u306e\u4e00\u90e8\u3068\u3057\u3066\u3001\u7279\u5fb4\u91cf\u306e\u9078\u629e\u3084\u91cd\u307f\u4ed8\u3051\u3092\u81ea\u52d5\u7684\u306b\u884c\u3046\u624b\u6cd5\u3067\u3059\u3002\u4f8b\u3048\u3070\u3001\u6b63\u5247\u5316\u306b\u3088\u3063\u3066\u91cd\u307f\u304c 0 \u306b\u8fd1\u3065\u304f\uff08\u30b9\u30d1\u30fc\u30b9\u5316\u3059\u308b\uff09\u5834\u5408\u3084\u3001\u6c7a\u5b9a\u6728\u7cfb\u306e\u3088\u3046\u306b\u5b66\u7fd2\u904e\u7a0b\u3067\u306e\u5206\u5272\u3078\u306e\u5bc4\u4e0e\uff08\u4e0d\u7d14\u5ea6\u6e1b\u5c11\u306a\u3069\uff09\u3092\u96c6\u8a08\u3057\u3066\u3001\u7279\u5fb4\u91cd\u8981\u5ea6\u3092\u7b97\u51fa\u3067\u304d\u308b\u5834\u5408\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u7d44\u307f\u8fbc\u307f\u6cd5\u306e\u5177\u4f53\u4f8b\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<br><strong>\u30fbLasso\uff08L1\u6b63\u5247\u5316\uff09<\/strong><br><strong>\u30fbElastic Net\uff08L1 + L2 \u306e\u6b63\u5247\u5316\uff09<\/strong><br><strong>\u30fb\u6c7a\u5b9a\u6728\uff08DT\uff09<\/strong><br><strong>\u30fb\u30e9\u30f3\u30c0\u30e0\u30d5\u30a9\u30ec\u30b9\u30c8\uff08RF\uff09<\/strong><\/p>\n\n\n\n<p><strong>\u30e1\u30ea\u30c3\u30c8<\/strong><br>\u30fb\u30d5\u30a3\u30eb\u30bf\u6cd5\u3088\u308a\u6027\u80fd\u3092\u610f\u8b58\u3057\u3064\u3064\u3001\u30e9\u30c3\u30d1\u30fc\u6cd5\u3088\u308a\u8a08\u7b97\u304c\u8efd\u3044\u3053\u3068\u304c\u591a\u3044<br>\u30fb\u5b66\u7fd2\u3068\u540c\u6642\u306b\u9078\u629e\u3067\u304d\u3001\u5b9f\u88c5\u30fb\u904b\u7528\u304c\u30b7\u30f3\u30d7\u30eb\u306b\u306a\u308a\u3084\u3059\u3044<\/p>\n\n\n\n<p><strong>\u30c7\u30e1\u30ea\u30c3\u30c8<\/strong><br>\u30fb\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\uff08\u6b63\u5247\u5316\u5f37\u5ea6\u306a\u3069\uff09\u306b\u654f\u611f\u3067\u3001\u8abf\u6574\u304c\u5fc5\u8981<br>\u30fb\u6728\u7cfb\u306e\u91cd\u8981\u5ea6\u306f\u76f8\u95a2\u306e\u5f37\u3044\u7279\u5fb4\u91cf\u304c\u3042\u308b\u3068\u8a55\u4fa1\u304c\u6b6a\u3080\u3053\u3068\u304c\u3042\u308b<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">SHAP \/ LIME \u30d9\u30fc\u30b9\u306e\u7279\u5fb4\u9078\u629e<\/h2>\n\n\n\n<p>\u3053\u3053\u307e\u3067\u7d39\u4ecb\u3057\u305f3\u5206\u985e\u3068\u306f\u5225\u306b\u3001<strong>SHAP<\/strong> \u3084 <strong>LIME<\/strong> \u3092\u7528\u3044\u305f\u30a2\u30d7\u30ed\u30fc\u30c1\u3082\u3042\u308a\u307e\u3059\u3002 <strong>SHAP \/ LIME<\/strong> \u306f\u3001\u30e2\u30c7\u30eb\u306e\u4e88\u6e2c\u7d50\u679c\u306b\u5bfe\u3059\u308b\u5404\u7279\u5fb4\u91cf\u306e\u5bc4\u4e0e\uff08\u91cd\u8981\u5ea6\uff09\u3092\u5b9a\u91cf\u5316\u30fb\u53ef\u8996\u5316\u3059\u308b\u30e2\u30c7\u30eb\u89e3\u91c8\uff08XAI\uff09\u306e\u305f\u3081\u306e\u624b\u6cd5\u3067\u3059\u3002\u3053\u308c\u3089\u3092\u7528\u3044\u3066\u5f97\u3089\u308c\u305f\u91cd\u8981\u5ea6\u3092\u3082\u3068\u306b\u7279\u5fb4\u91cf\u9078\u629e\u3078\u5fdc\u7528\u3059\u308b\u3053\u3068\u304c\u53ef\u80fd\u3067\u3059\u3002 \u305f\u3060\u3057\u3001\u3053\u308c\u3089\u306e\u91cd\u8981\u5ea6\u306f\u3042\u304f\u307e\u3067\u5b66\u7fd2\u6e08\u307f\u30e2\u30c7\u30eb\u306e\u6319\u52d5\u3092\u53cd\u6620\u3057\u305f\u3082\u306e\u3067\u3042\u308a\u3001\u7279\u5fb4\u91cf\u96c6\u5408\u3092\u5909\u3048\u3066\u518d\u5b66\u7fd2\u3059\u308b\u8a55\u4fa1\uff08\u30e9\u30c3\u30d1\u30fc\u6cd5\uff09\u3068\u306f\u6027\u8cea\u304c\u7570\u306a\u308a\u307e\u3059\u3002\u7279\u5fb4\u91cf\u9078\u629e\u3078\u306e\u5fdc\u7528\u306f\u53ef\u80fd\u3067\u3059\u304c\u3001\u4e3b\u76ee\u7684\u306f\u30e2\u30c7\u30eb\u306e\u4e88\u6e2c\u6839\u62e0\u306e\u8aac\u660e\u3067\u3042\u308b\u70b9\u3092\u610f\u8b58\u3057\u3066\u89e3\u91c8\u3059\u308b\u3053\u3068\u304c\u91cd\u8981\u3067\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u5404\u624b\u6cd5\u306e\u7cbe\u5ea6\u3068\u8a08\u7b97\u30b3\u30b9\u30c8<\/h2>\n\n\n\n<p>\u3053\u308c\u3089\u306e\u95a2\u4fc2\u306f\u3001\u30c7\u30fc\u30bf\u3084\u30e2\u30c7\u30eb\u3001\u6307\u6a19\u306e\u9078\u3073\u65b9\u306b\u3088\u3063\u3066\u5909\u308f\u308a\u307e\u3059\u304c\u3001\u3053\u3053\u3067\u306f\u3042\u304f\u307e\u3067\u76ee\u5b89\u3068\u3057\u3066\u6574\u7406\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td class=\"has-text-align-center\" data-align=\"center\"><strong>\u624b\u6cd5<\/strong><\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>\u7cbe\u5ea6<\/strong><\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>\u8a08\u7b97\u30b3\u30b9\u30c8<\/strong><\/td><\/tr><tr><td class=\"has-text-align-center\" data-align=\"center\">\u30d5\u30a3\u30eb\u30bf\u6cd5<\/td><td class=\"has-text-align-center\" data-align=\"center\">\u4f4e\u301c\u4e2d<\/td><td class=\"has-text-align-center\" data-align=\"center\">\u4f4e<\/td><\/tr><tr><td class=\"has-text-align-center\" data-align=\"center\">\u7d44\u307f\u8fbc\u307f\u6cd5<\/td><td class=\"has-text-align-center\" data-align=\"center\">\u4e2d\u301c\u9ad8<\/td><td class=\"has-text-align-center\" data-align=\"center\">\u4e2d<\/td><\/tr><tr><td class=\"has-text-align-center\" data-align=\"center\">\u30e9\u30c3\u30d1\u30fc\u6cd5<\/td><td class=\"has-text-align-center\" data-align=\"center\">\u4e2d\u301c\u9ad8<\/td><td class=\"has-text-align-center\" data-align=\"center\">\u9ad8<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u5b9f\u88c5<\/h2>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001\u5206\u985e\u30bf\u30b9\u30af\uff082\u5024\u5206\u985e\uff09\u3092\u60f3\u5b9a\u3057\u3066\u3001\u4ee3\u8868\u7684\u306a\u65b9\u6cd5\u3092 scikit-learn \u3067\u5b9f\u88c5\u3059\u308b\u4f8b\u3092\u793a\u3057\u307e\u3059\u3002\u5b9f\u88c5\u3057\u305f\u624b\u6cd5\u306f<strong>MI<\/strong>\u3001<strong>RFE<\/strong>\u3001<strong>RF<\/strong>\u3067\u3059\u3002<br>1. <strong>MI<\/strong>\uff08\u30d5\u30a3\u30eb\u30bf\u6cd5\uff09 \u3000<br>\u3000\u7279\u5fb4\u91cf\u3068\u76ee\u7684\u5909\u6570\u306e\u4f9d\u5b58\u5ea6\uff08\u975e\u7dda\u5f62\u95a2\u4fc2\u3082\u542b\u3080\uff09\u3092\u76f8\u4e92\u60c5\u5831\u91cf\u3067\u8a55\u4fa1\u3059\u308b\u624b\u6cd5<br>2. <strong>RFE<\/strong>\uff08\u30e9\u30c3\u30d1\u30fc\u6cd5\uff09 \u3000<br>\u3000\u4fc2\u6570\u306a\u3069\u3092\u57fa\u6e96\u306b\u3057\u305f\u30e2\u30c7\u30eb\u306e\u518d\u5e30\u7684\u306a\u8a13\u7df4\u306b\u3088\u308b\u624b\u6cd5<br>3. <strong>RF<\/strong>\uff08\u7d44\u307f\u8fbc\u307f\u6cd5\uff09 \u3000<br>\u3000\u30e9\u30f3\u30c0\u30e0\u30d5\u30a9\u30ec\u30b9\u30c8\u3067\u5f97\u3089\u308c\u308b\u91cd\u8981\u5ea6\uff08\u4e0d\u7d14\u5ea6\u6e1b\u5c11\u30d9\u30fc\u30b9\uff09\u306b\u57fa\u3065\u304f\u624b\u6cd5<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>!pip install japanize-matplotlib\n\nimport numpy as np\nimport matplotlib.pyplot as plt\nimport japanize_matplotlib\n\nfrom sklearn.datasets import load_breast_cancer\nfrom sklearn.model_selection import StratifiedKFold, cross_val_score\nfrom sklearn.pipeline import Pipeline\nfrom sklearn.preprocessing import StandardScaler\nfrom sklearn.linear_model import LogisticRegression\nfrom sklearn.ensemble import RandomForestClassifier\nfrom sklearn.feature_selection import SelectKBest, mutual_info_classif, RFE, SelectFromModel\n\n\n# \u30c7\u30fc\u30bf\ndata = load_breast_cancer()\nX = data.data\ny = data.target\n\n# \u8a55\u4fa1\u8a2d\u5b9a\ncv = StratifiedKFold(n_splits=5, shuffle=True, random_state=42)\nk_values = &#091;5,10,15,20,25,30]\n\nmi_scores = &#091;]\nrfe_scores = &#091;]\nrf_scores = &#091;]\n\nfor k in k_values:\n    # 1. MI: \u30d5\u30a3\u30eb\u30bf\u30fc\u6cd5\n    mi_pipeline = Pipeline(&#091;\n        (\"select\", SelectKBest(mutual_info_classif, k=k)),\n        (\"scale\", StandardScaler()),\n        (\"model\", LogisticRegression(max_iter=3000))\n    ])\n\n    mi_score = cross_val_score(\n        mi_pipeline, X, y, cv=cv, scoring=\"accuracy\"\n    ).mean()\n    mi_scores.append(mi_score)\n\n    # 2. RFE: \u30e9\u30c3\u30d1\u30fc\u6cd5\n    rfe_pipeline = Pipeline(&#091;\n        (\"scale\", StandardScaler()),\n        (\"select\", RFE(\n            LogisticRegression(max_iter=3000),\n            n_features_to_select=k\n        )),\n        (\"model\", LogisticRegression(max_iter=3000))\n    ])\n\n    rfe_score = cross_val_score(\n        rfe_pipeline, X, y, cv=cv, scoring=\"accuracy\"\n    ).mean()\n    rfe_scores.append(rfe_score)\n\n    # 3. RF: \u7d44\u307f\u8fbc\u307f\u6cd5\n    rf_pipeline = Pipeline(&#091;\n        (\"select\", SelectFromModel(\n            RandomForestClassifier(n_estimators=300, random_state=42),\n            threshold=-np.inf,\n            max_features=k\n        )),\n        (\"scale\", StandardScaler()),\n        (\"model\", LogisticRegression(max_iter=3000))\n    ])\n\n    rf_score = cross_val_score(\n        rf_pipeline, X, y, cv=cv, scoring=\"accuracy\"\n    ).mean()\n    rf_scores.append(rf_score)\n\n# \u30b0\u30e9\u30d5\nplt.figure(figsize=(10, 6))\nplt.plot(k_values, mi_scores, marker=\"o\", label=\"MI\")\nplt.plot(k_values, rfe_scores, marker=\"o\", label=\"RFE\")\nplt.plot(k_values, rf_scores, marker=\"o\", label=\"RF\")\n\nplt.xlabel(\"\u9078\u629e\u3057\u305f\u7279\u5fb4\u91cf\u6570\", fontsize=14)\nplt.ylabel(\"\u6b63\u89e3\u7387\", fontsize=14)\nplt.title(\"\u7279\u5fb4\u9078\u629e\u624b\u6cd5\u306e\u6bd4\u8f03\", fontsize=16)\nplt.legend(frameon=True, edgecolor=\"black\")\nplt.grid(False)\nplt.show()<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">\u7d50\u679c<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u6a2a\u8ef8\uff1a\u9078\u629e\u3057\u305f\u7279\u5fb4\u91cf\u6570<\/li>\n\n\n\n<li>\u7e26\u8ef8\uff1a\u4ea4\u5dee\u691c\u8a3c\u3067\u5f97\u3089\u308c\u305f\u6b63\u89e3\u7387\u306e\u5e73\u5747<\/li>\n\n\n\n<li>3\u672c\u306e\u7dda\uff1aMI\uff08\u30d5\u30a3\u30eb\u30bf\u6cd5\uff09 \/ RFE\uff08\u30e9\u30c3\u30d1\u30fc\u6cd5\uff09 \/ RF\uff08\u7d44\u307f\u8fbc\u307f\u6cd5\uff09\u306e\u6bd4\u8f03<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"866\" height=\"553\" src=\"https:\/\/since2020.jp\/media\/wp-content\/uploads\/2026\/05\/\u624b\u6cd5\u6bd4\u8f03.png\" alt=\"\" class=\"wp-image-8441\" srcset=\"https:\/\/since2020.jp\/media\/wp-content\/uploads\/2026\/05\/\u624b\u6cd5\u6bd4\u8f03.png 866w, https:\/\/since2020.jp\/media\/wp-content\/uploads\/2026\/05\/\u624b\u6cd5\u6bd4\u8f03-300x192.png 300w, https:\/\/since2020.jp\/media\/wp-content\/uploads\/2026\/05\/\u624b\u6cd5\u6bd4\u8f03-768x490.png 768w\" sizes=\"(max-width: 866px) 100vw, 866px\" \/><\/figure>\n\n\n\n<p>\u7d50\u679c\u306f\u4e0a\u8a18\u306e\u901a\u308a\u306b\u306a\u308a\u307e\u3057\u305f\u3002\u4eca\u56de\u306f\u3001<strong>\u9078\u629e\u3059\u308b\u7279\u5fb4\u91cf\u6570\uff08k\uff09<\/strong>\u3092\u5909\u5316\u3055\u305b\u305f\u3068\u304d\u306e <strong>\u6b63\u89e3\u7387<\/strong>\u306e\u63a8\u79fb\u3092\u6bd4\u8f03\u3057\u3066\u3044\u307e\u3059\u3002 \u5168\u4f53\u3068\u3057\u3066\u3001\u3044\u305a\u308c\u306e\u624b\u6cd5\u3067\u3082 k=20 \u524d\u5f8c\u3067\u6b63\u89e3\u7387\u304c\u5411\u4e0a\u3059\u308b\u50be\u5411\u304c\u898b\u3089\u308c\u307e\u3057\u305f\u3002 \u624b\u6cd5\u5225\u306b\u898b\u308b\u3068\u3001<strong>MI<\/strong> \u306f\u7279\u5fb4\u91cf\u6570\u304c\u3042\u308b\u7a0b\u5ea6\u591a\u3044\u3068\u304d\u306b\u7cbe\u5ea6\u304c\u4f38\u3073\u3084\u3059\u304f\u3001<strong>RFE<\/strong> \u306f\u5168\u4f53\u7684\u306b\u5b89\u5b9a\u3057\u305f\u6b63\u89e3\u7387\u3092\u793a\u3057\u307e\u3057\u305f\u3002<strong>RF<\/strong>\u306f<strong>MI<\/strong>\u306b\u4f3c\u305f\u6319\u52d5\u3092\u793a\u3057\u307e\u3057\u305f\u304c\u3001\u7cbe\u5ea6\u691c\u8a3c\u306f\u30ed\u30b8\u30b9\u30c6\u30a3\u30c3\u30af\u56de\u5e30\u3067\u884c\u3063\u3066\u3044\u308b\u305f\u3081\u3001\u4eca\u56de\u306f\u53c2\u8003\u7a0b\u5ea6\u306b\u6349\u3048\u307e\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u307e\u3068\u3081<\/h2>\n\n\n\n<p>\u7279\u5fb4\u91cf\u9078\u629e\u306f\u3001\u6c4e\u5316\u6027\u80fd\u306e\u5411\u4e0a\u3001\u8a08\u7b97\u91cf\u306e\u524a\u6e1b\u3001\u89e3\u91c8\u6027\u306e\u6539\u5584\u306a\u3069\u3092\u76ee\u7684\u306b\u3001\u5229\u7528\u3059\u308b\u7279\u5fb4\u91cf\u3092\u7d5e\u308a\u8fbc\u3080\u8003\u3048\u65b9\u3067\u3059\u3002\u624b\u6cd5\u306f\u5927\u304d\u304f <strong>\u30d5\u30a3\u30eb\u30bf\u6cd5 \/ \u30e9\u30c3\u30d1\u30fc\u6cd5 \/ \u7d44\u307f\u8fbc\u307f\u6cd5<\/strong> \u306e3\u3064\u306b\u6574\u7406\u3067\u304d\u3001\u305d\u308c\u305e\u308c\u300c\u8a55\u4fa1\u306e\u57fa\u6e96\u300d\u3084\u300c\u63a2\u7d22\u306e\u4ed5\u65b9\u300d\u304c\u7570\u306a\u308a\u307e\u3059\u3002\u306a\u304a\u3001\u4eca\u56de\u306e\u5b9f\u9a13\u7d50\u679c\u306f breast_cancer \u30c7\u30fc\u30bf\u3067\u306e\u4e00\u4f8b\u3067\u3042\u308a\u3001\u30c7\u30fc\u30bf\u306e\u6b21\u5143\u6570\u30fb\u76f8\u95a2\u69cb\u9020\u30fb\u30b5\u30f3\u30d7\u30eb\u6570\u306a\u3069\u306b\u3088\u3063\u3066\u3001\u6700\u9069\u306a\u624b\u6cd5\u3084\u7279\u5fb4\u91cf\u6570\u306f\u5909\u308f\u308a\u307e\u3059\u3002\u5b9f\u52d9\u3067\u306f\u3001\u7cbe\u5ea6\u6307\u6a19\u3060\u3051\u3067\u306a\u304f\u30c9\u30e1\u30a4\u30f3\u77e5\u8b58\u3084\u30d3\u30b8\u30cd\u30b9\u4e0a\u306e\u8981\u4ef6\u3082\u8e0f\u307e\u3048\u3001\u9069\u5207\u306a\u7279\u5fb4\u91cf\u3092\u9078\u3076\u3053\u3068\u304c\u91cd\u8981\u3067\u3059\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6a5f\u68b0\u5b66\u7fd2\u30e2\u30c7\u30eb\u306e\u6027\u80fd\u306f\u3001\u3069\u306e\u7279\u5fb4\u91cf\uff08\u8aac\u660e\u5909\u6570\uff09\u3092\u4f7f\u3046\u304b\u3067\u5927\u304d\u304f\u5de6\u53f3\u3055\u308c\u307e\u3059\u3002\u672c\u8a18\u4e8b\u3067\u306f \u7279\u5fb4\u91cf\u9078\u629e\uff08feature selection\uff09 \u306e\u5168\u4f53\u50cf\u3092\u6574\u7406\u3057\u3001\u5206\u985e\u30bf\u30b9\u30af\u3092\u984c\u6750\u306b scikit-learn \u3092\u7528\u3044\u305f\u5b9f\u88c5\u4f8b\u3082\u7d39 [&hellip;]<\/p>\n","protected":false},"author":96,"featured_media":8355,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","swell_btn_cv_data":"","footnotes":"","_wp_rev_ctl_limit":""},"categories":[1251],"tags":[1281,1282,419,1280,1283],"class_list":["post-8437","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-analysis","tag-1281","tag-1282","tag-419","tag-1280","tag-1283"],"_links":{"self":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/8437","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/users\/96"}],"replies":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/comments?post=8437"}],"version-history":[{"count":14,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/8437\/revisions"}],"predecessor-version":[{"id":8455,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/8437\/revisions\/8455"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media\/8355"}],"wp:attachment":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media?parent=8437"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/categories?post=8437"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/tags?post=8437"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}