{"id":4546,"date":"2024-02-16T10:49:15","date_gmt":"2024-02-16T01:49:15","guid":{"rendered":"https:\/\/blog.since2020.jp\/?p=4546"},"modified":"2024-02-20T09:51:18","modified_gmt":"2024-02-20T00:51:18","slug":"optuna-lightgbm-tuner","status":"publish","type":"post","link":"https:\/\/since2020.jp\/media\/optuna-lightgbm-tuner\/","title":{"rendered":"Optuna\u306e\u62e1\u5f35\u6a5f\u80fdLightGBM Tuner\u306e\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3092\u6df1\u6398\u308a\u3057\u3066\u307f\u305f"},"content":{"rendered":"\n<p>LightGBM\u3067\u30e2\u30c7\u30eb\u3092\u5b9f\u88c5\u3057\u305f\u969b\u306b\u3001LightGBM\u7528\u306b\u7279\u5316\u3057\u305f\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u81ea\u52d5\u6700\u9069\u5316\u306e\u305f\u3081\u306e\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u898b\u3064\u3051\u305f\u306e\u3067\u4f7f\u7528\u3057\u3066\u307f\u307e\u3057\u305f\u3002\u3053\u3053\u3067\u306f\u3069\u3046\u3084\u3063\u3066LightGBM Tuner\u304c\u30d1\u30e9\u30e1\u30fc\u30bf\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3057\u3066\u3044\u308b\u306e\u304b\u3092\u6df1\u304f\u898b\u3066\u307f\u307e\u3059\u3002<\/p>\n\n\n<h2>\u306f\u3058\u3081\u306b<\/h2>\n<p>LightGBM\u3067\u30e2\u30c7\u30eb\u3092\u5b9f\u88c5\u3057\u305f\u969b\u306b\u3001LightGBM\u7528\u306b\u7279\u5316\u3057\u305f\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u81ea\u52d5\u6700\u9069\u5316\u306e\u305f\u3081\u306e\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u898b\u3064\u3051\u305f\u306e\u3067\u4f7f\u7528\u3057\u3066\u307f\u307e\u3057\u305f\u3002<br \/>\r\nLightGBM Tuner\u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u4f55\u3082\u8003\u3048\u308b\u3053\u3068\u306a\u304f\u624b\u8efd\u306b 1 \u884c\u306e\u5909\u66f4\u3060\u3051\u3067\u8a66\u3059\u3053\u3068\u304c\u3067\u304d\u3001\u7cbe\u5ea6\u6539\u5584\u306b\u8ca2\u732e\u3057\u3066\u304f\u308c\u307e\u3057\u305f\u3002LightGBM \u306e\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u306b\u6163\u308c\u3066\u3044\u306a\u3044\u30e6\u30fc\u30b6\u30fc\u306b\u3068\u3063\u3066\u3001\u5f37\u529b\u306a\u52a9\u3063\u4eba\u3068\u306a\u308a\u5f97\u308b\u306e\u3067\u306f\u306a\u3044\u304b\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\r\n<p>LightGBM Tuner\u306e\u4f7f\u3044\u65b9\u306f\u305f\u304f\u3055\u3093\u8a18\u4e8b\u304c\u3042\u308b\u306e\u3067\u3001\u3053\u3053\u3067\u306f\u3069\u3046\u3084\u3063\u3066LightGBM Tuner\u304c\u30d1\u30e9\u30e1\u30fc\u30bf\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3057\u3066\u3044\u308b\u306e\u304b\u3092\u6df1\u304f\u898b\u3066\u307f\u307e\u3059\u3002<\/p>\r\n<p><strong>LightGBM Tuner\u306e\u4f7f\u3044\u65b9\u53c2\u8003\u30b5\u30a4\u30c8<\/strong><br \/>\r\n\u30fb<span style=\"color: #0000ff\"><a href=\"https:\/\/toukei-lab.com\/hyper-para-tuning\" style=\"color: #0000ff\">https:\/\/toukei-lab.com\/hyper-para-tuning<\/a><\/span><br \/>\r\n\u30fb<span style=\"color: #0000ff\"><a href=\"https:\/\/tech.preferred.jp\/ja\/blog\/hyperparameter-tuning-with-optuna-integration-lightgbm-tuner\/\" style=\"color: #0000ff\">https:\/\/tech.preferred.jp\/ja\/blog\/hyperparameter-tuning-with-optuna-integration-lightgbm-tuner\/<\/a><\/span><\/p>\r\n<p><!-- notionvc: f431ce64-7e25-48f4-a6cf-4434a68fc50a --><\/p>\n\n<h2>LightGBM Tuner\u3068\u306f<\/h2>\n<p><span data-token-index=\"0\" class=\"discussion-id-a319867e-8976-4449-b4bb-02d46007a86c notion-enable-hover\">Optuna<\/span>\u3068\u3044\u3046\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u3001LightGBM\u7528\u306b\u7279\u5316\u3057\u305f\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u81ea\u52d5\u6700\u9069\u5316\u306e\u305f\u3081\u306e\u30e2\u30b8\u30e5\u30fc\u30eb<!-- notionvc: 608f635f-d41e-4023-ba70-4790d26e7a67 --><\/p>\r\n<p>\u4ee5\u4e0b\u306e7\u3064\u306e\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u6bb5\u968e\u7684\u306b\u6700\u9069\u5316\u3057\u307e\u3059\u3002<br \/>\r\n<!-- notionvc: cebd382c-8756-47eb-b458-6968978ba827 -->\u30fblambda_l1(L1\u6b63\u5247\u5316\u9805\u306e\u4fc2\u6570)<!-- notionvc: 2cea7e7f-aafc-440c-b977-1e330f8cdbcc --><br \/>\r\n\u30fblambda_l2(L2\u6b63\u5247\u5316\u9805\u306e\u4fc2\u6570)<!-- notionvc: 5c0f96ed-948d-417f-a973-ea7d51a85ea1 --><br \/>\r\n\u30fbnum_leaves(1\u672c\u306e\u6728\u306e\u6700\u5927\u8449\u679a\u6570)<!-- notionvc: 435fa2ff-c802-4c58-94cd-5529fd251bc1 --><br \/>\r\n\u30fbfeature_fraction(\u5404\u6c7a\u5b9a\u6728\u306b\u304a\u3044\u3066\u30e9\u30f3\u30c0\u30e0\u306b\u62bd\u51fa\u3055\u308c\u308b\u5217\u306e\u5272\u5408)<!-- notionvc: d82f2bfb-e4f9-4dbc-8a5e-f7e922fe84c9 --><br \/>\r\n\u30fbbagging_fraction(\u5404\u6c7a\u5b9a\u6728\u306b\u304a\u3044\u3066\u30e9\u30f3\u30c0\u30e0\u306b\u62bd\u51fa\u3055\u308c\u308b\u6a19\u672c\u306e\u5272\u5408)<!-- notionvc: 5a13f59e-d340-4d76-92fd-359e1c0c0f28 --><br \/>\r\n\u30fbbagging_freq(\u3053\u3053\u3067\u6307\u5b9a\u3057\u305f\u30a4\u30c6\u30ec\u30fc\u30b7\u30e7\u30f3\u6bce\u306b\u30d0\u30ae\u30f3\u30b0\u5b9f\u65bd)<!-- notionvc: 84594a6d-c643-4611-8ded-3c8635a30588 --><br \/>\r\n\u30fbmin_child_sample(1\u679a\u306e\u8449\u306b\u542b\u307e\u308c\u308b\u6700\u5c0f\u30c7\u30fc\u30bf\u6570)<!-- notionvc: be489448-5ace-44f2-b99c-6a8ea372d6ed --><\/p>\r\n<p><strong>Optuna<\/strong><\/p>\r\n<p>\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u306e\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u81ea\u52d5\u6700\u9069\u5316\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3067\u3059\u3002<br \/>\r\n\u65e5\u672c\u306e\u6771\u4eac\u5927\u5b66\u767a\u306eAI\u30d9\u30f3\u30c1\u30e3\u30fcPreferred Networks\u793e\u304c\u958b\u767a\u3057\u307e\u3057\u305f\u3002<br \/>\r\n\u76ee\u7684\u95a2\u6570\u306e\u5024\u3092\u8a55\u4fa1\u3059\u308b\u305f\u3081\u306b\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u5024\u3092\u30b5\u30f3\u30d7\u30ea\u30f3\u30b0\u3057\u3066\u76ee\u7684\u95a2\u6570\u306e\u5024\u3092\u53d6\u5f97\u3057\u3001\u305d\u306e\u5024\u3092\u5143\u306b\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u63a8\u5b9a\u5024\u3092\u66f4\u65b0\u3059\u308b\u3068\u3044\u3046\u30d7\u30ed\u30bb\u30b9\u3092\u7e70\u308a\u8fd4\u3059\u30d9\u30a4\u30ba\u6700\u9069\u5316\u3092\u5b9f\u88c5\u3059\u308b\u3053\u3068\u3067\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u63a2\u7d22\u3092\u52b9\u7387\u7684\u306b\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002 <br \/>\r\n\u7c21\u5358\u306b\u3044\u3046\u3068\u3001\u8a66\u884c\u932f\u8aa4\u3092\u3057\u306a\u304c\u3089\u6700\u9069\u306a\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u63a2\u7d22\u3057\u3066\u3044\u304f\u30a4\u30e1\u30fc\u30b8\u3067\u3059\u3002<\/p>\r\n<p><!-- notionvc: 39dbcb38-9833-459f-bd20-215f8bc7f656 --><\/p>\n\n<h2>\u4e3b\u306a\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3068\u305d\u306e\u52d5\u4f5c\u539f\u7406<\/h2>\n<p>LightGBM Tuner\u306b\u304a\u3051\u308b\u4e3b\u306a\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u306e\u4e00\u3064\u306f\u30d9\u30a4\u30ba\u6700\u9069\u5316\u3067\u3059\u3002\u30d9\u30a4\u30ba\u6700\u9069\u5316\u306f\u9ad8\u52b9\u7387\u3067\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u6700\u9069\u306a\u7d44\u307f\u5408\u308f\u305b\u3092\u898b\u3064\u3051\u51fa\u3059\u624b\u6cd5\u3067\u3042\u308a\u3001\u7279\u306b\u8907\u96d1\u306a\u30e2\u30c7\u30eb\u3084\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306b\u304a\u3051\u308b\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u306b\u304a\u3044\u3066\u6709\u52b9\u3067\u3059\u3002<!-- notionvc: 56adce93-9740-4206-87ec-8673f3827b8f --><\/p>\r\n<p><strong>\u30d9\u30a4\u30ba\u6700\u9069\u5316\u306e\u30d7\u30ed\u30bb\u30b9<\/strong><\/p>\r\n<ol>\r\n\t<li>\u76ee\u7684\u95a2\u6570\u306e\u5b9a\u7fa9<br \/>\r\n\u76ee\u7684\u95a2\u6570\u306f\u6700\u9069\u5316\u3057\u305f\u3044\u95a2\u6570\u3067\u3059\u304c\u3001\u3053\u306e\u95a2\u6570\u306f\u76f4\u63a5\u7684\u306b\u306f\u77e5\u3089\u308c\u3066\u304a\u3089\u305a\u3001\u305d\u306e\u8a55\u4fa1\u306f\u9ad8\u4fa1\uff08\u8a08\u7b97\u30b3\u30b9\u30c8\u304c\u9ad8\u3044\u3001\u6642\u9593\u304c\u304b\u304b\u308b\u7b49\uff09\u3067\u3059\u3002<!-- notionvc: 30d7c07c-402a-462f-89a7-d68c8e3a1c5a --><!-- notionvc: 7e37243c-eed2-4c87-938f-64aa8ff63fcc --><\/li>\r\n\t<li>\u4e8b\u524d\u5206\u5e03\u306e\u8a2d\u5b9a<br \/>\r\n\u6700\u521d\u306b\u3001\u76ee\u7684\u95a2\u6570\u306e\u5f62\u72b6\u306b\u95a2\u3057\u3066\u4e0d\u78ba\u5b9f\u6027\u3092\u8868\u73fe\u3059\u308b\u305f\u3081\u306b\u3001\u4e8b\u524d\u5206\u5e03\u3092\u8a2d\u5b9a\u3057\u307e\u3059\u3002\u3053\u308c\u306f\u901a\u5e38\u3001\u30ac\u30a6\u30b9\u904e\u7a0b\uff08Gaussian Process, GP\uff09\u3092\u4f7f\u7528\u3057\u3066\u884c\u308f\u308c\u3001\u76ee\u7684\u95a2\u6570\u306e\u53ef\u80fd\u306a\u632f\u308b\u821e\u3044\u3092\u30e2\u30c7\u30eb\u5316\u3057\u307e\u3059\u3002<!-- notionvc: 0dac464e-ead2-4195-9bfe-4483fb15d54c --><\/li>\r\n\t<li>\u7372\u5f97\u95a2\u6570\u306e\u9078\u629e<br \/>\r\n\u3069\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u6b21\u306b\u8a55\u4fa1\u3059\u308b\u304b\u3092\u6c7a\u5b9a\u3059\u308b\u305f\u3081\u306b\u7372\u5f97\u95a2\u6570\u3092\u9078\u629e\u3057\u307e\u3059\u3002\u7372\u5f97\u95a2\u6570\u306f\u3001\u73fe\u5728\u306e\u30e2\u30c7\u30eb\u306e\u4e0d\u78ba\u5b9f\u6027\u3068\u65e2\u77e5\u306e\u60c5\u5831\u3092\u8003\u616e\u3057\u3066\u3001\u6700\u5927\u306e\u671f\u5f85\u6539\u5584\u3092\u63d0\u4f9b\u3059\u308b\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u7279\u5b9a\u3057\u307e\u3059\u3002<!-- notionvc: 0d1e4aae-f1dd-4624-80cd-f2da8d4427cf --><!-- --><!-- notionvc: 9df67091-e468-40c9-bb6a-497ad84061ee --><\/li>\r\n\t<li>\u6700\u9069\u306a\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u9078\u629e\u3068\u8a55\u4fa1<br \/>\r\n\u7372\u5f97\u95a2\u6570\u306b\u57fa\u3065\u304d\u3001\u6b21\u306b\u8a55\u4fa1\u3059\u3079\u304d\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u9078\u629e\u3057\u3001\u76ee\u7684\u95a2\u6570\u3092\u8a55\u4fa1\u3057\u307e\u3059\u3002\u3053\u306e\u7d50\u679c\u306f\u3001\u30e2\u30c7\u30eb\u306e\u66f4\u65b0\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<!-- notionvc: 35288dbc-ebb8-4ff0-a21f-2d7cd6b23c26 --><\/li>\r\n\t<li>\u4e8b\u5f8c\u5206\u5e03\u306e\u66f4\u65b0<br \/>\r\n\u65b0\u305f\u306b\u5f97\u3089\u308c\u305f\u89b3\u6e2c\u7d50\u679c\u3092\u7528\u3044\u3066\u3001\u30ac\u30a6\u30b9\u904e\u7a0b\u30e2\u30c7\u30eb\u3092\u66f4\u65b0\u3057\u3001\u76ee\u7684\u95a2\u6570\u306e\u5f62\u72b6\u306b\u95a2\u3059\u308b\u4e0d\u78ba\u5b9f\u6027\u3092\u6e1b\u3089\u3057\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u30d9\u30a4\u30ba\u306e\u5b9a\u7406\u3092\u4f7f\u7528\u3057\u3066\u884c\u308f\u308c\u307e\u3059\u3002<!-- notionvc: c28ae6cd-ffb0-4f50-9dbc-ada9275988ce --><!-- notionvc: c1b81e2b-eb5c-44a8-85ba-57c33961b999 --><\/li>\r\n<\/ol>\n\n<h2>\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u63a2\u7d22\u7a7a\u9593<\/h2>\n<p><strong>\u4eca\u307e\u3067\u306e\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0<br \/>\r\n<\/strong>\u4f8b\u3048\u3070\u3001\u57fa\u672c\u7684\u306a\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u304c\uff17\u3064\u3042\u308b\u3068\u3057\u307e\u3059\u3002\u6700\u9069\u306a\u7d44\u307f\u5408\u308f\u305b\u3092\u63a2\u7d22\u3059\u308b\u5834\u5408\u3001\u7d44\u307f\u5408\u308f\u305b\u306e\u6570\u306f\u639b\u3051\u7b97\u3067\u6c7a\u307e\u308b\u305f\u3081\u3001\u81a8\u5927\u306a\u63a2\u7d22\u7a7a\u9593\u306b\u306a\u308a\u307e\u3059\uff08\u4e0b\u56f3\uff09<br \/>\r\n<img decoding=\"async\" src=\"https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image7.png\" alt=\"\" width=\"1118\" height=\"131\" class=\"alignnone size-full wp-image-4552\" srcset=\"https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image7.png 1118w, https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image7-300x35.png 300w, https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image7-1024x120.png 1024w, https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image7-768x90.png 768w\" sizes=\"(max-width: 1118px) 100vw, 1118px\" \/><br \/>\r\n<!-- notionvc: a0315e52-30b7-4095-919b-8f1276950d2c --><!-- notionvc: e0c98e9d-b9b7-415b-a54f-f7ae614e37a0 --><\/p>\r\n<p><strong>LightGBM Tuner\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0<\/strong><br \/>\r\nStep-wise\u306e\u300c1\u30641\u3064\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u9806\u756a\u306b\u632f\u3063\u3066\u3044\u3063\u3066\u30011\u3064\u305a\u3064\u3044\u3044\u5024\u3092\u898b\u3064\u3051\u308b\u300d\u306e\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3068\u3001\u300c\u91cd\u8981\u306a\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u304b\u3089\u9806\u306b\u6700\u9069\u306a\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3059\u308b\u300d\u3068\u3044\u3046\u7d4c\u9a13\u5247\u3092LightGBM Tuner\u306e\u30b3\u30fc\u30c9\u306b\u306f\u843d\u3068\u3057\u8fbc\u307f\u3057\u3066\u3042\u308a\u307e\u3059\u3002\u4e00\u8a00\u3067\u307e\u3068\u3081\u308b\u3068\u3001\u7d4c\u9a13\u7684\u306b\u5f71\u97ff\u529b\u304c\u5927\u304d\u3044\u3068\u601d\u308f\u308c\u308b\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u304b\u3089\u9806\u6b21\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3092\u884c\u3044\u307e\u3059\u3002<br \/>\r\n<img decoding=\"async\" src=\"https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image2.png\" alt=\"\" width=\"1096\" height=\"136\" class=\"alignnone size-full wp-image-4553\" srcset=\"https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image2.png 1096w, https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image2-300x37.png 300w, https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image2-1024x127.png 1024w, https:\/\/since2020.jp\/media\/wp-content\/uploads\/2024\/02\/image2-768x95.png 768w\" sizes=\"(max-width: 1096px) 100vw, 1096px\" \/>\u9806\u6b21\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u6c7a\u5b9a\u3057\u3066\u3044\u304f\u305f\u3081\u3001\u63a2\u7d22\u306e\u7d44\u307f\u5408\u308f\u305b\u306f\u8db3\u3057\u7b97\u3067\u6c7a\u307e\u308a\u63a2\u7d22\u7a7a\u9593\u3092\u5927\u304d\u304f\u72ed\u3081\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<br \/>\r\n\u4e0a\u56f3\u3067\u306f\u7c21\u7565\u5316\u3055\u308c\u3066\u3044\u307e\u3059\u304c\u3001\u76f8\u4e92\u4f5c\u7528\u306e\u5927\u304d\u3044\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u306f\u540c\u6642\u306b\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3092\u884c\u3044\u307e\u3059\u3002<br \/>\r\n\u5177\u4f53\u7684\u306b\u306f bootstrap aggregating \u3092\u5236\u5fa1\u3059\u308b\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3067\u3042\u308b<!-- notionvc: e8687fb9-cb04-4904-ad90-db49bb49ddb4 --><span data-token-index=\"0\" class=\"notion-enable-hover\"><span style=\"color: #ff9900\"><em>bagging_fraction<\/em><\/span>\u3068<span style=\"color: #ff9900\"><em>bagging_freq<\/em><\/span>\u3001\u6b63\u5247\u5316\u9805\u306e\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3067\u3042\u308b<!-- notionvc: 741fc761-e64b-4d93-99a9-6c966ca4533f --><span style=\"color: #ff9900\"><em>reg_lambda<\/em><\/span>\u3068<span style=\"color: #ff9900\"><em>reg_alpha<\/em><\/span>\u306f\u540c\u6642\u306b\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3092\u884c\u3044\u307e\u3059\u3002<\/span><\/p>\r\n<p><!-- notionvc: 03108631-dd28-4f8a-9e83-4519d16b8010 --><!-- notionvc: 2765e7ef-94a6-4022-8a5f-bab65fcd674d --><!-- notionvc: 1f5944ec-1ce8-46cc-b72f-d268934745ba --><\/p>\n\n<h2>\u5b9f\u8df5\u7684\u306a\u6027\u80fd\u6bd4\u8f03<\/h2>\n<p>\u6700\u4f4e\u9650\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u6307\u5b9a\u3057\u305f\u3068\u304d<\/p>\r\n<div class=\"hcb_wrap\">\r\n<pre class=\"prism line-numbers lang-python\" data-lang=\"Python\"><code>params = { \r\n    'objective': 'regression_l1', \r\n    'metric': 'l1'\r\n    }<\/code><\/pre>\r\n<p>\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u5f8c\u306e\u30d1\u30e9\u30e1\u30fc\u30bf<\/p>\r\n<div class=\"hcb_wrap\">\r\n<pre class=\"prism line-numbers lang-python\" data-lang=\"Python\"><code>best_params = {\r\n    'objective': 'regression_l1', \r\n    'metric': 'l1', \r\n    'feature_pre_filter': False, \r\n    'lambda_l1': 3.4454358294911687e-08, \r\n    'lambda_l2': 1.727786973750472e-08, \r\n    'num_leaves': 5, \r\n    'feature_fraction': 1.0, \r\n    'bagging_fraction': 0.6104147834376046, \r\n    'bagging_freq': 7, \r\n    'min_child_samples': 20, \r\n    'num_iterations': 1000\r\n}<\/code><\/pre>\r\n<p>\u3053\u306e\u6642\u3001<br \/>\r\nWeighted Average of MAPE(\u52a0\u91cd\u5e73\u5747MAPE): 34.2%<br \/>\r\nAverage of MAE(\u5e73\u5747MAE): 51.9<\/p>\r\n<p>\u6b21\u306b\u3042\u308b\u7a0b\u5ea6\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u6307\u5b9a\u3057\u305f\u6642<\/p>\r\n<div class=\"hcb_wrap\">\r\n<pre class=\"prism line-numbers lang-python\" data-lang=\"Python\"><code>params = {\r\n    'objective': 'regression_l1',\r\n    'metric': 'mae',\r\n    'verbosity': -1,\r\n    # 'num_iterations': 400, \r\n    'verbose_eval':False,\r\n    'seed': 42,\r\n    'early_stopping_rounds':300,\r\n    'boosting': 'gbdt'\r\n}<\/code><\/pre>\r\n<p>\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u5f8c\u306e\u30d1\u30e9\u30e1\u30fc\u30bf<\/p>\r\n<div class=\"hcb_wrap\">\r\n<pre class=\"prism line-numbers lang-python\" data-lang=\"Python\"><code>best_params = {\r\n    'objective': 'regression_l1', \r\n    'metric': 'l1', \r\n    'verbosity': -1, \r\n    'verbose_eval': False, \r\n    'seed': 42, \r\n    'boosting': 'gbdt', \r\n    'feature_pre_filter': False, \r\n    'lambda_l1': 1.7706872604573067e-07, \r\n    'lambda_l2': 3.2117428494439906e-05, \r\n    'num_leaves': 106, \r\n    'feature_fraction': 0.9840000000000001, \r\n    'bagging_fraction': 0.8245814154748217, \r\n    'bagging_freq': 1, \r\n    'min_child_samples': 20, \r\n    'num_iterations': 1000, \r\n    'early_stopping_round': 300\r\n}<\/code><\/pre>\r\n<p>\u3053\u306e\u6642\u3001<br \/>\r\n<span data-token-index=\"1\" class=\"discussion-id-549dc375-bb65-455f-9d3f-ce873aa8c196 notion-enable-hover\">Weighted Average of MAPE(\u52a0\u91cd\u5e73\u5747MAPE): <span style=\"color: #ff0000\">26.0%<br \/>\r\n<\/span> Average of MAE:<span style=\"color: #ff0000\"> 38.1<br \/>\r\n<\/span><\/span><!-- notionvc: 932e0152-d8d5-4c71-a7a2-068b0037f614 --><\/p>\r\n<p>\u6700\u521d\u306b\u6307\u5b9a\u3057\u305f\u30d1\u30e9\u30e1\u30fc\u30bf\u306f\u5909\u66f4\u3055\u308c\u305a\u306b\u3001\u305d\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u306b\u5408\u3063\u305f\u30d1\u30e9\u30e1\u30fc\u30bf\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u304c\u5b9f\u884c\u3055\u308c\u308b\u306e\u3067\u3001\u3044\u3044\u611f\u3058\u306b\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u6307\u5b9a\u3059\u308b\u3068\u7cbe\u5ea6\u304c\u826f\u304f\u306a\u308a\u307e\u3059<\/p>\r\n<\/div>\r\n<\/div>\r\n<p><!-- notionvc: 1bb4739d-df7e-4391-9c95-773d4eaca63a --><\/p>\r\n<\/div>\r\n<\/div>\n\n<h2>\u307e\u3068\u3081<\/h2>\n<p>LightGBM Tuner\u306f\u3001LightGBM\u30e2\u30c7\u30eb\u306e\u6027\u80fd\u3092\u624b\u9593\u3092\u304b\u3051\u305a\u306b\u5411\u4e0a\u3055\u305b\u308b\u5f37\u529b\u306a\u30c4\u30fc\u30eb\u3067\u3059\u3002<\/p>\r\n<p>\u305d\u306e\u52b9\u7387\u7684\u306a\u30d1\u30e9\u30e1\u30fc\u30bf\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u30d7\u30ed\u30bb\u30b9\u306f\u3001\u30d9\u30a4\u30ba\u6700\u9069\u5316\u306b\u57fa\u3065\u304d\u3001\u63a2\u7d22\u7a7a\u9593\u3092\u72ed\u3081\u3064\u3064\u6700\u9069\u306a\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u7d44\u307f\u5408\u308f\u305b\u3092\u898b\u3064\u3051\u308b\u3053\u3068\u304c\u53ef\u80fd\u3067\u3057\u305f\u3002<br \/>\r\n\u3053\u306e\u30c4\u30fc\u30eb\u306e\u5229\u7528\u306f\u3001\u7279\u306b\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u306b\u4e0d\u6163\u308c\u306a\u30e6\u30fc\u30b6\u30fc\u306b\u3068\u3063\u3066\u3001\u30e2\u30c7\u30eb\u958b\u767a\u306e\u8ca0\u62c5\u3092\u8efd\u6e1b\u3057\u3001\u7cbe\u5ea6\u306e\u9ad8\u3044\u30e2\u30c7\u30eb\u69cb\u7bc9\u3092\u652f\u63f4\u3057\u307e\u3059\u3002<\/p>\r\n<p><!-- notionvc: 91f188bb-3468-4f89-8a22-fe5f0f143d9d --><\/p>","protected":false},"excerpt":{"rendered":"<p>LightGBM\u3067\u30e2\u30c7\u30eb\u3092\u5b9f\u88c5\u3057\u305f\u969b\u306b\u3001LightGBM\u7528\u306b\u7279\u5316\u3057\u305f\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u81ea\u52d5\u6700\u9069\u5316\u306e\u305f\u3081\u306e\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u898b\u3064\u3051\u305f\u306e\u3067\u4f7f\u7528\u3057\u3066\u307f\u307e\u3057\u305f\u3002\u3053\u3053\u3067\u306f\u3069\u3046\u3084\u3063\u3066LightGBM Tuner\u304c\u30d1\u30e9\u30e1\u30fc\u30bf\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3057\u3066 [&hellip;]<\/p>\n","protected":false},"author":62,"featured_media":3132,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","swell_btn_cv_data":"","footnotes":"","_wp_rev_ctl_limit":""},"categories":[1246],"tags":[359,480,331,39,360],"class_list":["post-4546","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-infrastructure","tag-lightgbm","tag-optuna","tag-python","tag-39","tag-360"],"_links":{"self":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/4546","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/users\/62"}],"replies":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/comments?post=4546"}],"version-history":[{"count":0,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/4546\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media\/3132"}],"wp:attachment":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media?parent=4546"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/categories?post=4546"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/tags?post=4546"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}