{"id":6010,"date":"2024-12-13T18:21:24","date_gmt":"2024-12-13T09:21:24","guid":{"rendered":"https:\/\/blog.since2020.jp\/?p=6010"},"modified":"2026-07-30T15:53:04","modified_gmt":"2026-07-30T06:53:04","slug":"polars_glossary","status":"publish","type":"post","link":"https:\/\/since2020.jp\/media\/polars_glossary\/","title":{"rendered":"Polars\u3068\u306f\uff1f2026\u5e74\u6700\u65b0\u7248\u3067\u8aad\u307f\u89e3\u304f\u8d85\u9ad8\u901f\u30c7\u30fc\u30bf\u51e6\u7406\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u5b9f\u529b"},"content":{"rendered":"\n<p>Polars\u3068\u306f\u4f55\u304b\u30922026\u5e74\u6700\u65b0\u7248\u306e\u60c5\u5831\u3067\u5fb9\u5e95\u89e3\u8aac\u3002Rust\u30d9\u30fc\u30b9\u306e\u9ad8\u901f\u30c7\u30fc\u30bf\u30d5\u30ec\u30fc\u30e0\u30e9\u30a4\u30d6\u30e9\u30ea\u3068\u3057\u3066\u6ce8\u76ee\u3055\u308c\u308b\u7406\u7531\u304b\u3089\u3001LazyFrame\u30fb\u30af\u30a8\u30ea\u6700\u9069\u5316\u30fbStreaming Engine\u30fbGPU\u5bfe\u5fdc\u306e\u6700\u65b0\u52d5\u5411\u3001AI\u6642\u4ee3\u306b\u304a\u3051\u308b\u5b9f\u8df5\u6d3b\u7528\u307e\u3067\u308f\u304b\u308a\u3084\u3059\u304f\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/p>\n\n\n<h2>\u306f\u3058\u3081\u306b<\/h2>\n<p>\u30c7\u30fc\u30bf\u91cf\u306e\u5897\u52a0\u3068AI\u6d3b\u7528\u306e\u52a0\u901f\u306b\u4f34\u3044\u3001\u30c7\u30fc\u30bf\u51e6\u7406\u30e9\u30a4\u30d6\u30e9\u30ea\u306b\u306f\u300c\u9ad8\u901f\u300d\u300c\u7701\u30e1\u30e2\u30ea\u300d\u300c\u30b9\u30b1\u30fc\u30e9\u30d6\u30eb\u300d\u304c\u3053\u308c\u307e\u3067\u4ee5\u4e0a\u306b\u6c42\u3081\u3089\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>\u305d\u306e\u4e2d\u3067\u6025\u901f\u306b\u5b58\u5728\u611f\u3092\u9ad8\u3081\u3066\u3044\u308b\u306e\u304c<strong>Polars<\/strong>\u3067\u3059\u3002<\/p>\n<p>Pandas\u30e9\u30a4\u30af\u306a\u64cd\u4f5c\u6027\u3092\u7dad\u6301\u3057\u306a\u304c\u3089\u3001Rust\u306b\u3088\u308b\u30cd\u30a4\u30c6\u30a3\u30d6\u5b9f\u88c5\u3068Apache Arrow\u3092\u30d9\u30fc\u30b9\u3068\u3057\u305f\u30e1\u30e2\u30ea\u8a2d\u8a08\u306b\u3088\u308a\u3001\u5927\u898f\u6a21\u30c7\u30fc\u30bf\u3067\u3082\u975e\u5e38\u306b\u9ad8\u901f\u306a\u51e6\u7406\u3092\u5b9f\u73fe\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>2026\u5e74\u73fe\u5728\u3067\u306f\u3001\u5358\u306a\u308bPandas\u4ee3\u66ff\u30e9\u30a4\u30d6\u30e9\u30ea\u3068\u3044\u3046\u4f4d\u7f6e\u4ed8\u3051\u3092\u8d85\u3048\u3001\u30c7\u30fc\u30bf\u30a8\u30f3\u30b8\u30cb\u30a2\u30ea\u30f3\u30b0\u3001AI\u30fb\u6a5f\u68b0\u5b66\u7fd2\u3001Lakehouse\u3001ETL\u57fa\u76e4\u306a\u3069\u5e45\u5e83\u3044\u9818\u57df\u3067\u63a1\u7528\u304c\u9032\u3093\u3067\u3044\u307e\u3059\u3002<\/p>\n<p>\u6700\u65b0\u7248\u3067\u306f\u3001Streaming Engine\u306e\u6210\u719f\u3001GPU\u30a2\u30af\u30bb\u30e9\u30ec\u30fc\u30b7\u30e7\u30f3\u3068\u306e\u9023\u643a\u5f37\u5316\u3001SQL\u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u306e\u62e1\u5145\u3001Cloud\u30fbLakehouse\u74b0\u5883\u3068\u306e\u89aa\u548c\u6027\u5411\u4e0a\u306a\u3069\u3001\u591a\u304f\u306e\u30a2\u30c3\u30d7\u30c7\u30fc\u30c8\u304c\u52a0\u3048\u3089\u308c\u3066\u3044\u307e\u3059\u3002<!-- notionvc: 524c23bf-db34-4d74-bcfe-08f8b734f023 --><\/p>\n<p><!-- notionvc: 1c2f0689-601c-4a95-b92d-6da8bd4724b9 --><\/p>\n<h2>Polars\u306e\u57fa\u672c\u6982\u5ff5<\/h2>\n<p><b>Polars\u3068\u306f\uff1f<\/b><\/p>\n<p>Polars\u306fRust\u3067\u958b\u767a\u3055\u308c\u305f\u9ad8\u901f\u30c7\u30fc\u30bf\u30d5\u30ec\u30fc\u30e0\u30e9\u30a4\u30d6\u30e9\u30ea\u3067\u3059\u3002<\/p>\n<p>Python\u3060\u3051\u3067\u306a\u304fRust\u30fbNode.js\u306a\u3069\u8907\u6570\u8a00\u8a9e\u304b\u3089\u5229\u7528\u3067\u304d\u3001Apache Arrow\u5f62\u5f0f\u3092\u30cd\u30a4\u30c6\u30a3\u30d6\u63a1\u7528\u3059\u308b\u3053\u3068\u3067CPU\u30ad\u30e3\u30c3\u30b7\u30e5\u52b9\u7387\u3084\u30e1\u30e2\u30ea\u52b9\u7387\u3092\u6700\u5927\u9650\u306b\u9ad8\u3081\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>\u4e3b\u306a\u7279\u5fb4\u306f\u4ee5\u4e0b\u306e\u901a\u308a\u3067\u3059\u3002<\/p>\n<ul>\n<li>Rust\u88fd\u306b\u3088\u308b\u9ad8\u3044\u5b9f\u884c\u6027\u80fd<\/li>\n<li>Apache Arrow\u30cd\u30a4\u30c6\u30a3\u30d6\u5bfe\u5fdc<\/li>\n<li>\u30de\u30eb\u30c1\u30b9\u30ec\u30c3\u30c9\u4e26\u5217\u51e6\u7406<\/li>\n<li>Lazy Evaluation\uff08\u9045\u5ef6\u5b9f\u884c\uff09<\/li>\n<li>Streaming Engine\u306b\u3088\u308b\u5927\u898f\u6a21\u30c7\u30fc\u30bf\u51e6\u7406<\/li>\n<li>Pandas\u306b\u8fd1\u3044API\u8a2d\u8a08<\/li>\n<\/ul>\n<p>\u8fd1\u5e74\u3067\u306fDuckDB\u3084Apache DataFusion\u306a\u3069Arrow\u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u3068\u306e\u9023\u643a\u3082\u9032\u307f\u3001\u300cPython\u9ad8\u901f\u30c7\u30fc\u30bf\u51e6\u7406\u30b9\u30bf\u30c3\u30af\u300d\u306e\u4e2d\u6838\u30e9\u30a4\u30d6\u30e9\u30ea\u3068\u3057\u3066\u5229\u7528\u3055\u308c\u308b\u30b1\u30fc\u30b9\u304c\u5897\u3048\u3066\u3044\u307e\u3059\u3002<\/p>\n<p><!-- notionvc: 69f9a99f-4b48-4d00-a195-c885eb2fb1ac --><\/p>\n<p><b>\u306a\u305cPolars\u304c\u9078\u3070\u308c\u308b\u306e\u304b\uff1f<\/b><\/p>\n<p>Polars\u304c\u8a55\u4fa1\u3055\u308c\u308b\u6700\u5927\u306e\u7406\u7531\u306f\u3001\u300c\u9ad8\u901f\u300d\u3060\u3051\u3067\u306f\u3042\u308a\u307e\u305b\u3093\u3002<\/p>\n<p><strong>\u5727\u5012\u7684\u306a\u51e6\u7406\u6027\u80fd<\/strong><\/p>\n<p>Polars\u3067\u306f\u30af\u30a8\u30ea\u5168\u4f53\u3092\u89e3\u6790\u3057\u3066\u6700\u9069\u5316\u3057\u3066\u304b\u3089\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n<p>\u4f8b\u3048\u3070<\/p>\n<ul>\n<li>\u4e0d\u8981\u306a\u5217\u306e\u8aad\u307f\u8fbc\u307f\u3092\u524a\u9664<\/li>\n<li>Filter\u3092\u5148\u306b\u9069\u7528<\/li>\n<li>Join\u9806\u5e8f\u306e\u6700\u9069\u5316<\/li>\n<li>Projection\u306e\u7d71\u5408<\/li>\n<li>Streaming\u53ef\u80fd\u306a\u51e6\u7406\u3078\u306e\u81ea\u52d5\u5909\u63db<\/li>\n<\/ul>\n<p>\u306a\u3069\u3092\u81ea\u52d5\u3067\u5b9f\u65bd\u3057\u307e\u3059\u3002<\/p>\n<p>\u305d\u306e\u305f\u3081\u3001\u4eba\u304cSQL\u3092\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3059\u308b\u3088\u3046\u306a\u6700\u9069\u5316\u3092\u3001\u30e9\u30a4\u30d6\u30e9\u30ea\u5074\u304c\u81ea\u52d5\u3067\u884c\u3063\u3066\u304f\u308c\u307e\u3059\u3002<\/p>\n<p><strong>\u30e1\u30e2\u30ea\u52b9\u7387\u304c\u975e\u5e38\u306b\u9ad8\u3044<\/strong><\/p>\n<p>Apache Arrow\u3092\u5229\u7528\u3059\u308b\u3053\u3068\u3067\u30b3\u30d4\u30fc\u56de\u6570\u3092\u6700\u5c0f\u9650\u306b\u6291\u3048\u3089\u308c\u307e\u3059\u3002<\/p>\n<p>\u6570GB\u301c\u6570\u5341GB\u898f\u6a21\u306e\u30c7\u30fc\u30bf\u3067\u3082\u3001Pandas\u3088\u308a\u5c11\u306a\u3044\u30e1\u30e2\u30ea\u3067\u51e6\u7406\u3067\u304d\u308b\u30b1\u30fc\u30b9\u304c\u591a\u304f\u3001\u30af\u30e9\u30a6\u30c9\u74b0\u5883\u3067\u306e\u30b3\u30b9\u30c8\u524a\u6e1b\u306b\u3082\u3064\u306a\u304c\u308a\u307e\u3059\u3002<\/p>\n<p><strong>AI\u30fbLLM\u6642\u4ee3\u3068\u306e\u76f8\u6027\u304c\u826f\u3044<\/strong><\/p>\n<p>2026\u5e74\u3067\u306fRAG\u3084\u7279\u5fb4\u91cf\u751f\u6210\u3001Embedding\u524d\u51e6\u7406\u306a\u3069\u3001\u5927\u91cf\u30c7\u30fc\u30bf\u3092\u6271\u3046AI\u30ef\u30fc\u30af\u30ed\u30fc\u30c9\u304c\u4e00\u822c\u5316\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>Polars\u306f<\/p>\n<ul>\n<li>\u30d9\u30af\u30c8\u30eb\u5316\u51e6\u7406<\/li>\n<li>Parquet\u4e2d\u5fc3\u306e\u30c7\u30fc\u30bf\u57fa\u76e4<\/li>\n<li>Lakehouse<\/li>\n<li>Feature Engineering<\/li>\n<\/ul>\n<p>\u3068\u306e\u76f8\u6027\u304c\u975e\u5e38\u306b\u826f\u304f\u3001AI\u57fa\u76e4\u3067\u3082\u63a1\u7528\u4f8b\u304c\u5897\u3048\u3066\u3044\u307e\u3059\u3002<\/p>\n<p><!-- notionvc: a30504d1-c6bc-4875-80ee-26f8ca62922a --><\/p>\n<p><!-- notionvc: e6884581-99dd-4f09-9986-2b0ec858e0e5 --><\/p>\n<p><b><!-- notionvc: a4ba5bb2-19ee-4f14-b5d4-63bcdd6842d3 --><\/b><\/p>\n<p><!-- notionvc: 3470bd4f-c791-435a-94b0-7ab1f97e052a --><\/p>\n<h2>\u6700\u65b0\u306e\u30d7\u30ed\u30bb\u30b9\u3068\u5f37\u5316\u3055\u308c\u305f\u624b\u6cd5<\/h2>\n<p><strong>\u3055\u3089\u306b\u9032\u5316\u3057\u305fLazyFrame<\/strong><\/p>\n<p>LazyFrame\u306f\u73fe\u5728\u3067\u3082Polars\u6700\u5927\u306e\u7279\u5fb4\u3067\u3059\u3002<\/p>\n<p>DataFrame API\u3068\u306f\u7570\u306a\u308a\u3001\u51e6\u7406\u5185\u5bb9\u3092\u4e00\u65e6\u5b9f\u884c\u8a08\u753b\u3068\u3057\u3066\u4fdd\u6301\u3057\u3001\u6700\u5f8c\u306b\u307e\u3068\u3081\u3066\u6700\u9069\u5316\u3057\u307e\u3059\u3002<\/p>\n<p>2026\u5e74\u73fe\u5728\u3067\u306f\u4ee5\u4e0b\u306e\u6700\u9069\u5316\u304c\u3055\u3089\u306b\u5f37\u5316\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<ul>\n<li>Predicate Pushdown<\/li>\n<li>Projection Pushdown<\/li>\n<li>Common Subplan Elimination<\/li>\n<li>Join Ordering Optimization<\/li>\n<li>Expression Simplification<\/li>\n<li>Slice Pushdown<\/li>\n<li>Streaming Optimization<\/li>\n<\/ul>\n<p>\u3053\u308c\u3089\u304c\u7d44\u307f\u5408\u308f\u3055\u308b\u3053\u3068\u3067\u3001\u8907\u96d1\u306aETL\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3067\u3082\u9ad8\u3044\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u7dad\u6301\u3067\u304d\u307e\u3059\u3002<\/p>\n<p><strong>Streaming Engine\u306e\u6210\u719f<\/strong><\/p>\n<p>2025\u5e74\u304b\u3089\u5927\u304d\u304f\u9032\u5316\u3057\u305f\u306e\u304cStreaming Engine\u3067\u3059\u3002<\/p>\n<p>\u73fe\u5728\u3067\u306f\u591a\u304f\u306eLazy\u30af\u30a8\u30ea\u304cStreaming\u5b9f\u884c\u53ef\u80fd\u306b\u306a\u308a\u3001<\/p>\n<ul>\n<li>CSV<\/li>\n<li>Parquet<\/li>\n<li>IPC<\/li>\n<li>NDJSON<\/li>\n<\/ul>\n<p>\u306a\u3069\u5927\u5bb9\u91cf\u30d5\u30a1\u30a4\u30eb\u3092\u30e1\u30e2\u30ea\u3078\u5168\u3066\u8aad\u307f\u8fbc\u307e\u305a\u51e6\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n<p>\u7279\u306b<\/p>\n<ul>\n<li>\u6570\u767eGB<\/li>\n<li>\u6570TB<\/li>\n<\/ul>\n<p>\u898f\u6a21\u306e\u30c7\u30fc\u30bf\u51e6\u7406\u3067\u3082\u5229\u7528\u3055\u308c\u308b\u30b1\u30fc\u30b9\u304c\u5897\u3048\u3066\u3044\u307e\u3059\u3002<\/p>\n<p><strong>SQL Interface\u306e\u5145\u5b9f<\/strong><\/p>\n<p>\u8fd1\u5e74\u3067\u306fSQL\u5229\u7528\u8005\u5411\u3051\u6a5f\u80fd\u3082\u62e1\u5f35\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>Python\u30b3\u30fc\u30c9\u3092\u66f8\u304b\u306a\u304f\u3066\u3082SQL\u30e9\u30a4\u30af\u306bPolars\u3092\u5229\u7528\u3067\u304d\u308b\u305f\u3081\u3001<\/p>\n<ul>\n<li>SQL\u30a8\u30f3\u30b8\u30cb\u30a2<\/li>\n<li>BI\u958b\u767a\u8005<\/li>\n<li>\u30c7\u30fc\u30bf\u30a2\u30ca\u30ea\u30b9\u30c8<\/li>\n<\/ul>\n<p>\u3067\u3082\u5c0e\u5165\u3057\u3084\u3059\u304f\u306a\u3063\u3066\u3044\u307e\u3059\u3002<\/p>\n<p><!-- notionvc: 5fd809cb-7c58-4d33-817f-01d70fc17c35 --><\/p>\n<p><!-- notionvc: 488ab01e-e57a-4046-977f-5180740f11ed --><\/p>\n<p><!-- notionvc: 0af176f5-6f10-4899-aa5f-8951bc9bd6e2 --><\/p>\n<p><!-- notionvc: fa159c1c-514e-4ea1-a27c-609db2b66cca --><\/p>\n<h2>Polars\u306e\u5fdc\u7528\u5206\u91ce\u3068\u5b9f\u52d9\u5229\u7528<\/h2>\n<p><b>\u30b9\u30b1\u30fc\u30e9\u30d6\u30eb\u306aETL\u51e6\u7406<\/b><\/p>\n<p>Polars\u306fETL\u57fa\u76e4\u3067\u975e\u5e38\u306b\u9ad8\u3044\u8a55\u4fa1\u3092\u53d7\u3051\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>\u4f8b\u3048\u3070<\/p>\n<ul>\n<li>CSV\u8aad\u307f\u8fbc\u307f<\/li>\n<li>\u30c7\u30fc\u30bf\u30af\u30ec\u30f3\u30b8\u30f3\u30b0<\/li>\n<li>Join<\/li>\n<li>\u96c6\u8a08<\/li>\n<li>Parquet\u4fdd\u5b58<\/li>\n<\/ul>\n<p>\u307e\u3067\u3092LazyFrame\u3067\u4e00\u62ec\u6700\u9069\u5316\u3067\u304d\u307e\u3059\u3002<\/p>\n<p>Airflow\u3084Dagster\u3001Prefect\u306a\u3069\u306e\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u7ba1\u7406\u30c4\u30fc\u30eb\u3068\u7d44\u307f\u5408\u308f\u305b\u308b\u30b1\u30fc\u30b9\u3082\u5897\u3048\u3066\u3044\u307e\u3059\u3002<\/p>\n<p><strong>Lakehouse\u3068\u306e\u9023\u643a<\/strong><\/p>\n<p>\u73fe\u5728\u3067\u306f<\/p>\n<ul>\n<li>Apache Iceberg<\/li>\n<li>Delta Lake<\/li>\n<li>Apache Arrow<\/li>\n<li>Parquet<\/li>\n<\/ul>\n<p>\u3068\u306e\u7d44\u307f\u5408\u308f\u305b\u304c\u4e00\u822c\u7684\u306b\u306a\u3063\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u4e0a\u306e\u5de8\u5927\u30c7\u30fc\u30bf\u3092\u9ad8\u901f\u306b\u51e6\u7406\u3067\u304d\u308b\u305f\u3081\u3001\u30af\u30e9\u30a6\u30c9\u30c7\u30fc\u30bf\u57fa\u76e4\u3068\u306e\u76f8\u6027\u3082\u975e\u5e38\u306b\u826f\u597d\u3067\u3059\u3002<\/p>\n<p><strong>\u6a5f\u68b0\u5b66\u7fd2\u524d\u51e6\u7406<\/strong><\/p>\n<p>Polars\u306fFeature Engineering\u3067\u3082\u6d3b\u8e8d\u3057\u307e\u3059\u3002<\/p>\n<p>\u4f8b\u3048\u3070<\/p>\n<ul>\n<li>\u6b20\u640d\u5024\u51e6\u7406<\/li>\n<li>\u30ab\u30c6\u30b4\u30ea\u30a8\u30f3\u30b3\u30fc\u30c9<\/li>\n<li>Window\u95a2\u6570<\/li>\n<li>\u6642\u7cfb\u5217\u7279\u5fb4\u91cf\u751f\u6210<\/li>\n<li>Rolling\u96c6\u8a08<\/li>\n<\/ul>\n<p>\u306a\u3069\u3092\u9ad8\u901f\u306b\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n<p>\u305d\u306e\u5f8c\u3001XGBoost\u3001LightGBM\u3001CatBoost\u3001scikit-learn\u3001PyTorch\u306a\u3069\u3078\u30b9\u30e0\u30fc\u30ba\u306b\u30c7\u30fc\u30bf\u3092\u53d7\u3051\u6e21\u305b\u307e\u3059\u3002<\/p>\n<p><strong>BI\u30fb\u30c0\u30c3\u30b7\u30e5\u30dc\u30fc\u30c9\u306e\u9ad8\u901f\u5316<\/strong><\/p>\n<p>DuckDB\u3084Arrow\u3092\u7d44\u307f\u5408\u308f\u305b\u308b\u3053\u3068\u3067\u3001<\/p>\n<ul>\n<li>KPI\u96c6\u8a08<\/li>\n<li>\u58f2\u4e0a\u5206\u6790<\/li>\n<li>\u9867\u5ba2\u5206\u6790<\/li>\n<li>\u30ed\u30b0\u5206\u6790<\/li>\n<\/ul>\n<p>\u306a\u3069\u3082\u9ad8\u901f\u306b\u5b9f\u65bd\u3067\u304d\u307e\u3059\u3002<\/p>\n<p>\u30c7\u30fc\u30bf\u30de\u30fc\u30c8\u751f\u6210\u51e6\u7406\u3068\u3057\u3066\u63a1\u7528\u3055\u308c\u308b\u30b1\u30fc\u30b9\u3082\u5897\u3048\u3066\u3044\u307e\u3059\u3002<\/p>\n<p><!-- notionvc: c657a4f9-b5c6-4796-aeeb-8243306d30fa --><\/p>\n<p><!-- notionvc: 40761b70-c604-490a-b11f-82c32528d7fe --><\/p>\n<p><!-- notionvc: 71119f5e-a480-4c8c-8fed-e0fc580e43ec --><\/p>\n<p><!-- notionvc: 2332660f-9f18-4e75-ab62-6bf65a50da6a --><\/p>\n<h2>\u30e1\u30ea\u30c3\u30c8\u30fb\u30c7\u30e1\u30ea\u30c3\u30c8<\/h2>\n<p><b>\u30e1\u30ea\u30c3\u30c8<\/b><\/p>\n<ul>\n<li><strong>\u975e\u5e38\u306b\u9ad8\u901f\u306a\u30c7\u30fc\u30bf\u51e6\u7406<\/strong>\uff1aRust\u5b9f\u88c5\u3068\u30de\u30eb\u30c1\u30b9\u30ec\u30c3\u30c9\u306b\u3088\u308a\u3001\u5927\u898f\u6a21\u30c7\u30fc\u30bf\u3067\u3082\u512a\u308c\u305f\u6027\u80fd\u3092\u767a\u63ee<\/li>\n<li><strong>LazyFrame\u306b\u3088\u308b\u81ea\u52d5\u6700\u9069\u5316<\/strong>\uff1a\u8907\u96d1\u306aETL\u3067\u3082\u52b9\u7387\u3088\u304f\u5b9f\u884c<\/li>\n<li><strong>Streaming Engine<\/strong>\uff1a\u30e1\u30e2\u30ea\u4f7f\u7528\u91cf\u3092\u6291\u3048\u306a\u304c\u3089\u5de8\u5927\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u53ef\u80fd<\/li>\n<li><strong>Apache Arrow\u30cd\u30a4\u30c6\u30a3\u30d6\u5bfe\u5fdc<\/strong>\uff1aDuckDB\u3084Lakehouse\u3068\u306e\u9023\u643a\u304c\u5bb9\u6613<\/li>\n<li><strong>AI\u30fb\u6a5f\u68b0\u5b66\u7fd2\u3068\u306e\u89aa\u548c\u6027<\/strong>\uff1a\u7279\u5fb4\u91cf\u751f\u6210\u3084RAG\u5411\u3051\u30c7\u30fc\u30bf\u524d\u51e6\u7406\u306b\u3082\u9069\u3057\u3066\u3044\u308b<\/li>\n<li><strong>Parquet\u4e2d\u5fc3\u306e\u30e2\u30c0\u30f3\u306a\u30c7\u30fc\u30bf\u57fa\u76e4\u306b\u6700\u9069<\/strong>\uff1a\u30af\u30e9\u30a6\u30c9\u30cd\u30a4\u30c6\u30a3\u30d6\u306a\u5206\u6790\u74b0\u5883\u3068\u306e\u76f8\u6027\u304c\u9ad8\u3044<\/li>\n<\/ul>\n<p><!-- notionvc: bfd2496b-37cf-4d41-90ff-ecb097cab957 --><\/p>\n<p><b>\u30c7\u30e1\u30ea\u30c3\u30c8<\/b><\/p>\n<ul>\n<li><strong>Pandas\u307b\u3069\u60c5\u5831\u91cf\u304c\u591a\u304f\u306a\u3044<\/strong>\uff1a\u65e5\u672c\u8a9e\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3084\u4e8b\u4f8b\u306f\u5897\u3048\u3066\u3044\u308b\u3082\u306e\u306e\u3001Pandas\u306b\u306f\u53ca\u3070\u306a\u3044<\/li>\n<li><strong>\u4e00\u90e8\u30e9\u30a4\u30d6\u30e9\u30ea\u306fPandas\u524d\u63d0<\/strong>\uff1a\u53ef\u8996\u5316\u3084\u7d71\u8a08\u30e9\u30a4\u30d6\u30e9\u30ea\u3067\u306fPandas\u3078\u306e\u5909\u63db\u304c\u5fc5\u8981\u306a\u5834\u5408\u304c\u3042\u308b<\/li>\n<li><strong>\u9ad8\u5ea6\u306a\u6700\u9069\u5316\u3092\u7406\u89e3\u3059\u308b\u3068\u52b9\u679c\u304c\u5927\u304d\u3044<\/strong>\uff1aLazyFrame\u3084\u5b9f\u884c\u8a08\u753b\u3092\u7406\u89e3\u3059\u308b\u3068\u6027\u80fd\u3092\u6700\u5927\u9650\u5f15\u304d\u51fa\u305b\u308b<\/li>\n<li><strong>\u51e6\u7406\u5185\u5bb9\u306b\u3088\u3063\u3066\u306fStreaming\u975e\u5bfe\u5fdc\u3082\u3042\u308b<\/strong>\uff1a\u8907\u96d1\u306a\u6f14\u7b97\u3067\u306f\u901a\u5e38\u5b9f\u884c\u306b\u30d5\u30a9\u30fc\u30eb\u30d0\u30c3\u30af\u3059\u308b\u30b1\u30fc\u30b9\u3082\u5b58\u5728\u3059\u308b<\/li>\n<\/ul>\n<p><!-- notionvc: 1511700a-3616-455d-b064-e40f5bfaada3 --><\/p>\n<p><!-- notionvc: fb78787f-e9ca-4dcb-a812-dd96b8c31e38 --><\/p>\n<h2>Polars\u306e\u5c06\u6765\u5c55\u671b<\/h2>\n<p><strong>Arrow\u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u306e\u4e2d\u6838\u3078<\/strong><\/p>\n<p>\u8fd1\u5e74\u306fApache Arrow\u3092\u4e2d\u5fc3\u3068\u3057\u305f\u30c7\u30fc\u30bf\u51e6\u7406\u57fa\u76e4\u304c\u6025\u901f\u306b\u666e\u53ca\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>Polars\u306f<\/p>\n<ul>\n<li>DuckDB<\/li>\n<li>DataFusion<\/li>\n<li>Apache Iceberg<\/li>\n<li>Delta Lake<\/li>\n<li>Lance<\/li>\n<li>Apache Arrow Flight<\/li>\n<\/ul>\n<p>\u306a\u3069\u3068\u306e\u9023\u643a\u3092\u5f37\u3081\u3066\u304a\u308a\u3001\u4eca\u5f8c\u3055\u3089\u306b\u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u306e\u4e2d\u6838\u3092\u62c5\u3046\u5b58\u5728\u306b\u306a\u308b\u3068\u671f\u5f85\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<p><!-- notionvc: 9c64570d-370e-4fed-945a-d25d1860aa7b --><\/p>\n<p><strong>GPU\u30fb\u30af\u30e9\u30a6\u30c9\u5bfe\u5fdc\u306e\u9032\u5316<\/strong><\/p>\n<p>GPU\u30a2\u30af\u30bb\u30e9\u30ec\u30fc\u30b7\u30e7\u30f3\u3068\u306e\u7d71\u5408\u3084\u3001\u5206\u6563\u5b9f\u884c\u57fa\u76e4\u3068\u306e\u9023\u643a\u3082\u6d3b\u767a\u306b\u9032\u3081\u3089\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>\u7279\u306bAI\u30ef\u30fc\u30af\u30ed\u30fc\u30c9\u3067\u306fCPU\u3060\u3051\u3067\u306a\u304fGPU\u3092\u6d3b\u7528\u3057\u305f\u9ad8\u901f\u524d\u51e6\u7406\u3078\u306e\u671f\u5f85\u304c\u9ad8\u307e\u3063\u3066\u304a\u308a\u3001\u4eca\u5f8c\u306e\u9032\u5316\u304c\u6ce8\u76ee\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<p><strong>AI\u6642\u4ee3\u306e\u6a19\u6e96\u30c7\u30fc\u30bf\u51e6\u7406\u30e9\u30a4\u30d6\u30e9\u30ea\u3078<\/strong><\/p>\n<p>LLM\u3084\u751f\u6210AI\u306e\u666e\u53ca\u306b\u3088\u308a\u3001\u300c\u5927\u91cf\u30c7\u30fc\u30bf\u3092\u52b9\u7387\u7684\u306b\u6574\u5f62\u30fb\u5909\u63db\u3059\u308b\u80fd\u529b\u300d\u306f\u307e\u3059\u307e\u3059\u91cd\u8981\u306b\u306a\u3063\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>Polars\u306f\u5358\u306a\u308b\u9ad8\u901fDataFrame\u30e9\u30a4\u30d6\u30e9\u30ea\u3067\u306f\u306a\u304f\u3001AI\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u5168\u4f53\u3092\u652f\u3048\u308b\u30c7\u30fc\u30bf\u51e6\u7406\u57fa\u76e4\u3068\u3057\u3066\u306e\u5f79\u5272\u3092\u62c5\u3044\u3064\u3064\u3042\u308a\u307e\u3059\u3002<\/p>\n<p>\u4eca\u5f8c\u306f\u3001\u30af\u30e9\u30a6\u30c9\u30cd\u30a4\u30c6\u30a3\u30d6\u74b0\u5883\u3084\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u5206\u6790\u57fa\u76e4\u3068\u306e\u7d71\u5408\u304c\u9032\u307f\u3001\u30c7\u30fc\u30bf\u30a8\u30f3\u30b8\u30cb\u30a2\u30ea\u30f3\u30b0\u306e\u6a19\u6e96\u30c4\u30fc\u30eb\u306e\u4e00\u3064\u3068\u3057\u3066\u3055\u3089\u306b\u5b58\u5728\u611f\u3092\u9ad8\u3081\u3066\u3044\u304f\u3067\u3057\u3087\u3046\u3002<!-- notionvc: ed08fe3d-a7d3-467e-b731-c466b31eba61 --><\/p>\n<p><!-- notionvc: 5dc9f376-c912-44ab-89aa-8afcd4355f5a --><\/p>\n<h2>\u307e\u3068\u3081<\/h2>\n<p>Polars\u306f\u3001\u3082\u306f\u3084\u300cPandas\u306e\u9ad8\u901f\u7248\u300d\u3068\u3044\u3046\u67a0\u3092\u8d85\u3048\u3001AI\u6642\u4ee3\u306e\u30c7\u30fc\u30bf\u51e6\u7406\u57fa\u76e4\u3092\u652f\u3048\u308b\u91cd\u8981\u306a\u30e9\u30a4\u30d6\u30e9\u30ea\u3078\u3068\u9032\u5316\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>2026\u5e74\u73fe\u5728\u3067\u306f\u3001LazyFrame\u306b\u3088\u308b\u9ad8\u5ea6\u306a\u30af\u30a8\u30ea\u6700\u9069\u5316\u3001\u6210\u719f\u3057\u305fStreaming Engine\u3001Apache Arrow\u3068\u306e\u30cd\u30a4\u30c6\u30a3\u30d6\u9023\u643a\u3001Lakehouse\u74b0\u5883\u3078\u306e\u9069\u5fdc\u306a\u3069\u3001\u5b9f\u52d9\u3067\u6c42\u3081\u3089\u308c\u308b\u6a5f\u80fd\u304c\u5927\u304d\u304f\u5145\u5b9f\u3057\u307e\u3057\u305f\u3002<\/p>\n<p>\u3053\u308c\u304b\u3089\u65b0\u305f\u306b\u30c7\u30fc\u30bf\u5206\u6790\u74b0\u5883\u3092\u69cb\u7bc9\u3059\u308b\u5834\u5408\u306f\u3082\u3061\u308d\u3093\u3001\u65e2\u5b58\u306ePandas\u30d9\u30fc\u30b9\u306e\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u898b\u76f4\u3059\u969b\u306b\u3082\u3001Polars\u306f\u6709\u529b\u306a\u9078\u629e\u80a2\u3068\u306a\u308b\u3067\u3057\u3087\u3046\u3002\u30c7\u30fc\u30bf\u91cf\u306e\u5897\u52a0\u3084AI\u6d3b\u7528\u304c\u9032\u3080\u3053\u308c\u304b\u3089\u306e\u6642\u4ee3\u306b\u304a\u3044\u3066\u3001\u305d\u306e\u4fa1\u5024\u306f\u307e\u3059\u307e\u3059\u9ad8\u307e\u3063\u3066\u3044\u304f\u3068\u8003\u3048\u3089\u308c\u307e\u3059\u3002<\/p>\n<p><!-- notionvc: bc455dc9-b2d4-4fae-b816-19f9b7d7dbeb --><\/p>","protected":false},"excerpt":{"rendered":"<p>Polars\u3068\u306f\u4f55\u304b\u30922026\u5e74\u6700\u65b0\u7248\u306e\u60c5\u5831\u3067\u5fb9\u5e95\u89e3\u8aac\u3002Rust\u30d9\u30fc\u30b9\u306e\u9ad8\u901f\u30c7\u30fc\u30bf\u30d5\u30ec\u30fc\u30e0\u30e9\u30a4\u30d6\u30e9\u30ea\u3068\u3057\u3066\u6ce8\u76ee\u3055\u308c\u308b\u7406\u7531\u304b\u3089\u3001LazyFrame\u30fb\u30af\u30a8\u30ea\u6700\u9069\u5316\u30fbStreaming Engine\u30fbGPU\u5bfe\u5fdc\u306e\u6700\u65b0\u52d5\u5411\u3001AI [&hellip;]<\/p>\n","protected":false},"author":22,"featured_media":6014,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","swell_btn_cv_data":"","footnotes":"","_wp_rev_ctl_limit":""},"categories":[1249],"tags":[1008,813,1005,1007,1006],"class_list":["post-6010","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-knowledge","tag-lazyframe","tag-polars","tag-python","tag-rust","tag-1006"],"_links":{"self":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/6010","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/comments?post=6010"}],"version-history":[{"count":1,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/6010\/revisions"}],"predecessor-version":[{"id":9243,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/6010\/revisions\/9243"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media\/6014"}],"wp:attachment":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media?parent=6010"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/categories?post=6010"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/tags?post=6010"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}