{"id":5862,"date":"2024-11-26T14:52:06","date_gmt":"2024-11-26T05:52:06","guid":{"rendered":"https:\/\/blog.since2020.jp\/?p=5862"},"modified":"2024-11-26T14:52:20","modified_gmt":"2024-11-26T05:52:20","slug":"databricks-unity-catalog","status":"publish","type":"post","link":"https:\/\/since2020.jp\/media\/databricks-unity-catalog\/","title":{"rendered":"Databricks Unity Catalog: \u30c7\u30fc\u30bf\u306e\u30ea\u30cd\u30fc\u30b8\u8ffd\u8de1\u306e\u6d3b\u7528\u6cd5"},"content":{"rendered":"\n

\u30c7\u30fc\u30bf\u7ba1\u7406\u306b\u304a\u3051\u308b\u30c7\u30fc\u30bf\u4f9d\u5b58\u95a2\u4fc2\u306e\u53ef\u8996\u5316\u306f\u3001\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u30c7\u30fc\u30bf\u57fa\u76e4\u3092\u69cb\u7bc9\u3059\u308b\u4e0a\u3067\u4e0d\u53ef\u6b20\u3067\u3059\u3002Databricks Unity Catalog\u306f\u3001\u30c7\u30fc\u30bf\u306e\u4f9d\u5b58\u95a2\u4fc2\uff08\u30ea\u30cd\u30fc\u30b8\uff09\u3092\u8ffd\u8de1\u3059\u308b\u5f37\u529b\u306a\u6a5f\u80fd\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002\r\n\u672c\u8a18\u4e8b\u3067\u306f\u3001Unity Catalog\u3092\u7528\u3044\u305f\u30ea\u30cd\u30fc\u30b8\u8ffd\u8de1\u306e\u6d3b\u7528\u65b9\u6cd5\u3092\u3001\u30c7\u30fc\u30bf\u5909\u63db\u30c4\u30fc\u30eb dbt\u3068\u7d44\u307f\u5408\u308f\u305b\u3066\u5177\u4f53\u7684\u306b\u89e3\u8aac\u3057\u307e\u3059\u3002jaffle_shop\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u7528\u3044\u305f\u30b5\u30f3\u30d7\u30eb\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u901a\u3058\u3066\u3001\u5b9f\u969b\u306e\u64cd\u4f5c\u65b9\u6cd5\u3092\u30c7\u30e2\u3057\u307e\u3059\u3002<\/p>\n\n\n

\u306f\u3058\u3081\u306b<\/h2>\n

\u30c7\u30fc\u30bf\u7ba1\u7406\u306b\u304a\u3051\u308b\u30c7\u30fc\u30bf\u4f9d\u5b58\u95a2\u4fc2\u306e\u53ef\u8996\u5316\u306f\u3001\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u30c7\u30fc\u30bf\u57fa\u76e4\u3092\u69cb\u7bc9\u3059\u308b\u4e0a\u3067\u4e0d\u53ef\u6b20\u3067\u3059\u3002Databricks Unity Catalog\u306f\u3001\u30c7\u30fc\u30bf\u306e\u4f9d\u5b58\u95a2\u4fc2\uff08\u30ea\u30cd\u30fc\u30b8\uff09\u3092\u8ffd\u8de1\u3059\u308b\u5f37\u529b\u306a\u6a5f\u80fd\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/span>
\r\n\u672c\u8a18\u4e8b\u3067\u306f\u3001Unity Catalog\u3092\u7528\u3044\u305f\u30ea\u30cd\u30fc\u30b8\u8ffd\u8de1\u306e\u6d3b\u7528\u65b9\u6cd5\u3092\u3001\u30c7\u30fc\u30bf\u5909\u63db\u30c4\u30fc\u30eb dbt\u3068\u7d44\u307f\u5408\u308f\u305b\u3066\u5177\u4f53\u7684\u306b\u89e3\u8aac\u3057\u307e\u3059\u3002jaffle_shop\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u7528\u3044\u305f\u30b5\u30f3\u30d7\u30eb\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u901a\u3058\u3066\u3001\u5b9f\u969b\u306e\u64cd\u4f5c\u65b9\u6cd5\u3092\u30c7\u30e2\u3057\u307e\u3059\u3002<\/span><\/p>\n\n

\u4f7f\u7528\u3059\u308b\u30c7\u30fc\u30bf\u3068\u74b0\u5883<\/h2>\n

\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8<\/strong>: jaffle_shop<\/code>\uff08dbt\u516c\u5f0f\u30b5\u30f3\u30d7\u30eb\u30c7\u30fc\u30bf\uff09<\/span><\/p>\r\n

\u30c4\u30fc\u30eb<\/strong>: Databricks\u3001Unity Catalog\u3001dbt<\/span><\/p>\r\n

\u76ee\u7684<\/strong>: Databricks Unity Catalog\u3092\u5229\u7528\u3057\u3066\u4ee5\u4e0b\u3092\u5b9f\u73fe\u3057\u307e\u3059\u3002<\/span><\/p>\r\n

\u30fbdbt\u306b\u3088\u308b\u30c7\u30fc\u30bf\u5909\u63db\u306e\u30ea\u30cd\u30fc\u30b8\uff08\u4f9d\u5b58\u95a2\u4fc2\uff09\u306e\u53ef\u8996\u5316<\/span><\/p>\r\n

\u30fb\u30c7\u30fc\u30bf\u30e2\u30c7\u30eb\u3068\u5b9f\u884c\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u306e\u7d71\u5408\u7684\u306a\u78ba\u8a8d<\/span><\/p>\r\n

<\/p>\n\n

dbt\u3068Unity Catalog\u3067\u306e\u30ea\u30cd\u30fc\u30b8\u8ffd\u8de1<\/h2>\n

Databricks Unity Catalog\u306f\u3001dbt\u3067\u5b9f\u884c\u3055\u308c\u305f\u30c7\u30fc\u30bf\u5909\u63db\u30d7\u30ed\u30bb\u30b9\u306e\u30ea\u30cd\u30fc\u30b8\u3092\u81ea\u52d5\u7684\u306b\u8a18\u9332\u3057\u307e\u3059\u3002\u4ee5\u4e0b\u306f\u3001jaffle_shop<\/code>\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306eELT\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3067\u751f\u6210\u3055\u308c\u305f\u30ea\u30cd\u30fc\u30b8\u56f3\u3067\u3059\u3002<\/span><\/p>\r\n\u30ea\u30cd\u30fc\u30b8\u5168\u4f53\u306e\u53ef\u8996\u5316<\/span><\/b>\r\n

\"\"<\/p>\r\n

\u3053\u306e\u30ea\u30cd\u30fc\u30b8\u56f3\u306f\u3001\u30c7\u30fc\u30bf\u5909\u63db\u306e\u5168\u4f53\u50cf\u3092\u8996\u899a\u7684\u306b\u628a\u63e1\u3067\u304d\u308b\u5f37\u529b\u306a\u30c4\u30fc\u30eb\u3067\u3059\u3002\u305f\u3068\u3048\u3070\u3001stg_customers<\/span>\u30c6\u30fc\u30d6\u30eb\u304c dim_customers<\/span> \u30c6\u30fc\u30d6\u30eb\u306b\u5909\u63db\u3055\u308c\u308b\u30d7\u30ed\u30bb\u30b9\u3092\u7c21\u5358\u306b\u8ffd\u8de1\u3067\u304d\u307e\u3059\u3002<\/span><\/p>\r\n

<\/p>\n\n

\u30bd\u30fc\u30b9\u3068\u30bf\u30fc\u30b2\u30c3\u30c8\u306e\u95a2\u9023\u8a73\u7d30<\/h2>\n

\u3055\u3089\u306b\u3001\u30ea\u30cd\u30fc\u30b8\u56f3\u3092\u30af\u30ea\u30c3\u30af\u3059\u308b\u3068\u3001\u4ee5\u4e0b\u306e\u3088\u3046\u306bdbt\u3067\u4f5c\u6210\u3057\u305f\u30bd\u30fc\u30b9\u30c6\u30fc\u30d6\u30eb\u3068\u30bf\u30fc\u30b2\u30c3\u30c8\u30c6\u30fc\u30d6\u30eb\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u78ba\u8a8d\u3067\u304d\u307e\u3059\u3002<\/span><\/p>\r\n

\"\"<\/p>\r\n

\u4f7f\u7528\u3057\u305f\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u306b\u95a2\u3057\u3066\u3082\u78ba\u8a8d\u53ef\u80fd\u3067\u3059\u3002<\/span><\/p>\r\n

\"\"<\/p>\r\n

<\/p>\n\n

dbt\u30b8\u30e7\u30d6\u306e\u5b9f\u884c\u3068\u30ea\u30cd\u30fc\u30b8\u306e\u81ea\u52d5\u8ffd\u8de1<\/h2>\n

1.dbt\u306e\u8a2d\u5b9a<\/strong>:<\/p>\r\n

Unity Catalog\u3068\u9023\u643a\u3059\u308b\u305f\u3081\u306b\u3001dbt\u30d7\u30ed\u30d5\u30a1\u30a4\u30eb\u3092\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u8a2d\u5b9a\u3057\u307e\u3059\u3002<\/p>\r\n

\r\n
dbt_project:\r\noutputs:\r\ndev:\r\ntype: databricks\r\ncatalog: unity_catalog\r\nschema: jaffle_shop\r\ntarget: dev\r\n<\/code><\/pre>\r\n<\/div>\r\n
 <\/p>\r\n
2.\u30c7\u30fc\u30bf\u5909\u63db\u30b8\u30e7\u30d6\u306e\u5b9f\u884c<\/strong>:<\/span><\/p>\r\n
dbt run<\/code> \u3092\u5b9f\u884c\u3057\u3066\u3001stg_customers<\/code> \u3084 dim_customers<\/code> \u306a\u3069\u306e\u30c6\u30fc\u30d6\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/span><\/p>\r\n
 <\/p>\r\n
\"\"<\/p>\r\n
3.\u30ea\u30cd\u30fc\u30b8\u306e\u78ba\u8a8d<\/strong>:<\/span><\/p>\r\n
Databricks\u306eUnity Catalog\u4e0a\u3067\u3001\u4f5c\u6210\u3057\u305f\u30c6\u30fc\u30d6\u30eb\u3068\u305d\u306e\u4f9d\u5b58\u95a2\u4fc2\u304c\u81ea\u52d5\u7684\u306b\u8ffd\u8de1\u3055\u308c\u3001\u8996\u899a\u7684\u306b\u8868\u793a\u3055\u308c\u307e\u3059\u3002<\/span><\/p>\r\n
<\/p>\r\n
<\/p>\r\n
<\/p>\n\n
\u307e\u3068\u3081<\/h2>\n
Databricks Unity Catalog\u306f\u3001\u30c7\u30fc\u30bf\u306e\u30ea\u30cd\u30fc\u30b8\u8ffd\u8de1\u3092\u4e00\u5143\u7ba1\u7406\u3067\u304d\u308b\u5f37\u529b\u306a\u30c4\u30fc\u30eb\u3067\u3059\u3002\u7279\u306bdbt\u3068\u9023\u643a\u3059\u308b\u3053\u3068\u3067\u3001\u30c7\u30fc\u30bf\u5909\u63db\u306e\u30d7\u30ed\u30bb\u30b9\u5168\u4f53\u3092\u53ef\u8996\u5316\u3057\u3001\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u30c7\u30fc\u30bf\u57fa\u76e4\u3092\u69cb\u7bc9\u3067\u304d\u307e\u3059\u3002<\/span><\/p>\r\n
\u672c\u8a18\u4e8b\u306e\u624b\u9806\u3092\u53c2\u8003\u306b\u3001\u305c\u3072\u81ea\u793e\u306e\u30c7\u30fc\u30bf\u74b0\u5883\u3067Unity Catalog\u306e\u6a5f\u80fd\u3092\u6d3b\u7528\u3057\u3066\u307f\u3066\u304f\u3060\u3055\u3044\u3002<\/span><\/p>\r\n
<\/p>","protected":false},"excerpt":{"rendered":"
\u30c7\u30fc\u30bf\u7ba1\u7406\u306b\u304a\u3051\u308b\u30c7\u30fc\u30bf\u4f9d\u5b58\u95a2\u4fc2\u306e\u53ef\u8996\u5316\u306f\u3001\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u30c7\u30fc\u30bf\u57fa\u76e4\u3092\u69cb\u7bc9\u3059\u308b\u4e0a\u3067\u4e0d\u53ef\u6b20\u3067\u3059\u3002Databricks Unity Catalog\u306f\u3001\u30c7\u30fc\u30bf\u306e\u4f9d\u5b58\u95a2\u4fc2\uff08\u30ea\u30cd\u30fc\u30b8\uff09\u3092\u8ffd\u8de1\u3059\u308b\u5f37\u529b\u306a\u6a5f\u80fd\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002 \u672c\u8a18\u4e8b\u3067\u306f\u3001 […]<\/p>\n","protected":false},"author":87,"featured_media":5778,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","swell_btn_cv_data":"","footnotes":"","_wp_rev_ctl_limit":""},"categories":[1249],"tags":[774,491,794],"class_list":["post-5862","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-knowledge","tag-databricks","tag-dbt","tag-unity-catalog"],"_links":{"self":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/5862","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/users\/87"}],"replies":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/comments?post=5862"}],"version-history":[{"count":0,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/5862\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media\/5778"}],"wp:attachment":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media?parent=5862"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/categories?post=5862"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/tags?post=5862"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}