{"id":5021,"date":"2024-05-23T14:01:37","date_gmt":"2024-05-23T05:01:37","guid":{"rendered":"https:\/\/blog.since2020.jp\/?p=5021"},"modified":"2024-05-23T14:02:29","modified_gmt":"2024-05-23T05:02:29","slug":"google-cloud-vm-airbyte","status":"publish","type":"post","link":"https:\/\/since2020.jp\/media\/google-cloud-vm-airbyte\/","title":{"rendered":"Google Cloud VM\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u4e0a\u306bAirbyte\u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b"},"content":{"rendered":"\n

\u3053\u306e\u6280\u8853\u30d6\u30ed\u30b0\u3067\u306f\u3001Google Cloud Platform (GCP)\u306eCompute Engine\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u306bAirbyte\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u305f\u3081\u306e\u8a73\u7d30\u306a\u624b\u9806\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002Airbyte\u306f\u30c7\u30fc\u30bf\u306e\u7d71\u5408\u3068\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u306e\u8a2d\u5b9a\u3092\u5bb9\u6613\u306b\u3059\u308b\u5f37\u529b\u306a\u30c4\u30fc\u30eb\u3067\u3059\u3002\u3053\u306e\u30ac\u30a4\u30c9\u3067\u306f\u3001\u516c\u5f0f\u306e\u624b\u9806\u306b\u5f93\u3044\u3001\u30ea\u30e2\u30fc\u30c8\u74b0\u5883\u3067\u306e\u30bb\u30c3\u30c8\u30a2\u30c3\u30d7\u304b\u3089\u30c7\u30d7\u30ed\u30a4\u307e\u3067\u3092\u8aac\u660e\u3057\u307e\u3059\u3002<\/p>\n\n\n

\u306f\u3058\u3081\u306b<\/h2>\n

\u3053\u306e\u6280\u8853\u30d6\u30ed\u30b0\u3067\u306f\u3001Google Cloud Platform (GCP)\u306eCompute Engine\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u306bAirbyte\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u305f\u3081\u306e\u8a73\u7d30\u306a\u624b\u9806\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002Airbyte\u306f\u30c7\u30fc\u30bf\u306e\u7d71\u5408\u3068\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u306e\u8a2d\u5b9a\u3092\u5bb9\u6613\u306b\u3059\u308b\u5f37\u529b\u306a\u30c4\u30fc\u30eb\u3067\u3059\u3002\u3053\u306e\u30ac\u30a4\u30c9\u3067\u306f\u3001\u516c\u5f0f\u306e\u624b\u9806\u306b\u5f93\u3044\u3001\u30ea\u30e2\u30fc\u30c8\u74b0\u5883\u3067\u306e\u30bb\u30c3\u30c8\u30a2\u30c3\u30d7\u304b\u3089\u30c7\u30d7\u30ed\u30a4\u307e\u3067\u3092\u8aac\u660e\u3057\u307e\u3059\u3002<\/span><\/p>\n\n

\u524d\u63d0\u6761\u4ef6<\/h2>\n

\u30fbGoogle Cloud Platform\u30a2\u30ab\u30a6\u30f3\u30c8<\/span><\/strong><\/em><\/p>\r\n

\u30fbGoogle Cloud SDK\u304c\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3055\u308c\u3066\u3044\u308b\u30ed\u30fc\u30ab\u30eb\u30de\u30b7\u30f3<\/span><\/strong><\/em><\/p>\r\n

\u30fbGCP\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u304c\u4f5c\u6210\u3055\u308c\u3066\u3044\u308b<\/span><\/strong><\/em><\/p>\r\n

\u30fbSSH\u63a5\u7d9a\u304c\u5b8c\u4e86\u3057\u3066\u3044\u308b<\/a><\/span><\/strong><\/em><\/p>\r\n

<\/p>\n\n

\u30b9\u30c6\u30c3\u30d7 1: Docker\u3068Docker<\/h2>\nCompose\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/strong><\/span><\/b>\r\n

SSH\u63a5\u7d9a\u3057\u3066\u3044\u308bVM\u30bf\u30fc\u30df\u30ca\u30eb\u3067\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/span><\/p>\r\n1.1 Docker\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/strong><\/span><\/b>\r\n

\r\n
sudo apt-get update\r\nsudo apt-get install -y apt-transport-https ca-certificates curl gnupg2 software-properties-common\r\ncurl -fsSL https:\/\/download.docker.com\/linux\/debian\/gpg | sudo apt-key add --\r\nsudo add-apt-repository \"deb [arch=amd64] https:\/\/download.docker.com\/linux\/debian buster stable\"\r\nsudo apt-get update\r\nsudo apt-get install -y docker-ce docker-ce-cli containerd.io\r\nsudo usermod -a -G docker $USE<\/code><\/span><\/pre>\r\n<\/div>\r\n1.2 Docker Compose\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/strong><\/span><\/b>\r\n
\r\n
sudo apt-get -y install docker-compose-plugin\r\ndocker compose version<\/code><\/span><\/pre>\r\n<\/div>\r\n1.3 SSH\u63a5\u7d9a\u306e\u518d\u8d77\u52d5<\/strong><\/span><\/b>\r\n
Docker\u30b0\u30eb\u30fc\u30d7\u306e\u5909\u66f4\u3092\u53cd\u6620\u3055\u305b\u308b\u305f\u3081\u3001\u73fe\u5728\u306eSSH\u30bb\u30c3\u30b7\u30e7\u30f3\u3092\u9589\u3058\u3066\u518d\u63a5\u7d9a\u3057\u307e\u3059\u3002<\/span><\/p>\r\n
\r\n
exit<\/code><\/span><\/pre>\r\n<\/div>\r\n
\u518d\u5ea6SSH\u63a5\u7d9a\u3092\u884c\u3044\u307e\u3059\u3002<\/span><\/p>\r\n
\"\"<\/p>\r\n
<\/p>\n\n
\u30b9\u30c6\u30c3\u30d7 2: Airbyte\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u8d77\u52d5<\/h2>\nAirbyte\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306e\u4f5c\u6210\u3068\u8d77\u52d5<\/strong><\/span><\/b>\r\n
SSH\u63a5\u7d9a\u3057\u3066\u3044\u308bVM\u30bf\u30fc\u30df\u30ca\u30eb\u3067\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/span><\/p>\r\n
\r\n
mkdir airbyte && cd airbyte\r\nwget https:\/\/raw.githubusercontent.com\/airbytehq\/airbyte\/master\/run-ab-platform.sh\r\nchmod +x run-ab-platform.sh\r\n.\/run-ab-platform.sh -bmkdir airbyte && cd airbyte\r\nwget https:\/\/raw.githubusercontent.com\/airbytehq\/airbyte\/master\/run-ab-platform.sh\r\nchmod +x run-ab-platform.sh<\/code><\/pre>\r\n<\/div>\r\n
\"\"<\/p>\r\n
<\/p>\n\n
\u30b9\u30c6\u30c3\u30d7 3: Airbyte\u306b\u63a5\u7d9a\u3059\u308b\u305f\u3081\u306eSSH\u30c8\u30f3\u30cd\u30eb\u306e\u4f5c\u6210<\/h2>\n
\u30ed\u30fc\u30ab\u30eb\u30bf\u30fc\u30df\u30ca\u30eb\u3067\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066SSH\u30c8\u30f3\u30cd\u30eb\u3092\u4f5c\u6210\u3057\u3001\u30ed\u30fc\u30ab\u30eb\u30de\u30b7\u30f3\u304b\u3089Airbyte\u306b\u63a5\u7d9a\u3057\u307e\u3059\u3002<\/span><\/p>\r\n
\r\n
gcloud --project=$PROJECT_ID beta compute ssh $INSTANCE_NAME -- -L 8000:localhost:8000 -N -f<\/code><\/pre>\r\n<\/div>\r\n
\u3053\u308c\u3067\u3001\u30ed\u30fc\u30ab\u30eb\u306e\u30d6\u30e9\u30a6\u30b6\u3067 http:\/\/localhost:8000<\/code><\/strong> \u306b\u30a2\u30af\u30bb\u30b9\u3057\u3066\u3001Airbyte\u306e\u30a6\u30a7\u30d6\u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u306b\u63a5\u7d9a\u3067\u304d\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002<\/span><\/p>\r\n
\"\"<\/p>\r\n
<\/p>\n\n
\u7d42\u308f\u308a\u306b<\/h2>\n
\u4ee5\u4e0a\u3067\u3001Google Cloud VM\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u4e0a\u3067Airbyte\u3092\u30c7\u30d7\u30ed\u30a4\u3057\u3001\u8d77\u52d5\u3059\u308b\u624b\u9806\u304c\u5b8c\u4e86\u3067\u3059\u3002Airbyte\u306f\u5f37\u529b\u306a\u30c7\u30fc\u30bf\u7d71\u5408\u30c4\u30fc\u30eb\u3067\u3042\u308a\u3001\u3053\u308c\u3092\u6d3b\u7528\u3059\u308b\u3053\u3068\u3067\u52b9\u7387\u7684\u306b\u30c7\u30fc\u30bf\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3092\u69cb\u7bc9\u3067\u304d\u307e\u3059\u3002\u5fc5\u8981\u306b\u5fdc\u3058\u3066\u3001Airbyte\u306e\u8a2d\u5b9a\u3092\u884c\u3044\u3001\u30c7\u30fc\u30bf\u306e\u7d71\u5408\u3092\u9032\u3081\u3066\u304f\u3060\u3055\u3044\u3002<\/span><\/p>\r\n\u53c2\u8003\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8<\/span><\/b>\r\n
https:\/\/docs.airbyte.com\/deploying-airbyte\/on-gcp-compute-engine<\/a><\/span><\/p>\r\n
<\/p>","protected":false},"excerpt":{"rendered":"
\u3053\u306e\u6280\u8853\u30d6\u30ed\u30b0\u3067\u306f\u3001Google Cloud Platform (GCP)\u306eCompute Engine\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u306bAirbyte\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u305f\u3081\u306e\u8a73\u7d30\u306a\u624b\u9806\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002Airbyte\u306f\u30c7\u30fc\u30bf\u306e\u7d71\u5408\u3068 […]<\/p>\n","protected":false},"author":87,"featured_media":4969,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","swell_btn_cv_data":"","footnotes":"","_wp_rev_ctl_limit":""},"categories":[1246],"tags":[622,143,207,503,504],"class_list":["post-5021","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-infrastructure","tag-airbyte","tag-gcp","tag-google-cloud","tag-ssh","tag-vm"],"_links":{"self":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/5021","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/users\/87"}],"replies":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/comments?post=5021"}],"version-history":[{"count":0,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/posts\/5021\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media\/4969"}],"wp:attachment":[{"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/media?parent=5021"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/categories?post=5021"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/since2020.jp\/media\/wp-json\/wp\/v2\/tags?post=5021"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}