ããð
æè¿ã®èšäº
ãã©ãã£ãããããã¯ããèŒããã
以åããããããã¯ãã«ã¯ãã©ãã£ããå¿ èŠãšèšã£ãŠããã®ã§ãããäžåºŠç°¡åã«ã§ãèšèªåããŸãã ãããã¯ãããããžã§ã¯ããšã®å¯Ÿæ¯ã«ãããšãããªæãã«ãªã£ãŠããŸããã¹ããŒãªãŒãšãã©ãã£ãã®å¯Ÿæ¯ãšåããããšãããããããªãããªãšæããŸãã ã¹ããŒãªãŒããè±éèãããªãŠããæ ç»ã ã£ãããããããŒãšã³ãã«ããããããšã³ãã«ããäœããããšã³ãã£ã³ã°ããããšãããããã©ãã£ãã¯çµãããªãæ¥åžžã®èªãã§ãããããã¯ä»ãã®äžçã«çããŠãã人ãã¡ã®å ±äœéšãšèããŸãã å æ¥ã®ã¿ãã»éè¡ã®ãããžã§
ã¹ã¿ãŒãã¢ããã®é»æ°
ã¹ã¿ãŒãã¢ããã§ç¹ã«å¿ èŠãªãã®ã ããã¯ç±éããšããããšã«ã¯ããŸãç°è«ã¯ãªããšæãã ãã ããã¯ãç±ãããã ãã§ã¯éçãããã ã©ããªã«ç±éãããåµæ¥è ãããŠãããã®ãŸãããç±ãããããšã¯å¯èœã§ããé ãé¢ãããšãããžå±ããããšã¯ãªããªãé£ããã ããã§ãç±ãé»æ°ã«å€ããã¿ãŒãã³ãå¿ èŠã«ãªãã ããã¯ã人ã ã£ããã«ã«ãã£ãŒã ã£ãããããã¯ãã ã£ããããããã©ããããã€ãã£ãŠããŸãã°é ãã®ç¯ãããšããããšãå¯èœã«ãªãã ãã ãçŸå®äžçãšåããã€ãã£ãé»æ°ããã®ãŸãŸè²¯ããããšã¯
Sales & Delivery Enablement
æ°ããŒã ãç«ã¡äžããŸãããã¡ã³ããŒïŒåã§ããw Sales & Delivery Enablementã¯ãã»ãŒã«ã¹ã»ã€ããŒãã«ã¡ã³ããšããªããªãŒã»ã€ããŒãã«ã¡ã³ããã¬ããã£ã³ã³ããæŠå¿µã§ãã ã»ãŒã«ã¹ã»ã€ããŒãã«ã¡ã³ãã¯å»å¹Žãããããã¡ãã»ãèŠãããããã«ãªã£ããå¶æ¥çµç¹ã®åŒ·åã¿ãããªã€ã¡ãŒãžã§ãããå人çã«ã¯ãã§ããåããšæã£ãŠããŸãã å³ã«ãããšã ã§ãããç¥èãšçµéšã®ç»åã¯æãããããã§åã£ãŠãããã®ã§ãã å³ã®éããç¥èããçµéšãžã®èªå°ãã¡ã€ã³ã§ãããå段ãšããŠç¥
16幎ã¶ãã«æ£ç€Ÿå¡ã«ãªã£ãŠå幎ãã£ã
ã¿ã€ãã«éãã§ãããšãæžããªããã§ãã è¯ããªã£ããšãã 1. ããŒã ãžã®ã³ããããæ·±ããªã ããã¯ãŸãããã§ãããããšã è¯ããæªããæ£ç€Ÿå¡ã¯çµç¹ãšã®ã€ãªããã匷ããããããŒã ããã®åœ±é¿ããããã ã§ãã³ããããæ·±ããªããšãã¯ãã¢ãŒã¡ã³ãã倧ãããªãã 2. éåãæžã ããã¯ãªãã£ã¹ã®äººãã¡ã®ãããã§ãã ããªãŒã ãšæ§ã ãªåããªãã¿ã¹ã¯ããã£ãŠããããããã§ãšãŠãå©ãããŸãã 3. çžæå ãžã®ãªãŒãã倪ããªã å人ã§ã¯çžæã«ããããªããããªäŒæ¥ãšçŽã§è©±ããŸãã ã
ãã¬ãžã³
èšäº
ãããžã§ã¯ããšã³ãžãã¢ãšããããŒã«
ãèããŠã¿ãã ãããžã§ã¯ããããŒãžã£ãŒãã¯è¯ãèããã©ããããžã§ã¯ããšã³ãžãã¢ãšããããŒã«ã¯ã»ãšãã©èããªãã ããã¯äœæ ãïŒ ãããããšã³ãžãã¢ã®ããŒã«ã¯ã€ãã察象ãšçµã³ã€ãã匷ãããã£ãšæãããš - ããã³ããšã³ããšã³ãžã㢠- ããã¯ãšã³ããšã³ãžã㢠- iOSãšã³ãžã㢠- Androidãšã³ãžã㢠- SRE çã ã ã§ã¯ããããžã§ã¯ããšã³ãžãã¢ã¯ãããžã§ã¯ããã€ããã®ãïŒããšãããšãã¯ãã¡ãã£ãšéããããã§ããããããããžã§ã¯ããšã¯äœãªã®ãããèããã æ°ã
ç²ããªãäŒè°
ãªã¢ãŒãäœå¶ã«ãªã£ãŠæ¯æ¥æ¯æ¥ãäœæéããªã³ã©ã€ã³äŒè°ããŠããæ¹ã ãç²ãæ§ã§ãã ä»ãŸã§ã¯ã移åæéãšããã£ãŠãäŒè°ãšäŒè°ã®éã§ã¡ãã£ãšæ°å転æã§ããŠãã®ã«ãä»ãçµäºãšåæã«æ¬¡ã®äŒè°ãšããã®ãçãããªãæ¥åžžã§ãã ãããªäŒè°ã§ãããããŸãã«ç²ããããšãªãã§ããïŒ ããã§ã¯ããããªç²ãã®åå ã®äžã€ã解æ¶ããŸãã ããã¯äœãïŒ çãã¯åçŽã§ããªãããããåãããªãããšã§ãã é¢è¥¿äººãã¿ã§ããã§ããã®è©±ãªããããïŒããšèšãã®ããããŸãããäŒè°ãããã§ãã ãªãïŒçµè«ãããããªããå
ãªãèšèªåãå¿ èŠã
ããããªãããžã§ã¯ããããŒã ã§ãèšèªåèšèªåãšããããŠããã®ã§ããããªãããããŠããã®ããèšèªåããŠãããããªããšã 人ã®è¡åã«ã¯çç±ããããŸãã ãè ¹ããããããã飯ãé£ã¹ãã æ²ããããšããã£ãããæ³£ãã ãã«ã«ãããããæãã ãããã£ãåçŽãªãã®ãããè€æ°ã®çç±ã圱é¿ããã£ãŠãããè¡çºããããŸãããããã£ããã®ã¯ããã«ã¯èª¬æã§ããªãã®ã§ãªããšãªãã§çä»ããŸãã ãªãã ãè¯ãåãããªããã©ã€ã€ãªäºæãããããå¥ã®éããè¡ããã ç¹ã«çç±ã¯ãªããã©ããµãã£ãšæ è¡ããã
ComposerããAIãã©ãããã©ãŒã ã®ãžã§ããèµ·åãã
# ããã¯äœïŒ [åå](https://qiita.com/yoko8ma/items/f6a64cb3c21148e29215)ã§ã€ãã£ãã«ã¹ã¿ã ã³ãŒããã¬ãŒãã³ã°ããããã±ãŒãžåããŠCloud Composerã®DAGããèµ·åããæé ã # æºå Cloud Storageã®ãã±ãããäœæãããçŸåšãML Engineã®åŠç¿åŠçã¯æ±äº¬ãªãŒãžã§ã³ã«ã¯ãªãã®ã§ãå°æ¹ŸãªãŒãžã§ã³ã§å®è¡ããããã±ãããå°æ¹ŸãªãŒãžã§ã³ã«äœæããã $ PROJECT_ID=<ãããžã§ã¯ãID>
GitHubã®éçšãèããŠã¿ã
# ããã¯äœïŒ ããŒã éçºã§ã¯ããã¡ã¯ããšããããããŒãžã§ã³ç®¡çããŒã«GitHubã§ããã©ã³ãã®äœæããã«ãªã¯ãšã¹ããã©ããã£ãŠéçšããŠãããèããŠã¿ããã® # ãã¿ãŒã³ ## å ±é - masterãããŒã¹ã«hotfixãäœæãã - hotfixããmasterãžãã«ãªã¯ãšã¹ããçºè¡ãããŒãžãã ## master-featureãã¿ãŒã³ ### ãã㌠- masterãããŒã¹ã«featureãã©ã³ããäœæãã - featureãã©ã³ãããmasterãžãã«ãªã¯ãš
ã2019å€ããšã³ãããŒãšã³ãæ©æ¢°åŠç¿ã®ã¢ãŒããã¯ãã£ã®æé©è§£ã¯ããã§ã¯ïŒ
# çµè« ![e2e arch.png](https://qiita-image-store.s3.ap-northeast-1.amazonaws.com/0/2137/7b9151b9-8281-4115-f1a2-f2c501b32156.png) - ååŠçãæšæºåçã®ããŒã¿ã®åŠçã¯Dataflowã§å®è¡ãã - åŠç¿ãè©äŸ¡ããããã€çã®ã¢ãã«ã®åŠçã¯AI Platformã®ãžã§ãã§å®è¡ãã - äžèšã®ã¯ãŒã¯ãããŒãComposerã管çãã # å¶çŽ - åŠç¿
GCPã®AI Platformã§åŠç¿ãžã§ããåãããŠã¿ã
# ããã¯äœïŒ Google Cloud Plataform(以äžGCP)ã®AI Platformã§Iris Datesetã®åŠç¿ãžã§ããå®è¡ããã åºæ¬çã«ã¯[å ¬åŒ](https://cloud.google.com/ml-engine/docs/scikit/getting-started-training?hl=ja)ããªãã£ãã ãã # æºå é©åœã«ã°ã°ã£ãŠäžèšã®ã€ã³ã¹ããŒã«ãèšå®ããã - scikit-learnã®ã€ã³ã¹ããŒã« - GCP SDKã®ã€ã³ã¹ããŒã«
Keras 深局åŠç¿ AppEngine Python gcp
# ããã¯äœïŒ - [åå](https://qiita.com/yoko8ma/items/0068f7ef1a1b03c5f46d)ã§å ¬éããAPIããã©ãŠã¶ããå©çšãã - ãœãŒã¹ã³ãŒã: [GitHub](https://github.com/yoko8ma/gcp-tutorial/tree/master/appengine/standard_python37/iris) # ç°å¢ - Keras - Python3ç³»ã®ã¹ã¿ã³ããŒãç°å¢ã®AppEngine - A
Kerasã§Irisã深局åŠç¿ããŠAPIã§å ¬éãã
# ããã¯äœïŒ - [åã®èšäº](https://qiita.com/yoko8ma/items/2dbf6c30afd885eb67d0)ã§åŠç¿ããã¢ãã«ã䜿ã£ãŠãã¢ã€ã¡ã®äºæž¬ãAPIãšããŠå ¬éããæé - APIã¯Google Cloud Platform(以äžGCP)ã®AppEngineäžã«ãããã€ãã - ãœãŒã¹ã³ãŒã: [GitHub](https://github.com/yoko8ma/gcp-tutorial/tree/master/appengine/sta
Kerasã§Irisã深局åŠç¿
# ããã¯ãªã«ïŒ - Kerasã䜿ã£ãŠscikit-learnã®ããŒã¿ã»ããã«ããã¢ã€ã¡ããŒã¿ãåé¡ãã - [GitHub](https://github.com/yoko8ma/gcp-tutorial/blob/master/notebook/Iris/Iris.ipynb)ã«notebookã¯ã¢ããæžã¿ # æºå - Python3ç³»ã§å®è¡ããã®ã§ä»®æ³ç°å¢ãçšæãã([åè](https://qiita.com/yoko8ma/items/89a1b6f404ba
Cloud Composerã§expr_pb2ã®ãšã©ãŒå¯Ÿå¿æ¹æ³
--- title: Cloud Composerã§expr_pb2ã®ãšã©ãŒå¯Ÿå¿æ¹æ³ tags: gcp CloudComposer BigQuery PubSub Python author: yoko8ma slide: false --- GCPã®Cloud Composerã§BigQueryãšãPub/SubãPythonããå®è¡ããããšãããšã次ã®ãããªãšã©ãŒãåºãå Žåãããã ``` [2019-08-08 06:46:48,377] {base_task_ru