SUTOð¡
èšäºäžèŠ§
ç»åã«ç §æå¹æãä»äžã§ããIC-LightãComfyUIã§è©ŠããŠã¿ã
ControlNetã®éçºè ã§ããlllyasvielæ°ãç»åã«ç §æå¹æãä»äžã§ãããIC-Lightããäœã£ãŠããŠããã®æ§èœã®ããã«Xã§ã話é¡ã«ãªã£ãã®ã§ããã£ãŠã¿ãããšæããŸãïŒ ãã¡ãâŠ
ä»»æã®ç»åã«å¯Ÿãã質åã«ãªãã§ãçããŠããããããã ãªãŒãã³ãœãŒã¹AIããŒã«ãmoondreamããè©ŠããŠã¿ã
moondreamãšã¯Moondream ã¯ä»»æã®ç»åã«å¯ŸããŠçŸå®äžçã®è³ªåã«çããããšãã§ããã³ã³ãã¥ãŒã¿ãŒ ããžã§ã³ã¢ãã«ããªãŒãã³ãœãŒã¹ã§é ä¿¡ãããŠããŸãã çŸåšã®ã¢ãã«åžå ŽâŠ
ããã¹ãã§ãµã©ããšUIã³ã³ããŒãã³ããäœã£ãŠããããOpenUIããããã£ãŠã¿ã
ä»åã¯ãOpen UIããšãããã£ããããŒã¹ã§UIã³ã³ããŒãã³ã(ç»é¢äžã«è¡šç€ºããUIã®ããŒã)ã®æ§ç¯ãã§ããAIããŒã«ãè©ŠããŠã¿ãããšæããŸãã æè¿ã¯text to appãã ãã¶æµâŠ
Ollamaãšé£æºããŠDifyã§RAGãã£ããããããå®å šç¡æã§äœã£ãŠéã¶
ååãããããããšè©±é¡ã«ãªã£ãŠãDifyããªãŒãã³ãœãŒã¹ã ãšç¥ããªããšãªãã€ã³ã¹ããŒã«ããŠã¿ãŸãããä»åã¯ããã®ç¶ãã§ãïŒ RAGãã£ãããããå¶äœã«ã¯chatGPTã®APIãâŠ
ã¯ãªãšã€ãã£ãã«ãAIããšãå€æ§æ§ããéèŠãªããŒã¯ãŒãã«ãªã£ãŠããã®ã¯"ããããã¯ãªãšã€ãã£ãã³ã³ãã³ãã®éèŠãçå¢ãã"ãâŠ
ä»åã®ã¿ã€ãã«ã«ããããŸãããã¿ãªããããããã¯ãªãšã€ãã£ãã³ã³ãã³ãã®éèŠãçå¢ããã®ãç¥ã£ãŠããŸãããïŒ Adobe MAX Japan 2023ãã»ãããŒçã§Adobeããã声ãâŠ
ã¡ãŸãã§äººæ°ã®ããŒã³ãŒãLLM ã¢ããªéçºãã©ãããã©ãŒã ãDifyããWindowsã®ããŒã«ã«ã§åãã
ããŸå€§äººæ°ã®ããŒã³ãŒããªAIã·ã¹ãã ã®éçºç°å¢ã®LLMããŒã«ãDifyãã ããŸãã«äººæ°ãªããã ããæµç³ã«èª¿ã¹ãŠãããªããããšæã£ããããããŸããããã ãªãŒã«ã€ã³ã¯ã³ã®âŠ
Ollamaã䜿ã£ãŠMicrosoftã®è»œéãªãŒãã³ãœãŒã¹LLMã®ãphi-3ããããŒã«ã«ã§è©ŠããŠã¿ã
ã¡ãŸãã§GPT3.5ããåªç§ããïŒãšè©±é¡ã«ãªã£ãŠããMicrosoft補ã®ãªãŒãã³ãœãŒã¹LLMã®ãphi-3ããããã¯ã¹ããŒããã©ã³ã®ããŒã«ã«ã§ãåããããããã®è»œããšããããšã§è©±é¡âŠ
ä»®æ³çãæ¿ããã§ããAIã®ãIDM-VTONãã§éãã§ã¿ã
ä»åã¯ä»»æã®ã¢ãã«ã«ä»®æ³è©Šçãæ軜ã«ã§ããIDM-VTONãè©ŠããŠã¿ãããšæããŸãïŒ ãããžã§ã¯ãããŒãžé¡ã¯ãã¡ãã ãã¢ã®UIã¯ãããªæãã§ããã ããã§ã¯æ©éã¢ãã«ãšâŠ
å ç»åã«ãããªã¢ã«ã€ã¡ãŒãžç»åäžæã§åæ ããããã¬ãŒãã³ã°äžèŠã®AIãZeSTããè©ŠããŠã¿ã
ç»åããç»åãžãããªã¢ã«ã転éãããŒãã·ã§ããã§ãã¬ãŒãã³ã°äžèŠãšããAIã®ãZeSTããä»åã¯è©ŠããŠã¿ãããšæããŸãïŒ ðãããžã§ã¯ãããŒãžé¡ã¯ä»¥äžã ããã§ã¯æ©éâŠ
æ匷ã®AIãã£ãããããã決ããããšããŠãããChatbot Arenaããã¿ããªã«è§Šã£ãŠã»ããïŒãŠãŒã¶ãŒç»é²äžèŠïŒ
Chatbot Arenaã£ãŠãåç¥ã§ããïŒ Chatbot Arenaã¯å€§èŠæš¡èšèªã¢ãã«ïŒLLMïŒã人éã®å¥œã¿ã«åºã¥ããŠè©äŸ¡ããããã«åœ¢åŒã®ãªãŒãã³ãã©ãããã©ãŒã ã§ãã ãŠãŒã¶ãŒã¯ããŸãâŠ
ä»»æã®ãªããžã§ã¯ãã€ã¡ãŒãžãããããªè§åºŠãã·ãã¥ãšãŒã·ã§ã³ã§åçæã§ãããðCustomNetããè©ŠããŠã¿ã
ç»åã®ãªããžã§ã¯ãã€ã¡ãŒãžãä¿æããªãããããããªã¢ã³ã°ã«ãäœçœ®ã§ã®èæ¯ãã³ã³ãããŒã«ã§ããããšã§è©±é¡ã«ãªã£ãŠãããCustomNetãã ä»åã¯ãã¡ãã®ã¢ãã«ãè©ŠããŠã¿âŠ
æ°ããAIãåºãŠããæã䜿çšåç»ãèŠãã ããããªãå®éã«è§Šã£ãŠæ€èšŒããæ¹ãè¯ããšæãçç±
æ°ããAIããªãªãŒã¹ããããã³ã«é©ãã€ã€çŽ¹ä»ããã¢ã«ãŠã³ããããAIé©ãå±ãæè¿ã¹ã¿ã³ããŒãã«ãªãã€ã€ãããããAIé©ãå±ããšããåéã æ°ããAIé¢é£ããŒã«ãAIãµãŒãâŠ
æ°ããçºè¡šãããŠãã2D-to-3Dã®ãInstantMeshããè©ŠããŠã¿ã
äžæã®åçãã3Dã®ã¡ãã·ã¥ã¢ãã«ïŒç«äœçãªãããã¯ãŒã¯æ§é ïŒãçæããããã®ãã¬ãŒã ã¯ãŒã¯ãInstantMeshããããããã ã£ãã®ã§è©ŠããŠã¿ãŸããã 3Dãäœããã¬ãŒã âŠ
èšèã§ç»åç·šéãã§ãããããã®ç²Ÿå¯ãã§è©±é¡ã®ãCosXL Editããè©ŠããŠã¿ã
Stability AIã®æ°ãã CosXLã¢ãã«ãã²ã£ãããšè©±é¡ãšãªã£ãŠããŸãã control netãinpaintingãmaskãäžèŠã§ããã³ããã ãã§æå®ç®æãä¿®æ£ïŒåçæïŒã§ãããšãããããâŠ
AIã掻èºãããšããã¯â倧人ã®"æè²ãåŠç¿ãªã©ã®åéãçµæ§å€§ãããããããªã
ã€ã³ã¿ãŒããããã¹ããŒããã©ã³ãªã©ã®é²åã§ãæ å ±ãæã«å±ããšããã«åžžã«ããããã«ãªããŸããã ã²ãšæåãšã¯èããããªããããã®é²åã§ãã äžå¿æåã«æžããŠãããŸâŠ
ç»åã«ç §æå¹æãä»äžã§ããIC-LightãComfyUIã§è©ŠããŠã¿ã
ControlNetã®éçºè
ã§ããlllyasvielæ°ãç»åã«ç
§æå¹æãä»äžã§ãããIC-Lightããäœã£ãŠããŠããã®æ§èœã®ããã«Xã§ã話é¡ã«ãªã£ãã®ã§ããã£ãŠã¿ãããšæããŸãïŒ
ãã¡ããControlNetåæ§ãªãŒãã³ãœãŒã¹ãçŽ æŽãããð¥³
ãããžã§ã¯ãããŒãžðãããžã§ã¯ãããŒãžé¡ã¯ãã¡ã
æ©éããã£ãŠã¿ããã¢ã®UIã¯ãããªæãã§ããã
ãã¬ã¹ãçãããã¡ããã§è©ŠããŠã¿ãã®ã§ããããš
ä»»æã®ç»åã«å¯Ÿãã質åã«ãªãã§ãçããŠããããããã ãªãŒãã³ãœãŒã¹AIããŒã«ãmoondreamããè©ŠããŠã¿ã
moondreamãšã¯Moondream ã¯ä»»æã®ç»åã«å¯ŸããŠçŸå®äžçã®è³ªåã«çããããšãã§ããã³ã³ãã¥ãŒã¿ãŒ ããžã§ã³ã¢ãã«ããªãŒãã³ãœãŒã¹ã§é
ä¿¡ãããŠããŸãã
çŸåšã®ã¢ãã«åžå Žãããããšéåžžã«å°ããããã©ã¡ãŒã¿ãŒã¯ 16 åãããªããšã®ããšã
ãã®å°ããã§ãæºåž¯é»è©±ãªã©ãå«ãããŸããŸãªããã€ã¹äžã§ããŒã«ã«å®è¡ã§ããããã«ãªã£ãŠããã®ã売ãã¿ããã§ããã
ãããžã§ã¯ãããŒãžé¡ðãããžã§ã¯ãã
ããã¹ãã§ãµã©ããšUIã³ã³ããŒãã³ããäœã£ãŠããããOpenUIããããã£ãŠã¿ã
ä»åã¯ãOpen UIããšãããã£ããããŒã¹ã§UIã³ã³ããŒãã³ã(ç»é¢äžã«è¡šç€ºããUIã®ããŒã)ã®æ§ç¯ãã§ããAIããŒã«ãè©ŠããŠã¿ãããšæããŸãã
æè¿ã¯text to appãã ãã¶æµè¡ã£ãŠããŸããæè¿ã¯Create XYZã倧人æ°ã§ããïŒ
ðãããžã§ã¯ãããŒãžã¯ãã¡ã
ãšããããšã§æ©éããŒã«ã«ã§èµ·åïŒ
ç¡æã«ãã ããç§ã¯ä»åãç¡æã®LLMã䜿ããããOllamaã®llama3ã§èšå®ã
Ollamaãšé£æºããŠDifyã§RAGãã£ããããããå®å šç¡æã§äœã£ãŠéã¶
ååãããããããšè©±é¡ã«ãªã£ãŠãDifyããªãŒãã³ãœãŒã¹ã ãšç¥ããªããšãªãã€ã³ã¹ããŒã«ããŠã¿ãŸãããä»åã¯ããã®ç¶ãã§ãïŒ
RAGãã£ãããããå¶äœã«ã¯chatGPTã®APIã䜿ã£ãŠãããã£ãã®ã§ããããã£ãããªã®ã§ãããŸã§æ¥ããLLMãç¡æã®ãã®ã§å
šéšç¡æã§ãããã欲ãã§ãŠããŸãå°ã調ã¹ããšOllamaãšã®é£æºã§Difyãã§ããèšäºèŠã€ããããã§ãã£ãŠã¿ãããšã«ããŸããã
ãããããïœïŒ
ãš
Ollamaã§Meta瀟補ã®ãªãŒãã³LLMãLlama3ããè©ŠããŠã¿ã
ä»åã¯ãããŸã§ã§æãé«æ§èœãªãªãŒãã³ã«å©çšå¯èœãª LLMãšåé«ãMeta Llama 3ãè©ŠããŠã¿ãããšæããŸãã
ð Meta Llama 3ã®è©³ãã説æã¯ãã¡ãð
Xã§ã話é¡ã§ãïŒ
Claude 3 SonnetãGPT-3.5çãšæ¯èŒããŠãåªããŠãããšè©äŸ¡ãããŠãããšãâŠïŒïŒ
ãšããããšã§æ©éãã®Llama3ãOllamaã§è©ŠããŠã¿ãããšæããŸãã
Ollamaãå°å
¥æžã¿ã§ããã°
ã¯ãªãšã€ãã£ãã«ãAIããšãå€æ§æ§ããéèŠãªããŒã¯ãŒãã«ãªã£ãŠããã®ã¯"ããããã¯ãªãšã€ãã£ãã³ã³ãã³ãã®éèŠãçå¢ãã"ããã£ãŠããã®ããããã
ä»åã®ã¿ã€ãã«ã«ããããŸãããã¿ãªããããããã¯ãªãšã€ãã£ãã³ã³ãã³ãã®éèŠãçå¢ããã®ãç¥ã£ãŠããŸãããïŒ
Adobe MAX Japan 2023ãã»ãããŒçã§Adobeããã声ã倧ã«ããŠäœåºŠãèšã£ãŠããããšãã¡ããã¡ãAdobeããã倧ã
çã«èšã£ãŠããã®ã§ããããããã¯ãªãšã€ãã£ãã³ã³ãã³ãã®éèŠãçå¢ããã£ãŠã
ãããæ¯åããããªå Žæã§ã
ããšãã°tech insiderããã®Adobe
ã¡ãŸãã§äººæ°ã®ããŒã³ãŒãLLM ã¢ããªéçºãã©ãããã©ãŒã ãDifyããWindowsã®ããŒã«ã«ã§åãã
ããŸå€§äººæ°ã®ããŒã³ãŒããªAIã·ã¹ãã ã®éçºç°å¢ã®LLMããŒã«ãDifyãã
ããŸãã«äººæ°ãªããã ããæµç³ã«èª¿ã¹ãŠãããªããããšæã£ããããããŸããããã
ãªãŒã«ã€ã³ã¯ã³ã®ã¯ãŒã¯ã¹ããŒã¹ã§èŠèŠçã«çæåAIã¢ããªãäœæãäœçŸãã®ç¬èª/ãªãŒãã³ãœãŒã¹ LLM ãšã®ã·ãŒã ã¬ã¹ãªçµ±åãã§ãã¡ãããšããç°åžžãªããŒã«ã§ãã
ãã®Difyãã¯ã©ãŠããµãŒãã¹ã ãš200ååã®GPTç¡æãã©ã€ã¢ã«ãã§ããã®ã§ã¡ãã£
Ollamaã䜿ã£ãŠMicrosoftã®è»œéãªãŒãã³ãœãŒã¹LLMã®ãphi-3ããããŒã«ã«ã§è©ŠããŠã¿ã
ã¡ãŸãã§GPT3.5ããåªç§ããïŒãšè©±é¡ã«ãªã£ãŠããMicrosoft補ã®ãªãŒãã³ãœãŒã¹LLMã®ãphi-3ããããã¯ã¹ããŒããã©ã³ã®ããŒã«ã«ã§ãåããããããã®è»œããšããããšã§è©±é¡ã«ãªã£ãŠãã®ã§ã¡ãã£ãšããã£ãŠã¿ãããšæããŸãïŒ
ã¡ãªã¿ã«Phi-3ã¯2024幎4æãªãªãŒã¹ãããŠã§ãPhi-3-miniïŒ3.8GBïŒãPhi-3-smallïŒ70GBïŒãPhi-3-midiumïŒ140GBïŒãã
ä»®æ³çãæ¿ããã§ããAIã®ãIDM-VTONãã§éãã§ã¿ã
ä»åã¯ä»»æã®ã¢ãã«ã«ä»®æ³è©Šçãæ軜ã«ã§ããIDM-VTONãè©ŠããŠã¿ãããšæããŸãïŒ
ãããžã§ã¯ãããŒãžé¡ã¯ãã¡ãã
ãã¢ã®UIã¯ãããªæãã§ããã
ããã§ã¯æ©éã¢ãã«ãšæŽæãçšæããŠè©ŠããŠã¿ãŸãã
é·è¢ã§ãããã¡ãããšåè¢ã®è±æTã·ã£ããçãŠãããŸããïŒ
æãã»ãŒç Žç¶»ããŠãªãã§ãããããã
ã€ãã¯æã·ã£ãã®ç·æ§ã«ãããã«ãŒãã£ã¬ã³ããããããšæããŸãã
ããã§ããã次ã¯ãã®çŸãã女æ§
å ç»åã«ãããªã¢ã«ã€ã¡ãŒãžç»åäžæã§åæ ããããã¬ãŒãã³ã°äžèŠã®AIãZeSTããè©ŠããŠã¿ã
ç»åããç»åãžãããªã¢ã«ã転éãããŒãã·ã§ããã§ãã¬ãŒãã³ã°äžèŠãšããAIã®ãZeSTããä»åã¯è©ŠããŠã¿ãããšæããŸãïŒ
ðãããžã§ã¯ãããŒãžé¡ã¯ä»¥äžã
ããã§ã¯æ©éããã£ãŠã¿ãããšæããŸãïŒ
ãµã³ãã«ããã£ãã®ã§è©Šãã«ãã¡ãã§ãã¹ãã
ã€ã³ãããããããŒã¡ãã«å¯ŸããŠãããªã¢ã«ããã£ãããšåæ ãããŠããŸããïŒ
ãªãªãžãã«ã®ç»åã§ãè©ŠããŠã¿ãããšæããŸãã
ãŸãã¯ãã°ã«ãããšç·è²ã®æ¶²äœã
æ匷ã®AIãã£ãããããã決ããããšããŠãããChatbot Arenaããã¿ããªã«è§Šã£ãŠã»ããïŒãŠãŒã¶ãŒç»é²äžèŠïŒ
Chatbot Arenaã£ãŠãåç¥ã§ããïŒ
Chatbot Arenaã¯å€§èŠæš¡èšèªã¢ãã«ïŒLLMïŒã人éã®å¥œã¿ã«åºã¥ããŠè©äŸ¡ããããã«åœ¢åŒã®ãªãŒãã³ãã©ãããã©ãŒã ã§ãã
ãŠãŒã¶ãŒã¯ããŸããŸãªã¢ãã«ãšå¯Ÿè©±ããã©ã¡ãã®ã¢ãã«ãããè¯ãå¿çããããæ祚ããããšã§ãã¢ãã«éã®ã©ã³ãã³ã°ã圢æããããšãããã®ã
ããã觊ã£ãŠã¿ããšæå€ãšå·®ç°ããããã®ã ãªããšæå¿ããã®ã§èšäºã«ãŸãšããŸããã
ðãã
ä»»æã®ãªããžã§ã¯ãã€ã¡ãŒãžãããããªè§åºŠãã·ãã¥ãšãŒã·ã§ã³ã§åçæã§ãããðCustomNetããè©ŠããŠã¿ã
ç»åã®ãªããžã§ã¯ãã€ã¡ãŒãžãä¿æããªãããããããªã¢ã³ã°ã«ãäœçœ®ã§ã®èæ¯ãã³ã³ãããŒã«ã§ããããšã§è©±é¡ã«ãªã£ãŠãããCustomNetãã
ä»åã¯ãã¡ãã®ã¢ãã«ãè©ŠããŠã¿ãããšæããŸãã
ãããžã§ã¯ãããŒãžé¡ã¯ãã¡ãã
ãã¡ããUIã§ãã
ä»åã¯ãã¡ãã®äžæ¯ç«ã®æãç«ã®ç»åã§è©ŠããŠã¿ãããšããããŸãã
ããã§ããã
ãããéã³ã©ãæãããã§ãïŒïŒ
åç»ã¯ãã¡ãããã
ãã¿ã³ãœã¡ãœã¡ãã
æ°ããAIãåºãŠããæã䜿çšåç»ãèŠãã ããããªãå®éã«è§Šã£ãŠæ€èšŒããæ¹ãè¯ããšæãçç±
æ°ããAIããªãªãŒã¹ããããã³ã«é©ãã€ã€çŽ¹ä»ããã¢ã«ãŠã³ããããAIé©ãå±ãæè¿ã¹ã¿ã³ããŒãã«ãªãã€ã€ãããããAIé©ãå±ããšããåéã
æ°ããAIé¢é£ããŒã«ãAIãµãŒãã¹ãªã©ã次ã
ãšç»å Žããäžã§ããããã®é©ãã¹ãæ©èœãæ§èœããŸãšããŠåç»ããã¹ãã§çŽ¹ä»ããŠããæ¹ã
ãæãèšèã®ããã§ãã
ããæè¿ã®AIæè¡ã®é²åã«ã¯ç®ãèŠåŒµããã®ããããŸãã
ãã®ç°åžžãªé床ã§é²åããAIæ
å ±ããŸãšããŠéäžéå ±ã§ã
æ°ããçºè¡šãããŠãã2D-to-3Dã®ãInstantMeshããè©ŠããŠã¿ã
äžæã®åçãã3Dã®ã¡ãã·ã¥ã¢ãã«ïŒç«äœçãªãããã¯ãŒã¯æ§é ïŒãçæããããã®ãã¬ãŒã ã¯ãŒã¯ãInstantMeshããããããã ã£ãã®ã§è©ŠããŠã¿ãŸããã
3Dãäœããã¬ãŒã ã¯ãŒã¯ã¯ä»ã«ãããã€ããã£ãŠãéå»ã«ãããªæãã§è©ŠããŠããŸãã
ããŠä»åã¯ã©ããªæãã§ããããïŒïŒ
ãããžã§ã¯ãé¡ã¯ä»¥äžããã
æ®éã3Dã¢ãã«ãäœãæã¯è€æ°ã®ç»åãããŒã¿ãåºã«ããŠè©³çŽ°ãå ããŠããå¿
èŠããããŸãããI
èšèã§ç»åç·šéãã§ãããããã®ç²Ÿå¯ãã§è©±é¡ã®ãCosXL Editããè©ŠããŠã¿ã
Stability AIã®æ°ãã CosXLã¢ãã«ãã²ã£ãããšè©±é¡ãšãªã£ãŠããŸãã
control netãinpaintingãmaskãäžèŠã§ããã³ããã ãã§æå®ç®æãä¿®æ£ïŒåçæïŒã§ãããšããããã粟å¯ãªè
åšçãªã¢ãã«ãCosXLãã§ãã
èšèã®ç解ã®ç²ŸåºŠãé«ããããŒã«ããã®æå®ç¯å²ããªããšãèšèªã®ã¿ã§é©çšç®æãç解ãããšããããšã®åãã
CosXLã¯baseãšEditã® 2 ã€ã®ã¢ãã«ã§
AIã掻èºãããšããã¯â倧人ã®"æè²ãåŠç¿ãªã©ã®åéãçµæ§å€§ãããããããªã
ã€ã³ã¿ãŒããããã¹ããŒããã©ã³ãªã©ã®é²åã§ãæ
å ±ãæã«å±ããšããã«åžžã«ããããã«ãªããŸããã
ã²ãšæåãšã¯èããããªããããã®é²åã§ãã
äžå¿æåã«æžããŠãããŸãããåã©ããè¥è
ã®åŠæ ¡æè²ã¯AIãããããªãããã€ã³ã¿ãŒãããããšãŠã䟿å©ã ããããå€ããããªã«ããäžçªå€§äºã§ãã
ç¹ã«çŸ©åæè²æéäžã¯åŠã¶ã ãã§ãªãã瀟äŒæ§ãåºæ¬çãªç掻ã¹ãã«ã身ã«ã€ããå Žã§ããããŸãã倧åŠæè²ã«è³ã£ãŠã¯ãå°éçãªç¥