åœç«æ å ±åŠç ç©¶æãLLM-jp-4ããªãŒãã³ãœãŒã¹å ¬éïŒæ¥æ¬è£œLLMã®æ°ããªäžæ©
NIIã£ãŠãããšãããLLM-jp-4ã£ãŠããAIãå ¬éãããã ã£ãŠïŒ
ããã ããåœç«æ å ±åŠç ç©¶æïŒNIIïŒã2026幎4æ3æ¥ã«ãæ¥æ¬èªã«åŒ·ãå€§èŠæš¡èšèªã¢ãã«ãLLM-jp-4ãããªãŒãã³ãœãŒã¹ã§å ¬éãããã ãåœã®ç ç©¶æ©é¢ãæ¬æ ŒçãªLLMã誰ã§ã䜿ãã圢ã§åºãã®ã¯ãããªã倧ããªãã¥ãŒã¹ã ãã
ãªãŒãã³ãœãŒã¹ã£ãŠããšã¯ã誰ã§ãã¿ãã§äœ¿ããã®ïŒ
ãã®éããäŒæ¥ã§ãå人ã§ãèªç±ã«ããŠã³ããŒãããŠäœ¿ããããäžèº«ãæ¹é ããããèªåã®ãµãŒãã¹ã«çµã¿èŸŒãã ããã§ããããChatGPTãClaudeã¿ãããªåçšã¢ãã«ã¯äžèº«ããã©ãã¯ããã¯ã¹ã ãã©ããªãŒãã³ãœãŒã¹ãªãã¢ãã«ã®éã¿ãã¢ãŒããã¯ãã£ã誰ã§ãæ€èšŒã§ãããã ãéææ§ãšä¿¡é Œæ§ã®é¢ã§ãšãŠãéèŠã ãã
ä»åã¯2ã€ã®ã¢ãã«ãããã£ãŠèãããã©ãã©ãéãã®ïŒ
8Bã¢ãã«ãš32B-A3Bã¢ãã«ã®2çš®é¡ã ãã8Bã¯çŽ86åãã©ã¡ãŒã¿ã®éåžžã¢ãã«ã§ã32B-A3Bã¯MoEãšããç¹æ®ãªã¢ãŒããã¯ãã£ã䜿ã£ãçŽ320åãã©ã¡ãŒã¿ã®ã¢ãã«ãªãã ãã©ã¡ããçŽ12å ããŒã¯ã³ã®é«å質ãªããŒã¿ã§åŠç¿ãããŠãããã
MoEã£ãŠäœãªã®ïŒæ®éã®ã¢ãã«ãšäœãéãã®ïŒ
MoEã¯ãå°éå®¶ã®æ··åããšããæå³ã§ãã¢ãã«ã®äžã«è€æ°ã®å°éå®¶ïŒãšãã¹ããŒãïŒãããã¯ãŒã¯ãæã£ãŠããŠãå ¥åã«å¿ããŠäžéšã®ãšãã¹ããŒãã ãã䜿ãä»çµã¿ã ãã32Bã¢ãã«ã¯å šäœã§320åãã©ã¡ãŒã¿ãããã©ãæšè«æã«å®éã«åãã®ã¯çŽ30åãã©ã¡ãŒã¿ã ããã€ãŸãã倧ããªã¢ãã«ã®è³¢ããæã¡ãªãããèšç®ã³ã¹ãã¯å°ããã¢ãã«äžŠã¿ã§æžããã ã
ãããïŒããã§æ§èœã¯ã©ã®ããããªã®ïŒ
äžéšã®æ¥æ¬èªãã³ãããŒã¯ã§ã¯GPT-4oãQwen3-8Bãäžåãã¹ã³ã¢ãåºããŠãããããã ãæ³šæãå¿ èŠã§ããäžéšã®ãã³ãããŒã¯ããšããã®ããã€ã³ããç¹å®ã®ã¿ã¹ã¯ã§äžåã£ãŠããŠããç·ååã§ã¯ãŸã åçšã¢ãã«ã«åã°ãªãéšåãããããšã¯ããããªãŒãã³ãœãŒã¹ã®æ¥æ¬èªã¢ãã«ãšããŠã¯ãããã¯ã©ã¹ã®æ§èœãšèšã£ãŠãããã
ã§ãããªãã§åœã®ç ç©¶æ©é¢ãããããLLMãäœãã®ïŒChatGPTãšãã䜿ãã°ããããããªãã®ïŒ
ãã質åã ããæµ·å€ã®åçšã¢ãã«ã ãã«é Œããšãããã€ããªã¹ã¯ããããã ããŸããæ¥æ¬èªã®æ±ããè±èªã»ã©åŸæãããªãããšããããããã«ãæ¿åºãäŒæ¥ã®æ©å¯ããŒã¿ãæµ·å€ã®APIã«éãããšãžã®æžå¿µããããèªåœã§é«æ§èœãªã¢ãã«ãæã€ããšã¯ãAIã®äž»æš©ããšãèšããéèŠãªæŠç¥ãªãã ãã
æ¥æ¬ã§ã¯ä»ã«ãLLMãäœã£ãŠãããšãããããã®ïŒ
ããããNTTã®ãtsuzumiããABEJAã®ãABEJA LLMããPreferred Networksã®ãPLaMoãããµã€ããŒãšãŒãžã§ã³ãã®æ¥æ¬èªã¢ãã«ãªã©ãæ°éäŒæ¥ãç©æ¥µçã«éçºããŠãããã ããã ãNIIã®ããã«åœã®ç ç©¶æ©é¢ãå€§èŠæš¡ã¢ãã«ããªãŒãã³ãœãŒã¹ã§åºãã®ã¯æå³åããéãã誰ã§ãç ç©¶ãéçºã«äœ¿ããå ±éåºç€ãæäŸããŠãããã ãã
æ£é¢ããåãåä¿µã§æŠãã®ã¯ç¢ºãã«é£ãããã§ããªãŒãã³ãœãŒã¹ã®åŒ·ã¿ã¯ãäžçäžã®ç ç©¶è ããšã³ãžãã¢ãæ¹è¯ã«åå ã§ããããšãMetaãåºããLlamaã·ãªãŒãºããå ¬éåŸã«ã³ãã¥ããã£ãé©ãã»ã©ã®æ¹è¯ãå ãããããNIIã2026幎床äžã«ããã«å€§ããªã¢ãã«ã軜éã¢ãã«ãå ¬éããäºå®ã§ãç¶ç¶çã«ãšã³ã·ã¹ãã ãè²ãŠãŠããæ¹éãªãã ã
12å ããŒã¯ã³ã®ããŒã¿ã£ãŠã©ãããéããŠããã®ïŒ
詳现ã¯å ¬éæ å ±ããèªã¿åããç¯å²ã ãã©ãæ¥æ¬èªã®WebããŒã¿ãæžç±ãè«æãã³ãŒããªã©å€æ§ãªãœãŒã¹ããé«å質ãªãã®ãå³éžããŠããããå®ã¯ããŒã¿ã®è³ªãããLLMã®æ§èœãå·Šå³ããæå€§ã®èŠå ãªãã ã12å ããŒã¯ã³ã¯éãšããŠãçžåœã ãã©ããã以äžã«ãæ¥æ¬èªã®ããŒã¿ãã©ãã ãäžå¯§ã«éãããããããæ¥æ¬è£œã¢ãã«ã®åè² ã©ããã ãã
ããããã®æ¥æ¬ã®AIéçºã¯ã©ããªã£ãŠããã®ããªïŒ
ãªãŒãã³ãœãŒã¹ã¢ãã«ãå å®ããããšã§ã倧åŠãäžå°äŒæ¥ã§ãLLMã䜿ã£ãç ç©¶ã»ãµãŒãã¹éçºããããããªãã®ãäžçªå€§ããããä»ãŸã§ã¯é«é¡ãªAPIå©çšæãæãããèªåã§äœååããããŠåŠç¿ãããã®äºæã ã£ããã©ãLLM-jp-4ã®ãããªã¢ãã«ãããã°ããã¡ã€ã³ãã¥ãŒãã³ã°ããŠèªç€Ÿã®æ¥åã«ç¹åãããããšãã§ãããAIç ç©¶ã®æ°äž»åãé²ã倧äºãªäžæ©ã ãã