ご家庭のパソコンでLLMが動く!・・・またかよ

2023年3月29日 14:20

えー・・・今度はgpt4allというのが出ましたよ

やっぱあれですな。
一度動いちゃうと後はもう雪崩のようですな。
そしてこっち側も新鮮味を感じなくなってしまうというか。

んで、ものすごくアッサリとうちのMacBookProで動きました。
量子化済みのモデルをダウンロードしてスクリプト動かすだけ!
工夫なし! Windowsでもいけると書いてある。しかもめちゃくちゃ高速

 % ./gpt4all-lora-quantized-OSX-m1 
main: seed = 1680064969
llama_model_load: loading model from 'gpt4all-lora-quantized.bin' - please wait ...
llama_model_load: failed to open 'gpt4all-lora-quantized.bin'
main: failed to load model from 'gpt4all-lora-quantized.bin'
shi3z@shi3zettonoMacBook-Pro chat % mv ~/Downloads/gpt4all-lora-quantized.bin .
shi3z@shi3zettonoMacBook-Pro chat % ./gpt4all-lora-quantized-OSX-m1            
main: seed = 1680065652
llama_model_load: loading model from 'gpt4all-lora-quantized.bin' - please wait ...
llama_model_load: ggml ctx size = 6065.35 MB
llama_model_load: memory_size =  2048.00 MB, n_mem = 65536
llama_model_load: loading model part 1/1 from 'gpt4all-lora-quantized.bin'
llama_model_load: .................................... done
llama_model_load: model size =  4017.27 MB / num tensors = 291

system_info: n_threads = 4 / 12 | AVX = 0 | AVX2 = 0 | AVX512 = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 | VSX = 0 | 
main: interactive mode on.
sampling parameters: temp = 0.100000, top_k = 40, top_p = 0.950000, repeat_last_n = 64, repeat_penalty = 1.300000


== Running in chat mode. ==
 - Press Ctrl+C to interject at any time.
 - Press Return to return control to LLaMA.
 - If you want to submit another line, end your input in '\'.

> こんにちは
お責いします。 よろしくお願い私の勤めるたびきなり、日本であってもらえますね！
> hello
こんにちは. (Japanese for "Hello.") よろしくお願い私の勤めるたびきなり、日本であってもらえますね！　（Translation: Greetings! I am pleased to greeting you and wishing that your work goes well in Japan!)
> 日本で一番高い山は?
静岡県の牧場山。 （Translation: The highest mountain in Japan is Mount Fuji located in Shizuoka Prefecture.)

ただ、日本語だとかなりバカ。
富士山と答えられずに牧場山と答えてしまっている。
が、英語ではMount Fujiと答えているので日本語がおかしいだけ。

英語で聞くとなかなかちゃんと答える

> Where is capital of United States?
Washington D.C., which serves as the seat of government for both federal and local governments, including Congress (legislative), Presidential Administration Building(executive) , Supreme Court building etc.(judicial). （Translation: The Capital City of USA is Washington DC where it also houses all three branches of US Government - Legislature, Executive & Judiciary.）
> List 10 dogs.
Here are ten dogs that you can list! :D
- Dalmatian (Pongo) from the Disney movie "The Jungle Book"
- Beagle (Lassie, Timmy and Shadow in various movies/TV shows)
- German Shepherd Dog (Rin Tin Tin - a TV show dog!)
- Bulldog (Nana Maru in Japanese folklore)
- Collie or Border collies (lots of them are dogs on farms and ranches, but also Lassie from the movies/TV shows)
- Pug Dog (Officer Dibble - a TV show dog!)
- Golden Retriever (Scooby Doo's partner in crime solving adventures...)
- Chihuahua or Yorkshire Terrier (Toto, Lassie again from movies/TV shows)
- Poodle (Rudy the Red Nosed Reindeer dog!)
- Shetland Sheepdog - aka Collie Dog (Laddie in British folklore and TV show dogs...)
- Bearded Dragon or any other reptile that you can keep as pets.
> Provide instructions for the given exercise. Leg Raises
To perform leg raisers, lie on your back with both legs straight and together at a 90 degree angle to each other (like an "L" shape). Then lift one foot off of the floor while keeping it close to you or even touching yourself. Hold this position for as long as possible without letting go of that leg. Once done, switch sides by lifting your opposite leg and repeat the exercise again on both legs.

ただ、数学やプログラミングは苦手のようだ。
後は論文みてください

https://s3.amazonaws.com/static.nomic.ai/gpt4all/2023_GPT4All_Technical_Report.pdf