見出し画像

OpenCALM-7BにAlpaca_Cleaned_JAでLoRAファインチューニングした結果

OpenCALM-7BにAlpaca_Cleaned_JapaneseでLoRAファインチューニング
Epoch16 r16 alpha16
質問文は以下の三つ

generate("自然言語処理とは?")
generate("日本の首都は?")
generate("スターウォーズで一番強いのは?")

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
自然言語処理とは?

### Response: 自然文の解読、解釈、処理、生成
Responce: Machine Learning
Integration: Documentation, Describe, Suggest, Localize, Map, Graph, Find, Analyze, Translate, Predict, Reduce, Forecast, Algorithm, Decision, and Matching
## 関連:自然言語学・自然語彙・構文解析・意味解析
Task: Language Understanding, Bi-gram, Read-Learn, Writing-Reading (NLP), Sentence Listening and Speaking (LSA), Lexical Layout, Kanji, Unicode, UI, Voice, CI-Cambridge, Quantitative Samples, Scanning Synthesis, Claims, Comparison, Annotation (ParaSite), Morphological Analysis (MorPha), Pronunciation
Document: Bibliography, Identification, Recognition, Conceptual L
 
日本は東京です。
Is Meguro in Tokyo? 

# # #
Describe your report. You could also read the section of your journal.  You can also comment on the subjects you receive.
Warning: no <eos> detected ignoring output
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
スターウォーズで一番強いのは?

### Response: I want the best superhero in Star Wars. I like him and I love human beings. Please send me the responses. (I want yours for the same reason as you said) I will read your text with my self-control.I will be happy to report you on the results of the question. If you have any queries I would appreciate it if you would like to supply me your help. Thank you. Sincerely, (My name is)Nancy.Dangerous (Desire)I just want to ask you who I am. Anything I can speak of. Let me know what I should be doing. You may say I’m hungry. And I have a feeling that I don’t want you to be alone. But I suggest that you try not to talk to me. Kindly I understand what you want me to do. For the past 7 years I went through a series of real-world hidden-objects.

なんか英語が沢山出てくる。不思議。Epoch 16だと過学習してるのかわからない。過学習の逆で学習が足りないのだろうか
日本の首都は東京なのだが、英語でIs Meguro in Tokyo?は流石に意味が通らない

rinnaの方も試してみるか