モデルのマージテスト

alex123bg

2023年7月29日 16:01

動画のマージについて、YouTubeで簡単に解説されいたので、試してみました。動画はこちらです↓

動画にならって、マージ設定します。
元のモデルはこちらです。
モデルA：BrainDance _BD071

モデルB：NewBra beta

A : B = 0.7 : 0.3 でマージします。

しばらくして、モデルがマージされました。

マージ前後で比べてみます。まずマージ前。

medium hair, 1girl, detailed face, detailed body, fashion model posing,
Design an urban park setting, with green spaces, playgrounds, and a sense of community and leisure.
best quality,masterpiece,ultra high res,accent lighting, 8k,
Negative prompt: (worst quality:2), (low quality:2), (normal quality:2),nsfw
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 1660822794, Size: 512x768, Model hash: 2b69964bbc, Model: _BD071, Clip skip: 2, Version: v1.3.2

Time taken: 53.09sTorch active/reserved: 3429/5008 MiB, Sys VRAM: 5269/16273 MiB (32.38%)

マージ後です。

medium hair, 1girl, detailed face, detailed body, fashion model posing,
Design an urban park setting, with green spaces, playgrounds, and a sense of community and leisure.
best quality,masterpiece,ultra high res,accent lighting, 8k,
Negative prompt: (worst quality:2), (low quality:2), (normal quality:2),nsfw
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 1660822794, Size: 512x768, Model hash: 32822033dd, Model: _BD071_NewBratest, Clip skip: 2, Version: v1.3.2

Time taken: 52.94sTorch active/reserved: 3319/4896 MiB, Sys VRAM: 5157/16273 MiB (31.69%)

アップスケールした画像（マージ後モデル）

元の画像 _BD071 が7割なので、こちらの影響が強いようですが、リアルっぽさが出ている画像もあります。

別の組み合わせで試してみます。
_BreakTheDarknessV08ma.safetensors: 0.6
NewBratest.safetensors: 0.4

マージ前（_BreakTheDarknessV08ma）

medium hair, 1girl, detailed face, detailed body, fashion model posing,
Design an urban park setting, with green spaces, playgrounds, and a sense of community and leisure.
best quality,masterpiece,ultra high res,accent lighting, 8k,
Negative prompt: (worst quality:2), (low quality:2), (normal quality:2),nsfw
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 1977235152, Size: 512x768, Model hash: 8ff7fada71, Model: _BreakTheDarknessV08ma, Clip skip: 2, Version: v1.3.2

Time taken: 52.71sTorch active/reserved: 3311/4896 MiB, Sys VRAM: 5147/16273 MiB (31.63%)

マージ後

medium hair, 1girl, detailed face, detailed body, fashion model posing,
Design an urban park setting, with green spaces, playgrounds, and a sense of community and leisure.
best quality,masterpiece,ultra high res,accent lighting, 8k,
Negative prompt: (worst quality:2), (low quality:2), (normal quality:2),nsfw
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 1977235152, Size: 512x768, Model hash: e928c211b7, Model: _BTD08_NewBratest, Clip skip: 2, Version: v1.3.2

Time taken: 51.83sTorch active/reserved: 3330/4914 MiB, Sys VRAM: 5165/16273 MiB (31.74%)

同系統のモデルのため、同様の傾向が見られます。

動画で紹介されていたモデルをマージしてみます。

flat2DAnimerge_v30.safetensors
Paperspaceでは以下のコードでダウンロードしました。

%cd /notebooks/stable-diffusion-webui/models/Stable-diffusion
!wget -nc https://civitai.com/api/download/models/103436 -O flat2DAnimerge_v30.safetensors

これを NewBratest と 0.5 でマージします。

生成画面を比べてみます。
プロンプトや生成条件は同じにします。

flat2DAnimerge

1 slender woman, straight hair, shy smiling,(summer costumes,strapless,pencil skirt:1.1),hair ribbon, lots of lights,(4k,masterpiece,best quality),dutch angle,(simple background:1.1)
Negative prompt: cropped,(worst quality:2),(low quality:2),(normal quality:2),split view, monochrome, grayscale, bad hand, muted arms,fused arms,abs,nsfw,pencil
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 3095593116, Size: 512x768, Model hash: 5dd56bfa12, Model: flat2DAnimerge_v30, Clip skip: 2, Version: v1.3.2

NewBratest

マージモデル　flat2DAnime_NewBratest_05

イラストの実写系とのバランスが難しいです。もうちょい作ってみます。

1 slender woman, straight hair, shy smiling,(summer costumes,strapless,pencil skirt:1.1),hair ribbon,eyeshadow,
lots of lights,(4k,masterpiece,best quality),dutch angle,(simple background:1.1)
Negative prompt: cropped,(worst quality:2),(low quality:2),(normal quality:2),split view, monochrome, grayscale, bad hand, muted arms,fused arms,abs,nsfw,pencil
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 2195548751, Size: 512x768, Model hash: 786e9caa57, Model: flat2DAnime_NewBratest_05, Clip skip: 2, Version: v1.3.2

(masterpiece:1.5, illustration:1.7, ultra-detailed:1.5), girl, 24yo women, nun sit on the bench at public garden, bench, shy, blushing, beautiful, beautiful face, beautiful eyes, detailed eyes, beautiful lips, green eyes, brown hair, short hair, volumetric shadow, volumetric lighting, green ribbon on the hair, green bow tie, green glasses, black outfit, piercing:0.4, tomboy, boyish, face focus, hand cuffs, crowd, long skirt,
Negative prompt: cropped,(worst quality:2),(low quality:2),(normal quality:2),split view, monochrome, grayscale, bad hand, muted arms,fused arms,abs,nsfw,pencil
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 1393651830, Size: 512x768, Model hash: 786e9caa57, Model: flat2DAnime_NewBratest_05, Clip skip: 2, Version: v1.3.2

Photo of a beautiful woman, (masterpiece, best quality,absurdres, Ultra HD, Sharp) exceptional, best aesthetic, natural lighting, instagram [:detailed_face:6],
Negative prompt: bad-hands-5 badartist badpromptversion ng deepnegative_v1_75t shiny skin, multiple girls (worst quality:2), (low quality:2), (normal quality:2), lowres, bad anatomy, bad hands, normal quality,(loli,babyface:1.4), (mutated hands and fingers:1.02), lowres,bad anatomy,bad hands,text,error,missing fingers,extra digit,fewer digits,cropped,worst quality,low quality,normal quality.jpeg

artifacts,signature,watermark,username,blurry,missing arms,long neck,Humpbacked,malformed limbs,more than 2 thighs,text,poorly drawn,more than 2 nipples, more than 1 penis,unclear eyes,poorly drawn hands,mutilated,missing legs,mutated hands and fingers,jpeg artifacts,extra legs,username,low res,limb.jpeg artifacts,poorly drawn face,missing fingers,long body,fused fingers,malformed,multiple breasts,deformed,bad face,worst quality,lowers,bad proportions, poorly drawn,Sleeveless,mutated,error,bad anatomy, Missing limbs,mutation,malformed hands,ugly,worst quality,artist

name,signature,mutation poorly drawn,missing fingers,three legs, fewer digits,mutation,Humpbacked,mutated hands,extra digit,extra arms,long neck,blurry,missing arms,too many fingers,bad hands,duplicate,watermark,mutated hands and fingers,malformed mutated, bad feet,cropped,fused anus,missing limb,extra digit,three arms,text font ui,normal quality,morbid,out of frame,disfigured,worst quality,bad anatomy disfigured malformed mutated,transexual,low quality,extra limbs, Painting Frame, duplicates, repeated, repetitive, patterns, pattern, duplicated, multiple images, side by side, more than 1 image, feet EasyNegative young, loli, teen, child, sketches, lowres, normal quality, (worst quality:2), (low quality:2), (normal quality:2), badhands.jpeg artifacts, fuzzy, blurry, sketch, low details, Ugly, horrendous, weird, disgusting
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 2249030381, Size: 512x768, Model hash: 786e9caa57, Model: flat2DAnime_NewBratest_05, Clip skip: 2, Version: v1.3.2

Illustration of a beautiful woman, (masterpiece, best quality,absurdres, Ultra HD, Sharp) exceptional, best aesthetic, natural lighting, instagram [:detailed_face:6],
Negative prompt: bad-hands-5 badartist badpromptversion ng deepnegative_v1_75t shiny skin, multiple girls (worst quality:2), (low quality:2), (normal quality:2), lowres, bad anatomy, bad hands, normal quality,(loli,babyface:1.4), (mutated hands and fingers:1.02), lowres,bad anatomy,bad hands,text,error,missing fingers,extra digit,fewer digits,cropped,worst quality,low quality,normal quality.jpeg

artifacts,signature,watermark,username,blurry,missing arms,long neck,Humpbacked,malformed limbs,more than 2 thighs,text,poorly drawn,more than 2 nipples, more than 1 penis,unclear eyes,poorly drawn hands,mutilated,missing legs,mutated hands and fingers,jpeg artifacts,extra legs,username,low res,limb.jpeg artifacts,poorly drawn face,missing fingers,long body,fused fingers,malformed,multiple breasts,deformed,bad face,worst quality,lowers,bad proportions, poorly drawn,Sleeveless,mutated,error,bad anatomy, Missing limbs,mutation,malformed hands,ugly,worst quality,artist

name,signature,mutation poorly drawn,missing fingers,three legs, fewer digits,mutation,Humpbacked,mutated hands,extra digit,extra arms,long neck,blurry,missing arms,too many fingers,bad hands,duplicate,watermark,mutated hands and fingers,malformed mutated, bad feet,cropped,fused anus,missing limb,extra digit,three arms,text font ui,normal quality,morbid,out of frame,disfigured,worst quality,bad anatomy disfigured malformed mutated,transexual,low quality,extra limbs, Painting Frame, duplicates, repeated, repetitive, patterns, pattern, duplicated, multiple images, side by side, more than 1 image, feet EasyNegative young, loli, teen, child, sketches, lowres, normal quality, (worst quality:2), (low quality:2), (normal quality:2), badhands.jpeg artifacts, fuzzy, blurry, sketch, low details, Ugly, horrendous, weird, disgusting
Steps: 20, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 3656281004, Size: 512x768, Model hash: 786e9caa57, Model: flat2DAnime_NewBratest_05, Clip skip: 2, Version: v1.3.2