見出し画像

普段手描きでマンガを描いている一般人男性が、LongWriterとClaude3.5Sonnetと画像生成でAIマンガを作る話

こんなAIマンガができました✍️

クソデカコンテクストを出力できるLongWriterと、Claude3.5Sonnetを使ってAIマンガを作る実験を行いました。
手描きでマンガを描いたことが無い人が、生成AIだけでAIマンガを作る、という想定で実験しています。

今回やったこと

  • LongWriterを使ってストーリーを生成

  • Clade3.5Sonnetを使って、翻訳+シナリオ形式に変換

  • Clade3.5Sonnetを使って、キャラクター設定を生成

  • Clade3.5Sonnetを使って、各シーンの演出(画像生成用のプロンプト)を生成

  • DALL-E3とniji・journeyを使って、各シーンの画像を生成

  • Googleスライドを使って、ネームを作成

  • Googleスライドを使って、マンガ原稿の作成

今回やらなかったこと

  • AIの出力を吟味したり修正すること

  • 画像生成のスタイルを統一すること

  • 生成された画像の加工

完成したAIマンガ

The Visionary Knight-1
The Visionary Knight-2
The Visionary Knight-3
The Visionary Knight-4
The Visionary Knight-5

制作noteを記していきます。


(前回のAIマンガ制作note)

LongWriterを使ってストーリー(英語)を生成する

shi3zさんが紹介されていたLongWiterを使って、マンガのストーリーを生成してみます。

HuggingFaceにデモがあったので、とりあえずそれで動かしてみます。


HuggingFace上で動作するLongWriterのデモ画面

Set Prompt

あなたは優秀な文筆家です。入力されたテキストを抽象的に解釈して、1万字の物語を英語で書いてください。

Prompt

- 下記の人物を主人公とした物語を書いてください
- 空間に描いたものを具現化する能力を持ち、古代の哲学者や偉大な宗教家と会話することができる、好奇心旺盛で何にでも首を突っ込んでトラブルに巻き込まれる、異能力者を取り締まる政府の機関のエージェントの女性

入力すると、少し待ったあとスラスラと英文が出力されます。
入力は日本語でできますが、出力は英語を指定した方が安定する感じがします。
エラーが出て出力が途中で切れてしまったのですが、その一部を使ってAIマンガを仕上げるところまでやってみます。

出力(一部)

Title: The Visionary Vigilante

In a world where the boundaries of reality and imagination blurred, there existed a government agency dedicated to maintaining the balance between the extraordinary and the mundane. This agency, known only to a select few, employed individuals with unique abilities to monitor and regulate those who possessed extraordinary powers. Among these agents was a woman named Elara, a curious and inquisitive individual with a knack for getting herself into trouble.

Elara had the extraordinary ability to visualize and manifest objects and ideas from her mind into the physical world. This gift, however, came with a price. It allowed her to have profound conversations with ancient philosophers and great religious leaders, but it also made her a target for those who sought to exploit her powers for their gain.

As an agent of the government, Elara's primary responsibility was to track and apprehend individuals with abilities like hers, ensuring they did not pose a threat to society. However, her own powers often led her down a path of unintended adventures and conflicts.

One fateful day, Elara received a mysterious message, a letter written in an ancient script she had once studied. The letter claimed to contain the secrets of a long-lost civilization, one that possessed knowledge far beyond the understanding of modern science. Intrigued by the prospect of uncovering such a treasure, Elara decided to investigate.

As she delved deeper into the mystery, Elara found herself crossing paths with a group of individuals who also sought the secrets of the ancient civilization. Among them was a charismatic leader named Aric, who claimed to be the rightful heir to the lost city's legacy. Elara couldn't help but be drawn to Aric's charm and passion, but she also couldn't ignore the warning signs that suggested he might have ulterior motives.

Determined to uncover the truth, Elara used her abilities to visualize and manifest the ancient city, bringing it to life in her mind. Through her vision, she discovered that the city held a powerful artifact capable of altering the very fabric of reality. Aric, it seemed, had been after this artifact all along, believing it could grant him unimaginable power.

As Elara and Aric's paths continued to intertwine, she found herself questioning her own loyalties. Could she really trust her instincts and intuition, or was she destined to be drawn into the web of deception and danger that surrounded the ancient city?

In a climactic battle, Elara and Aric faced off, each wielding their powers to the limit. In the end, it was Elara's unwavering determination and courage that prevailed. She managed to secure the artifact and prevent it from falling into the wrong hands, but not without sacrificing her own sense of identity and purpose.

As the dust settled, Elara realized that her journey was far from over. She had uncovered a truth that would forever change her life, and she knew that she would have to continue to navigate the delicate balance between the extraordinary and the mundane, using her gifts to protect those who couldn't protect themselves.

And so, the story of the visionary vigilante, Elara, continued, as she embarked on a new chapter of her extraordinary life, ready to face whatever challenges lay ahead.

LongWriter

修正せずにこのまま使います。

LongWriterについては、npaka大先生のnoteにGoogle Colabで動かす方法が書いてあるので、次回はそちらを試してみようと思います。


Clade3.5Sonnetを使って、翻訳+シナリオ形式に変換する

LongWriterの出力の翻訳は、Claude3.5Sonnetを使いました。
こちらもshi3zさんのアイデア。
ついでに脚本形式に修正してもらいました。

入力

下記のテキストを、翻訳して脚本形式の日本語で記してくだださい。
一つのシーンは4-5個のセリフで構成し、出来事、主人公の感情、主人公の行動がよく表現されたものにしてください。
状況説明説明や演出は、ト書きの形で記してください。

(上記の出力をコピペ)

出力

はい、承知いたしました。脚本形式の日本語で、指定された形式に沿って翻訳いたします。

タイトル: 『幻視の騎士』

第1幕

(現代と幻想が入り混じる世界。政府機関のオフィス内部)
エララ: (困惑した表情で) 「また変な任務か...超能力者を追跡だって?」
上司: 「君の能力が必要なんだ。危険な奴らを見つけ出して欲しい」
エララ: (ため息をつきながら) 「分かったわ。でも、私自身もターゲットになる可能性があるのよね」
上司: 「だからこそ、君が最適任なんだ。気をつけろよ」
(エララは不安そうな表情で、オフィスを後にする)

第2幕

(エララの自宅。彼女は古い手紙を手に取っている)
エララ: (興奮した様子で) 「この文字...昔勉強した古代文字だわ!」
(手紙を読み進めるエララ。目が輝いている)
エララ: 「失われた文明の秘密...?これは調査する価値があるわ!」
(エララは目を閉じ、手紙の内容を頭の中で視覚化し始める)
エララ: (目を開けながら) 「よし、行動開始ね。この謎を解き明かすわ」

第3幕

(古代都市の遺跡。エララとアリックが対峙している)
アリック: (魅力的な笑みを浮かべながら) 「エララ、君の能力は素晴らしい。一緒に働かないか?」
エララ: (警戒しながらも、少し心惹かれている様子で) 「あなたの目的は何なの?本当のことを言って」
アリック: 「この都市の遺産を受け継ぐことさ。世界を変える力を手に入れるんだ」
エララ: (動揺しながら) 「それは...危険すぎるわ。そんなことはさせられない!」
(二人の間に緊張が走る)

第4幕

(古代都市の中心部。エララとアリックが激しく戦っている)
エララ: (力を振り絞りながら) 「この力を悪用させるわけにはいかない!」
アリック: (怒りに満ちた表情で) 「邪魔をするな!この力は俺のものだ!」
(エララは目を閉じ、全身に光が満ちていく)
エララ: (決意に満ちた声で) 「これで終わりよ、アリック!」
(まばゆい光が辺りを包み、アリックの姿が消える)

第5幕

(静かになった古代都市。エララは疲れ果てた様子で立っている)
エララ: (artifacts(遺物)を見つめながら) 「これで世界は安全になったわ...でも、私は変わってしまった」
(彼女の周りに、幻のように古代都市の姿が浮かび上がる)
エララ: (決意を新たにする表情で) 「新しい冒険が始まるのね。私にしかできないことがあるはず」
(エララは街へと歩み出す。彼女の背後で、古代都市の幻影が静かに消えていく)

Claude3.5Sonnet

修正せずにこのまま使います。


Clade3.5Sonnetを使って、キャラクター設定を生成する

画像生成するときにキャラクターの造形を安定させるため、登場人物の設定を作っておきます。
上記のシナリオをそのまま使って、各キャラクターの設定をClaude3.5Sonnetに考えてもらいました。

入力

下記のシナリオの登場人物を、視覚から情報を得ることが難しい人のために視覚的特徴、能力、性質を英語で詳細に説明してください。

(上記の出力をコピペ)

出力

Certainly. I'll provide detailed descriptions of the main characters in English, focusing on their visual characteristics, abilities, and personalities.

1. Elara:
Visual characteristics:
- A woman in her late 20s or early 30s
- Medium height with an athletic build
- Long, wavy hair often tied back in a practical ponytail
- Expressive eyes that change color slightly with her moods
- Typically wears practical, professional clothing suitable for fieldwork

Abilities:

- Can visualize and manifest objects and ideas from her mind into the physical world
- Able to have conversations with historical figures and religious leaders in her mind
- Skilled in deciphering ancient scripts and languages

Personality:

- Curious and inquisitive
- Often conflicted between her duty and her personal beliefs
- Brave and determined, willing to face dangerous situations
- Empathetic, which sometimes leads her to question her missions
- Intelligent and quick-thinking, able to adapt to new situations rapidly
1. The Boss:
Visual characteristics:
- A man in his 50s or 60s
- Tall with a commanding presence
- Short, graying hair and a well-trimmed beard
- Often seen in formal business attire, typically dark suits
- Has a stern expression most of the time

Abilities:

- No supernatural abilities mentioned, but likely has extensive knowledge of the agency and its operations
- Skilled in managing and directing agents with extraordinary abilities

Personality:

- Authoritative and decisive
- Prioritizes the agency's mission above all else
- Shows concern for his agents' well-being, but remains professionally detached
- Pragmatic in his approach to solving problems
1. Aric:
Visual characteristics:
- A man in his mid-30s
- Tall and well-built with an air of confidence
- Striking features with piercing eyes
- Usually dressed in stylish, expensive clothing that hints at his ambition

Abilities:

- Not explicitly stated, but likely possesses some form of supernatural ability
- Highly charismatic and persuasive
- Knowledgeable about ancient civilizations and their artifacts

Personality:

- Charismatic and passionate about his goals
- Ambitious, seeking power and control
- Manipulative, using his charm to influence others
- Determined and ruthless in pursuit of his objectives
- Possibly believes his actions are justified for a greater purpose

These character descriptions provide a comprehensive understanding of the main figures in the story, their appearances, abilities, and personalities, catering to those who may have difficulty obtaining visual information.

Claude3.5Sonnet

修正せずにこのまま使います。


Clade3.5Sonnetを使って、各シーンの演出(画像生成用のプロンプト)を生成する

LongWiter+Claude3.5Sonnetの出力は、第1幕〜第5幕までの5つのシーンで構成されているので、5ページのマンガになる想定で、Claude3.5Sonnetに各シーンごとに画像生成用のプロンプトを作ってもらいます。

入力

下記のシナリオの第1幕を、視覚から情報を得ることが難しい人のためにセリフごとに区分して状況と演出を英語で詳細に説明してください。
セリフは含めないでください。
登場人物についての説明も考慮してください。

タイトル: 『幻視の騎士』

第1幕

(現代と幻想が入り混じる世界。政府機関のオフィス内部)
エララ: (困惑した表情で) 「また変な任務か...超能力者を追跡だって?」
上司: 「君の能力が必要なんだ。危険な奴らを見つけ出して欲しい」
エララ: (ため息をつきながら) 「分かったわ。でも、私自身もターゲットになる可能性があるのよね」
上司: 「だからこそ、君が最適任なんだ。気をつけろよ」
(エララは不安そうな表情で、オフィスを後にする)

第2幕

(エララの自宅。彼女は古い手紙を手に取っている)
エララ: (興奮した様子で) 「この文字...昔勉強した古代文字だわ!」
(手紙を読み進めるエララ。目が輝いている)
エララ: 「失われた文明の秘密...?これは調査する価値があるわ!」
(エララは目を閉じ、手紙の内容を頭の中で視覚化し始める)
エララ: (目を開けながら) 「よし、行動開始ね。この謎を解き明かすわ」

第3幕

(古代都市の遺跡。エララとアリックが対峙している)
アリック: (魅力的な笑みを浮かべながら) 「エララ、君の能力は素晴らしい。一緒に働かないか?」
エララ: (警戒しながらも、少し心惹かれている様子で) 「あなたの目的は何なの?本当のことを言って」
アリック: 「この都市の遺産を受け継ぐことさ。世界を変える力を手に入れるんだ」
エララ: (動揺しながら) 「それは...危険すぎるわ。そんなことはさせられない!」

(二人の間に緊張が走る)

第4幕

(古代都市の中心部。エララとアリックが激しく戦っている)
エララ: (力を振り絞りながら) 「この力を悪用させるわけにはいかない!」
アリック: (怒りに満ちた表情で) 「邪魔をするな!この力は俺のものだ!」
(エララは目を閉じ、全身に光が満ちていく)
エララ: (決意に満ちた声で) 「これで終わりよ、アリック!」
(まばゆい光が辺りを包み、アリックの姿が消える)

第5幕

(静かになった古代都市。エララは疲れ果てた様子で立っている)
エララ: (artifacts(遺物)を見つめながら) 「これで世界は安全になったわ...でも、私は変わってしまった」
(彼女の周りに、幻のように古代都市の姿が浮かび上がる)
エララ: (決意を新たにする表情で) 「新しい冒険が始まるのね。私にしかできないことがあるはず」
(エララは街へと歩み出す。彼女の背後で、古代都市の幻影が静かに消えていく)

Certainly. I'll provide detailed descriptions of the main characters in English, focusing on their visual characteristics, abilities, and personalities.

1. Elara:
Visual characteristics:
- A woman in her late 20s or early 30s
- Medium height with an athletic build
- Long, wavy hair often tied back in a practical ponytail
- Expressive eyes that change color slightly with her moods
- Typically wears practical, professional clothing suitable for fieldwork

Abilities:

- Can visualize and manifest objects and ideas from her mind into the physical world
- Able to have conversations with historical figures and religious leaders in her mind
- Skilled in deciphering ancient scripts and languages

Personality:

- Curious and inquisitive
- Often conflicted between her duty and her personal beliefs
- Brave and determined, willing to face dangerous situations
- Empathetic, which sometimes leads her to question her missions
- Intelligent and quick-thinking, able to adapt to new situations rapidly

1. The Boss:
Visual characteristics:
- A man in his 50s or 60s
- Tall with a commanding presence
- Short, graying hair and a well-trimmed beard
- Often seen in formal business attire, typically dark suits
- Has a stern expression most of the time

Abilities:

- No supernatural abilities mentioned, but likely has extensive knowledge of the agency and its operations
- Skilled in managing and directing agents with extraordinary abilities

Personality:

- Authoritative and decisive
- Prioritizes the agency's mission above all else
- Shows concern for his agents' well-being, but remains professionally detached
- Pragmatic in his approach to solving problems
1. Aric:
Visual characteristics:
- A man in his mid-30s
- Tall and well-built with an air of confidence
- Striking features with piercing eyes
- Usually dressed in stylish, expensive clothing that hints at his ambition

Abilities:

- Not explicitly stated, but likely possesses some form of supernatural ability
- Highly charismatic and persuasive
- Knowledgeable about ancient civilizations and their artifacts

Personality:

- Charismatic and passionate about his goals
- Ambitious, seeking power and control
- Manipulative, using his charm to influence others
- Determined and ruthless in pursuit of his objectives
- Possibly believes his actions are justified for a greater purpose

出力

Title: "The Visionary Knight"

Act 1:

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 1: Elara's face contorts into a confused expression. Her eyebrows furrow, and her lips purse slightly as she speaks. Her body language suggests discomfort and uncertainty about the situation.

Action 2: The boss, a tall man in his 50s or 60s with short, graying hair and a well-trimmed beard, leans forward in his chair. His stern face softens slightly as he explains the situation. He's wearing a dark, formal suit that emphasizes his authoritative presence.

Action 3: Elara sighs deeply, her shoulders slumping slightly. She runs a hand through her hair, a gesture of resignation and concern. Her eyes dart around the room, reflecting her inner turmoil about the potential dangers of the mission.

Action 4: The boss nods solemnly, his expression a mix of understanding and determination. He leans back in his chair, his posture conveying confidence in his decision and trust in Elara's abilities.

Final Action: Elara turns to leave the office, her face etched with worry. Her steps are slow and hesitant as she walks towards the door. As she reaches for the handle, she pauses for a moment, her body tense with anxiety about the mission ahead. The boss watches her leave, his face returning to its usual stern expression.

This scene establishes the unique world setting, introduces Elara as a character with special abilities working for a government agency, and sets up the conflict and danger she faces in her line of work. The interaction between Elara and her boss highlights the tension between duty and personal safety, as well as the trust and expectations placed on Elara due to her unique abilities.

Cluaude3.5Sonnet

第1幕の舞台設定(Setting)、キャラクターの説明(Character Introduction)、5つのアクション(Action 1〜Final Action)という構成で出力してくれています。
これを元に、画像生成用のプロンプトを作ります。

5つのアクションそれぞれに舞台設定とキャラクターの説明があった方がよいので…

  • Setting

  • Character Introduction

  • Action

という形式に整理します。

Action1

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 1: Elara's face contorts into a confused expression. Her eyebrows furrow, and her lips purse slightly as she speaks. Her body language suggests discomfort and uncertainty about the situation.

Action 2

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 2: The boss, a tall man in his 50s or 60s with short, graying hair and a well-trimmed beard, leans forward in his chair. His stern face softens slightly as he explains the situation. He's wearing a dark, formal suit that emphasizes his authoritative presence.

Action 3

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 3: Elara sighs deeply, her shoulders slumping slightly. She runs a hand through her hair, a gesture of resignation and concern. Her eyes dart around the room, reflecting her inner turmoil about the potential dangers of the mission.

Action 4

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 4: The boss nods solemnly, his expression a mix of understanding and determination. He leans back in his chair, his posture conveying confidence in his decision and trust in Elara's abilities.

Final Action

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Final Action: Elara turns to leave the office, her face etched with worry. Her steps are slow and hesitant as she walks towards the door. As she reaches for the handle, she pauses for a moment, her body tense with anxiety about the mission ahead. The boss watches her leave, his face returning to its usual stern expression.

第2幕〜第5幕も同じことを行なって、各ページ各コマの画像生成用のプロンプトを用意します。


DALL-E3とniji・journeyを使って、画像を生成する

上記で作ったプロンプトを使って、画像を生成していきます。

通常、マンガを作る場合は、先にネームを描いて、ページ内のコマ割り、吹き出し(セリフ)の位置、作画の構図を一緒に考えます。
ネームは、ストーリー全体の緩急や各ページの視線誘導の設計図になるので、本来は先に考えておかないといけないし、ネーム上で設計した構図やカメラアングルを画像生成用のプロンプトに反映した方がクオリティは上がると思うのですが、今回は手描きでマンガを描いたことが無い人が生成AIのみでAIマンガを描く、ということを想定して、手描きのプロセスを排除し、いきなり画像を生成してしまいます。

画像の生成は、DALL-E3(ChatGPT上)と、niji・journeyを使いました。
出力は吟味せずに、最初に出てきた画像をそのまま候補にして、1つのコマに対して5つの候補画像がある状態にしました。
また、各ページ5つのプロンプトが生成されていますが、各ページのコマ数は4〜5コマにしたので、画像の候補数としては余裕がある状態にします。

以下、各幕のClaude3.5Sonnetの出力したシナリオ、プロンプト、DALL-E3の出力、niji・journeyの出力、の順番で列挙します。
niji・journeyのパラメーターは出力ごとに調整しているので、全体としてはばらつきがありますが、各コマごとに複数回は出力していません。

画像生成し始めてから、画像生成のスタイルを明示的に指定したらよかった、と思ったんですが、キャラクターの造形がある程度安定していたので、一旦そのまま仕上げることにしました。


第1幕

第1幕
(現代と幻想が入り混じる世界。政府機関のオフィス内部)
エララ: (困惑した表情で) 「また変な任務か...超能力者を追跡だって?」
上司: 「君の能力が必要なんだ。危険な奴らを見つけ出して欲しい」
エララ: (ため息をつきながら) 「分かったわ。でも、私自身もターゲットになる可能性があるのよね」
上司: 「だからこそ、君が最適任なんだ。気をつけろよ」
(エララは不安そうな表情で、オフィスを後にする)

Claude3.5Sonnet

第1幕-1

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 1: Elara's face contorts into a confused expression. Her eyebrows furrow, and her lips purse slightly as she speaks. Her body language suggests discomfort and uncertainty about the situation.
第1幕-1、DALL-E3の出力
第1幕-1、niji・journeyの出力

第1幕-2

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 2: The boss, a tall man in his 50s or 60s with short, graying hair and a well-trimmed beard, leans forward in his chair. His stern face softens slightly as he explains the situation. He's wearing a dark, formal suit that emphasizes his authoritative presence.
第1幕-2、DALL-E3の出力
第1幕-2、niji・journeyの出力

第1幕-3

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 3: Elara sighs deeply, her shoulders slumping slightly. She runs a hand through her hair, a gesture of resignation and concern. Her eyes dart around the room, reflecting her inner turmoil about the potential dangers of the mission.
第1幕-3、DALL-E3の出力
第1幕-3、niji・journeyの出力

第1幕-4

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Action 4: The boss nods solemnly, his expression a mix of understanding and determination. He leans back in his chair, his posture conveying confidence in his decision and trust in Elara's abilities.
第1幕-4、DALL-E3の出力
第1幕-4、niji・journeyの出力

第1幕-5

Setting: The scene opens in a modern government agency office with a blend of contemporary and fantastical elements. The room is spacious, filled with a mix of high-tech equipment and traditional office furniture. The atmosphere is tense and slightly mysterious.

Character Introduction: Elara, a woman in her late 20s or early 30s with an athletic build and long, wavy hair tied back in a ponytail, stands in front of her boss's desk. She's wearing practical, professional clothing suitable for fieldwork. Her expressive eyes reflect her conflicted emotions.

Final Action: Elara turns to leave the office, her face etched with worry. Her steps are slow and hesitant as she walks towards the door. As she reaches for the handle, she pauses for a moment, her body tense with anxiety about the mission ahead. The boss watches her leave, his face returning to its usual stern expression.
第1幕-5、DALL-E3の出力
第1幕-5、niji・journeyの出力

第2幕

(エララの自宅。彼女は古い手紙を手に取っている)
エララ: (興奮した様子で) 「この文字...昔勉強した古代文字だわ!」
(手紙を読み進めるエララ。目が輝いている)
エララ: 「失われた文明の秘密...?これは調査する価値があるわ!」
(エララは目を閉じ、手紙の内容を頭の中で視覚化し始める)
エララ: (目を開けながら) 「よし、行動開始ね。この謎を解き明かすわ

Claude3.5Sonnet

第2幕-1

Setting: The scene transitions to Elara's home. It's a cozy, lived-in space that reflects her personality - a mix of modern comfort and ancient artifacts. Soft lighting fills the room, creating a warm atmosphere.

Character Focus: Elara is alone in this scene, allowing us to see her in a more relaxed, personal environment. She's changed from her work attire into more comfortable clothing, her long wavy hair now loose around her shoulders.

Action 1: Elara picks up an old, weathered letter from her desk. Her fingers trace the edges of the paper delicately. Her body language shifts from relaxed to alert as she recognizes something familiar about the letter.
第2幕-1、DALL-E3の出力
第2幕-1、niji・journeyの出力

第2幕-2

Setting: The scene transitions to Elara's home. It's a cozy, lived-in space that reflects her personality - a mix of modern comfort and ancient artifacts. Soft lighting fills the room, creating a warm atmosphere.

Character Focus: Elara is alone in this scene, allowing us to see her in a more relaxed, personal environment. She's changed from her work attire into more comfortable clothing, her long wavy hair now loose around her shoulders.

Action 2: Elara's eyes widen with excitement. She leans in closer to the letter, her face illuminated by a nearby lamp. Her lips move silently as she reads, her expression growing more animated with each passing moment.
第2幕-2、DALL-E3の出力
第2幕-2、niji・journeyの出力

第2幕-3

Setting: The scene transitions to Elara's home. It's a cozy, lived-in space that reflects her personality - a mix of modern comfort and ancient artifacts. Soft lighting fills the room, creating a warm atmosphere.

Character Focus: Elara is alone in this scene, allowing us to see her in a more relaxed, personal environment. She's changed from her work attire into more comfortable clothing, her long wavy hair now loose around her shoulders.

Action 3: As Elara continues reading, her eyes begin to sparkle with interest and curiosity. She straightens up, holding the letter closer to the light. Her free hand gesticulates slightly, as if she's processing the information physically as well as mentally.
第2幕-3、DALL-E3の出力
第2幕-3、niji・journeyの出力

第2幕-4

Setting: The scene transitions to Elara's home. It's a cozy, lived-in space that reflects her personality - a mix of modern comfort and ancient artifacts. Soft lighting fills the room, creating a warm atmosphere.

Character Focus: Elara is alone in this scene, allowing us to see her in a more relaxed, personal environment. She's changed from her work attire into more comfortable clothing, her long wavy hair now loose around her shoulders.

Action 4: Elara closes her eyes, her face relaxing into deep concentration. The room seems to fade away as she focuses intently. This is a visual representation of her unique ability to visualize and manifest ideas in her mind.
第2幕-4、DALL-E3の出力
第2幕-4、niji・journeyの出力

第2幕-5

Setting: The scene transitions to Elara's home. It's a cozy, lived-in space that reflects her personality - a mix of modern comfort and ancient artifacts. Soft lighting fills the room, creating a warm atmosphere.

Character Focus: Elara is alone in this scene, allowing us to see her in a more relaxed, personal environment. She's changed from her work attire into more comfortable clothing, her long wavy hair now loose around her shoulders.

Action 5: Elara's eyes snap open, filled with determination and a hint of adventure. She sets the letter down on the desk with purpose and begins to move around the room, gathering items she might need for her investigation. Her movements are quick and decisive, showcasing her readiness for action.
第2幕-5、DALL-E3の出力
第2幕-5、niji・journeyの出力

第3幕

(古代都市の遺跡。エララとアリックが対峙している)
アリック: (魅力的な笑みを浮かべながら) 「エララ、君の能力は素晴らしい。一緒に働かないか?」
エララ: (警戒しながらも、少し心惹かれている様子で) 「あなたの目的は何なの?本当のことを言って」
アリック: 「この都市の遺産を受け継ぐことさ。世界を変える力を手に入れるんだ」
エララ: (動揺しながら) 「それは...危険すぎるわ。そんなことはさせられない!」
(二人の間に緊張が走る)

Claude3.5Sonnet

第3幕-1

Setting: The scene shifts dramatically to the ruins of an ancient city. Crumbling stone structures, weathered by time, surround Elara and Aric. The air is thick with dust and an otherworldly energy, creating a tense atmosphere.

Character Introduction: Aric appears for the first time. He's a tall, well-built man in his mid-30s with striking features and piercing eyes. His stylish, expensive clothing contrasts sharply with the ruined surroundings, hinting at his ambition and confidence.

Action 1: Aric approaches Elara with a charismatic smile. His body language is open and inviting, but there's an underlying tension in his stance. He extends his hand towards Elara in a gesture of partnership.
第3幕-1、DALL-E3の出力
第3幕-1、niji・journeyの出力

第3幕-2

誤って飛ばしました。

第3幕-3

Setting: The scene shifts dramatically to the ruins of an ancient city. Crumbling stone structures, weathered by time, surround Elara and Aric. The air is thick with dust and an otherworldly energy, creating a tense atmosphere.

Character Introduction: Aric appears for the first time. He's a tall, well-built man in his mid-30s with striking features and piercing eyes. His stylish, expensive clothing contrasts sharply with the ruined surroundings, hinting at his ambition and confidence.

Action 3: Aric's smile widens as he speaks, his eyes gleaming with passion and ambition. He gestures grandly at the ruins around them, his movements fluid and captivating. His charisma is palpable, filling the space between them.
第3幕-3、DALL-E3の出力
第3幕-3、niji・journeyの出力

第3幕-4

Setting: The scene shifts dramatically to the ruins of an ancient city. Crumbling stone structures, weathered by time, surround Elara and Aric. The air is thick with dust and an otherworldly energy, creating a tense atmosphere.

Character Introduction: Aric appears for the first time. He's a tall, well-built man in his mid-30s with striking features and piercing eyes. His stylish, expensive clothing contrasts sharply with the ruined surroundings, hinting at his ambition and confidence.

Action 4: Elara's expression shifts from cautious interest to shock and concern. Her body tenses, and she takes a small step back. Her hands clench at her sides, revealing her inner turmoil and the conflict between her curiosity and her sense of duty.
第3幕-4、DALL-E3の出力
第3幕-4、niji・journeyの出力

第3幕-5

Setting: The scene shifts dramatically to the ruins of an ancient city. Crumbling stone structures, weathered by time, surround Elara and Aric. The air is thick with dust and an otherworldly energy, creating a tense atmosphere.

Character Introduction: Aric appears for the first time. He's a tall, well-built man in his mid-30s with striking features and piercing eyes. His stylish, expensive clothing contrasts sharply with the ruined surroundings, hinting at his ambition and confidence.

Final Action: The atmosphere becomes charged with tension. Elara and Aric stand facing each other, their stances mirroring their opposing views. The ruins around them seem to pulse with energy, reflecting the intensity of their confrontation. Elara's eyes dart around, assessing potential escape routes, while Aric's gaze remains fixed on her, his smile now tinged with a hint of danger.
第3幕-5、DALL-E3の出力
第3幕-5、niji・journeyの出力

第4幕

(古代都市の中心部。エララとアリックが激しく戦っている)
エララ: (力を振り絞りながら) 「この力を悪用させるわけにはいかない!」
アリック: (怒りに満ちた表情で) 「邪魔をするな!この力は俺のものだ!」
(エララは目を閉じ、全身に光が満ちていく)
エララ: (決意に満ちた声で) 「これで終わりよ、アリック!」
(まばゆい光が辺りを包み、アリックの姿が消える)

Claude3.5Sonnet

第4幕-1

Setting: The scene shifts to the heart of the ancient city. The surroundings are filled with crumbling structures and mysterious artifacts, pulsing with an otherworldly energy. The air is thick with tension and the remnants of a bygone era.

Character Focus: Elara and Aric are engaged in an intense confrontation. Their appearances show signs of their struggle - Elara's practical clothing is disheveled, while Aric's stylish attire is rumpled and torn in places.

Action 1: Elara stands in a defensive stance, her body taut with tension. Her eyes are fierce and determined, her hair partially loose from its ponytail. She's visibly straining, suggesting she's using her powers to their limit.
第4幕-1、DALL-E3の出力
第4幕-1、niji・journeyの出力

第4幕-2

Setting: The scene shifts to the heart of the ancient city. The surroundings are filled with crumbling structures and mysterious artifacts, pulsing with an otherworldly energy. The air is thick with tension and the remnants of a bygone era.

Character Focus: Elara and Aric are engaged in an intense confrontation. Their appearances show signs of their struggle - Elara's practical clothing is disheveled, while Aric's stylish attire is rumpled and torn in places.

Action 2: Aric's formerly charming demeanor has transformed into one of rage. His face is contorted with anger, his eyes blazing with fury. His body language is aggressive, leaning forward as if ready to pounce.
第4幕-2、DALL-E3の出力
第4幕-2、niji・journeyの出力

第4幕-3

Setting: The scene shifts to the heart of the ancient city. The surroundings are filled with crumbling structures and mysterious artifacts, pulsing with an otherworldly energy. The air is thick with tension and the remnants of a bygone era.

Character Focus: Elara and Aric are engaged in an intense confrontation. Their appearances show signs of their struggle - Elara's practical clothing is disheveled, while Aric's stylish attire is rumpled and torn in places.

Action 3: Elara closes her eyes, her face a mask of intense concentration. A soft glow begins to emanate from her body, gradually intensifying. The air around her seems to shimmer and distort, hinting at the manifestation of her powers.
第4幕-3、DALL-E3の出力
第4幕-3、niji・journeyの出力

第4幕-4

Setting: The scene shifts to the heart of the ancient city. The surroundings are filled with crumbling structures and mysterious artifacts, pulsing with an otherworldly energy. The air is thick with tension and the remnants of a bygone era.

Character Focus: Elara and Aric are engaged in an intense confrontation. Their appearances show signs of their struggle - Elara's practical clothing is disheveled, while Aric's stylish attire is rumpled and torn in places.

Action 4: The glow surrounding Elara reaches its peak intensity. Her eyes snap open, filled with resolve. Her stance shifts from defensive to offensive, her entire being radiating power and determination.
第4幕-4、DALL-E3の出力
第4幕-4、niji・journeyの出力

第4幕-5

Setting: The scene shifts to the heart of the ancient city. The surroundings are filled with crumbling structures and mysterious artifacts, pulsing with an otherworldly energy. The air is thick with tension and the remnants of a bygone era.

Character Focus: Elara and Aric are engaged in an intense confrontation. Their appearances show signs of their struggle - Elara's practical clothing is disheveled, while Aric's stylish attire is rumpled and torn in places.

Final Action: A blinding light erupts from Elara, engulfing the entire area. The light is so intense that it obscures everything from view. As the light begins to fade, Aric is nowhere to be seen, having vanished in the aftermath of Elara's power display.
第4幕-5、DALL-E3の出力
第4幕-5、niji・journeyの出力

第5幕

(静かになった古代都市。エララは疲れ果てた様子で立っている)
エララ: (artifacts(遺物)を見つめながら) 「これで世界は安全になったわ...でも、私は変わってしまった」
(彼女の周りに、幻のように古代都市の姿が浮かび上がる)
エララ: (決意を新たにする表情で) 「新しい冒険が始まるのね。私にしかできないことがあるはず」
(エララは街へと歩み出す。彼女の背後で、古代都市の幻影が静かに消えていく)

Claude3.5Sonnet

第5幕-1

Setting: The ancient city has fallen silent after the intense battle. The ruins stand still, bathed in an ethereal, post-conflict glow. The air is thick with dust and residual energy from the recent supernatural clash.

Character Focus: Elara stands alone amidst the ruins, her appearance reflecting the toll of the battle. Her clothes are disheveled, her hair loose and windswept. Despite her physical exhaustion, her eyes remain alert and thoughtful.

Action 1: Elara stands in the center of the ruins, her posture slumped with fatigue. Her gaze is fixed on the artifacts scattered around her, remnants of the power she and Aric fought over. Her expression is a mixture of relief and contemplation.
第5幕-1、DALL-E3の出力
第5幕-1、niji・journeyの出力

第5幕-2

Setting: The ancient city has fallen silent after the intense battle. The ruins stand still, bathed in an ethereal, post-conflict glow. The air is thick with dust and residual energy from the recent supernatural clash.

Character Focus: Elara stands alone amidst the ruins, her appearance reflecting the toll of the battle. Her clothes are disheveled, her hair loose and windswept. Despite her physical exhaustion, her eyes remain alert and thoughtful.

Action 2: As Elara observes the artifacts, the air around her begins to shimmer. The ruins of the ancient city start to materialize around her in ghostly, translucent forms. This manifestation is a visual representation of Elara's unique ability to visualize and manifest thoughts.
第5幕-2、DALL-E3の出力
第5幕-2、niji・journeyの出力

第5幕-3

Setting: The ancient city has fallen silent after the intense battle. The ruins stand still, bathed in an ethereal, post-conflict glow. The air is thick with dust and residual energy from the recent supernatural clash.

Character Focus: Elara stands alone amidst the ruins, her appearance reflecting the toll of the battle. Her clothes are disheveled, her hair loose and windswept. Despite her physical exhaustion, her eyes remain alert and thoughtful.

Action 3: Elara's expression shifts from contemplation to determination. She straightens her posture, her eyes gaining a new spark of purpose. Her hands, previously limp at her sides, now clench into fists, symbolizing her renewed resolve.
第5幕-3、DALL-E3の出力
第5幕-3、niji・journeyの出力

第5幕-4

Setting: The ancient city has fallen silent after the intense battle. The ruins stand still, bathed in an ethereal, post-conflict glow. The air is thick with dust and residual energy from the recent supernatural clash.

Character Focus: Elara stands alone amidst the ruins, her appearance reflecting the toll of the battle. Her clothes are disheveled, her hair loose and windswept. Despite her physical exhaustion, her eyes remain alert and thoughtful.

Action 4: With purposeful steps, Elara begins to walk away from the center of the ruins. Her stride is steady and determined, contrasting with her earlier fatigue. She moves towards what appears to be the outskirts of the ancient city.
第5幕-4、DALL-E3の出力
第5幕-4、niji・journeyの出力

第5幕-5

Setting: The ancient city has fallen silent after the intense battle. The ruins stand still, bathed in an ethereal, post-conflict glow. The air is thick with dust and residual energy from the recent supernatural clash.

Character Focus: Elara stands alone amidst the ruins, her appearance reflecting the toll of the battle. Her clothes are disheveled, her hair loose and windswept. Despite her physical exhaustion, her eyes remain alert and thoughtful.

Final Action: As Elara walks away, the ghostly images of the ancient city that had materialized around her begin to fade. The shimmering apparitions dissolve into the air, leaving behind only the actual ruins. This gradual disappearance of the vision creates a poignant transition, symbolizing the end of one chapter and the beginning of another in Elara's journey.
第5幕-5、DALL-E3の出力
第5幕-5、niji・journeyの出力

これらの画像を使ってAIマンガを作っていきます。


niji・joureyアプリ、Discord、ウェブ版の違いについての所感

niji・journeyについては、第1幕はiPhoneアプリ、第2幕はDiscord、第3幕以降はウェブ版で出力していますが、それぞれプロンプトの効き方が違うように思います。

iPhoneアプリでは、プロンプトを独自に区切るので、意図した通りの指示として通っているのか若干不明です。

iPhoneアプリ版niji・journeyの出力履歴

Discord版では、比較的プロンプトを全部読んでくれている感じがしますが、厳密に読んでいるために主題を取り違えているような感触があります。

Discord版niji・journeyの出力履歴

下記の出力では、冒頭の舞台設定についての記述の中の「古代都市」に引っ張られて、ここで主題としたい内容(基本的には登場人物)が副題になってしまっている感じがあります。

Discord版niji・journeyの出力履歴

ウェブ版では、入力したプロンプトに対して、かなり解釈(もしくは要約)が行われているような感触があります。
また、スタイルやカオスのパラメーター次第で、てんでバラバラの出力になる傾向がありました。

ウェブ版niji・journeyの出力画面

出力の安定性ではDiscord版が使いやすいですが、UIはiPhoneアプリ版かウェブ版が使いやすかったです。
ターボモードだとかなり出力が早いですし、ズームアウトやパンなどの出力画像の加工が容易なので、niji・journeyで安定して出力できるとよいのですが。


Googleスライドを使って、ネームを作成する

Claude3.5Sonnetが出力したシナリオのセリフ部分を使って、Googleスライドでネームを作ります。

細かい調整は後で行うこととして、一旦ざっくりコマと吹き出し(セリフ)の位置を決めて、おおよその視線誘導のアタリを作ります。

ネーム-P1
ネーム-P2
ネーム-P3
ネーム-P4
ネーム-P5


ネーム作りの練習についての所感

前述、“今回は手描きでマンガを描いたことが無い人が生成AIのみでAIマンガを描く、ということを想定して”、と書きましたが、ここで私がこれまで手描きでマンガを描いてきた知見が活きているので、本当に全く手描きでマンガを描いた経験の無い人が、つまずかずにこれを行えるかは確証の無いところです。

WebtoonスタジオやAIマンガに取り組まれているスタートアップなどでも、ネームが描ける人材が枯渇していると聞きますので、現状、ここがボトルネックになっているのであろうと想像されます。


私がマンガを勉強するときにやった練習法で、n=1の話ではあるんですが、好きなマンガの冒頭4ページのコマ割りと吹き出し(セリフ)、コマの中の主題を描き写してみる練習法:ネーム模写がオススメです。

個人的には、古い漫画よりも、ウェブに掲載されてSNSにもそのまま投稿される最近のマンガから取り組むのがオススメです。
コマが大きく、1ページあたりのコマ数が4-5コマぐらいで、複雑性が少ないので、模写もしやすいし、取り入れたときに読者にとっても負担が少ないです。

冒頭4ページは、読者がそのマンガに出会って、とりあえず読んでくれるページ数と言われていて、冒頭4ページで読者の心を掴めなければ、すぐに読者は離脱してしまいます。
なので、冒頭4ページには読者が「とりあえず1話目ぐらいは読んでみるか」という最低限の訴求を行うための、以下の要素(いわゆるツカミ)が含まれています。

  • そのマンガの絵柄、雰囲気、ジャンル

  • そのマンガの主人公のビジュアルと自己紹介

  • そのマンガの主人公が「何をする話か」という主題の提示

これらが伝わって離脱してしまうのであれは、それは好みの話なので仕方ないのですが、これらが伝わらずに離脱する、という状況は避けたいです。

ネーム模写の例

「山と食欲と私」冒頭4ページのネーム模写
漫画「クマ撃ちの女」冒頭4ページのネーム模写

上記の事例は文字が入っていないですが、手描きでいいので文字まで入れてみるのがおすすめです。
文字が入っていると、上記ぐらいの雑な絵でも「面白いマンガだ」ということが実感できると思います。


上記2作品は、新潮社のウェブマンガサイト「くらげバンチ」の連載作品です。
くらげバンチの作品は、ツカミの設計に力が入っていて、コミックスも表紙を見たら「どんな風に楽しめるマンガか」が一目でわかるようになっています。

「山と食欲と私」
素朴系の女の子が、おそらく一人で山に登って、しかも結構本気の登山で、山頂ですごく美味しそうなご飯を食べている様子を見て気分よくなれそうなマンガなんだなーという感じがします。

「クマ撃ちの女」
サバサバ系の女性が山でクマをガチハンティングする、ドキュメンタリー性の高いマンガなんだなーという感じがします。

編集側にかなりこだわりがあるように感じます。
ご参考まで。


Googleスライドを使って、マンガ原稿を作成する

Googleスライド上で作成したネームに適した生成した画像を選んで、貼り付けます。
Googleスライド上では、画像の左右反転、画像自体の大きさ調整、トリミングでフレーミングをを使って調整します。

Googleスライド上での画像の調整

セリフの位置も調整して、スムーズに視線誘導できるようにします。

視線誘導のイメージ

全ページできたら完成です!


ふり返り

よりクオリティを上げるには

今回はAIの出力を吟味していないので、ストーリーが荒唐無稽なものになっていますが、しっかりプロットを作って入力し、出力ごとに修正を加えれば、もっとクオリティを上げられそうな予感がします。

もちろん手描きのネームを描いたり、下描きからimage2imageしたり、生成画像を手描きで修正すれば、もっと納得のいくものが作れると思います。

今回は、あくまで私は指示を出すだけで、手を動かすのはAI、というコンセプトで制作しましたが、AIにお任せでも、まぁマンガとして読めるものができる、というのは半年前ぐらいの状況を鑑みると、劇的な変化のように思えます。

同じシナリオを使ってもうひと手間かけてクオリティを上げるなら…

  • ストーリーがより分かりやすいものになるよう、セリフの修正、追記を行う

  • 必要があればナレーションを加える

  • 描き文字、擬音語、動作や感情を表現する漫符を加えて情報量を補完する

  • 画像を生成する際に、プロンプトに共通のスタイル指定を含める

  • ページ全体の統一感が出るように、画像の輝度、彩度、コントラストの調整を行う

などかなと思います。


よりチャレンジングな取り組みをするなら

同じ方策で30-40ページ程度の長さのAIマンガが作れるかチャレンジしてみたいです。

これまで、長大なコンテキストが扱えない生成AIでは、プロットを作りこんでいても、ストーリーの一貫性を担保したまま終結させることに困難がありました。

今回、5ページのAIマンガの元になったストーリーは英語で3268文字でした。
30ページなら約16,500文字、40ページなら約26,400文字の一貫性のあるストーリーが出力できれば、実現できるかもしれません。

そうすると、30-40ページのネームを作るところが大きなハードルになると思われます。

ネームについては、ある程度典型的な型があるように思うので、ルールベースで設計してもよいかもしれません。

また何か挑戦したらnoteを記すようにします。


関連記事

他のマンガxAI関連の記事もぜひお楽しみください。

2024年8月20日 公開

この記事が気に入ったらサポートをしてみませんか?