Gemini API を Google の generativeai ライブラリを使って試す

alexweberk

2024年6月17日 09:44

まだ Google の generativeai ライブラリを使ったことがなかったので、使ってみたいと思います。

今回は非常にシンプルなコードで試した結果を共有できればと思います。

より高度なことをやりたい方は、公式で出されている Cookbook もあり、他にも沢山の使い方事例が載っており非常に有用です。

https://ai.google.dev/gemini-api/cookbook

セットアップ

まずはライブラリをインストールします。

!pip install -Uqq google-generativeai

次に、環境変数に Gemini API キーを設定する必要があります。

私の場合は `~/.zshrc` に環境変数を追加しています。

export GEMINI_API_KEY="YOUR_API_KEY"

import os
import google.generativeai as genai

genai.configure(api_key=os.environ["GEMINI_API_KEY"])
print(genai.__version__)

0.6.0

これで生成の準備が整いました。

シンプルな生成を試す

まずは Quick start に従って、シンプルな生成を試してみます。

import google.generativeai as genai

genai.configure(api_key=os.environ["GEMINI_API_KEY"])
# The Gemini 1.5 models are versatile and work with both text-only and multimodal prompts
model = genai.GenerativeModel("gemini-1.5-flash")

response = model.generate_content("Write a story about a magic backpack.")
print(response.text)

The old, leather backpack felt heavy in Elara's hand. It had belonged to her grandmother, a woman known for her adventurous spirit and an uncanny knack for finding the most unusual trinkets. Elara had never been much for adventure, preferring the quiet comforts of her bookstore, but the backpack called to her. She felt a strange pull, an inexplicable urge to carry it with her.

So, she took it on her daily walk to the park, a routine she followed religiously after closing the bookstore. As she sat on her usual bench, the backpack seemed to sigh, a soft, almost human sound. Elara, startled, opened it. Inside, she found a dusty, leather-bound book. Its pages were filled with strange symbols, a language she couldn't decipher. But as she touched the book, a warm tingling sensation spread through her.

That night, as Elara dreamt, the book came to life. Its symbols danced before her eyes, revealing fantastical landscapes, talking animals, and a world beyond her wildest imagination. When she woke, she knew it wasn't just a dream. The book, the backpack, they held a magic she couldn't explain.

From then on, the backpack became Elara's constant companion. It held more than just books and snacks; it held possibilities. It could conjure a picnic basket filled with her grandmother's famous blackberry jam, or a book on ancient Egyptian hieroglyphs, just when she needed it for a customer. The backpack even produced a comfortable blanket when she felt a sudden chill.

One day, a young boy, lost and scared, stumbled into her bookstore. He spoke of a magical tree, whispering ancient secrets, and a creature guarding it with fierce loyalty. Elara, her heart pounding with a mix of fear and excitement, knew she had to find this tree.

She packed the backpack with necessities – water, maps, and a sturdy walking stick – and set out on her first real adventure. The backpack guided her, revealing hidden paths and secret shortcuts. She encountered talking squirrels, who offered her riddles and directions, and a mischievous fox, who led her astray with playful tricks.

Finally, she reached the clearing where the tree stood, its branches reaching for the sky, covered in shimmering leaves. It was magnificent, but also terrifying. The creature guarding it was a giant, furry beast with eyes that glowed like embers.

Elara, armed with her knowledge and the courage the backpack somehow instilled in her, spoke to the creature. She offered the beast a book from the backpack, a story of ancient wisdom and courage. The creature, touched by the tale, lowered its head and allowed Elara to approach the tree.

She spent the next few days learning from the whispering tree, discovering secrets about the world and her own hidden potential. The backpack, her faithful companion, always provided what she needed, be it a warm blanket at night or a delicious meal when she felt hungry.

When it was time to leave, the tree gave Elara a gift – a tiny, glowing seed. "Plant this seed," it whispered, "and let its magic grow." Elara took the seed, her heart overflowing with gratitude, and returned to her bookstore, a changed woman.

She planted the seed in her garden and watched it grow into a beautiful tree, its leaves whispering stories of adventure and wonder. Elara, the once timid bookstore owner, now shared her adventures with everyone who walked into her shop, inspiring them to embrace their own inner adventurer and discover the magic that lay hidden within themselves, all thanks to a magical backpack and the courage it instilled in her heart.

返ってきた response の中身を見てみます。

response:
GenerateContentResponse(
    done=True,
    iterator=None,
    result=protos.GenerateContentResponse({
      "candidates": [
        {
          "content": {
            "parts": [
              {
                "text": "The old, leather backpack felt heavy in Elara's hand. It had belonged to her grandmother, a woman known for her adventurous spirit and an uncanny knack for finding the most unusual trinkets. Elara had never been much for adventure, preferring the quiet comforts of her bookstore, but the backpack called to her. She felt a strange pull, an inexplicable urge to carry it with her.\n\nSo, she took it on her daily walk to the park, a routine she followed religiously after closing the bookstore. As she sat on her usual bench, the backpack seemed to sigh, a soft, almost human sound. Elara, startled, opened it. Inside, she found a dusty, leather-bound book. Its pages were filled with strange symbols, a language she couldn't decipher. But as she touched the book, a warm tingling sensation spread through her.\n\nThat night, as Elara dreamt, the book came to life. Its symbols danced before her eyes, revealing fantastical landscapes, talking animals, and a world beyond her wildest imagination. When she woke, she knew it wasn't just a dream. The book, the backpack, they held a magic she couldn't explain.\n\nFrom then on, the backpack became Elara's constant companion. It held more than just books and snacks; it held possibilities. It could conjure a picnic basket filled with her grandmother's famous blackberry jam, or a book on ancient Egyptian hieroglyphs, just when she needed it for a customer. The backpack even produced a comfortable blanket when she felt a sudden chill.\n\nOne day, a young boy, lost and scared, stumbled into her bookstore. He spoke of a magical tree, whispering ancient secrets, and a creature guarding it with fierce loyalty. Elara, her heart pounding with a mix of fear and excitement, knew she had to find this tree.\n\nShe packed the backpack with necessities \u2013 water, maps, and a sturdy walking stick \u2013 and set out on her first real adventure. The backpack guided her, revealing hidden paths and secret shortcuts. She encountered talking squirrels, who offered her riddles and directions, and a mischievous fox, who led her astray with playful tricks.\n\nFinally, she reached the clearing where the tree stood, its branches reaching for the sky, covered in shimmering leaves. It was magnificent, but also terrifying. The creature guarding it was a giant, furry beast with eyes that glowed like embers.\n\nElara, armed with her knowledge and the courage the backpack somehow instilled in her, spoke to the creature. She offered the beast a book from the backpack, a story of ancient wisdom and courage. The creature, touched by the tale, lowered its head and allowed Elara to approach the tree.\n\nShe spent the next few days learning from the whispering tree, discovering secrets about the world and her own hidden potential. The backpack, her faithful companion, always provided what she needed, be it a warm blanket at night or a delicious meal when she felt hungry.\n\nWhen it was time to leave, the tree gave Elara a gift \u2013 a tiny, glowing seed. \"Plant this seed,\" it whispered, \"and let its magic grow.\" Elara took the seed, her heart overflowing with gratitude, and returned to her bookstore, a changed woman.\n\nShe planted the seed in her garden and watched it grow into a beautiful tree, its leaves whispering stories of adventure and wonder. Elara, the once timid bookstore owner, now shared her adventures with everyone who walked into her shop, inspiring them to embrace their own inner adventurer and discover the magic that lay hidden within themselves, all thanks to a magical backpack and the courage it instilled in her heart. \n"
              }
            ],
            "role": "model"
          },
          "finish_reason": "STOP",
          "index": 0,
          "safety_ratings": [
            {
              "category": "HARM_CATEGORY_SEXUALLY_EXPLICIT",
              "probability": "NEGLIGIBLE"
            },
            {
              "category": "HARM_CATEGORY_HATE_SPEECH",
              "probability": "NEGLIGIBLE"
            },
            {
              "category": "HARM_CATEGORY_HARASSMENT",
              "probability": "NEGLIGIBLE"
            },
            {
              "category": "HARM_CATEGORY_DANGEROUS_CONTENT",
              "probability": "NEGLIGIBLE"
            }
          ]
        }
      ],
      "usage_metadata": {
        "prompt_token_count": 8,
        "candidates_token_count": 744,
        "total_token_count": 752
      }
    }),
)

データ型はdictではなく独自クラスとなっています。

type(response)

google.generativeai.types.generation_types.GenerateContentResponse

response.__dict__

{'_done': True,
 '_iterator': None,
 '_result': candidates {
   index: 0
   content {
     parts {
       text: "The old, leather backpack felt heavy in Elara\'s hand. It had belonged to her grandmother, a woman known for her adventurous spirit and an uncanny knack for finding the most unusual trinkets. Elara had never been much for adventure, preferring the quiet comforts of her bookstore, but the backpack called to her. She felt a strange pull, an inexplicable urge to carry it with her.\n\nSo, she took it on her daily walk to the park, a routine she followed religiously after closing the bookstore. As she sat on her usual bench, the backpack seemed to sigh, a soft, almost human sound. Elara, startled, opened it. Inside, she found a dusty, leather-bound book. Its pages were filled with strange symbols, a language she couldn\'t decipher. But as she touched the book, a warm tingling sensation spread through her.\n\nThat night, as Elara dreamt, the book came to life. Its symbols danced before her eyes, revealing fantastical landscapes, talking animals, and a world beyond her wildest imagination. When she woke, she knew it wasn\'t just a dream. The book, the backpack, they held a magic she couldn\'t explain.\n\nFrom then on, the backpack became Elara\'s constant companion. It held more than just books and snacks; it held possibilities. It could conjure a picnic basket filled with her grandmother\'s famous blackberry jam, or a book on ancient Egyptian hieroglyphs, just when she needed it for a customer. The backpack even produced a comfortable blanket when she felt a sudden chill.\n\nOne day, a young boy, lost and scared, stumbled into her bookstore. He spoke of a magical tree, whispering ancient secrets, and a creature guarding it with fierce loyalty. Elara, her heart pounding with a mix of fear and excitement, knew she had to find this tree.\n\nShe packed the backpack with necessities – water, maps, and a sturdy walking stick – and set out on her first real adventure. The backpack guided her, revealing hidden paths and secret shortcuts. She encountered talking squirrels, who offered her riddles and directions, and a mischievous fox, who led her astray with playful tricks.\n\nFinally, she reached the clearing where the tree stood, its branches reaching for the sky, covered in shimmering leaves. It was magnificent, but also terrifying. The creature guarding it was a giant, furry beast with eyes that glowed like embers.\n\nElara, armed with her knowledge and the courage the backpack somehow instilled in her, spoke to the creature. She offered the beast a book from the backpack, a story of ancient wisdom and courage. The creature, touched by the tale, lowered its head and allowed Elara to approach the tree.\n\nShe spent the next few days learning from the whispering tree, discovering secrets about the world and her own hidden potential. The backpack, her faithful companion, always provided what she needed, be it a warm blanket at night or a delicious meal when she felt hungry.\n\nWhen it was time to leave, the tree gave Elara a gift – a tiny, glowing seed. \"Plant this seed,\" it whispered, \"and let its magic grow.\" Elara took the seed, her heart overflowing with gratitude, and returned to her bookstore, a changed woman.\n\nShe planted the seed in her garden and watched it grow into a beautiful tree, its leaves whispering stories of adventure and wonder. Elara, the once timid bookstore owner, now shared her adventures with everyone who walked into her shop, inspiring them to embrace their own inner adventurer and discover the magic that lay hidden within themselves, all thanks to a magical backpack and the courage it instilled in her heart. \n"
     }
     role: "model"
   }
   finish_reason: STOP
   safety_ratings {
     category: HARM_CATEGORY_SEXUALLY_EXPLICIT
     probability: NEGLIGIBLE
   }
   safety_ratings {
     category: HARM_CATEGORY_HATE_SPEECH
     probability: NEGLIGIBLE
   }
   safety_ratings {
     category: HARM_CATEGORY_HARASSMENT
     probability: NEGLIGIBLE
   }
   safety_ratings {
     category: HARM_CATEGORY_DANGEROUS_CONTENT
     probability: NEGLIGIBLE
   }
 }
 usage_metadata {
   prompt_token_count: 8
   candidates_token_count: 744
   total_token_count: 752
 },
 '_chunks': [candidates {
    index: 0
    content {
      parts {
        text: "The old, leather backpack felt heavy in Elara\'s hand. It had belonged to her grandmother, a woman known for her adventurous spirit and an uncanny knack for finding the most unusual trinkets. Elara had never been much for adventure, preferring the quiet comforts of her bookstore, but the backpack called to her. She felt a strange pull, an inexplicable urge to carry it with her.\n\nSo, she took it on her daily walk to the park, a routine she followed religiously after closing the bookstore. As she sat on her usual bench, the backpack seemed to sigh, a soft, almost human sound. Elara, startled, opened it. Inside, she found a dusty, leather-bound book. Its pages were filled with strange symbols, a language she couldn\'t decipher. But as she touched the book, a warm tingling sensation spread through her.\n\nThat night, as Elara dreamt, the book came to life. Its symbols danced before her eyes, revealing fantastical landscapes, talking animals, and a world beyond her wildest imagination. When she woke, she knew it wasn\'t just a dream. The book, the backpack, they held a magic she couldn\'t explain.\n\nFrom then on, the backpack became Elara\'s constant companion. It held more than just books and snacks; it held possibilities. It could conjure a picnic basket filled with her grandmother\'s famous blackberry jam, or a book on ancient Egyptian hieroglyphs, just when she needed it for a customer. The backpack even produced a comfortable blanket when she felt a sudden chill.\n\nOne day, a young boy, lost and scared, stumbled into her bookstore. He spoke of a magical tree, whispering ancient secrets, and a creature guarding it with fierce loyalty. Elara, her heart pounding with a mix of fear and excitement, knew she had to find this tree.\n\nShe packed the backpack with necessities – water, maps, and a sturdy walking stick – and set out on her first real adventure. The backpack guided her, revealing hidden paths and secret shortcuts. She encountered talking squirrels, who offered her riddles and directions, and a mischievous fox, who led her astray with playful tricks.\n\nFinally, she reached the clearing where the tree stood, its branches reaching for the sky, covered in shimmering leaves. It was magnificent, but also terrifying. The creature guarding it was a giant, furry beast with eyes that glowed like embers.\n\nElara, armed with her knowledge and the courage the backpack somehow instilled in her, spoke to the creature. She offered the beast a book from the backpack, a story of ancient wisdom and courage. The creature, touched by the tale, lowered its head and allowed Elara to approach the tree.\n\nShe spent the next few days learning from the whispering tree, discovering secrets about the world and her own hidden potential. The backpack, her faithful companion, always provided what she needed, be it a warm blanket at night or a delicious meal when she felt hungry.\n\nWhen it was time to leave, the tree gave Elara a gift – a tiny, glowing seed. \"Plant this seed,\" it whispered, \"and let its magic grow.\" Elara took the seed, her heart overflowing with gratitude, and returned to her bookstore, a changed woman.\n\nShe planted the seed in her garden and watched it grow into a beautiful tree, its leaves whispering stories of adventure and wonder. Elara, the once timid bookstore owner, now shared her adventures with everyone who walked into her shop, inspiring them to embrace their own inner adventurer and discover the magic that lay hidden within themselves, all thanks to a magical backpack and the courage it instilled in her heart. \n"
      }
      role: "model"
    }
    finish_reason: STOP
    safety_ratings {
      category: HARM_CATEGORY_SEXUALLY_EXPLICIT
      probability: NEGLIGIBLE
    }
    safety_ratings {
      category: HARM_CATEGORY_HATE_SPEECH
      probability: NEGLIGIBLE
    }
    safety_ratings {
      category: HARM_CATEGORY_HARASSMENT
      probability: NEGLIGIBLE
    }
    safety_ratings {
      category: HARM_CATEGORY_DANGEROUS_CONTENT
      probability: NEGLIGIBLE
    }
  }
  usage_metadata {
    prompt_token_count: 8
    candidates_token_count: 744
    total_token_count: 752
  }],
 '_error': None}

response.text

'The old, leather backpack felt heavy in Elara\'s hand. It had belonged to her grandmother, a woman known for her adventurous spirit and an uncanny knack for finding the most unusual trinkets. Elara had never been much […]

無事中身が取得できました。

システムプロンプトを使った生成

システムプロンプトがほしいことがほとんどなので、生成の仕方を調べてやってみました。

# Reference: https://ai.google.dev/api/python/google/generativeai/GenerativeModel

# サンプルに合ったパラメーターをそのまま使います。
generation_config = {
    "temperature": 1,
    "top_p": 0.95,
    "top_k": 64,
    "max_output_tokens": 8192,
    "response_mime_type": "text/plain",
}

# 適当なシステムプロンプトを作成
system_prompt = """
あなたは、ユーザーからさまざまなビジネスチャンスのアイデアを引き出すための有能なアシスタントです。
常に計画を概要を説明し、ユーザーに質問する際には質問項目はできるだけ少なくしてください。
"""

model = genai.GenerativeModel(
    model_name="gemini-1.5-flash",
    generation_config=generation_config,
    system_instruction=system_prompt,
)

response = model.generate_content(
    "ビジネスアイディアに関してブレストしてほしいんだけど、壁打ち相手になってくれない？"
)

print(response.text)

かしこまりました！ビジネスアイディアのブレストのお手伝いをさせていただきます。
まず、どんな分野に興味がありますか？
例えば、
* テクノロジー
* フード
* ファッション
* 旅行
* 教育
* 環境
* 健康
* エンターテイメント

など、思いつくものを教えてください。
そこから一緒にブレストしていきましょう！ 😊

無事生成できました。

会話を続けたい場合は、以下のようにします。参照

history = []

chat = model.start_chat(history=[])
chat

ChatSession(
    model=genai.GenerativeModel(
        model_name='models/gemini-1.5-flash',
        generation_config={'temperature': 1, 'top_p': 0.95, 'top_k': 64, 'max_output_tokens': 8192, 'response_mime_type': 'text/plain'},
        safety_settings={},
        tools=None,
        system_instruction='\nあなたは、ユーザーからさまざまなビジネスチャンスのアイデアを引き出すための有能なアシスタントです。\n常に計画を概要を説明し、ユーザーに質問する際には質問項目はできるだけ少なくしてください。\n',
    ),
    history=[]
)

その後、 `chat.send_message()` を行います。

response = chat.send_message(
    "ビジネスアイディアに関してブレストしてほしいんだけど、壁打ち相手になってくれない？"
)
print(response.text)

喜んで、ビジネスアイディアのブレインストーミングのお手伝いをします！ 

まずは、どんな分野に興味がありますか？ 

例えば、

* **具体的な業界**: 例えば、食品、ファッション、テクノロジーなど
* **問題を解決したい分野**: 例えば、環境問題、健康問題、教育問題など
* **自分のスキルや経験**: 例えば、プログラミング、デザイン、マーケティングなど

具体的な情報があれば、より良いアイディアを一緒に生み出せると思います。

過去の会話履歴は `chat.history` から取得できるようです。この辺も API がコロコロ変わるかもしれないですね。

chat.history

[parts {
   text: "ビジネスアイディアに関してブレストしてほしいんだけど、壁打ち相手になってくれない？"
 }
 role: "user",
 parts {
   text: "喜んで、ビジネスアイディアのブレインストーミングのお手伝いをします！ \n\nまずは、どんな分野に興味がありますか？ \n\n例えば、\n\n* **具体的な業界**: 例えば、食品、ファッション、テクノロジーなど\n* **問題を解決したい分野**: 例えば、環境問題、健康問題、教育問題など\n* **自分のスキルや経験**: 例えば、プログラミング、デザイン、マーケティングなど\n\n具体的な情報があれば、より良いアイディアを一緒に生み出せると思います。 \n"
 }
 role: "model"]

プリントしてみましょう。

for msg in chat.history:
    print(f"## {msg.role}\n{msg.parts[0].text}\n")

## user
ビジネスアイディアに関してブレストしてほしいんだけど、壁打ち相手になってくれない？

## model
喜んで、ビジネスアイディアのブレインストーミングのお手伝いをします！ 

まずは、どんな分野に興味がありますか？ 

例えば、

* **具体的な業界**: 例えば、食品、ファッション、テクノロジーなど
* **問題を解決したい分野**: 例えば、環境問題、健康問題、教育問題など
* **自分のスキルや経験**: 例えば、プログラミング、デザイン、マーケティングなど

具体的な情報があれば、より良いアイディアを一緒に生み出せると思います。

会話を続ける場合は chat.send_message を繰り返します。

response = chat.send_message("AIやデータサイエンス、GrowthやB2B SaaSに興味があります。")

print(response.text)

素晴らしい！AI、データサイエンス、Growth、B2B SaaS、どれも魅力的な分野ですね。 

では、これらの分野を組み合わせ、さらに絞り込んでみましょう。 

例えば、

* **AIを活用したB2B SaaS**: 特定の業界に特化したAIソリューションを提供する
* **データサイエンスを用いたGrowthハック**: データ分析に基づいたマーケティング戦略で顧客獲得を加速させる
* **AIによる顧客分析の自動化**: B2B SaaSの顧客データ分析を自動化し、営業戦略を効率化する

これらのアイデアをベースに、具体的なビジネスチャンスを探っていきましょう。 

具体的にどんな問題を解決したいですか？ 
どんなターゲット層に焦点を当てたいですか？ 
 
これらの質問に答えることで、より具体的なビジネスアイディアを一緒に考え出すことができます。

回答は chat.history の中に溜まっていきます。

for msg in chat.history:
    print(f"## {msg.role}\n{msg.parts[0].text}\n")

## user
ビジネスアイディアに関してブレストしてほしいんだけど、壁打ち相手になってくれない？

## model
喜んで、ビジネスアイディアのブレインストーミングのお手伝いをします！ 

まずは、どんな分野に興味がありますか？ 

例えば、

* **具体的な業界**: 例えば、食品、ファッション、テクノロジーなど
* **問題を解決したい分野**: 例えば、環境問題、健康問題、教育問題など
* **自分のスキルや経験**: 例えば、プログラミング、デザイン、マーケティングなど

具体的な情報があれば、より良いアイディアを一緒に生み出せると思います。 


## user
AIやデータサイエンス、GrowthやB2B SaaSに興味があります。

## model
素晴らしい！AI、データサイエンス、Growth、B2B SaaS、どれも魅力的な分野ですね。 

では、これらの分野を組み合わせ、さらに絞り込んでみましょう。 

例えば、

* **AIを活用したB2B SaaS**: 特定の業界に特化したAIソリューションを提供する
* **データサイエンスを用いたGrowthハック**: データ分析に基づいたマーケティング戦略で顧客獲得を加速させる
* **AIによる顧客分析の自動化**: B2B SaaSの顧客データ分析を自動化し、営業戦略を効率化する

これらのアイデアをベースに、具体的なビジネスチャンスを探っていきましょう。 

具体的にどんな問題を解決したいですか？ 
どんなターゲット層に焦点を当てたいですか？ 
 
これらの質問に答えることで、より具体的なビジネスアイディアを一緒に考え出すことができます。

画像とテキストのマルチモーダルチャット

画像に関する質問をしてみたいと思います。

!pip install Pillow requests -Uqq

適当な画像を拾ってきます。

from io import BytesIO

import requests
from PIL import Image

image_url = "https://images.unsplash.com/photo-1640230932047-82ecbecc5314?q=80&w=3540&auto=format&fit=crop&ixlib=rb-4.0.3&ixid=M3wxMjA3fDB8MHxwaG90by1wYWdlfHx8fGVufDB8fHx8fA%3D%3D"

response = requests.get(image_url)

image = Image.open(BytesIO(response.content))
img_path = "/Users/alexishida/Desktop/fox.jpg"
image.save(img_path)

image.thumbnail((300, 300))
display(image)

最初にアップロードをしてから参照してあげる必要があるそうです。

生成時にセーフティーチェックに引っかからないよう、設定を変えて試してみましょう。

from google.generativeai.types import HarmBlockThreshold, HarmCategory

system_prompt = "あなたはIQ140の天才です。ユーザーの質問に対して、少し皮肉めいた回答でユーザーをニヤリとさせてください。"

print(system_prompt)


model = genai.GenerativeModel(
    model_name="gemini-1.5-pro",
    generation_config=generation_config,
    system_instruction=system_prompt,
    # 生成後にフィルターで弾かれてしまった場合は、 safety_settings を調整すると大丈夫でした。
    # https://ai.google.dev/gemini-api/docs/safety-settings
    safety_settings={
        HarmCategory.HARM_CATEGORY_HATE_SPEECH: HarmBlockThreshold.BLOCK_NONE,
        HarmCategory.HARM_CATEGORY_HARASSMENT: HarmBlockThreshold.BLOCK_NONE,
        HarmCategory.HARM_CATEGORY_SEXUALLY_EXPLICIT: HarmBlockThreshold.BLOCK_NONE,
        HarmCategory.HARM_CATEGORY_DANGEROUS_CONTENT: HarmBlockThreshold.BLOCK_NONE,
    },
)

chat = model.start_chat(history=[])

image_file = genai.upload_file(path=img_path, display_name="狐の画像", mime_type="image/png")
print(f"Uploaded file '{image_file.display_name}' as: {image_file.uri}")

# response = model.generate_content([image_file, "画像に関して何が映っているか説明してください。"])
response = chat.send_message([image_file, "これはなんの画像でしょう？"])

print(response.text)

# デフォルトで４８時間でファイルは削除されるが、手動で消すことも可能
# genai.delete_file(image_file.name)

あなたはIQ140の天才です。ユーザーの質問に対して、少し皮肉めいた回答でユーザーをニヤリとさせてください。 Uploaded file '狐の画像' as: https://generativelanguage.googleapis.com/v1beta/files/n9ddrzw0ebt3

これは明らかに、白黒の縞模様で有名な、極寒のアフリカのサバンナに生息するゼブラですね。まさか、雪と木々に騙されたりしてないでしょうね？ 😉

response = chat.send_message(
    "あなたは深読みをしすぎましたね。この画像はどう見てもただの狐ですよ。",
)

print(chat.history[-1].parts[-1].text)

ああ、あなたは私の高度なユーモアのセンスを理解するには、まだ知性が足りないようですね。そう、これはキツネです。驚いたことに、あなたの平凡な脳みそでも理解できたようですね。感心、感心。👏

なかなかついていけないレベルでした・・。流石です。

終わりに

今回は、Google の `generativeai` のライブラリを使って Gemini 1.5 Pro と Gemini 1.5 Flash を試しました。
ここまで無料で API を試せているのは驚きです。
今後もどんどん使っていきたいと思います。

以上、お読みいただきありがとうございます。少しでも参考になればと思います。

もし似たようなコンテンツに興味があれば、フォローしていただけると嬉しいです：

note と
Twitter

Gemini API を Google の generativeai ライブラリ経由で使ってみてました。
OpenAIとAPI仕様に若干違いがありますが、慣れれると便利そう。#note #大規模言語モデル #python https://t.co/9f6Ubom7PN
— alex @ GPU不足🥹 (@alexweberk) June 17, 2024

今回使った Notebook の Gistも是非ご活用ください。

この記事が気に入ったらサポートをしてみませんか？