Agent With Media

Handle media messages on WhatsApp with a Gemini agent and SQLite session history.

agent_with_media.py

"""
Agent With Media
================

Demonstrates agent with media.
"""

from agno.agent import Agent
from agno.db.sqlite import SqliteDb
from agno.models.google import Gemini
from agno.os.app import AgentOS
from agno.os.interfaces.whatsapp import Whatsapp

# ---------------------------------------------------------------------------
# Create Example
# ---------------------------------------------------------------------------

agent_db = SqliteDb(db_file="tmp/persistent_memory.db")
media_agent = Agent(
    name="Media Agent",
    model=Gemini(id="gemini-3.5-flash"),
    db=agent_db,
    add_history_to_context=True,
    num_history_runs=3,
    add_datetime_to_context=True,
    markdown=True,
)

# Setup our AgentOS app
agent_os = AgentOS(
    agents=[media_agent],
    interfaces=[Whatsapp(agent=media_agent)],
)
app = agent_os.get_app()


# ---------------------------------------------------------------------------
# Run Example
# ---------------------------------------------------------------------------

if __name__ == "__main__":
    agent_os.serve(app="agent_with_media:app", reload=True)

Run the Example

1. Set up your virtual environment

   Mac

   uv venv --python 3.12
   source .venv/bin/activate
   

   uv venv --python 3.12
   .venv\Scripts\activate
   
2. Install dependencies

   uv pip install -U "agno[os]" google-genai
   
3. Export environment variables

   Mac/Linux

   export GOOGLE_API_KEY="your_google_api_key_here"
   export WHATSAPP_ACCESS_TOKEN="your_whatsapp_access_token_here"
   export WHATSAPP_APP_SECRET="your_whatsapp_app_secret_here"
   export WHATSAPP_PHONE_NUMBER_ID="your_whatsapp_phone_number_id_here"
   export WHATSAPP_VERIFY_TOKEN="your_whatsapp_verify_token_here"
   

   $Env:GOOGLE_API_KEY="your_google_api_key_here"
   $Env:WHATSAPP_ACCESS_TOKEN="your_whatsapp_access_token_here"
   $Env:WHATSAPP_APP_SECRET="your_whatsapp_app_secret_here"
   $Env:WHATSAPP_PHONE_NUMBER_ID="your_whatsapp_phone_number_id_here"
   $Env:WHATSAPP_VERIFY_TOKEN="your_whatsapp_verify_token_here"
   
4. Expose the server

   Start ngrok for port 7777 and copy its public HTTPS URL. Keep ngrok running:

   ngrok http 7777
   
5. Start AgentOS

   Save the code above as agent_with_media.py, then run:

   python agent_with_media.py
   

   Keep the server running while you configure and verify the webhook.

6. Configure the webhook

   Follow WhatsApp setup. In Meta, set the callback URL to https://<your-ngrok-url>/whatsapp/webhook, use the same verify token as WHATSAPP_VERIFY_TOKEN, and subscribe to the messages field. Verify the webhook while AgentOS and ngrok are running.

Full source: cookbook/05_agent_os/19_whatsapp/media.py