Skip to content

Latest commit

 

History

History
196 lines (129 loc) · 5.89 KB

testing.md

File metadata and controls

196 lines (129 loc) · 5.89 KB

TaleWeave AI Testing

Contents

User Profiles

Staff

Admin

Goals:

  • to host a game world as a Discord bot and/or website
  • to set up automation, backups, and webhooks
  • to set up interaction with other bots
  • to moderate the world and remove inappropriate events and/or images

Skills:

  • familiar with Docker containers
  • familiar with JSON and YAML
  • familiar with setting up Discord bots
  • basic knowledge of ComfyUI and Ollama
  • access to plenty of disk space and 1-2 GPUs

Notes:

  • may be connected through Discord or web (mobile web should offer some admin options as well)
  • could also be a player

Moderator

Notes:

  • non-admin moderator
  • TBD

Users

Player

Goals:

  • to play as a character in the game world
  • may want to set up some automation, webhooks, or interaction between bots

Skills:

  • may know some JSON
  • may be familiar with scripting Discord bots and/or REST APIs

Notes:

  • could be playing in Discord, web, or mobile web
  • can interact with characters and items on their turn
  • needs to be prompted and notified when their turn starts

Spectator

Goals:

  • to watch the game world as events unfold
  • to render and visualize recent events

Skills:

  • has a Discord account and/or web browser

Notes:

  • could be watching in Discord, web, or mobile web
  • cannot interact with characters or items in the world
  • can browse and view the world
  • can render recent events

Developers

ML Engineer

Goals:

  • exporting prompts, actions, and results/replies as training data
  • analyzing character movements, interactions, and notes to find emergent behavior

Skills:

  • familiar with Python and Jupyter
  • familiar with JSON, probably also YAML
  • familiar with LLMs and prompting
  • able to run Docker containers

Project Contributor

Goals:

  • to add new actions and features
  • to fix bugs in the game engine
  • to improve the web client

Skills:

  • familiar with Python and/or Typescript
  • familiar with JSON and YAML
  • familiar with REST and websocket APIs
  • basic knowledge of Discord bots
  • basic knowledge of LLMs
  • able to run Docker containers
  • may be familiar with React and MUI (frontend)
  • may be familiar with Pydantic and other Python dependencies (backend)

Mod Developer

Goals:

  • to develop new features as game systems
  • to develop new actions and logic using existing systems

Skills:

  • familiar with Python
  • probably familiar with JSON and/or YAML
  • basic knowledge of LLMs, especially prompting

User Stories

User Stories for Staff

Admin configures and runs a new server

As an Admin, I want to configure a server, create a new world, and host it online so that players can join.

Admin removes inappropriate events from the game history

As an Admin, I want to remove inappropriate events and images from the game history, so that players are comfortable.

User Stories for Users

Player joins the game as a character

As a Player, I want to join a running world as an existing character, so that I can act as that character.

Player leaves the game during their turn

As a Player, I want to leave a running world at any time, including during my turn, so that I can go touch grass.

Spectator renders a recent event

As a Spectator, I want to render a recent event from the game, so that I can visualize the characters and their actions.

User Stories for Developers

ML Engineer collects prompts and actions to fine-tune a character model

As an ML engineer, I want to collect data from the game history, especially prompts, actions, and their results, so that I can fine-tune an LLM to be a better model for characters.

ML Engineer collects character movement and conversations to chart emergent behavior

As an ML engineer, I want to collect data from the game history, especially character movement, interactions, and conversations, so that I can graph their movements and discover any emergent behavior in the game world.

Mod Developer creates a new system for the game

As a Mod Developer, I want to write a Python module with a new game system and load it into a test world, so that I can develop custom features.

Project Contributor fixes a bug in the engine

As a Project Contributor, I want to fix a bug in the game engine, so that players have a good experience.