Skip to content

Updated Prompt IDEs table #1133

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Updated Prompt IDEs table #1133

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 8 additions & 16 deletions docs/tooling/IDEs/intro.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,21 +7,21 @@ sidebar_position: 1
Prompt engineering is an iterative design task. More formalized iterative design
fields (e.g. logo design) have well established tooling which allows designers to
be more efficient. Similar tooling exists in the prompt engineering space, with
a variety of prompt engineering IDEs (integrated development environments) having
a variety of prompt engineering IDEs (integrated development environments) having
recently been created. There exists a surprising range of such tooling, with everything
from research interfaces to professionally designed IDEs.
This chapter will provide an overview of some of the tools which may be of interest to
you as a prompt engineer.

See the final article in this chapter for my recommendations on tools to use.

Due to waitlists, I have not yet been able to access all IDEs mentioned here.
Due to wait lists, I have not yet been able to access all IDEs mentioned here.
Additionally, due to the number of tools coming out, not all have a dedicated page.


Here is a table of the tools we will be discussing in this chapter:

## Text Prompt IDEs

| Name | Hosted Solution | Open Source | Research Focused| Business Model| Launched | Modalities | Supported Providers |
| ------------------------------------------ | -- | --| --| ------ | ------- | ---- | ---- |
| [GPT-3 Playground](https://beta.openai.com/docs/quickstart) | ✅ | ❌ | ❌ | Pay per tokens | ✅ | Text | OpenAI|
Expand All @@ -32,24 +32,21 @@ Here is a table of the tools we will be discussing in this chapter:
| [PromptSource](https://github.com/bigscience-workshop/promptsource) | ❌ | ✅ | ✅ | None | ✅ | Text | |
| [PromptChainer](https://arxiv.org/pdf/2203.06566.pdf) | ❌ | | ✅ | None | ✅ | Text | |
| [PromptMaker](https://dl.acm.org/doi/abs/10.1145/3491101.3503564) |❌ | | ✅| | | Text| |
| [PromptSandbox](https://promptsandbox.io) | ✅ | ✅ | ✅ | Free | ✅ | Text | OpenAI |
| [ChainForge](https://github.com/ianarawjo/ChainForge) | ✅ | ✅ | ✅ | Free | ✅ | Text | OpenAI |

| Name | Hosted Solution | Open Source | Research Focused| Business Model| Launched | Modalities | Supported Providers |
| ------------------------------------------ | -- | --| --| ------ | ------- | ---- | ---- |
| [Prompts.ai](https://prompts.ai/) | ✅ | ✅ | ❌| None | ✅ | Text | OpenAI |
| [Snorkel](https://snorkel.ai/snorkel-flow-platform/foundation-model/) | ✅ | ❌ | ❌| | ✅ | Text | |
| [Multi](https://www.multi.tech) | | | ❌ | | Wait list | Text, Image | |
| [Human Loop](https://humanloop.com) | ✅ | | ❌ | | Wait list| Text | |
| [Spellbook (Scale AI)](https://scale.com/spellbook) | ✅ | ❌ | ❌| | Wait list | Text | |
| [Kollaprompt](https://kollaprompt.com) | ✅ | ❌ | ❌| Under Development | Wait list | Text, Image, Audio | OpenAI, Stable Diffusion |
| [Promptable](https://promptable.ai/projects/default/workspace) | ✅ | ❌ | ❌| | Wait list | Text | OpenAI|
| [DiscuroAI](https://www.discuro.com) | ✅ | ❌ | ❌| | ✅ | Text, Image | OpenAI|
| [PromptShake](https://promptshake.com/?ref=producthunt) | ✅ | ❌ | ❌| | Wait list | Text | |
| [GPT IDE](https://gptide.com) | ❌ | ❌ | ❌| | ✅ | Text, images + audio later | OpenAI, later Stability.AI and more |
| [The Forge AI](https://theforgeai.com/) | ✅ | ❌ | ❌ | Marketplace | Wait list | Text, Images | OpenAI, Stable Diffusion |
| [Orquesta AI Prompts](https://orquesta.cloud/platform/ai-llm-prompts) | ✅ | ❌ | ❌ | Enterprise | ✅ | Text | Custom, Public, Private LLMs |
| [AnySolve](https://www.anysolve.ai/) | ✅ | ❌ | ❌ | Freemium | ✅ | Text, images + audio later | OpenAI, Stability.AI and more |
| [PromptMixer](https://www.promptmixer.dev/) | ❌ | ❌ | ❌ | Freemium | ✅ | Text | OpenAI, Anthropic, Gemini and more |
| [Zenprompts](https://zenprompts.ai/) | ✅ | ❌ | ❌ | Freemium | ✅ | Text | OpenAI, Anthropic |
| [PromptTools]( https://github.com/hegelai/prompttools/) | ✅ | ✅ | ❌ | Free | ✅ | Text | OpenAI, Anthropic, LLaMA |
| [Google AI Studio](https://aistudio.google.com/app/prompts/new_chat) | ✅ | ❌ | ❌ | | ✅ | Text, images | Gemini |

## Image Only IDEs

Expand All @@ -63,11 +60,6 @@ Here is a table of the tools we will be discussing in this chapter:
**Hosted Solution**: The tool is hosted on a website and can be used without installing anything.

**Research Focused**: The tool is designed for research purposes, and may not be as
user friendly as other tools.
user-friendly as other tools.

**Business Model**: Type of business model.