-
Notifications
You must be signed in to change notification settings - Fork 698
New Tools for venice_image Skill (vision, enhance, upscale) #577
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
10 commits
Select commit
Hold shift + click to select a range
93ae31a
new image tools (enhance, upscale, vision)
yornfifty 3679887
add new function to store file as bytes for general purpose s3 upload
yornfifty a4f3b22
Merge branch 'crestalnetwork:main' into venice_image
yornfifty a49841f
Refactor: Retrieve configuration from skill context in _arun instead …
yornfifty 79c5a86
chore : change api_key_provider's enum from "platform_hosted" to "pla…
yornfifty 2fec87d
docs: Replace invalid _arun docstring in ImageUpscale with clear, det…
yornfifty 3506320
Merge branch 'main' into venice_image
yornfifty a71cafc
add 'venice_' prefix for the name of each tool
yornfifty 62c95e4
Merge branch 'main' into venice_image
yornfifty 63f0277
Merge branch 'main' into venice_image
hyacinthus File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,119 @@ | ||
| # Venice Image Skill Suite | ||
|
|
||
| Venice Image is a comprehensive skill suite for intelligent agents, enabling state-of-the-art AI image generation, enhancement, upscaling, and vision analysis using the [Venice AI API](https://venice.ai/). This suite offers a modular interface: each sub-tool covers a focused aspect of visual intelligence, while sharing unified configuration and error handling. | ||
|
|
||
| --- | ||
|
|
||
| ## Features | ||
|
|
||
| ### 1. **Image Generation** | ||
| Prompt-based creation of new artworks or photorealistic images, with support for multiple leading AI models, extensive style presets, and negative prompting. Models include: | ||
| - **Fluently XL** (realism, professional art) | ||
| - **Flux Dev** (innovative research, art workflows) | ||
| - **Lustify SDXL** (photorealistic, NSFW/SFW) | ||
| - **Pony Realism** (anime/character detail, Danbooru tags) | ||
| - **Venice SD35 / Stable Diffusion 3.5** (Stability AI, creative design) | ||
|
|
||
| ### 2. **Image Enhancement** | ||
| Stylize or refine *existing* images without changing their resolution—ideal for artistic edits, restoration, or visual polishing. | ||
|
|
||
| ### 3. **Image Upscaling** | ||
| Increase resolution by 2x or 4x while preserving essential details (with optional noise/replication settings). Great for preparing web images for print or HD use. | ||
|
|
||
| ### 4. **Image Vision** | ||
| Obtain highly detailed, context-rich textual descriptions of images—useful for content understanding, accessibility, indexing, or cognitive agents. | ||
|
|
||
| --- | ||
|
|
||
| ## How It Works | ||
|
|
||
| - Tools call the Venice API via secure network requests, automatically handling authentication, rate limiting, and error management. | ||
| - Any generated or processed images are transparently stored in an object store (S3 or compatible), with returned URLs ready for user consumption. | ||
| - Unified logging and troubleshooting: every tool shares a robust diagnostic backbone for consistent developer experience. | ||
|
|
||
| --- | ||
|
|
||
| ## Setup and Configuration | ||
|
|
||
| All skills require a **Venice API key** for operation. | ||
|
|
||
| ### Required Configuration | ||
| - `enabled` *(bool)*: Enable or disable the overall skill suite. | ||
| - `api_key` *(string, sensitive)*: Your [Venice AI API key](https://venice.ai/). | ||
| - `states`: Enable/disable and set visibility for each sub-tool (public/private/disabled). | ||
|
|
||
| ### Advanced Options | ||
| - `safe_mode` *(bool, default: true)*: If true, blurs images classified as adult/NSFW. | ||
| - `hide_watermark` *(bool, default: true)*: Request images without a Venice watermark (subject to Venice policy). | ||
| - `embed_exif_metadata` *(bool, default: false)*: Whether to embed prompt/config info in EXIF metadata. | ||
| - `negative_prompt` *(string)*: Default negative prompt, e.g. `(worst quality: 1.4), bad quality, nsfw`. | ||
| - `rate_limit_number` / `rate_limit_minutes`: (optional) Set a max request rate per agent. | ||
|
|
||
| For per-tool configuration, refer to the `states` section in [schema.json](./schema.json): | ||
| - Each tool (e.g. `image_generation_flux_dev`, `image_enhance`, etc.) can be set to `"public"` (all users), `"private"` (agent owner only), or `"disabled"` (hidden). | ||
|
|
||
| #### Example (YAML/JSON-like) | ||
| ```json | ||
| { | ||
| "enabled": true, | ||
| "api_key": "<YOUR_VENICE_API_KEY>", | ||
| "safe_mode": true, | ||
| "states": { | ||
| "image_vision": "public", | ||
| "image_enhance": "private", | ||
| "image_upscale": "disabled", | ||
| "image_generation_flux_dev": "public" | ||
| } | ||
| } | ||
| ``` | ||
|
|
||
| --- | ||
|
|
||
| ## Usage Patterns | ||
|
|
||
| Each sub-tool has its own standardized input: | ||
| - URL-based tools (`image_enhance`, `image_upscale`, `image_vision`) require a web-accessible image URL. | ||
| - Generation tools require a *prompt* and offer flexible parameters (size, style, negative prompt, etc). | ||
|
|
||
| Errors and troubleshooting info are always returned in a structured dictionary, with clear separation of success and error fields. | ||
|
|
||
| --- | ||
|
|
||
| ## Output and Storage | ||
|
|
||
| - All generated/processed images are written to S3-compatible storage using a SHA256-based unique key. | ||
| - Returned URLs are agent-accessible and stable. | ||
| - For Vision and non-binary results, the output is returned inline as a dictionary. | ||
|
|
||
| --- | ||
|
|
||
| ## Security, License & Compliance | ||
|
|
||
| - Your Venice API key is required and kept confidential per config practices. | ||
| - Generated images and tool usage are subject to [Venice AI Terms of Service](https://venice.ai/) and the terms of the respective models (e.g. Stability AI, Black Forest Labs). | ||
| - Agents should implement their own access and moderation layers; Safe Mode and watermarking are best-effort. | ||
|
|
||
| --- | ||
|
|
||
| ## Included Sub-Tools | ||
|
|
||
| _(For detailed docs, see the respective sub-tool README entries.)_ | ||
|
|
||
| - image_generation_fluently_xl | ||
| - image_generation_flux_dev | ||
| - image_generation_flux_dev_uncensored | ||
| - image_generation_lustify_sdxl | ||
| - image_generation_pony_realism | ||
| - image_generation_venice_sd35 | ||
| - image_generation_stable_diffusion_3_5 | ||
| - image_enhance | ||
| - image_upscale | ||
| - image_vision | ||
|
|
||
| --- | ||
|
|
||
| ## Contributing & Support | ||
|
|
||
| For issues, bugfixes, or requests, please open a GitHub issue or contact the maintainers. This suite is regularly updated as Venice AI evolves. | ||
|
|
||
| --- |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.