Skip to content

Latest commit

 

History

History
53 lines (39 loc) · 1.92 KB

README.MD

File metadata and controls

53 lines (39 loc) · 1.92 KB

program used for proxy GPU work

Build

cargo build --release

Quick start

run gpuproxy

gpuproxy --url <ip>:<port> --log-level <lv> run --db-dsn <database url> --disable-worker <true/false> --fs-resource-path <path> --allow-type <task type> --max-tasks <int> --no-gpu <true/false> --resource-type <db/fs>
  1. url: the endpoint that the gpuproxy listens
  2. log-level: program log level
  3. db-dsn: database connecton string (support sqlite3/mysql)
  4. disable-worker: whether to prohibit the gruproxy from running as a worker
  5. fs-resource-path: if the resources are stored in file system, then configure the folder path here
  6. max-tasks: how many tasks can run at most
  7. no-gpu: whether to use gpu
  8. resource-type: resource type (fs/db)
  9. allow-type: task types supported by workers

run gpuproxy_worker

gpuproxy_worker run --url http://<ip>:<port> --db-dsn <database url> --fs-resource-path <path> --allow-type <task type> --max-tasks <int> --no-gpu <true/false> --resource-type <db/fs>
  1. url: the endpoint that the gpuproxy, connect to the gpuproxy to get the task and submit the execution result
  2. log-level: program log level
  3. db-dsn: database connecton string sqlite3
  4. fs-resource-path: if the resources are stored in file system, then configure the folder path here
  5. max-tasks: how many tasks can run at most
  6. no-gpu: whether to use gpu
  7. resource-type: resource type (fs/rpc)
  8. allow-types: task types supported by workers

run the gpu proxy plugin with venus-cluster

the plugin needs to be configured into the venus-worker configuration file, loaded and run as a plugin

[[processors.c2]]
bin="<cluster_c2_plugin 插件路径>"
args = ["run", "--gpuproxy-url", "http://127.0.0.1:18888","--log-level", "trace"]  #插件参数

after the program runs, the c2 task will be automatically submitted to the task center, and the final result will be continuously polled