feat: 🎸 add inference feature#246
Merged
zezhishao merged 3 commits intoGestaltCogTeam:masterfrom Jul 9, 2025
Merged
Conversation
duyifanict
force-pushed
the
dev/ustf_inference
branch
from
4bda8af to
f53f15f
Compare
add experimental script for inference processing
duyifanict
force-pushed
the
dev/ustf_inference
branch
from
f53f15f to
967d017
Compare
add web page and api server for inference processing
duyifanict
changed the title
zezhishao
reviewed
Jul 9, 2025
|
|
||
| MODEL_ARCH = TimeMoE | ||
|
|
||
| MODEL_PARAM = { |
Collaborator
There was a problem hiding this comment.
from_pretrained 需要使用前面的 pretrained 变量
basicts/runners/base_utsf_runner.py
Outdated
| super().__init__(cfg) | ||
|
|
||
| # setup graph flag | ||
| self.need_setup_graph = cfg['MODEL'].get('SETUP_GRAPH', False) |
Collaborator
There was a problem hiding this comment.
这个变量应该不用。setup_graph 这种做法是只在普通的小模型里面才会用到的，算是历史遗留问题。
很早期的研究（例如 17、18 年）会用 pytorch 语法写 tensorflow 风格的实现（可能是因为他们用惯了 tensorflow）。TF 那时候是静态图，需要在第一次 forward 的时候真正建立计算图，所以才有了这么个参数。后来的大模型都是 pytorch 了，就不需要这个参数了。
Contributor
Author
There was a problem hiding this comment.
明确不需要此参数，但是推理流程要兼顾小模型和大模型，这里保留参数但固定为false
| from easytorch.utils import set_visible_devices | ||
|
|
||
| sys.path.append(os.path.abspath(os.path.join(__file__,'..','..','..'))) | ||
| class inference_engine(object): |
junkim0209
pushed a commit
to junkim0209/BasicTS_mjk
that referenced
this pull request
Aug 29, 2025
* feat: 🎸 add inference script add experimental script for inference processing * feat: 🎸 add inference server add web page and api server for inference processing * update review
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
add experimental script for inference processing
resolved #212