Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问一下,dbn训练的fine-tuning阶段如何理解?rbm输出给bp的是w、c 还是feature? #5

Open
gaopenggang opened this issue Apr 24, 2018 · 5 comments

Comments

@gaopenggang
Copy link

我是初学者,你能给我解释一下微调阶段的原理吗?或者给我推荐点详细的资料吗?

@zhuofupan
Copy link
Owner

主页有rbm资料链接
rbm是无监督训练 W,b 到一个好的状态,rbm的前向传递过程就是特征提取<预训练>
dbn继承训练好的 W,b 后,再在最后加一个分类层,也就是dbm加分类层<微调>

@gaopenggang
Copy link
Author

微调时,DBN的每一层训练完成后自然要把参数传递给一个大的NN,这个NN的输入时什么?结构是否会应为要继承RBM的w.b 受限?损失函数如何定义?我是研究机器人相关的,是dl的初学者,请见谅。

@zhuofupan
Copy link
Owner

看不太懂你提的问题。

@gaopenggang
Copy link
Author

哈哈,应该是我问的有问题。我自己查资料吧,谢谢了。

@zhuofupan
Copy link
Owner

不客气

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants