What's the SOTA architecture/framework for retrieval-based open-domain chatbots?

[Lisennk]

Hi all. What is the go-to solution for creating a retrieval-based open-domain chatbot in 2022? We have a huge dataset, but it's not labeled to use RASA or other intent-matching engines.

[stephenroller]

Retrieval models have fallen out of fashion compared to generative models recently, but AFAIK the poly-encoder model remains very strong.

[Lisennk]

Thanks, Stephen. I thought that it makes sense to get retrieval and generative models output to pass it to the reranker and that way choose what's best. What do you think about this approach compared to just using generative models?

[stephenroller]

It's reasonable, but if your re-ranker is substantially less powerful (smaller, less trained, etc) than the generator, it may have a hard time distinguishing.