Granular Querying by Specific Data Collections in Knowledge Base (e.g., clients, projects, or selected documents)

[danialt]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

In the process of developing an application that integrates Dify’s knowledge base, my users often manage diverse information related to different clients and projects. A common requirement is the ability to query specific data collections (like client-related documents or project files) to retrieve relevant information quickly and efficiently.

Currently, Dify’s API doesn’t seem to support this level of granular querying, which means users are forced to search across the entire knowledge base, even when they only need to focus on specific clients or projects. This results in irrelevant search results, slowing down the workflow -- not to mention security (project belong to clients).

For example, users might want to:

• Search only through documents related to Client A without including other client data.
  

• Retrieve content only associated with Project X while excluding other projects.
  

This functionality is essential for users who work on multiple clients or projects concurrently and need a more targeted way to retrieve relevant data for meetings or project updates.

2. Additional context or comments

By enabling granular querying capabilities, such as filtering searches by specific clients or projects, Dify would significantly enhance search efficiency and precision for users managing large and diverse knowledge bases. For example, the system could allow users to:

• Select specific clients or projects to search within.
  

• Apply metadata or tags to categorize documents, enabling more focused search queries.
  

This would be especially useful for professionals working with multiple clients or managing various projects, as it would allow them to narrow their searches and improve their productivity.

3. Can you help us with this feature?

• I am interested in contributing to this feature.