🚀 Feature: Add Citations to Responses #2106
Description
🔖 Feature description
When users submit multi-paged documents (from 10 pages onwards) users will feel reassured if they are given references to a specific page or section in the document. In a response, users will have a button/text element that guides them to the specific section. When clicking on it, a new window appears with the specific section highlighted.
As of now, DocsGPT does this:
But, if we went with the number citations or physical links to the specific page, it would be much easier to refer to that page. (imagine using this to find a section in a shakespeare book. if you want to write an essay with citations, it would be impossible to do it with this current setup).
For example, this is how Perplexity implements this:
Clicking on the numbers re-directs users to a new wikipedia page in the browser. I already feel like the way sources are displayed in DocsGPT is better than perplexity, so adding citations will make it even clearer to the user.
🎤 Why is this feature needed ?
Helps users feel reassured that the LLM isn't hallucinating and is basing its response on provided context/fact. Especially due to model hallucination (had my own experiences with ChatGPT with this when GPT 4 just came out).
✌️ How do you aim to achieve this?
I haven't read the code enough to know how DocsGPT reads context, but I think it could be possible by having a RAG server divide the document into segments hierarchically. Since this will be mostly used for research papers, textbooks or documentation, having an hierarchical solution helps the model find information quicker (or so a freshmen college student with limited knowledge in LLMs i.e me thinks).
🔄️ Additional Information
Another solution I have considered is standard chunking by page or every 3 paragraphs. This number can also be changed dynamically (maybe have another SLM decide on this or smth). Im brimming with ideas, but let me know if this is a good idea or what to change.
👀 Have you spent some time to check if this feature request has been raised before?
- I checked and didn't find similar issue
Are you willing to submit PR?
Yes I am willing to submit a PR!