ChatGPT Powered Question Answering Over Documents
よって
Skanda Vivek |
更新済み 한 달 전 |
Artificial Intelligence/Machine Learning
Health Check
N/A
すべてのディスカッションに戻る
Whole document is not being parsed in the context
pratikbharsakle
일 년 전
I am sending a text from a PDF document. The text is approximately 50000 chars long and PDF is of approx 30 pages. I observed in the response, the content only shows part of text I sent as part of request. And the API is not able to answer the question whose answer is present on page 1 or page 2 of text submitted.
Would appreciate some help on this matter.
ディスカッションに参加しましょう－以下にコメントを追加してください：
ログイン/サインアップして新しいコメントを投稿
Hi - thanks for your question. Good observation that the response contains only part of the text. This is because ChatGPT has limitations on the number of max. tokens it can accept. Under the hood, the API is doing an embeddings comparison to find which chunks of text most likely contain the answer (which is why the reponse only has chunks of text).
Here is an article I wrote if you want more details - feel free to let me know if you have any other questions.
https://pub.towardsai.net/chatgpt-api-101-a-beginners-guide-95e6d41c716f
Best,
Skanda