[Question] talk to local docs

[kalle07]

so long this feature works . . .

So if the PDF file is indexed and embedded and I ask a question
then the PDF is searched and an attempt is made to find 2-4 snippeds with 256/512 characters per ... (you can customize the parameters)

I have noticed that sometimes the answer is recalculated after a few lines ...

1. is the PDF also searched again for new snippeds?
2. how can you force something like this so that the PDF is searched several times in one answer?

[cosmic-snow]

I have noticed that sometimes the answer is recalculated after a few lines ...

The snippets it uses are incorporated into the prompt behind the scenes, so that contributes to filling up the context.

If you can and the model allows it, increase your context size.

1. is the PDF also searched again for new snippeds?

As long as a LocalDocs collection is active, every new prompt is used to find relevant snippets. You may lose the information of previous ones when the context is recalculated.

2. how can you force something like this so that the PDF is searched several times in one answer?

I'm not sure I understand this one. It already looks for several snippets in a single answer, depending on your settings.

[kalle07]

i see ...

so the snippet size and , snippet per prompt depends on model ?
(my ram is not on the limmit)
how i can verify , only try and error ?

[cosmic-snow]

so the snippet size and , snippet per prompt depends on model ?

No, they depend on the setting for those. How many you can use* depends on the context length setting, and what is useful as a context length setting depends on memory and the model itself.

*) Meaning: in total, because each snippet is added to the context together with the prompt.

[kalle07]

is the max context lenght read out of the model specs?
and so i can write in the box eg 99999999 "press enter" and see what is the max number of the model?

first test a model accept 32768, i choose 16384
in context lenght i choose 512 and 28
i re-index my PDF
first answer is very well ... second answer
"35, unter G herf682- und, schf120, aus im,652 verp inf;,n25 auf5 um/0 undf255/23 in52275, derernf54125 zu:5,ff5,25f555- (- (4 und50 schf9255f8 über,6 und st und .....(and so on)"

btw. who can programm that the list of the models is not sorted by upper and lower case letters ^^