Hi,
Many thanks for releasing a Python binding for Llama2-cpp!
There is a seed variable in the code that can be set up for Llama2 model. We noticed that the default value is -1 and the official comment said that If -1, a random seed is used..
To disable using a random seed, we are wondering if it just needs to be set up as 0? Whether this (seed=0) will make sure that the model's output will be exactly the same for the same input and the same prompt?
Thank you!
Hi,
Many thanks for releasing a Python binding for Llama2-cpp!
There is a
seedvariable in the code that can be set up for Llama2 model. We noticed that the default value is-1and the official comment said thatIf -1, a random seed is used..To disable using a random seed, we are wondering if it just needs to be set up as
0? Whether this (seed=0) will make sure that the model's output will be exactly the same for the same input and the same prompt?Thank you!