I have set up a knowledgebase table in my app, and have linked the OpenAI “Ask question about a table” action to it. When I ask a question from the Glide Editor, it answers perfectly. When I ask the identical question from my phone, it makes up garbage. Consistently.
I’d appreciate any tips to address this.
I think that large language models are non-deterministics, which means that the model can produce different outputs even when given the same input.
Though with “Ask question about a table”, it should point to the same row for context, and given that, the answers should not be too far away from each other. Can you offer a sample of what doesn’t work?
Sure thing. My knowledgebase is filled with help articles about an IoT device. One of these articles describes how the device is suitable for outdoor installation.
When I ask “Can the device be installed outside” from Glide Editor it gives the correct response every time (that it can be installed outside). When I ask from my phone, it gives the incorrect response every time (that it can’t be installed outside).
Do you have any setups for this section?
Yes, the Temperature is 0, Maximum length is 2,500 and Frequency penalty is blank.