Is there a character limit in the “Generate Text” Workflow step? I ask as when I review previously ran Workflows, there is text missing from the message and instruction. Both end in “…”. Is this for review purposes only? Or is this proof that not all text is being sent to the LLM?
There is a limit in tokens you can send to and receive back, but the “…” thing you mentioned might just be a display thing.
Do they allow you to copy the whole log?
The copy and visualization for both the Instruction and Message are 500 characters each including the “…”
My assumption is more than 500 characters for each are being sent but I am looking for confirmation.
I’m pretty sure I send more than 500 in a lot of cases, that should be possible. The tokens limit for most LLM models are much more than that.
A sample of 552 characters and 98 words here equal to only 136 tokens.
The total allowed context can go to 200k or even 1M in some models, so it shouldn’t be a problem in your case. I think it’s just a display thing.
2 Likes
Oh I like that tool!
1 Like
It’s here if you want to take a look.