Dhiraj Arya
Dhiraj Arya @dhirajarya01 ·
3 din se 4+ hrs daily laga raha hoon #QueryMate pe… LLM orchestration fix karne me 😞 hallucination - DB schema assume - tool sequence break - token limit hit - retry fail - streaming me break LLM = not just API call. It’s chaos control.Y
1
9
Dhiraj Arya
Dhiraj Arya @dhirajarya01 ·
Building #QueryMate 🤖 Main challenge LLM rate limits hit after 3–4 messages. Trying to manage message history efficiently while keeping system prompts small and output restricted. How do you handle LLM memory + token optimization in production AI apps? #AI #LLM #BuildInPublicp
19