spacestr

🔔 This profile hasn't been claimed yet. If this is your Nostr profile, you can claim it.

Edit
seb
Member since: 2022-12-23
seb
seb 10d

I did not find how to enable reasoning with the proxy. The model I use supports it but it does not seem to return any reasoning content. Did I miss something ? This is the curl command: curl -N http://localhost:16666/v1/chat/completions \ -H "Content-Type: application/json" \ -d '{ "model": "gemma4-31b", "messages": [ {"role": "user", "content": "Write a haiku about technology"} ], "stream": true, "chat_template_kwargs": {"enable_thinking": true} }'

Welcome to seb spacestr profile!

About Me

⛷️🧗‍♂️🏃🚴 in 🇨🇭

Interests

  • No interests listed.

Videos

Music

My store is coming soon!

Friends