kk. Gonna pull and restart right now!

Just want to confirm you saw I have my provider hosted on both: onion: http://5nltc2eumzxl6652tjxggf2eywypxmmcsiscoqqq42nif2hgb4f3ouqd.onion clearnet: https://routstr.rewolf.dev/ Thanks y'all! Out of interest do you have a public communications channel for dev discussions? Would love to see what you guys are cooking! And maybe share some ideas

Fixed my issue. Proxy forwards headers to Ollama (including the Origin header). Ollama's CORS filter rejects the https://chat.routstr.com origin. So I had to add it to OLLAMA_ORIGINS.

I ask this because the docs (https://docs.routstr.com/providers/configuration#model-configuration) say "sats per 1k tokens" but when I look at other providers returned by api.routstr.com they look more like they're denominated in bitcoin (on the order of 1e-8)

done! But I'm still not sure my model-based pricing is correct. Should the `pricing` fields be in orders of bitcoin or in sats? Like for 1sat, would it be 1e-8 or 1.

awesome! Loving it guys!

Have restarted!

Btw , I tried using my provider by adding it manually in the UI settings (just realised this was possible, awesome!) But it's failing. Perhaps my model pricing is wrong. Initially my pricing was resulting in it showing "Min 18,000sats" whereas other models had a 1000times lower minimums. So I guessed I was off by 1000. but now, although the min is fixed, the chat says my provider is overcharging etc. I'm trying to get model-based pricing set up. The docs say that the "pricing" object contains prices in sats/1000 tokens. But if I look at the models in api.routstr.com they have much smaller numbers in "pricing" object, and there's an additional (generated) object "sats_pricing" that seems to have the pricing in sats. If I try setting the same pricing for my Gemma 2 model as routrstr's gemma model I get errors. I've posted two examples of errors I've gotten while trying different configurations. I'll leave it as-is for now.

I have it running on clearnet too now at http://routstr.rewolf.dev

5nltc2eumzxl6652tjxggf2eywypxmmcsiscoqqq42nif2hgb4f3ouqd.onion should be live