Add Tempr's DeepInfra, Together AI, Fireworks AI and Hugging Face models - #7587
Closed
chrissalomon wants to merge 1 commit into
Closed
chrissalomon wants to merge 1 commit into
chrissalomon wants to merge 1 commit into
Conversation
chrissalomon
force-pushed
the
add-tempr-inference-hosts
branch
from
September 20, 2026 18:51
a8e25a0 to
f9e63d1
Compare
Contributor
Action items
|
- The mirror copied each host entry's root scalars and tables verbatim, including ones restating the lab's own values (Together's Nemotron and GLM entries, Hugging Face's open_weights). Now compared against the lab entry and kept only where they genuinely differ. - Where a host lists controls but Tempr exposes none, the leading comment now says so and why, instead of reading as a gap: Together AI's GLM effort levels are inverted, and Hugging Face is a router Tempr forwards no reasoning settings to at all.
chrissalomon
force-pushed
the
add-tempr-inference-hosts
branch
from
September 20, 2026 19:01
f9e63d1 to
bf0519d
Compare
Contributor
|
No actionable findings. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fourth batch for Tempr's AI Gateway (
api.temprhq.io/v1), after #7448, #7452 and #7586: the inference hosts it serves — DeepInfra (49), Together AI (10), Fireworks AI (24) and Hugging Face (54). Tempr relays each on the caller's own key for that host, with no markup on tokens.Each entry mirrors the host's own
base_modelattribution, real per-model deltas and pricing, since it's the same model on the same account. Reasoning is the one thing not mirrored: it comes from Tempr'sGET /v1/models, so it can differ from the host's own entry where Tempr deliberately exposes less (below).Reasoning controls per host, not per lab. These were established by live testing against each host, because the same model family genuinely behaves differently across them: GLM-5.3's effort levels are a proper ladder on Fireworks, can't stop reasoning on DeepInfra, and are inverted on Together AI (where "low" produces no thinking and "max" does), so Together's GLM models are listed with no levels at all, and each of those files says why rather than leaving the empty set unexplained. Fireworks rejects any unknown field, so it takes
reasoning_effortonly. Bedrock's entries are in #7586. Each file's leading comment records the fields a caller sets for that model.Hugging Face is listed with no reasoning options at all. It's a router rather than a host: of its models, most have more than one live upstream provider and none of the reasoning models has only one, so there's no deterministic behavior to advertise —
zai-org/GLM-5.3-Flashis served by Together AI and DeepInfra at once, and those two disagree. Tempr therefore sends no reasoning settings there, and each file says so.Not included: 78 models these hosts define themselves, whose own entries carry no
base_model(Together AI'sQwen/…-Turbovariants, Fireworks'accounts/fireworks/models/…, and similar). Each needs a lab entry created under its creating lab first, which is per-model research rather than a mirror, so they're better as their own change.Docs: https://temprhq.io/docs/gateway-chat-completions#reasoning
🤖 Generated with Claude Code