Skip to content

Conversation

@timoclsn
Copy link
Contributor

@timoclsn timoclsn commented Jul 15, 2025

  • Make small model configurable in config via optional small_model key

I like the idea of a small model and making it configurable is in in line with the existing "model" key. This allows e.g. to use a model that is unlimited in the copilot subscription.

@thdxr
Copy link
Contributor

thdxr commented Jul 15, 2025

image

lol

@timoclsn
Copy link
Contributor Author

😄 Hey @thdxr, can you make the small model configurable?

@thdxr
Copy link
Contributor

thdxr commented Jul 16, 2025

haha - PR looks good but lets not do switch the summarize model yet? i need to do a bit of research

@timoclsn timoclsn force-pushed the add-small-model-config-and-use-in-compact branch from 50b7452 to 5bafec1 Compare July 16, 2025 06:24
@timoclsn timoclsn changed the title feat: make small model configurable and also use in /compact feat(config): make small model configurable and also use in /compact Jul 16, 2025
@timoclsn
Copy link
Contributor Author

Makes sense! I split it into two PRs. Here is the one for the summarize feature: #1041

FWIW I always manually switch to a "small" model (Gemini 2.5 Flash) before using /compact and it works pretty well.

I think amp also uses Gemini 2.5 Flash for summarization:

@timoclsn timoclsn changed the title feat(config): make small model configurable and also use in /compact feat(config): make small model configurable Jul 16, 2025
@thdxr thdxr merged commit 18abcab into sst:dev Jul 18, 2025
@timoclsn timoclsn deleted the add-small-model-config-and-use-in-compact branch July 18, 2025 21:51
nipuna-perera pushed a commit to nipuna-perera/opencode that referenced this pull request Jul 26, 2025
achembarpu pushed a commit to achembarpu/opencode that referenced this pull request Aug 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants