3 ms·
Thanks for posting this. I tried using your Guidelines instructions format[1] in my app but no matter what, the LanguageModelSession always returns very lengthy
by hbcondo714 1y ago
Thanks for posting this. I tried using your Guidelines instructions format[1] in my app but no matter what, the LanguageModelSession always returns very lengthy / verbose responses. I set the maximumResponseTokens[2] option to various small numbers but it doesn't appear to have any effect. Did you by chance encounter this issue as well?
[1] https://github.com/slipboxai/swift-scribe/blob/7952c9e845cffb866068c693d125e57d115f7133/Scribe/Models/MemoModel.swift#L63 https://github.com/slipboxai/swift-scribe/blob/7952c9e845cff...
[2] https://developer.apple.com/documentation/foundationmodels/generationoptions/maximumresponsetokens https://developer.apple.com/documentation/foundationmodels/g...