2 ms·
This is fantastic, it's the right level for the structure that I'm interested in building. While langchain looks great, for my use case (generating templated co
by IanCal 4y ago
This is fantastic, it's the right level for the structure that I'm interested in building. While langchain looks great, for my use case (generating templated code) I have a much stricter process and more branching than I can see it easily supporting (maybe it does? I can't quite figure it out). Marvin looks very nice.
Something I'd like to see in the docs and/or supported is caching, and setting details like temperature. I can wrap the ai_fns myself for caching though temperature would be very good.
- jlowin 4y agoThanks! Caching is highly requested! We have an issue open (https://github.com/PrefectHQ/marvin/issues/102 https://github.com/PrefectHQ/marvin/issues/102) and expect to tackle it soon. You can set temperature as a setting today (sorry we haven't documented all the settings yet) by setting the env var `MARVIN_OPENAI_MODEL_TEMPERATURE=0.2` or at runtime with `marvin.settings.openai_model_temperature=0.2`. Note the temperature is set when a bot / ai_fn is created, not when it's called, so you need to do this early.
- IanCal 4y agoWonderful, that lets me crank it down to 0 and I can then for now add a diskcache decorator. I'll follow that issue and comment on it with some requests (who doesn't love more requests ;) ).