3 ms·
Does it support Metal / MPS acceleration?
by bravura 3y ago
Does it support Metal / MPS acceleration?
- SOLAR_FIELDS 3y agoI’ve gotten mine running with FastChat - they have a Metal/MPS option. Sadly 7b is not very good for SQL tasks. I think even with RAG it would struggle.