3Sophons

10 ms·

121.
Demo: Run LLM on your own devices. portable across GPUs/CPUs/OSes(thenewstack.io)
1 points by 3Sophons 3y ago|1 comments
122.
by 3Sophons 3y ago
LlamaEdge revolutionizes AI/LLM runtime with lightweight (<5MB), portable, and secure applications for diverse CPUs/GPUs across different OSes, simplifying development and deployment from local to edge and cloud. https:/&
123.
Demo: Use WebAssembly to Run LLMs on Your Own Device with WasmEdge(youtube.com)
2 points by 3Sophons 3y ago|6 comments
124.
Demo: Interact with open source LLMs via a web interface locally [video](youtube.com)
1 points by 3Sophons 3y ago|0 comments
125.
Single command to self-host open source LLMs on Mac, Jetson etc. portable(llamaedge.com)
1 points by 3Sophons 3y ago|0 comments
126.
by 3Sophons 3y ago
Run Nous-Hermes-2-Mixtral-8x7B on Mac + Across Devices with 1 single command Build a Nous-Hermes-2-Mixtral-8x7B chat app in @rustlang on my MacBook, runs it on a Jetson device, and access it anywhere on the web! Write once run anywhere,
127.
Run Nous-Hermes-2-Mixtral-8x7B with one Command on Mac, Jetson and more(secondstate.io)
1 points by 3Sophons 3y ago|1 comments
128.
by 3Sophons 3y ago
Based on WasmEdge, LlamaEdge apps are <5 MB, self-contained (no complex dependencies), sandboxed (cloud ready), and can be orchestrated by container tools. LlamaEdge apps are portable across diverse CPUs, GPUs, and OSes. It is super easy
129.
LlamaEdge: Lightweight portable LLM tools for your local, edge& server devices(github.com)
2 points by 3Sophons 3y ago|1 comments
130.
by 3Sophons 3y ago
Steps: https://www.secondstate.io/articles/mixtral-8-7b/
131.
Demo: Selfhost Mixtral 8x7B MoE on Mac+cross devices, PORTABLE 2MB inference app(youtube.com)
1 points by 3Sophons 3y ago|2 comments
132.
by 3Sophons 3y ago
you can use any open source models
133.
Use WASM as a cross-platform LLM backend for LangChain: Any LLMs on any device(github.com)
3 points by 3Sophons 3y ago|1 comments
134.
Self-host SOLAR-10.7B-Instruct-v1.0 LLM with portable 2MB AI inference app(secondstate.io)
1 points by 3Sophons 3y ago|0 comments
135.
by 3Sophons 3y ago
Fully portable inference app only 2MB. Try it on your Mac with one single command: https://www.secondstate.io/run-llm/
136.
Selfhost LLMs like Mixtral 8x7B on the Edge & across devices.(secondstate.io)
1 points by 3Sophons 3y ago|1 comments
137.
by 3Sophons 3y ago
Run open source large language model 'Mixtral-8x7B' locally. This MoE model use open source protocol Apache 2.0. It is the most powerful open weight model currently on the market. It can be easily deployed on various devices with
138.
Easy Setup Self-host Mixtral-8x7B across devices with a 2M inference app(secondstate.io)
2 points by 3Sophons 3y ago|1 comments
139.
A unikernel designed specifically for running WASM apps and compatible with WASI(github.com)
5 points by 3Sophons 3y ago|1 comments
140.
by 3Sophons 3y ago
Fully portable across OSes and hardwares
141.
Run on Mac Japanese LLM CALM2-7B with portable 2M inference app and create API(secondstate.io)
4 points by 3Sophons 3y ago|1 comments
142.
by 3Sophons 3y ago
Microservices with WASM: Microservices architectures are becoming the norm, and OpenShift is a leading platform for deploying them. WASM can be used to build lightweight, high-performance microservices that can be containerized and managed
143.
WASM and OpenShift Combine for Efficient, Scalable Applications(cloud.redhat.com)
2 points by 3Sophons 3y ago|1 comments
144.
by 3Sophons 3y ago
1 The concept of Wasm and WebAssembly System Interface (WASI) 2 Usage outside the browser 3 Running Wasm workloads with Podman step-by-step instructions for setting up on Windows/ macOS
145.
Secure Efficient Portable: Unleash WASM's Potential with Podman on macOS/Windows(developers.redhat.com)
2 points by 3Sophons 3y ago|1 comments
146.
Goodbye Poor Conf WiFi: Run Self-Hosted Mistralite LLM at AWS Re:Invent "(twitter.com)
1 points by 3Sophons 3y ago|0 comments
147.
StarlingLM Runs Across Devices – No Python Hassles(secondstate.io)
1 points by 3Sophons 3y ago|1 comments
148.
by 3Sophons 3y ago
4 commands to run LLMs Directly on Rust+Wasm
149.
Run BerkeleyEECS Starling 7B on any device with a single binary app. Zero Python(twitter.com)
2 points by 3Sophons 3y ago|2 comments
150.
by 3Sophons 3y ago
Indeed. There are the others like LlamaCode, Yi and so many more

More ›