4 ms·
Someone has modified microgpt to build a tiny GPT that generates Korean first names, and created a web page that visualizes the entire process [1]. Users can i
by teleforce 8mo ago
Someone has modified microgpt to build a tiny GPT that generates Korean first names, and created a web page that visualizes the entire process [1].
Users can interactively explore the microgpt pipeline end to end, from tokenization until inference.
[1] English GPT lab:
https://ko-microgpt.vercel.app/ https://ko-microgpt.vercel.app/
- camkego 8mo agoI have no affiliation with the website, but the website is pretty neat if you are learning LLM internals. It explains: Tokenization, Embedding, Attention, Loss & Gradient, Training, Inference and comparison to "Real GPT" Pretty nifty. Even if you are not interested in the Korean language
- love2read 8mo agoBy "modified" this person of course means that they swapped out the list of X0,000 names from English to Korean names. That is seemingly the only change. The attached website is a fully ai-generated "visualization" based on the original blog post with little added.
- big-chungus4 8mo agoIt's a good website and probably AI generated with some insane expensive model that us mere mortals are too poor to afford, thus it has a value
- sprobertson 8mo agoThis kind of thing is pretty easy to do with a much leaner model https://docs.pytorch.org/tutorials/intermediate/char_rnn_generation_tutorial.html https://docs.pytorch.org/tutorials/intermediate/char_rnn_gen...
- arijun 8mo agoI assume the goal isn't to generate Korean names but to learn GPTs.
- sprobertson 8mo agoSure, but use the tool for the job IMO. GPTs are much more complex so should demonstrate a much more complex task.
- sahildeepreel 8mo agoso impressive!