4 ms·
OT: I don't know about their scaling strategy for LLM but their scaling strategy for displaying pictures is disappointing. (it's all blurry)
by johnchristopher 4y ago
OT: I don't know about their scaling strategy for LLM but their scaling strategy for displaying pictures is disappointing.
(it's all blurry)
- ricopags 4y agoCame here to point this out, though not as pithily :D Really, really bad mark on whoever is in charge of their web marketing. Images should never look that bad, not even in support, but definitely not in marketing. edit: so this post is more useful, 4k res using Edge browser
- Kelamir 4y agoLast time I viewed it, I believe it wasn't blurry. Perhaps to scale the traffic the images are now displayed in lower quality? But I'm not sure anymore that it wasn't initially blurry... Perhaps I'm hallucinating, like large language models. Current image displayed is https://www.cerebras.net/wp-content/uploads/2023/03/Scaling-laws-blog-comparison-uai-258x119.png https://www.cerebras.net/wp-content/uploads/2023/03/Scaling-... , will see if it changes.
- Kelamir 4y agoI can confirm, it does change. As of now, it displays one of higher quality: https://www.cerebras.net/wp-content/uploads/2023/03/Scaling-laws-blog-comparison.png https://www.cerebras.net/wp-content/uploads/2023/03/Scaling-...
- thewataccount 4y agoThey're dynamically scaled and something must be broken. If you inspect source you can find the raw images, here's a few: https://www.cerebras.net/wp-content/uploads/2023/03/Downstream-tasks-figure.png https://www.cerebras.net/wp-content/uploads/2023/03/Downstre... https://www.cerebras.net/wp-content/uploads/2023/03/Scaling-laws-blog-comparison.png https://www.cerebras.net/wp-content/uploads/2023/03/Scaling-... https://www.cerebras.net/wp-content/uploads/2023/03/Scaling-Laws-blog-fig-2.png https://www.cerebras.net/wp-content/uploads/2023/03/Scaling-... EDIT: Looks like it scores better with less training - up until it matches GPT-J/Pythia/OPT and doesn't appear to have much benefit. It maybe scores slightly better then GPT-J which is pretty "eh", I'm not sure if GPT-J level performance is really useful for anything? NeoX 20B outperforms it in everything if you don't care about the amount of training needed. Does the better performance for less training matter if that benefit only applies when it's only performing a lot worse then GPT-J? It appears to lose it's scaling benefits before the performance is interesting enough to matter?
- deleted 4y ago[deleted]
- johnchristopher 4y agoDisabling ublock on Firefox fixes the issue for me. edit: scratch that, it seems the AJAX endpoint returns 504 more often that not.
- thewataccount 4y agoYeah it seems hit/miss depending on the window size and stuff. My guess is whatever is supposed to decide what size to request is messed up.
- lanshanbob 4y agoI think it's fixed now