6 ms·
A bunch of you seem interested in taking up the challenge: having to write smarter software, wistful for the old days when it was forced on you. Turns out, you
by sillysaurusx 6y ago
A bunch of you seem interested in taking up the challenge: having to write smarter software, wistful for the old days when it was forced on you.
Turns out, you can! There's a big domain that needs your help, today: deep learning.
A lot of the software is currently crude. For example, to train a StyleGAN model, the official way to do it is to encode each photo as uncompressed(!) RGB, resulting in a 10-20x size explosion.
There's plenty of room at the top, and never moreso in AI software. Consider it! Every one of you can pivot to deep learning, if you want to. There's really nothing special or magical in terms of knowledge that you need to study. A lot of it is just "Get these bits from point A to point B efficiently."
There's also room for beautiful tools. It reminds me a lot of Javascript in 2008. I'm sure that will sound repugnant for a majority of devs. But for a certain type of dev, you'll hear that ringing noise of opportunity knocking.
- zozbot234 6y agoThe highest-performance deep learning framework is most likely Theano which still has to be ported to current Python 3.x. There's quite a bit of low-hanging work to be found via fixing things like that.
- AlexCoventry 6y agoHighest performance by what metric? I thought Theano has been dead for a couple of years, at this point.
- TheSpiceIsLife 6y ago> There's a big domain that needs your help, today: Enterprise software! But we’re more likely to see true General Artificial Intelligence before we see a 2x increased in enterprise software performance.
- keenmaster 6y agoRobotic process automation (RPA) can really help boost the performance of enterprise software, and it is just starting to take off.
- supertrope 6y agoWhat is the difference between RPA and macros? edit: It seems fragile in the face of any GUI changes.
- keenmaster 6y agoMy understanding is that they’re more autonomous, more extensible, and generally result in more widespread gains in efficiency than standard macros. https://www.uipath.com/blog/whats-the-difference-between-robots-and-macros https://www.uipath.com/blog/whats-the-difference-between-rob...
- tbrownaw 6y agoRPA is something like "macros on steroids". It tries to be something like shell scripting for script-hostile GUI applications, but at least the one product I've gotten to play with is still way more clunky than proper shell scripting.
- keenmaster 6y agoIn response to your edit: I can see how GUI changes would be a problem for RPAs, but that seems solvable. For minor GUI changes, an RPA can theoretically identify where salient features have remained and just re-train on where they were subjected to change. If that approach fails, you can "show" the computer the new GUI and manually identify what changed. If that fails, you can restart training from scratch with the new GUI. That should take less time than training on the old GUI if the new GUI is any good. Maybe that's the best/cleanest approach in most cases and just becomes annoying with complex processes that need a lot of training data. Keep in mind, though, that RPAs often link together different pieces of software, and if the GUI changes for one of them you'd only have to retrain on that piece. I wouldn't be surprised if enterprise software vendors start optimizing their programs for RPAs so that they don't have to rely on hacky GUI monitoring as much. The end game is that large, frequently run RPAs will serve as a flag for the organization to develop, find, or outsource an end-to-end program that executes the same process without an RPA. RPAs, then, will always be the scout at the frontier of automatable office work, finding who can be freed from rote drudgery next and serving as a bridge to the best programmatic solution.
- ammanley 6y agoVery heartening to hear. You think some of us tired enterprise/product devs that come from non-traditional (read: didn't study CS) background can make it? Any recommended starting resources? I've heard supposedly good things about fast.ai as a "guided tour".
- sillysaurusx 6y agoAbsolutely. I didn't study CS. What you need is determination. There's no substitute for this. If you have that, there are all kinds of resources. Here are a few... Resource 1: a community. We've set up a discord server for AI dev. It has 360 users. At any given time, around ~50 people are online, of which ~10 are skilled devs. Come join! https://discordapp.com/invite/x52Xz3y https://discordapp.com/invite/x52Xz3y Resource 2: Find something fun for you, and pursue that. I like generative AI, so for me that's been GPT-2 and StyleGAN. Gwern has some lovely tutorial-type articles on both. GPT-2: https://www.gwern.net/GPT-2 https://www.gwern.net/GPT-2 StyleGAN: https://www.gwern.net/Faces https://www.gwern.net/Faces Peter Baylies' StyleGAN tutorial notebook is a hands-on resource. This was actually how I started, nearly a year ago. github: https://github.com/pbaylies/stylegan-encoder https://github.com/pbaylies/stylegan-encoder notebook: https://colab.research.google.com/drive/179SPYbBC8pKDxVRjZepIvIma8SITPJvU?usp=sharing https://colab.research.google.com/drive/179SPYbBC8pKDxVRjZep... (The original notebook was broken; this is a copy I've updated with some fixes.) Lastly, follow a bunch of AI people on twitter. Here are a few to get you started: https://twitter.com/i/lists/1160386581850730496/members https://twitter.com/i/lists/1160386581850730496/members The reason to follow them is, whenever you see something that seems interesting or fun, tweet at them and say so! Ask questions. Ask how to get started. Everyone is shockingly nice and helpful. My theory is, the software is so crude and often hard to use, that we all like to celebrate together whenever one of us gets it working, and we're happy to share that knowledge however we can. (Twitter is a bit chaotic right now due to world events, but I imagine it might return to normal within a couple weeks.) And yes, you're right about fast.ai and other courses. You can go that route if you like it. I found it more exciting to dive into the deep end, though, and try to tinker with stuff.
- YeGoblynQueenne 6y ago