11 ms·

Rabbit R1 source code [part 1]

353 points by wibbily 2y ago

perrins 2y ago
[dead]
perrins 2y ago
[dead]
saltsaman 2y ago
...Aaand It's Gone!
- GaggiX 2y ago
  Deleted by the author, no DMCA.
abrichr 2y ago
For an open source alternative, check out https://github.com/OpenAdaptAI/OpenAdapt https://github.com/OpenAdaptAI/OpenAdapt. We combine Segment Anything Model with GPT4-V to understand recordings of workflows in desktop user interfaces, then replay them according to the user's instructions.
deleted 2y ago
[deleted]
popey 2y ago
Looks like the repo was just removed from GH.
- GaggiX 2y ago
  The repo was deleted by the author, no DMCA. I imagine the author realized that the code uploaded do not prove any of the claims made on the README.
Aleksdev 2y ago
Rabbit R1 was such a dumb product. You have to buy a proprietary piece of plastic to use some flavor of chat GPT. Never encountered a person with one.
rideontime 2y ago
Taken down, now archived here: https://web.archive.org/web/20240423183114/https://github.com/rabbitscam/rabbitr1 https://web.archive.org/web/20240423183114/https://github.co...
- GaggiX 2y ago
  Deleted by the author probably because of: https://web.archive.org/web/20240424095544/https://github.com/rabbitscam/rabbitr1/issues/11 https://web.archive.org/web/20240424095544/https://github.co...
ach9l 2y ago
why are people surprised they use playwright? how do they imagine a lam would work? in the end an "action" would always have to come as a computer command, be it an api call, or function call generation, an "action" is code to be executed. transformers generate tokens and only tokens, it is up to you to decide how you want the flow of tokens to be. i find the use of playwright quite clever, you could use puppeteer and make it write scripts for web browsing as well, but in the end an action will always come back to computer code, written as text as a human would do. the fact they use playwright does not imply it is not generative ai, on the contrary it is a clever way of showcasing how to configure a transformer to bypass an api lock-in such as the midjourney one.
m3kw9 2y ago
The UIUX isn’t good, AI models are useless without good user experiences
deleted 2y ago
[deleted]
georgehill 2y ago
Why did they upload the code to some random site instead of GitHub? EDIT: > But let's call a spade a spade – this is a blatant lie. And we're about to expose it with the first partial release of the source code for its so-called "large action model". FYI, Text to Action is possible. I personally tested a couple of apps, but I don't think anything reliable exists like we humans. I would not disregard what they claim is completely false.
- paxys 2y ago
  Because it will be taken down from Github.
- claytonjy 2y ago
  to reduce the chances of GitHub taking it down, perhaps? not sure it'll help though
- no-dr-onboard 2y ago
  It buys time for them. GitHub will have a lengthy internal discussion about DMCA takedown requests and the fact that the code isn't on their server. During this time it'll give the HN and reddit communities time to grab the link and redistribute.
  - georgehill 2y ago
    Understood! But zipped files are super fishy though. What if this repo is spreading malware?
    - fwip 2y ago
      Zip is just a tarball that Windows understands.
- dxbednarczyk 2y ago
  Potentially due to the threat of DMCAs. Pixeldrain and Mega are widely used in piracy and sometimes leaks like these, considering they are not known for complying with them most of the time, unlike GitHub.
ado__dev 2y ago
Not surprised at all. This and the Humane Pin both seemed like a quick cash grab before phones integrated all the new AI goodness. I'm expecting we'll see that window close by the time I/O and WWDC wrap up this year, so they had to move fast.
- miki123211 2y ago
  This is really troubling to me. I feel like all these companies are really hamstrung by the fact that they don't have enough access to our phone's features. There's no way to build a Siri competitor if you're not Apple or Google, the APIs to send and read texts, make calls, control music apps etc just don't exist. Chat GPT integrated with your phone's operating system is a lot more useful than pure Chat GPT. I wouldn't be surprised if Open AI gets dethroned by Apple and Google because of that fact alone. It doesn't matter how good your model is if you're not allowed to use it due to anticompetitive practices. If anything deserves antitrust scrutiny, it's the locking down of private APIs, not some petty disputes about App Store fees.
  - ENGNR 2y ago
    This is why we need change to open it up. We can’t allow a platform to just forever swallow the next layer of tech up forever and ever
  - BenjaminSangwa 2y ago
    100% agree with this. there are ways to jump into apples walled garden though. in a way that they wouldn't be able to stop or patch without fundamentally changing their Eco-system approach. But 100% everyone should be able to build and swap the agent on their device. but it's not your device. its apples. they let you use it. Same with YouTube and our data. it's not really ours. try get your YouTube watch data. it will take 2 weeks by then its 2 weeks old. you can do nothing with that data. much bigger conversations needed that are not happening.
- pnw 2y ago
  A company founded in 2018 that raised over $200m is a "quick cash grab"?
rodiger 2y ago
At least it'll look nice on a shelf thanks to Teenage Engineering's good work :)
- WanderPanda 2y ago
  TE might have their name really damaged by this. I wonder why they agreed to this colab in the first place
  - msephton 2y ago
    The rabbit guy is on the board of Teenage Engineering.
  - micromacrofoot 2y ago
    they were paid money in exchange for services
  - BadHumans 2y ago
    I don't think any fan of Teenage Engineering is no longer a fan because they were paid to design a product that flopped.
    - serf 2y ago
      why not? they clearly wanted to exploit AI hype in order to turn a profit, even if they did so indirectly. Why shouldn't that speak to their motives and trustworthiness? if Apple started churning out guns, landmines, snakeoil, cancer cures, NFTs, and magic-AIs their reputation would falter.
      - wilsonnb3 2y ago
        Apple might be able to get away with all that, their reality distortion field is unmatched, but I agree that teenage engineering might actually take a reputation hit if they are too liberal with their outsourcing. Personally, the Vision Pro wasn’t really my cup of tea but I will be standing in line on day one at my local Apple Store for the Landmine Pro.
aw4y 2y ago
I expect it (or at least I hope) to be really hackable.
- plugin-baby 2y ago
  Based on how hackable their infra is?
  - aw4y 2y ago
    basically
rvz 2y ago
Big if true. Could set back the AI device hype 5 years back after Humane getting exposed as another scam.
- jagger27 2y ago
  You already have the best AI hardware we’ll see for a while in your hand.
  - passion__desire 2y ago
    I remember Mozilla was working on 3D web browsers. Could be new way to do things in Vision Pro? Is there any progress on that front?
adlpz 2y ago
Any background on how the code got leaked? Insider? Hacked servers?
jthnme 2y ago
Some will call it scam, some will call it MVP
- deleted 2y ago
  [deleted]
- godelski 2y ago
  If your product doesn't work anywhere near what your "live demo" shows, it's a scam. That's very different from "here's the product we envision and need money to build it." And just because others have scam demos (including Gemini) that doesn't make it okay. It makes it a race to the bottom (and is why I'm more upset about Gemini because big players are held to higher standards)
- ikurei 2y ago
  In and of itself, the product might be a decent MVP to validate the idea or some aspects of the design. The problem is in how they've marketed. If you're taking people's money and giving them an MVP, you need to be upfront about it; if you aren't you're doing a bad thing.
deleted 2y ago
[deleted]
paxys 2y ago
Meh. I don't think they ever hid the fact that the device is basically a ChatGPT wrapper. As long as it can achieve what it advertises, who cares how the backend looks? At least it has the decency to charge a reasonably price ($200, rather than $700 + subscription like the Ai Pin).
- furyofantares 2y ago
  > I don't think they ever hid the fact that the device is basically a ChatGPT wrapper. "Large Action Model"
- deleted 2y ago
  [deleted]
- deleted 2y ago
  [deleted]
- k8svet 2y ago
  >As long as it can achieve what it advertises, who cares how the backend looks? so if I pump out enough advertising, you're going to give me the usernames, passwords, and active sessions for your accounts to me? I need to log out of this thread asap. I thought the defenses of Ai Pin were going to drive me nuts, I need to preserve some sanity. Has everyone lost their minds? Are tons of people here working for equally scummy, shoddy, if not scammy, startups? Seriously, what the hell.
  - paxys 2y ago
    > you're going to give me the usernames, passwords, and active sessions for your accounts to me? You give all of those to every smartphone maker. Why is this any different? Is there evidence that their handling is insecure?
    - k8svet 2y ago
      If I found out that Android was eavesdropping my Spotify credentials, I'd be just as stupified, yes. If I found that Android built in some Spotify integration that worked by stealing my active session cookies to do some backdoor integration with it, and billed it as some future AI smart service, I'd find it equally g-d absurd, yes. Do I think that me logging into the Spotify app, in Android, and it exchanging those credentials for an app-internal access token is the same as a server hijacking my session? No, not really, I don't. That's what's so damn brazen and shoddy about this. SPOTIFY HAS OAUTH.
GaggiX 2y ago
We already know that the large action model would not be available at launch, but I wonder how well it does works as an AI assistant.
godelski 2y ago
Please upload source in an unzipped format. If the concern is about GitHub taking it down, use an alternative. There's plenty and many other ways to distribute source in an uncompressed manner. Otherwise this is indistinguishable from a hack. How do I know these zips are secure? The mega and pixeldrain report different sizes. Rabbit is entirely about hype and a scam, how are we supposed to know this isn't the same nefarious ploy? I appreciate what's being done and think it's good to call out these scams (I've done so myself) but help by building some trust. We understand the need for anonymity but a nefarious actor could just as easily mascaraed as the same repo. And if you do need files downloaded, provide hashes. (Fwiw, xz, despite recent events, is great at compression and can help you reduce your bandwidth if needed)
- titaniumtown 2y ago
  > (Fwiw, xz, despite recent events, is great at compression and can help you reduce your bandwidth if needed) zstd level 22 is even better in my experience
- nebulous1 2y ago
  What is the reason for it to be uncompressed?
  - mimischi 2y ago
    I suppose the risk of a 0-day in the compression format, given we’re in the post-xz-era. Publishing the source code in clear text would alleviate such risk for the consumer
  - godelski 2y ago
    1. I can read it on my phone or in my browser. 2. Why should I have to download text to __read text__? 3. We don't want to normalize unnecessary behavior that is something scammers and bad actors can easily take advantage of. While I don't believe the leak is nefarious or contains an exploit, normalizing a requirement to download files that can issue exploits -- when there are easy alternatives that make this unnecessary -- just helps create the exact type of environment that scammers thrive in. 3 is incredibly important. If we're going to call out scammers we shouldn't do it in a manner where we're enabling an environment for more scammers to thrive in. Doing what's done here just created a rich opportunity for hackers who can now post a "rabbit source code leak" and just provide people with a different link. Makes for easy picking. Uncompressed and readable code just makes this harder and easier for people to determine if something nefarious is going on.
extr 2y ago
I really think this + the humane AI pin would be super interesting products if they made them hackable. The hardware is super cool, no problem if the software isn't there yet, it's not like they're being sold at Best Buy, I'm not worried about my mom acquiring one of these and getting her passwords leaked. Who cares if the auth flow is super hacky/insecure? Let us self host it! Let the community create more playwright scripts!
- jsunderland323 2y ago
  Yeah, I had a similar thought. If they just removed the ai or only focused on building a voice command to mobile app sdk there could be something viable there. Sadly that’s just not what they made at all.
- roughly 2y ago
  Humane is founded and populated by ex-Apple folks, so I wouldn't hold my breath. You're right, though - it's a bit weird because ostensibly the interface is via the GPT system and you've gotta work through those interactions (same problem Alexa had), but given how early both the platform and the product category are, they'd benefit big from letting early adopters build capabilities for them.
  - harryp_peng 2y ago
    Worst possible thing is that bozos learn the closed source model. The closed source model only worked because they had the Great SJ.
- 999900000999 2y ago
  Agreed. The Rabbit R1 looks like it would be the perfect device to play with. As is I just assumed Rabbit was sending off pictures and stuff to a Chat GPT API or something. I never assumed the models ran on device
- disconcision 2y ago
  this exists! https://www.openinterpreter.com/ https://www.openinterpreter.com/ even their hardware is (apparently) open-sourced
phh 2y ago
> In reality, they're simply relying on several Playwright automation scripts to do the job for you, which is why they only support four apps: Spotify, Midjourney, Doordash, and UberEats. I think that part is mostly fine? I'd rather make give a LLM access to https://woob.tech https://woob.tech to be my personal assistant while parsing 99% less noise, than have a LLM that parse and understand stupidly complicated web pages, and randomly fail at the task because the name of my doctor is bobby drop tables. That being said, it can be interesting to use LLMs to assist creating woob plugins.
- vunderba 2y ago
  Midjourney does not have a public API and I'm pretty sure that automating a Midjourney account is against the TOS, so I wouldn't expect that functionality to last long.
- saltsaman 2y ago
  The problem is that they claim to have developed a groundbreaking Large Action Model when in fact it's just a playwright wrapper
  - ach9l 2y ago
    you can't automate playwright without a decision making component in front of it, they are definitely using a transformer there. one could train a llama and make it perform triggers to playwright automations. you can even get deep into transformer tokenization and create action tokens and a formal grammar for your generation, build a parser on top of your predict function and have a "lam" working. the fact that they use playwright does not imply it is not generative ai. i'd say it is really hard to do those actions without a transformer involved
Jonovono 2y ago
What NFT projects were they involved with?
- ugh123 2y ago
  /s? Underrated comment.
  - itishappy 2y ago
    > Sadly, this shouldn't come as a shock to anyone who's done minimal due diligence on the team. After all, they were still hawking NFTs just two years ago.
  - tripletao 2y ago
    No sarcasm, https://web.archive.org/web/20221203132009/https://gama.io/ https://web.archive.org/web/20221203132009/https://gama.io/
ipsum2 2y ago
I implemented my own DIY version of Rabbit at a hackathon using Playwright and VNC. I feel extremely validated that they use the same things that I thought of.
- rkwz 2y ago
  Wow, can you share more about the Playwright+VNC combo?
kish_kush 2y ago
[flagged]
ugh123 2y ago
If it can do what it claims to do, which is automate on top of existing apps by your voice, whats the difference? Seems innovative regardless of the tech underneath.
amiantos 2y ago
I'm really into AI stuff but both the AI Pin and Rabbit R1 underwhelm. They are products that don't need to exist if the problem they're solving was truly solvable right now, because the best place for that problem to be solved is already in our hands: our phones. But we're not all talking to AI assistants in our phones all day. Why? Because the technology isn't good enough to do it yet? Because people don't want to talk to digital assistants? Once the tech is good enough that it can motivate ordinary people to look silly talking to their phones outloud, it'll be on our phones and easy to use, and there will be no need for kitschy little handheld devices. No one wants to carry around another device. That said, smart glasses sound like a great idea to me, but I wear glasses all ay long, so I am extremely biased. I don't think most people want to voluntarily wear glasses to just put a computer on their face, so I wouldn't bet on glasses, either. Sorry, Zuck.
- ENGNR 2y ago
  Because the phone platforms want 30% of everything sold and won’t let your app change its behaviour. It’s the same reason YouTube and Netflix actively opted out of having their iPads apps work on Vision Pro - platform wars. So the only real play is to be Apple/Android or try to bypass them by pretending there’s a new product category other than a phone and hope to get some small critical mass there.
- azinman2 2y ago
  I don’t know why I need to keep saying this, but the point of the pin is to replace phones. It’s meant for you to have access to digital services while staying in the moment and avoiding a screen. Many ppl are addicted to their smartphones, so they propose something different. You can like and prefer a phone but it’s their raison d’etre.
  - _heimdall 2y ago
    To be fair, it seems reasonable to presume that the goal of these pins is to get users addicted to the new form factor with much less competition in the market rather than to help with tech addiction.
- 2y ago
eterpstra 2y ago
Maybe they hacked together something that can feasibly me marketed as an AI-assistant knowing that whatever they build now will get "steamrolled" by GPT-5 (Sam's words, not mine). When GPT-5 gets released, update the OS and it'll work as advertised... EZ-PZ!
xori 2y ago
Not much here explicitly in the source code dump. A little insight into their worker node infra but no "secret sauce" imo.
- saltsaman 2y ago
  Isn't the secret sauce just VNC with playwright? What more do you need to achieve 80% of what they are showcasing (basic doordash orders, spotify controls)?
  - rhinoceraptor 2y ago
    I can't find any purported auomation scripts for those services as claimed in the Github page. There is a reference to "cm-spotify-client" which seems to be some sort of custom integration code they've written, but other than that there is no reference to doordash, midjourney, or uber eats. This dump seems to just be the code/infrastructure to run chromium/playwright in kubernetes, wrapped in a Node API to accept commands, persist/hydrate browser state, etc.
    - unraveller 2y ago
      Is there a less convoluted less enterprisy implementation of such a project someone can point to. I was interested to see what is or isn't so intensive about it. Or is this a good scaffold to start a fork?
mafuyu 2y ago
Pretty much in-line with my expectations. I ordered one because I thought the design was neat, and I was interested in hacking around and flashing my own stuff onto it. The pricing was clearly at or below cost. Looking at just the concept (and ignoring execution), I don't really see the point of this thing? The whole thing is a feature that could exist on a smartphone. The dream of an AI agent that you can converse with to replace your smartphone could be compelling, but nowhere close to reality yet. Even then, the big smartphone OS companies are obviously better positioned for this. The smartphone is the hub for all your information, plus they have years of voice assistant, automation, and home IoT integration to build off of. Humane was silly because it was a smartwatch without any of the proper software support, but Rabbit is essentially doing the same but targeting a smartphone replacement. If you really want to break out and try to dethrone smartphone vendors, you'll have to come up with something more compelling than a worse user interface to a poorly made software platform. That's a software feature you're building. In some sense, I do think Rabbit had a better approach than Humane, though. Getting a bunch of low-priced "toy" devices into the market that are just a frontend to your server software could get you off the ground. The software needs to exist, though...
animex 2y ago
I just couldn't fathom the big three phone platforms not implementing this on a device that we all have and is capable of same if-not better dynamic voice integration. At the very least, I hope products like the Rabbit spur these companies to start innovating again. Even if they are smoke & mirrors, the interest shows there's demand for these features. Site Note: I've noticed Google Home's voice assistant has declined over time -- it used to handle complex queries and now it can barely understand simple directions. It used to understand me perfectly in the noisiest environments and now it makes many transcribing errors.
- redserk 2y ago
  Like in iOS with SiriKit? Blame app developers for prioritizing implementing less useful features. https://developer.apple.com/documentation/sirikit/ https://developer.apple.com/documentation/sirikit/
  - Wowfunhappy 2y ago
    The problem with Siri is their voice recognition sucks, especially compared to e.g. Whisper.
iamleppert 2y ago
Who cares how its made if you can make a bag from it before anyone is the wiser? The point in all this stuff is to make bags of money, whatever way you can do that don't matter as long as you gettin the bread.
vunderba 2y ago
One of the bizarre talking points in defense of the existence of rabbit was to get away from our phones. It's just completely inexplicable to me because it's not like it was ever intended to be a replacement, the only difference is congratulations you now have to lug around two separate brick shaped appliances wherever you go...
deleted 2y ago
[deleted]
stranded22 2y ago
They gave 12 months perplexity pro with it - and I am already a subscriber. So, I basically paid a bit extra for another 12 months and a rabbit r1 to play with. If it doesn't work how I want, I should be able to sell on whilst keeping the perplexity pro sub.
- linsomniac 2y ago
  So you were able to get your Perplexity Rabbit gift to work? I'm also already a subscriber, and tried several times to get the Rabbit offer to work, and it never seems to have worked.
  - brianjking 2y ago
    Email them, they applied it for me.
anon115 2y ago
LOL
serf 2y ago
I never understood the appeal outside the cute form-factor, all of the demos were absolutely terrible. an aside : npr doesn't like the 'spade' comment, although I think the explanation is kind of iffy.[0] [0]: https://www.npr.org/sections/codeswitch/2013/09/19/224183763/is-it-racist-to-call-a-spade-a-spade https://www.npr.org/sections/codeswitch/2013/09/19/224183763...
latentcall 2y ago
I thought the idea of the Rabbit R1 was cool. I have a strong feeling this will end up like the Humane Pin, which is sad. I'm glad companies are trying something different. I'd love to be able to use my phone hands free without having to look at it, and interface with ChatGPT/Claude/whatever but I am not sure if it's possible? Siri works very poorly and is unreliable. I'd like to be able to use an LLM as a personal assistant. Set timers, call people, message people, but also be able to ask questions like the voice chat function in the ChatGPT app. Maybe one day!
- mulderc 2y ago
  I must be a Siri unicorn but for setting timers, calling people, messaging people, controlling my smart home, adding things to my shared shopping list, adding items to my 3rd party task manager, controlling my music. It works great!
NetOpWibby 2y ago
According to their CTO in the Discord[0]: > If someone spends enough time with the login minions they can extract these code. But these code are locked down and are sanitized. LAM lives elsewhere. This is someone looking at the rabbit hole not understanding how it works. And tries to be smart. [0]: https://cdn.discordapp.com/attachments/1185274946981732374/1232410511652687902/IMG_8101.png?ex=66295b3b&is=662809bb&hm=929befc438ea4ca2e7d459a1ef1b2a3caa562e9d0597e8472316af396672e021& https://cdn.discordapp.com/attachments/1185274946981732374/1...
- patleeman 2y ago
  Can somebody translate this?
  - kotaKat 2y ago
    The code is their "minions" to handle actions on websites. When you ask it to, say, book a trip, and it tries to search AirBnB. "If someone spends enough time with the login minions they can extract these code" AKA "Someone will figure out how this worked, but our code is secure, trust us". The "rabbit hole" they mention is the whole "cloud" system that Rabbit talks about using to manage all of your services and integrations and 'rabbits' you create that run tasks.
    - saltsaman 2y ago
      So it is a confirmed leak and they are just doing damage control?
      - rhinoceraptor 2y ago
        It seems to just be a leak of their sandboxed headless browser setup and the API code for controlling it. Obviously such a thing will run arbitrary JS from the web so inevitably there will be something like a browser sandbox exploit, and subsequent dump of its filesystem. The leak doesn't seem to contain what Rabbit calls the LAM, their purported AI model for interacting with UIs. And what the leakers are claiming is that Rabbit's automation is just handwritten scripts which seems to be completely unsubstantiated. The rabbit secret sauce could still turn out to be a scam but I didn't see anything to corroborate any of the leakers' claims. Grepping the files I found no reference to doordash, uber eats or midjourney, only a path reference to what appears to be a spotify integration library, but the source for that isn't there.

353 points by wibbily 2y ago

perrins 2y ago

[dead]

perrins 2y ago

[dead]

saltsaman 2y ago

...Aaand It's Gone!

GaggiX 2y ago
Deleted by the author, no DMCA.

abrichr 2y ago

For an open source alternative, check out https://github.com/OpenAdaptAI/OpenAdapt https://github.com/OpenAdaptAI/OpenAdapt. We combine Segment Anything Model with GPT4-V to understand recordings of workflows in desktop user interfaces, then replay them according to the user's instructions.

deleted 2y ago

[deleted]

popey 2y ago

Looks like the repo was just removed from GH.

GaggiX 2y ago
The repo was deleted by the author, no DMCA. I imagine the author realized that the code uploaded do not prove any of the claims made on the README.

Aleksdev 2y ago

Rabbit R1 was such a dumb product. You have to buy a proprietary piece of plastic to use some flavor of chat GPT. Never encountered a person with one.

rideontime 2y ago

Taken down, now archived here: https://web.archive.org/web/20240423183114/https://github.com/rabbitscam/rabbitr1 https://web.archive.org/web/20240423183114/https://github.co...

GaggiX 2y ago
Deleted by the author probably because of: https://web.archive.org/web/20240424095544/https://github.com/rabbitscam/rabbitr1/issues/11 https://web.archive.org/web/20240424095544/https://github.co...

ach9l 2y ago

why are people surprised they use playwright? how do they imagine a lam would work? in the end an "action" would always have to come as a computer command, be it an api call, or function call generation, an "action" is code to be executed. transformers generate tokens and only tokens, it is up to you to decide how you want the flow of tokens to be. i find the use of playwright quite clever, you could use puppeteer and make it write scripts for web browsing as well, but in the end an action will always come back to computer code, written as text as a human would do. the fact they use playwright does not imply it is not generative ai, on the contrary it is a clever way of showcasing how to configure a transformer to bypass an api lock-in such as the midjourney one.

m3kw9 2y ago

The UIUX isn’t good, AI models are useless without good user experiences

deleted 2y ago

[deleted]

georgehill 2y ago

Why did they upload the code to some random site instead of GitHub? EDIT: > But let's call a spade a spade – this is a blatant lie. And we're about to expose it with the first partial release of the source code for its so-called "large action model". FYI, Text to Action is possible. I personally tested a couple of apps, but I don't think anything reliable exists like we humans. I would not disregard what they claim is completely false.

paxys 2y ago
Because it will be taken down from Github.
claytonjy 2y ago
to reduce the chances of GitHub taking it down, perhaps? not sure it'll help though
no-dr-onboard 2y ago
It buys time for them. GitHub will have a lengthy internal discussion about DMCA takedown requests and the fact that the code isn't on their server. During this time it'll give the HN and reddit communities time to grab the link and redistribute.
- georgehill 2y ago
  Understood! But zipped files are super fishy though. What if this repo is spreading malware?
  - fwip 2y ago
    Zip is just a tarball that Windows understands.
dxbednarczyk 2y ago
Potentially due to the threat of DMCAs. Pixeldrain and Mega are widely used in piracy and sometimes leaks like these, considering they are not known for complying with them most of the time, unlike GitHub.

ado__dev 2y ago

Not surprised at all. This and the Humane Pin both seemed like a quick cash grab before phones integrated all the new AI goodness. I'm expecting we'll see that window close by the time I/O and WWDC wrap up this year, so they had to move fast.

miki123211 2y ago
This is really troubling to me. I feel like all these companies are really hamstrung by the fact that they don't have enough access to our phone's features. There's no way to build a Siri competitor if you're not Apple or Google, the APIs to send and read texts, make calls, control music apps etc just don't exist. Chat GPT integrated with your phone's operating system is a lot more useful than pure Chat GPT. I wouldn't be surprised if Open AI gets dethroned by Apple and Google because of that fact alone. It doesn't matter how good your model is if you're not allowed to use it due to anticompetitive practices. If anything deserves antitrust scrutiny, it's the locking down of private APIs, not some petty disputes about App Store fees.
- ENGNR 2y ago
  This is why we need change to open it up. We can’t allow a platform to just forever swallow the next layer of tech up forever and ever
- BenjaminSangwa 2y ago
  100% agree with this. there are ways to jump into apples walled garden though. in a way that they wouldn't be able to stop or patch without fundamentally changing their Eco-system approach. But 100% everyone should be able to build and swap the agent on their device. but it's not your device. its apples. they let you use it. Same with YouTube and our data. it's not really ours. try get your YouTube watch data. it will take 2 weeks by then its 2 weeks old. you can do nothing with that data. much bigger conversations needed that are not happening.
pnw 2y ago
A company founded in 2018 that raised over $200m is a "quick cash grab"?

rodiger 2y ago

At least it'll look nice on a shelf thanks to Teenage Engineering's good work :)

WanderPanda 2y ago
TE might have their name really damaged by this. I wonder why they agreed to this colab in the first place
- msephton 2y ago
  The rabbit guy is on the board of Teenage Engineering.
- micromacrofoot 2y ago
  they were paid money in exchange for services
- BadHumans 2y ago
  I don't think any fan of Teenage Engineering is no longer a fan because they were paid to design a product that flopped.
  - serf 2y ago
    why not? they clearly wanted to exploit AI hype in order to turn a profit, even if they did so indirectly. Why shouldn't that speak to their motives and trustworthiness? if Apple started churning out guns, landmines, snakeoil, cancer cures, NFTs, and magic-AIs their reputation would falter.
    - wilsonnb3 2y ago
      Apple might be able to get away with all that, their reality distortion field is unmatched, but I agree that teenage engineering might actually take a reputation hit if they are too liberal with their outsourcing. Personally, the Vision Pro wasn’t really my cup of tea but I will be standing in line on day one at my local Apple Store for the Landmine Pro.

aw4y 2y ago

I expect it (or at least I hope) to be really hackable.

plugin-baby 2y ago
Based on how hackable their infra is?
- aw4y 2y ago
  basically

rvz 2y ago

Big if true. Could set back the AI device hype 5 years back after Humane getting exposed as another scam.

jagger27 2y ago
You already have the best AI hardware we’ll see for a while in your hand.
- passion__desire 2y ago
  I remember Mozilla was working on 3D web browsers. Could be new way to do things in Vision Pro? Is there any progress on that front?

adlpz 2y ago

Any background on how the code got leaked? Insider? Hacked servers?

jthnme 2y ago

Some will call it scam, some will call it MVP

deleted 2y ago
[deleted]
godelski 2y ago
If your product doesn't work anywhere near what your "live demo" shows, it's a scam. That's very different from "here's the product we envision and need money to build it." And just because others have scam demos (including Gemini) that doesn't make it okay. It makes it a race to the bottom (and is why I'm more upset about Gemini because big players are held to higher standards)
ikurei 2y ago
In and of itself, the product might be a decent MVP to validate the idea or some aspects of the design. The problem is in how they've marketed. If you're taking people's money and giving them an MVP, you need to be upfront about it; if you aren't you're doing a bad thing.

deleted 2y ago

[deleted]

paxys 2y ago

Meh. I don't think they ever hid the fact that the device is basically a ChatGPT wrapper. As long as it can achieve what it advertises, who cares how the backend looks? At least it has the decency to charge a reasonably price ($200, rather than $700 + subscription like the Ai Pin).

furyofantares 2y ago
> I don't think they ever hid the fact that the device is basically a ChatGPT wrapper. "Large Action Model"
deleted 2y ago
[deleted]
deleted 2y ago
[deleted]
k8svet 2y ago
>As long as it can achieve what it advertises, who cares how the backend looks? so if I pump out enough advertising, you're going to give me the usernames, passwords, and active sessions for your accounts to me? I need to log out of this thread asap. I thought the defenses of Ai Pin were going to drive me nuts, I need to preserve some sanity. Has everyone lost their minds? Are tons of people here working for equally scummy, shoddy, if not scammy, startups? Seriously, what the hell.
- paxys 2y ago
  > you're going to give me the usernames, passwords, and active sessions for your accounts to me? You give all of those to every smartphone maker. Why is this any different? Is there evidence that their handling is insecure?
  - k8svet 2y ago
    If I found out that Android was eavesdropping my Spotify credentials, I'd be just as stupified, yes. If I found that Android built in some Spotify integration that worked by stealing my active session cookies to do some backdoor integration with it, and billed it as some future AI smart service, I'd find it equally g-d absurd, yes. Do I think that me logging into the Spotify app, in Android, and it exchanging those credentials for an app-internal access token is the same as a server hijacking my session? No, not really, I don't. That's what's so damn brazen and shoddy about this. SPOTIFY HAS OAUTH.

GaggiX 2y ago

We already know that the large action model would not be available at launch, but I wonder how well it does works as an AI assistant.

godelski 2y ago

Please upload source in an unzipped format. If the concern is about GitHub taking it down, use an alternative. There's plenty and many other ways to distribute source in an uncompressed manner. Otherwise this is indistinguishable from a hack. How do I know these zips are secure? The mega and pixeldrain report different sizes. Rabbit is entirely about hype and a scam, how are we supposed to know this isn't the same nefarious ploy? I appreciate what's being done and think it's good to call out these scams (I've done so myself) but help by building some trust. We understand the need for anonymity but a nefarious actor could just as easily mascaraed as the same repo. And if you do need files downloaded, provide hashes. (Fwiw, xz, despite recent events, is great at compression and can help you reduce your bandwidth if needed)

titaniumtown 2y ago
> (Fwiw, xz, despite recent events, is great at compression and can help you reduce your bandwidth if needed) zstd level 22 is even better in my experience
nebulous1 2y ago
What is the reason for it to be uncompressed?
- mimischi 2y ago
  I suppose the risk of a 0-day in the compression format, given we’re in the post-xz-era. Publishing the source code in clear text would alleviate such risk for the consumer
- godelski 2y ago
  1. I can read it on my phone or in my browser. 2. Why should I have to download text to __read text__? 3. We don't want to normalize unnecessary behavior that is something scammers and bad actors can easily take advantage of. While I don't believe the leak is nefarious or contains an exploit, normalizing a requirement to download files that can issue exploits -- when there are easy alternatives that make this unnecessary -- just helps create the exact type of environment that scammers thrive in. 3 is incredibly important. If we're going to call out scammers we shouldn't do it in a manner where we're enabling an environment for more scammers to thrive in. Doing what's done here just created a rich opportunity for hackers who can now post a "rabbit source code leak" and just provide people with a different link. Makes for easy picking. Uncompressed and readable code just makes this harder and easier for people to determine if something nefarious is going on.

extr 2y ago

I really think this + the humane AI pin would be super interesting products if they made them hackable. The hardware is super cool, no problem if the software isn't there yet, it's not like they're being sold at Best Buy, I'm not worried about my mom acquiring one of these and getting her passwords leaked. Who cares if the auth flow is super hacky/insecure? Let us self host it! Let the community create more playwright scripts!

jsunderland323 2y ago
Yeah, I had a similar thought. If they just removed the ai or only focused on building a voice command to mobile app sdk there could be something viable there. Sadly that’s just not what they made at all.
roughly 2y ago
Humane is founded and populated by ex-Apple folks, so I wouldn't hold my breath. You're right, though - it's a bit weird because ostensibly the interface is via the GPT system and you've gotta work through those interactions (same problem Alexa had), but given how early both the platform and the product category are, they'd benefit big from letting early adopters build capabilities for them.
- harryp_peng 2y ago
  Worst possible thing is that bozos learn the closed source model. The closed source model only worked because they had the Great SJ.
999900000999 2y ago
Agreed. The Rabbit R1 looks like it would be the perfect device to play with. As is I just assumed Rabbit was sending off pictures and stuff to a Chat GPT API or something. I never assumed the models ran on device
disconcision 2y ago
this exists! https://www.openinterpreter.com/ https://www.openinterpreter.com/ even their hardware is (apparently) open-sourced

phh 2y ago

> In reality, they're simply relying on several Playwright automation scripts to do the job for you, which is why they only support four apps: Spotify, Midjourney, Doordash, and UberEats. I think that part is mostly fine? I'd rather make give a LLM access to https://woob.tech https://woob.tech to be my personal assistant while parsing 99% less noise, than have a LLM that parse and understand stupidly complicated web pages, and randomly fail at the task because the name of my doctor is bobby drop tables. That being said, it can be interesting to use LLMs to assist creating woob plugins.

vunderba 2y ago
Midjourney does not have a public API and I'm pretty sure that automating a Midjourney account is against the TOS, so I wouldn't expect that functionality to last long.
saltsaman 2y ago
The problem is that they claim to have developed a groundbreaking Large Action Model when in fact it's just a playwright wrapper
- ach9l 2y ago
  you can't automate playwright without a decision making component in front of it, they are definitely using a transformer there. one could train a llama and make it perform triggers to playwright automations. you can even get deep into transformer tokenization and create action tokens and a formal grammar for your generation, build a parser on top of your predict function and have a "lam" working. the fact that they use playwright does not imply it is not generative ai. i'd say it is really hard to do those actions without a transformer involved

Jonovono 2y ago

What NFT projects were they involved with?

ugh123 2y ago
/s? Underrated comment.
- itishappy 2y ago
  > Sadly, this shouldn't come as a shock to anyone who's done minimal due diligence on the team. After all, they were still hawking NFTs just two years ago.
- tripletao 2y ago
  No sarcasm, https://web.archive.org/web/20221203132009/https://gama.io/ https://web.archive.org/web/20221203132009/https://gama.io/

ipsum2 2y ago

I implemented my own DIY version of Rabbit at a hackathon using Playwright and VNC. I feel extremely validated that they use the same things that I thought of.

rkwz 2y ago
Wow, can you share more about the Playwright+VNC combo?

kish_kush 2y ago

[flagged]

ugh123 2y ago

If it can do what it claims to do, which is automate on top of existing apps by your voice, whats the difference? Seems innovative regardless of the tech underneath.

amiantos 2y ago

I'm really into AI stuff but both the AI Pin and Rabbit R1 underwhelm. They are products that don't need to exist if the problem they're solving was truly solvable right now, because the best place for that problem to be solved is already in our hands: our phones. But we're not all talking to AI assistants in our phones all day. Why? Because the technology isn't good enough to do it yet? Because people don't want to talk to digital assistants? Once the tech is good enough that it can motivate ordinary people to look silly talking to their phones outloud, it'll be on our phones and easy to use, and there will be no need for kitschy little handheld devices. No one wants to carry around another device. That said, smart glasses sound like a great idea to me, but I wear glasses all ay long, so I am extremely biased. I don't think most people want to voluntarily wear glasses to just put a computer on their face, so I wouldn't bet on glasses, either. Sorry, Zuck.

ENGNR 2y ago
Because the phone platforms want 30% of everything sold and won’t let your app change its behaviour. It’s the same reason YouTube and Netflix actively opted out of having their iPads apps work on Vision Pro - platform wars. So the only real play is to be Apple/Android or try to bypass them by pretending there’s a new product category other than a phone and hope to get some small critical mass there.
azinman2 2y ago
I don’t know why I need to keep saying this, but the point of the pin is to replace phones. It’s meant for you to have access to digital services while staying in the moment and avoiding a screen. Many ppl are addicted to their smartphones, so they propose something different. You can like and prefer a phone but it’s their raison d’etre.
- _heimdall 2y ago
  To be fair, it seems reasonable to presume that the goal of these pins is to get users addicted to the new form factor with much less competition in the market rather than to help with tech addiction.
2y ago

eterpstra 2y ago

Maybe they hacked together something that can feasibly me marketed as an AI-assistant knowing that whatever they build now will get "steamrolled" by GPT-5 (Sam's words, not mine). When GPT-5 gets released, update the OS and it'll work as advertised... EZ-PZ!

xori 2y ago

Not much here explicitly in the source code dump. A little insight into their worker node infra but no "secret sauce" imo.

saltsaman 2y ago
Isn't the secret sauce just VNC with playwright? What more do you need to achieve 80% of what they are showcasing (basic doordash orders, spotify controls)?
- rhinoceraptor 2y ago
  I can't find any purported auomation scripts for those services as claimed in the Github page. There is a reference to "cm-spotify-client" which seems to be some sort of custom integration code they've written, but other than that there is no reference to doordash, midjourney, or uber eats. This dump seems to just be the code/infrastructure to run chromium/playwright in kubernetes, wrapped in a Node API to accept commands, persist/hydrate browser state, etc.
  - unraveller 2y ago
    Is there a less convoluted less enterprisy implementation of such a project someone can point to. I was interested to see what is or isn't so intensive about it. Or is this a good scaffold to start a fork?

mafuyu 2y ago

Pretty much in-line with my expectations. I ordered one because I thought the design was neat, and I was interested in hacking around and flashing my own stuff onto it. The pricing was clearly at or below cost. Looking at just the concept (and ignoring execution), I don't really see the point of this thing? The whole thing is a feature that could exist on a smartphone. The dream of an AI agent that you can converse with to replace your smartphone could be compelling, but nowhere close to reality yet. Even then, the big smartphone OS companies are obviously better positioned for this. The smartphone is the hub for all your information, plus they have years of voice assistant, automation, and home IoT integration to build off of. Humane was silly because it was a smartwatch without any of the proper software support, but Rabbit is essentially doing the same but targeting a smartphone replacement. If you really want to break out and try to dethrone smartphone vendors, you'll have to come up with something more compelling than a worse user interface to a poorly made software platform. That's a software feature you're building. In some sense, I do think Rabbit had a better approach than Humane, though. Getting a bunch of low-priced "toy" devices into the market that are just a frontend to your server software could get you off the ground. The software needs to exist, though...

animex 2y ago

I just couldn't fathom the big three phone platforms not implementing this on a device that we all have and is capable of same if-not better dynamic voice integration. At the very least, I hope products like the Rabbit spur these companies to start innovating again. Even if they are smoke & mirrors, the interest shows there's demand for these features. Site Note: I've noticed Google Home's voice assistant has declined over time -- it used to handle complex queries and now it can barely understand simple directions. It used to understand me perfectly in the noisiest environments and now it makes many transcribing errors.

redserk 2y ago
Like in iOS with SiriKit? Blame app developers for prioritizing implementing less useful features. https://developer.apple.com/documentation/sirikit/ https://developer.apple.com/documentation/sirikit/
- Wowfunhappy 2y ago
  The problem with Siri is their voice recognition sucks, especially compared to e.g. Whisper.

iamleppert 2y ago

Who cares how its made if you can make a bag from it before anyone is the wiser? The point in all this stuff is to make bags of money, whatever way you can do that don't matter as long as you gettin the bread.

vunderba 2y ago

One of the bizarre talking points in defense of the existence of rabbit was to get away from our phones. It's just completely inexplicable to me because it's not like it was ever intended to be a replacement, the only difference is congratulations you now have to lug around two separate brick shaped appliances wherever you go...

deleted 2y ago

[deleted]

stranded22 2y ago

They gave 12 months perplexity pro with it - and I am already a subscriber. So, I basically paid a bit extra for another 12 months and a rabbit r1 to play with. If it doesn't work how I want, I should be able to sell on whilst keeping the perplexity pro sub.

linsomniac 2y ago
So you were able to get your Perplexity Rabbit gift to work? I'm also already a subscriber, and tried several times to get the Rabbit offer to work, and it never seems to have worked.
- brianjking 2y ago
  Email them, they applied it for me.

anon115 2y ago

LOL

serf 2y ago

I never understood the appeal outside the cute form-factor, all of the demos were absolutely terrible. an aside : npr doesn't like the 'spade' comment, although I think the explanation is kind of iffy.[0] [0]: https://www.npr.org/sections/codeswitch/2013/09/19/224183763/is-it-racist-to-call-a-spade-a-spade https://www.npr.org/sections/codeswitch/2013/09/19/224183763...

latentcall 2y ago

I thought the idea of the Rabbit R1 was cool. I have a strong feeling this will end up like the Humane Pin, which is sad. I'm glad companies are trying something different. I'd love to be able to use my phone hands free without having to look at it, and interface with ChatGPT/Claude/whatever but I am not sure if it's possible? Siri works very poorly and is unreliable. I'd like to be able to use an LLM as a personal assistant. Set timers, call people, message people, but also be able to ask questions like the voice chat function in the ChatGPT app. Maybe one day!

mulderc 2y ago
I must be a Siri unicorn but for setting timers, calling people, messaging people, controlling my smart home, adding things to my shared shopping list, adding items to my 3rd party task manager, controlling my music. It works great!

NetOpWibby 2y ago

According to their CTO in the Discord[0]: > If someone spends enough time with the login minions they can extract these code. But these code are locked down and are sanitized. LAM lives elsewhere. This is someone looking at the rabbit hole not understanding how it works. And tries to be smart. [0]: https://cdn.discordapp.com/attachments/1185274946981732374/1232410511652687902/IMG_8101.png?ex=66295b3b&is=662809bb&hm=929befc438ea4ca2e7d459a1ef1b2a3caa562e9d0597e8472316af396672e021& https://cdn.discordapp.com/attachments/1185274946981732374/1...

patleeman 2y ago
Can somebody translate this?
- kotaKat 2y ago
  The code is their "minions" to handle actions on websites. When you ask it to, say, book a trip, and it tries to search AirBnB. "If someone spends enough time with the login minions they can extract these code" AKA "Someone will figure out how this worked, but our code is secure, trust us". The "rabbit hole" they mention is the whole "cloud" system that Rabbit talks about using to manage all of your services and integrations and 'rabbits' you create that run tasks.
  - saltsaman 2y ago
    So it is a confirmed leak and they are just doing damage control?
    - rhinoceraptor 2y ago
      It seems to just be a leak of their sandboxed headless browser setup and the API code for controlling it. Obviously such a thing will run arbitrary JS from the web so inevitably there will be something like a browser sandbox exploit, and subsequent dump of its filesystem. The leak doesn't seem to contain what Rabbit calls the LAM, their purported AI model for interacting with UIs. And what the leakers are claiming is that Rabbit's automation is just handwritten scripts which seems to be completely unsubstantiated. The rabbit secret sauce could still turn out to be a scam but I didn't see anything to corroborate any of the leakers' claims. Grepping the files I found no reference to doordash, uber eats or midjourney, only a path reference to what appears to be a spotify integration library, but the source for that isn't there.