9 ms·
Reverse engineering yet another eBook format
- tapia 4y agoThis is really an issue that should not exist. I have also bought textbooks only to be immediately disappointed by the fact that you have to use a specific app (like the adobe DRM thing... or just try to get your money back). Then you have to start figuring out how to remove the DRM and lose time with that. Sometimes the quality of the book is also pretty bad, e.g. they don't even include a digital table of contents, which should be essential in a digital copy of any book (this has happened to me with textbooks from Springer). In my case, this has lead to actually buying less textbooks and just pirate the books instead. I don't have the time to deal with all this customer-unfriendly behavior.
- hackernewds 4y agoThese are pretty poor excuses to cope with piracy
- brutusborn 4y agoIf legal options aren’t useable, the black market will fill the void. Once this is fixed, the dynamic swings back (like how torrenting became less popular since streaming services) You might find it immoral, but 99% of the world disagrees with you (e.g. ubiquity of illegal drug use worldwide)
- midoridensha 4y agoMaybe my perception is off, but it seemed to me that torrenting really dropped off a cliff when Netflix was dominant, and had basically everything available on it. Then, when the streaming service market blew up because the content owners wanted to make more money by only offering their content on their own service (Disney+, CBS all access, etc.), torrenting went back up because it was no longer inexpensive for a streaming subscription, since you needed a dozen of them to cover everything you wanted to see (with usually only one show on one service that you care about).
- brutusborn 4y agoYeah definitely, the pendulum swings based on consumer satisfaction. Hopefully streaming can be federated in some way and we can get past this phase.
- midoridensha 4y agoI kinda doubt it: doing so would decrease profits, because you wouldn't, for instance, be able to pay a tiny amount to just watch one show on Disney+ instead of having to buy a full subscription. Instead, it's going to be like cable TV and landline telephone service: something new will come along to attract people's attention, and they'll just keep pissing customers off, and as more and more leave, the service will get worse and worse, and the prices higher and higher, to take advantage of the suckers who refuse to leave, until the whole thing finally implodes.
- tapia 4y agoI think that the poor excuses are in the other side. Adding DRM to files to actively preventing the user to choose in which devices he/she wants to read the file and for how long the content will be available goes against the whole concept of "buying" a book. When I buy a book I expect to be able to open it in ten years in whatever device I'm using, running any OS that I want. That's why we have standard formats. And I also expect that the quality of a book for which I payed 50-90€ for (because that is normally the price range) to have a good quality and at least a table of contents. A few occasions I had to manually add table of contents for books that otherwise would have been unusable to me.
- T3OU-736 4y ago"buying a book". You're not, though. Nor a film/movie. It is, at least in the US, treated as something along the lines of a temporary contract to view. And so... DRM is used to as a tool of enforcement of the contract term's expiration.
- inkblotuniverse 4y agoHence piracy is the better option.
- midoridensha 4y agoPiracy is the moral option.
- suprjami 4y agoYeah, that's the whole problem.
- goosedragons 4y agoOne of my textbooks came with a digital copy. I would sometimes just use that on my iPad instead of lugging in the physical book to campus. I remember racking my brain all day on a problem that asked you to prove some result, wondering how the hell that was true only to get home and realize the digital version flipped the inequality...
- psychphysic 4y agoCould have been a Dantzig moment![0] [0] https://www.snopes.com/fact-check/the-unsolvable-math-problem/ https://www.snopes.com/fact-check/the-unsolvable-math-proble...
- charlieyu1 4y agoAs a maths teacher who also have written a textbook, I have seen a drastic increase in errors in books compared to 5-10 years ago. I don't know why, maybe the scheduler is tighter or proofreading is now too expensive.
- this-pony 4y agoFrom what I heard, it’s because Springer et al. hired editors in India to cut costs…
- ta988 4y agoThe last springer book I've had is so poorly written that there is absolutely no way it was proofread. It is not just one mistake here or there. It looks like a quick draft with incomplete sentences, repetitions all over. Looks like those "cheap" packt books.
- jtbayly 4y agoI have a $70 ebook (Amazon Kindle) of an academic work (not a textbook) and it is practically unusable. So many problems compared to the physical book. Never again.
- Finnucane 4y agoHandling complex material has never been a priority for the Kindle. To be fair, more recent iterations have improved support for things like tables and MathMl, but it’s still a work in progress.
- treeman79 4y agoWith my adhd I learn programming drastically better on physical books. Stupid I know, but it helps drastically to see it on paper. Sadly it’s either crazy expensive, or not even an option to get paper for newer frameworks
- ykonstant 4y ago> Stupid I know, but it helps drastically to see it on paper. Not stupid at all. Myself, and every single colleague of mine that I know (pure mathematicians) have to print every non-trivial document that we really want to study deeply.
- TeMPOraL 4y agoI'm reminded of 'edw519, and his habit of printing out source code listings to work on without losing focus. See e.g. http://static.v25media.com/edw519_mod.html#chapter_49 http://static.v25media.com/edw519_mod.html#chapter_49, and then CTRL+F for "print" from there.
- treeman79 4y agoI used to do this all the time in my early career. Stopped at some point. Probably when I stopped working on really hard things and started working on complicated things that touch tons of files. Going to try this again. It was really helpful
- viraptor 4y ago> Downloading the files was super easy, barely an inconvenience I love how the zeitgeist / popular culture allows this expression to escape the original context and become popular, but not a silly meme.
- Chinjut 4y agoWhat expression? What was the original context?
- edflsafoiewq 4y agohttps://www.urbandictionary.com/define.php?term=Super%20Easy%2C%20Barely%20an%20Inconvenience https://www.urbandictionary.com/define.php?term=Super%20Easy...
- eesmith 4y agoI was curious if there was an older history. A Google Book search for: "Super Easy" "Barely an Inconvenience" indeed found nothing before about 2018, and then a few books use that combined phrase. Most intriguingly, one is in Shatner's 2022 book "Boldly Go: Reflections on a Life of Awe and Wonder" > Two of my three daughters live within a couple of miles of my house, while the other lives about fifty miles away - super easy to visit, barely an inconvenience. Either he's really plugged into YouTubers or I can't help but think it comes from a ghostwriter.
- thrdbndndn 4y agoAlmost all the non-major online ebook viewers are like that. Some of them would obfuscate the image resources, but that's about it. Big players typically have something "better". Bookwalker (a Japanese ebook vendor) has the most complicated viewers in my experience, and it always convert all the text to image on server side before serving. (And it obfuscates the images on server side too, so you have to reverse this process yourself if you want to download them).
- xvilka 4y ago> it always convert all the text to image on server side before serving. It probably easy to recover to absolute precision with OpenAI-like models. I bet using AI could help a lot with recovering books in the future.
- innocenat 4y agoBookWalker generally don't have exclusive rights to their books, so just buy from other place instead. On books that they do have exclusivity, though, people are doing exactly that, OCR the book and recreate the EPUB.
- thrdbndndn 4y agoPeople also have already cracked their Android client so you can straight up get EPUBs. But it's not publically available since BW is very quick about patching their app once the crack is well known.
- chocolatkey 4y agoReverse-engineering Japanese ebook DRM is much more fun than English. You run into all sorts of mistaken cryptography assumptions, fun exploits, obfuscation etc. Hint for bookwalker: check out the app
- yellow_lead 4y agoCan anyone tell me the status of Kindle DRM? I want to buy some kindle only books but don't own a kindle. Is this even doable?
- blackoil 4y agoNot the answer you seek, but Kindle has apps for major platforms and a web based viewer.
- themadturk 4y agoThe problem is that the latest versions of the Amazon reader for PC and Mac don't download the books in a format compatible with Calibre's DeDRM scripts. This is compounded by Amazon flipping off the choice to always update the software automatically (yes, it's stated as "always update automatically" if checked), so the first thing you have to do when starting up is go into settings and make sure the checkbox is cleared.
- yellow_lead 4y agoStill useful - thanks!
- vrotaru 4y agoThe web based reader will refuse to display some books, unfortunately. In my case this was the sort of book than can be only realistically read on a big screen tablet, not on a Kindle. Well, I've shrugged and downloaded the pdf from libgen
- markx2 4y agoThere are plugins - a search will find them - you can use with Calibre to remove DRM. https://calibre-ebook.com/ https://calibre-ebook.com/
- rdl 4y agoI don’t think there is an easy way to DeDRM the latest kindle format used by the Mac/pc and iOS reader, and there is no easy way to download all kindle books in your account for “transfer to device via usb” for e-ink devices all at once. I’m trying to archive my 4k or so kindle books (already did a similar number of audible using openaudible) because I don’t trust Amazon to preserve access to them indefinitely.
- PaulHoule 4y agoThose web viewers for e-Books make PDF look great. There is nothing I dread more at the library for my uni than seeing a book is "in the collection" but is only visible through a web viewer. It's like trying to read the book through a shaving mirror. (1) They try to slice the book into the thinnest possible salami so you are always click click clicking to navigate (2) You can't download the book to read on the bus (3) There is a general "evil" trend in the web to hide the content as much as possible. Cookie popups and "subscribe to our email newsletter" popups count, but hard-to-use navigation, <iframe> and friends all make their contribution. You'd think the people who make this stuff are paid more the less content is visible on the page. (4) and of course it seems like the people are paid the more you have to struggle to log in.
- rightbyte 4y agoYe. I find it insane that it is faster to look in the paper book register and find the correct page then search their crappy ebooks. I have timed it. The ebook experience is abyssal.
- cl3misch 4y ago> My old instincts kicked in and I decided it would be more fun to hack and blog for a week than to waste any time dealing with the customer support. Don't get me wrong, I like reverse engineering as much as the next guy. But if you really are annoyed by such DRM tactics, you _should_ deal with their customer support to communicate your frustration. Otherwise, nothing will ever change.
- survirtual 4y agoSince when has complaining to customer support as a retail consumer ever changed anything? Retail can cause change by using third party media channels and, by some miracle, generating enough attention that it makes business sense to respond. Enterprise customers are a different story.
- userbinator 4y agoIf they get enough angry expletive-laced rants about how horrible their system is, maybe they'll pass that feedback on. And you get a good catharsis out of it.
- midoridensha 4y agoYou're just wasting your breath, and the CS people don't care.
- notwokeno 4y agoNo. This stuff is intentional and the reader isn't the customer.
- Gigachad 4y agoExtract the file and then complain to support for a refund.
- i_am_toaster 4y agoI probably would have stopped at the pdf level because I’m lazy. Thanks for not being me, following through with your hatred, and doing a short write-up!
- barnacled 4y agoI am writing a book I intend to release commercially, and a good sized one at that (likely 1,500 pages+). I am absolutely stubbornly determined to release it as both print and DRM-free PDF. It'll get pirated anyway (if anybody cares enough to do so), so why bother punishing paying customers?
- frankfrankfrank 4y agoHe was clearly not happy with owning nothing.
- thot_experiment 4y ago> More importantly, allow me to retire from having to write the tools that bypass your restrictions. FFS PLEASE! I waste so much of my life fighting DRM and anti-RE measures. It's so infinitely frustrating to fight against stuff that shouldn't exist in the first place. Someone wasted their time to waste my time and in the end we end up exactly in the same spot.
- inadequatespace 4y agoYep. Unfortunately, the someone in question was paid in money, rather than respect, which puts food on the table for them.
- midoridensha 4y agoNo, you don't wind up in the same spot. Most customers aren't like you, and don't waste their time fighting DRM and anti-RE measures: they just put up with the BS and pay through the nose for it. So the publishers profit handsomely, and the people they employ to write all that BS get paid too. The customers of all the ebooks get shafted, but they don't care about that, and they certainly don't care that they made your life harder so they could make more profit.
- chungy 4y agoI'm flabbergasted by a digital-only edition being $82. That's a price I'd find step even for print. I paid less than that for the print+digital combination of The Art of Computer Programming Volume 4B. $82 and being forced into a time-limited web viewer. That's just... what's the market for that?
- krapht 4y agoTextbooks are a lot more work to prepare than people think, and the market is in the thousands. Especially specialist textbooks like this require the input of many upper-middle class professionals who aren't exactly cheap - much like software. I mean, how much time do you think it would cost to prepare a 400 page textbook on Amazon AWS, with curated examples and training exercises? How many man-hours of senior engineering talent would be required? How many copies could you realistically sell? Some textbook authors have previously posted on HN that the money is terrible in technical books, and the biggest benefit has just been credibility that the authors can use to sell themselves as consultants.
- ta988 4y agoThe issue here is that publishers are raking up all the money and not even providing a good service anymore. The physical quality of my recent books, the formatting of the ebooks and the typesetting has gone downhill in the last 10 years or so. Books prices are still high, publisher profits are skyrocketing and quality of product goes down. It is time to setup a new way to support writters for publishing their books that doesn't involve those scammers. Not every writer can do their own typesetting and distribution.
- BeetleB 4y ago20 years ago, most engineering textbooks were about $100 in the US. I discovered they sell them cheaper in Europe, and the cost to buy from Europe + shipping was still a lot cheaper.
- RomanPushkin 4y ago> "Access Duration: 84 Months"... > Despite all the warning signs, I went ahead and bought the ebook... > ...allow me to retire from having to write the tools that bypass your restrictions. You either agree to the rules, or you're breaking them. If you're breaking the rules, authors won't get compensated and we won't see other Human Kenetics books. This should be illegal. Personally, I would love to pay hundreds for a limited access to books I would like to read. But folks aren't inspired too much about writing books today that can make them a living, since there are pirates everywhere. They want free content, because "information should be free". No, it shouldn't. Pay for it.
- JadeNB 4y ago> Personally, I would love to pay hundreds for a limited access to books I would like to read. … Why? I'd assume that this was sarcastic, except that the sarcastic reading seems to support the post with which you seem to be arguing, and the rest of the paragraph: > But folks aren't inspired too much about writing books today that can make them a living, since there are pirates everywhere. They want free content, because "information should be free". No, it shouldn't. Pay for it. seems to be sincere.
- tucosan 4y agoThis is a ridiculous take. There were no such restrictions on books after you legitimately purchased them for hundreds of years now. If you buy the hardcopy of the very same book, no such restriction would apply. Rip-off schemes, where the publishers uses DRM to cripple the reading experience by providing the content via a proprietary reader with bad UX, is one of the very reasons people resort to pirating in the first place.
- RomanPushkin 4y agoWhat is ridiculous take? Authors want to sell access to information they've collected, improved, filtered, and so on. They invested tremendous amount of effort into making this available to you for a very low price (less than $1/month). The sharing is implemented the certain way, super inconvenient - but you have been informed multiple times in advance, and accepted that. > There were no such restrictions on books after you legitimately purchased them for hundreds of years now. For hundreds of years there were no book pirates, and computers. Even libraries buy books so they can share to a limited audience.
- charcircuit 4y agoThis isn't a new ebook format. This is just a web viewer for epub files.
- mdaniel 4y ago> Reverse engineering yet another eBook format > Surprise, surprise, our website was using one of the most popular ebook formats! :-/
- userbinator 4y agoThis reminds me of a similar experience I had, over a decade ago now, with RE'ing Flash-based eBook viewers and converting their often simply-a-wrapped-SWF formats back into something (relatively) sane like PDF. Those who have eBooks that are either a single SWF or a collection of them will know what I mean. "does not allow for you to download your book" Besides noticing the odd use of "your" there, if you see that sentence and think "challenge accepted", it means you still have the old-school "hacker spirit".