8 ms·
I just bought a pro subscription. First impressions: The new o1-Pro model is an insanely good writer. Aside from favoring the long em-dash (—) which isn't on m
by A_D_E_P_T 2y ago
I just bought a pro subscription.
First impressions: The new o1-Pro model is an insanely good writer. Aside from favoring the long em-dash (—) which isn't on most keyboards, it has none of the quirks and tells of old GPT-4/4o/o1. It managed to totally fool every "AI writing detector" I ran it through.
It can handle unusually long prompts.
It appears to be very good at complex data analysis. I need to put it through its paces a bit more, though.
- az226 2y agoWhat’s the context window?
- rahimnathwani 2y ago128k tokens
- the_clarence 2y agoYou can use the emdash by writing dash twice -- it works in a surprising number of editors and rendering engines
- Atotalnoob 2y agoAI writing detectors are snake oil
- mirrorlake 2y agoAnecdotally, English/History/Communications professors are confirming cheaters with them because they find it easy to identify false information. The red flags are so obvious that the checker tools are just a formality: student papers now have fake URLs and fake citations. Students will boldly submit college papers which have paragraphs about nonexistent characters, or make false claims about what characters did in a story. The e-mail correspondence goes like this: "Hello Professor, I'd like to meet to discuss my failing grade. I didn't know that using ChatGPT was bad, can I have some points back or rewrite my essay?"
- A_D_E_P_T 2y agoYeah but they "detect" the characteristic AI style: The limited way it structures sentences, the way it lays out arguments, the way it tends to close with an "in conclusion" paragraph, certain word choices, etc. o1-Pro doesn't do any of that. It writes like a human. Damnit. It's too good. It just saved me ~6 hours in drafting a complicated and bespoke legal document. Before you ask: I know what I'm doing, and it did a better job in five minutes than I could have done over those six hours. Homework is over. Journalism is over. A large slice of the legal profession is over. For real this time.
- dr_dshiv 2y ago> Before you ask: I know what I'm doing, and it did a better job in five minutes than I could have done over those six hours. Seems like lawyers could do more faster because they know what they are doing. Experts dont get replaced, they get tools to amplify and extend their expertise
- energy123 2y agoReplacement doesn't happen only if the demand for their services scales proportional to the productivity improvements, which is true sometimes but not always true, and is less likely to be true if the productivity improvements are very large.
- dgacmu 2y agoahh, but: > I know what I'm doing Is exactly the key element in being able to use spicy autocomplete. If you don't know what you're doing, it's going to bite you and you won't know it until it's too late. "GPT messed up the contract" is not an argument I would envy anyone presenting in court or to their employer. :) (I say this mostly from using tools like copilot)
- Sleaker 2y agoWell... Lawyers already got slapped for filings straight from ai output. So not new territory as far as that's concerned :)
- CharlieDigital 2y agoStartup I'm at has generated a LOT of content using LLMs and once you've reviewed enough of the output, you can easily see specific patterns in the output. Some words/phrases that, by default, it overuses: "dive into", "delve into", "the world of", and others. You correct it with instructions, but it will then find synonyms so there is also a structural pattern to the output that it favors by default. For example, if we tell it "Don't start your writing with 'dive into'", it will just switch to "delve into" or another synonym. Yes, all of this can be corrected if you put enough effort into the prompt and enough iterations to fix all of these tells.
- ballooney 2y ago[flagged]
- dartos 2y agoAll of what you described can change wildly from model to model. Even across different versions of the same model. Maybe a database could be built with “tells” organized by model.
- liontwist 2y agoExactly. Fixing the old tells just means there are new ones.
- handfuloflight 2y ago> Maybe a database could be built with “tells” organized by model. Automated by the LLMs themselves.
- dartos 2y agoNo thanks, I’d like it to be accurate ;) Regular ol tests would do
- handfuloflight 2y agoI should have been more precise. I meant the LLMs would output their tells for you, naturally. But that's obvious.
- daemonologist 2y agoThey're not very accurate, but I think snake oil is a bit too far - they're better than guessing at least for the specific model(s) they're trained on. OpenAI's classifier [0] was at 26% recall, 91% precision when it launched, though I don't know what models created the positives in their test set. (Of course they later withdrew that classifier due to its low accuracy, which I think was the right move. When a company offers both an AI Writer and an AI Writing detector people are going to take its predictions as gospel and _that_ is definitely a problem.) All that aside, most models have had a fairly distinctive writing style, particularly when fed no or the same system prompt every time. If o1-Pro blends in more with human writing that's certainly... interesting. [0] https://openai.com/index/new-ai-classifier-for-indicating-ai-written-text/ https://openai.com/index/new-ai-classifier-for-indicating-ai...
- dangdetector 2y agoDoubtful AI writing is obvious as hell.
- efficax 2y agoof course they are. it’s simple: if they worked they would be incorporated into the loss function of the models and then they would no longer work
- rahimnathwani 2y agoWould you mind sharing any favourite example chats?
- A_D_E_P_T 2y agoGive me a prompt and I'll share the result.
- rahimnathwani 2y agoGreat! Suggested prompt below: I need help creating a comprehensive Anki deck system for my 8-year-old who is following a classical education model based on the trivium (grammar stage). The child has already: - Mastered numerous Latin and Greek root words - Achieved mathematics proficiency equivalent to US 5th grade - Demonstrated strong memorization capabilities Please create a detailed 12-month learning plan with structured Anki decks covering: 1. Core subject areas prioritized in classical education (specify 4-5 key subjects) 2. Recommended daily review time for each deck 3. Progression sequence showing how decks build upon each other 4. Integration strategy with existing knowledge of Latin/Greek roots 5. Sample cards for each deck type, including: - Basic cards (front/back) - Cloze deletions - Image-based cards (if applicable) - Any special card formats for mathematical concepts For each deck, please provide: - Clear learning objectives - 3-5 example cards with complete front/back content - Estimated initial deck size - Suggested intervals for introducing new cards - Any prerequisites or dependencies on other decks Additional notes: - Cards should align with the grammar stage focus on memorization and foundational knowledge - Please include memory techniques or mnemonics where appropriate - Consider both verbal and visual learning styles - Suggest ways to track progress and adjust difficulty as needed Example of the level of detail needed for card examples: Subject: Latin Declensions Card Type: Basic Front: 'First declension nominative singular ending' Back: '-a (Example: puella)'
- A_D_E_P_T 2y agohttps://chatgpt.com/share/67522170-8fec-8005-b01c-2ff174356d05 https://chatgpt.com/share/67522170-8fec-8005-b01c-2ff174356d...
- deleted 2y ago[deleted]
- Mordisquitos 2y ago> Aside from favoring the long em-dash (—) which isn't on most keyboards Interesting! I intentionally edit my keyboard layout to include the em-dash, as I enjoy using it out of sheer pomposity—I should undoubtedly delve into the extent to which my own comments have been used to train GPT models!
- ValentinA23 2y ago–: alt+shift+minus on my azerty(fr) mac keyboard. I use it constantly. "Stylometry" hazard though !
- jgalt212 2y agodelve? Did ChatGPT write this comment for you?
- pests 2y agoFor me, at least, it's common knowledge "delve" is overused and I would include it in a mock reply.
- A_D_E_P_T 2y agoThat's the joke.
- deleted 2y ago[deleted]
- taneq 2y agoSome of us are just greedy and deep, okay?
- Der_Einzige 2y agoFYI: It's trivial to fix any LLM's "slop" properties: https://github.com/sam-paech/antislop-sampler https://github.com/sam-paech/antislop-sampler https://openreview.net/forum?id=FBkpCyujtS&nesting=2&sort=date-desc https://openreview.net/forum?id=FBkpCyujtS&nesting=2&sort=da...
- Filligree 2y ago
- vessenes 2y agoI noticed a writing style difference, too, and I prefer it. More concise. On the coding side, it's done very well on large (well as large as it can manage) codebase assessment, bug finding, etc. I will reach for it rather than o1-preview for sure.
- _cs2017_ 2y agoNo internet access makes it very hard to benefit from o1 pro. Most of the complex questions I would ask require google search for research papers, language or library docs, etc. Not sure why o1 pro is banned from the internet, was it caught downloading too much porn or something?
- ilt 2y agoOr worse still, referencing papers it shouldn’t be referencing because of paywalls may be.
- jwpapi 2y agoWait how did you buy it. I’m just getting forwarded to Team Plan I already have. Sitting in Germany, tried US VPN as well.
- apstls 2y agoThe endpoint for upgrading for the normal web interface was returning 500s for me. Upgrading through the iOS app worked though.
- pests 2y ago> the long em-dash (—) which isn't on most keyboards On Windows its Windows Key + . to get the emoji picker, its in the Symbols tab or find it in recents.
- Wolfenstein98k 2y agoWell not for me it's not, that is a zoom function. En dash is Alt+0150 and Em dash is Alt+0151
- pests 2y agoHow do you have that configured? The Windows+. shortcut was added in a later update to W10 and pops up a GUI for selecting emojis, symbols, or other non-typable characters.
- heyjamesknight 2y ago> Aside from favoring the long em-dash (—) This is a huge improvement over previous GPT and Claude, which use the terrible "space, hyphen, space" construct. I always have to manually change them to em-dashes.
- dougb5 2y agoThat's encouraging to hear that it's a better writer, but I wonder if "quirks and tells" can only be seen in hindsight. o1-pro's quirks may only become apparent after enough people have flooded the internet with its output.
- karaterobot 2y agoI use the emdash a lot. Maybe too much. On MacOS, it's so easy to type—just press shift-option-minus—that I don't even think about it anymore!
- bhtru 2y agoOr double type ‘-‘ and in many apps it’ll auto transform the two dashes to emdash. However, the method you’re describing is far more reliable, thanks!
- pjs_ 2y agoLong emdash is the way -- possible proof of AGI here
- layer8 2y ago> which isn't on most keyboards This shouldn’t really be a serious issue nowadays. On macOS it’s Option+Shift+'-', on Windows it’s Ctrl+Alt+Num- or (more cryptic) Alt+0151. The Swiss army knife solution is to configure yourself a Compose key, and then it’s an easy mnemonic like for example Compose 3 - (and Compose 2 - for en dash).
- aucisson_masque 2y ago> It managed to totally fool every "AI writing detector" I ran it through. For now, as ai power increase, ai powered ai writing detection tool also gets better.
- onlyrealcuzzo 2y agoIt's also because it's brand new. Give it a few weeks for them to classify its outputs, and they won't have a problem.
- bigfudge 2y agoI’m less sure. This seems like an asymmetrical battle with a lot more money flowing to develop the models that write than detect.
- imgabe 2y agoWriters love the em-dash though. It's a thing.
- carabiner 2y agoMy 10th grade english teacher (2002, just as blogging was taking off) called it sloppy and I gotta agree with her. These days I see it as youtube punctuation, like jump cut editing for text.
- esafak 2y agoHow is it sloppy?
- lee-rhapsody 2y agoIt's not. People just like to pretend they have moral superiority for their opinions on arbitrary writing rules, when in reality the only thing that matters is if you're clearly communicating something valuable. I'm a professional writer and use em-dashes without a second thought. Like any other component of language, just don't _over_ use them.
- thomasfromcdnjs 2y agoI love using it in my creative writing, I use it for an abrupt change. Find it kinda weird that it's so controversial.
- davidmurphy 2y agoAnyone who read "The Mac is not a typewriter" — a fantastic book of the early computer age — likely uses em dashes.
- cableshaft 2y agoSome autocorrect software automatically converts two hyphens in a row into an emdash. I know that's how it worked in Microsoft Word and just verified it's doing that with Google Docs. So it's not like it's hard to include an emdash in your writing. Could be a tell for emails, though.
- ed_elliott_asc 2y agoDoes it still hallucinate? This for me is key, if it does it will be limited.
- yCombLinks 2y agoThe current architect of LLMs will always "hallucinate".
- galleywest200 2y agoThis is interesting, because at my job I have to manually edit registration addresses that use the long em-dash as our vendor only supports ASCII. I think Windows automatically converts two dashes to the long em-dash.
- veidr 2y agoMacs have always been able to type the em dash — the key combination is ⌥⇧- (Option-Shift-hyphen). I often use them in my own writing. (Hope it doesn't make somebody think I'm phoning it in with AI!)