6 ms·
My Mathematics PhD research workflow: LaTeX notes and instant pdf referencing
- rcap 5y agoAuthor here, if you have any questions, feel free to ask them. It really is amazing how hard it is just to retrieve the currently opened pdf file and its page number in a pdf viewer. Some pdf viewers (Like Zathura) provide this via DBus, but even very common ones like Evince don't. I managed to find a way using gvfs, although it's a bit of a hack. For others (e.g. Mendeley), I have no idea on how to do this... Anybody have ideas? it is Qt based, maybe I can hook into that via some debugging tool?
- dancsi 5y agoI guess it will be easier to get it working with Zotero, as it's open source, and I think it even supports custom plug-ins.
- jessriedel 5y agoYes, Zotero does support custom plug-ins ("add-ons").
- 533474 5y agoTry emacs and org-mode sometime. Configurability is off the charts and vi keybindings are easily configurable (and so are the snippets). I loved the workflow, I believe that a mind like yours will also find emacs elisp captivating and I would love to see what you could come up with in that much more flexible ecosystem (I am a former Vim evangelist)
- hollerith 5y agoWhat does org mode have to do with the problem where you have a document open in a PDF viewer and you want to retrieve the location of the document in the file system and what page is currently showing in the viewer's window?
- nonrandomstring 5y agoIf you're using Org-ref, and have used that to drill down into your pdfs then you always have the document context (and bibtex etc context) from within emacs. But I don't think that is the OPs use case, so apologies for the noise. Also careful use of unix find with pdfgrep can be handy.
- joeman1000 5y agoThe fact that pdf-tools (in emacs) makes this an utterly trivial task.
- joeman1000 5y agoThe solution is emacs. I know you’ve got a lot invested in vim already. You can get instant LaTeX rendering with AUCTeX, view the pdf in emacs with pdf-tools, which can be used with something like org-ref (there are many bibliography packages) to query a db with the DOI of the pdf. (Try saying that two times fast). This EmacsConf talk should give you a taste of what I mean: https://emacsconf.org/2021/talks/research/ https://emacsconf.org/2021/talks/research/ Your old post with instantly rendering latex snippets actually inspired me to start using vim/LaTeX. This opened up a whole new world for me. I started programming, got back into my engineering degree, started using emacs/org-mode and have nearly finished the degree. Thank you, from the bottom of my heart. I don’t know what I’d be doing if I hadn’t seen your post. It revealed a way of using computers that I had never seen before.
- jgwil2 5y agoThis one? https://castel.dev/post/lecture-notes-1/ https://castel.dev/post/lecture-notes-1/ HN thread: https://news.ycombinator.com/item?id=19448678 https://news.ycombinator.com/item?id=19448678
- joeman1000 5y agoYes, this is the one. I couldn’t help but want the same speed and beauty as in that post.
- triyambakam 5y agoWhere are you taking your degree?
- joeman1000 5y agoMonash university
- sverona 5y agoNo questions. You're a pretty swell dude and I used a lot of your advice while writing my thesis. Love your work.
- randomsilence 5y agoHave you tried contacting the developers? This seems like a feature that every pdf viewer should have.
- mixedmath 5y agoOn recent-ish versions of evince it is possible to do a bit more via dbus. For example, forward and reverse synctex search between evince and vim over dbus is done at [1]. I use this when I use evince, but I acknowledge that it has stupid flaws. [1]: https://github.com/peterbjorgensen/sved https://github.com/peterbjorgensen/sved
- mixedmath 5y agoHaving written this, I am actually completely incapable of retrieving the page number over dbus. (As you had mentioned). I'm a bit surprised that forward and reverse search can still be done.
- bryanph_ 5y agoSpecifically being able to create a deep link to a passage is a very powerful capability indeed. The friction required to look up a paper and navigate to the specific passage for a given reference can really be so high that we just end up avoiding it altogether I feel. Kudos to you for trying to solve this problem! I personally find LaTeX a little too friction-full (is that a word?) on the input side. The output looks beautiful but the lack of feedback when writing stuff keeps me from actually adding stuff to it. Although your daily notes seems like it might help with this tendency a little bit. This is a problem I'm currently trying to solve with my current project (https://topictrails.com/ https://topictrails.com/ if you're interested).
- alan-hn 5y agoPersonally for feedback I use editors like overleaf or the extension for vscode that autocompilea and displays a PDF next to the working TeX file. I prefer it over something like LyX or waiting to compile manually.
- t_mann 5y agoModern tools like Overleaf are great, especially for collaboration. But it's still extremely annoying having to google every little thing like "how can I move this element on the slide a bit to the right?" or even things that you'd expect would be easier in a software designed for mathematicians like "how can I format this common type of math problem (eg an optimization problem) nicely?". Plain LaTeX's overall useability has strong 80's vibes and the output does look nice, but imho doesn't justify the effort (especially given that the competition like Word has really come of age wrt to equation editing). If it wasn't for tools like Overleaf I might have ditched it, but there is also strong peer pressure in math-heavy fields to keep using it.
- omaranto 5y agoMaybe Word has come of age in terms of equation editing, but has it come to age in terms of usability? I haven't used in about 10 years, but back then it crashed a lot on larger documents, and I suffered a lot from never knowing if I was inside the invisible tags or not, so I never knew when I was typing right after a list if I would start a new list item or not, or when typing next to italic text if the new text would be italic or not. I also remember that trying to move anything, like an embedded image, would move tons of other things too. I definitely found LaTeX much easier to use. And that's excluding Word line-breaking which always looked rather poor to me: some lines were left very empty and others overcrowded. It just didn't look professional to me. Perhaps that was been fixed too.
- adhesive_wombat 5y agoI just wish there was a good way to have something like Zeal[1] for PDFs. Navigating a big pile of huge datasheets and manuals (a processor TRM can be 5000 pages!) is such a huge pain and that's assuming they have decent TOCs, which many do not. [1]: https://zealdocs.org https://zealdocs.org
- gsatic 5y agoI use pdfgrep a lot. Probably possible to convert pdfs to html (with the default pdf tools on nix - pdftotext pdf2txt et al) and pull them into zeal.
- godelski 5y agoDoes anyone have a good reference for Tikz? I feel like I'm pretty good at it (at least better than most my peers) but I also believe it takes a significant amount of time to create interesting pictures and do even basic things that PPT or other basic tools can do easily. I want the full editing power of tikz but doing the basic parts is tough (same with manim, though lower barrier to entry). As for writing documents with lots of math, absolutely no problem. I can churn that our faster than peers can with Word.
- ivansavz 5y agoThe best way to TikZ is to copy-paste from previous figures you've created. The second best is to look for a similar figure on TeXample https://texample.net/tikz/examples/ https://texample.net/tikz/examples/ or stack overflow https://tex.stackexchange.com/questions/tagged/tikz-pgf https://tex.stackexchange.com/questions/tagged/tikz-pgf The third best option is to use squared paper to draw by hand, then transfer hand-drawn stuff into TikZ code. It's slow as hell, but works well if you build up a collection of components you can copy-paste into other figs later. There are also some GUI tools you could try: https://www.mathcha.io/ https://www.mathcha.io/ https://homepages.inf.ed.ac.uk/cheunen/freetikz/freetikz.html https://homepages.inf.ed.ac.uk/cheunen/freetikz/freetikz.htm... https://tikzit.github.io/ https://tikzit.github.io/ etc. (more links in this thread https://tex.stackexchange.com/questions/84890/does-there-exist-an-online-latex-diagram-graphical-editor-that-produces-correspo https://tex.stackexchange.com/questions/84890/does-there-exi... )
- godelski 5y agoI know you're trying to be helpful, but the first two best options you suggest are already things I do. For the third, I'm not sure those are great options either since really it isn't the translating hand drawings to tikz that's the issue (the examples are pretty brute force too. Though I can see some use cases for mathcha. I am more looking for tips and tricks that have helped people build their skills and streamline the process.
- benibela 5y agoI have the best reference. I ask Till Tantau when I have any urgent tikz questions. The advantage of working at the university of Lübeck: his office is next to my office.
- hexomancer 5y agoYou may also want to check out sioyek which is an open source PDF viewer specifically designed for reading research papers and textbooks. https://github.com/ahrm/sioyek https://github.com/ahrm/sioyek Disclaimer: I am the developer of sioyek
- deleted 5y ago[deleted]
- retskrad 5y agoI looked at the math in the article and I asked myself, what compels people to choose this path for their career? Nothing about it looks appealing. It looks like a bunch of gibberish for 99% of humanity and only 1% of people willingly go to school to learn this stuff. I have a lot of respect for people who have jobs involving this level of math and physics so dummies like me have the ability to type out this comment.
- MarcelOlsz 5y agoI've been trying to learn math for years but truly have no idea where to begin. I started with Kiselev's Geometry and Gelfand's Algebra. I used to hate Math. When I read Lockharts Lament some years ago and it brought me to tears. Ever since then I've had a big appreciation for it but no real time to get into it. Gelfand's Algebra is really cool because it starts with the most basic problems ever that a 3rd grader can do, and works it's way up. It's worth checking out!
- the_svd_doctor 5y agoMath for the sake of math can be very self fulfilling. Like an intellectual hobby (it just takes a lot of work and energy).
- Twisol 5y agoThis only answers a small piece of your question, but it's important to realize that the mathematical notation you see is only how mathematics is recorded and communicated. Most of what goes into doing mathematics happens in your head. "Doing" mathematics requires you to know what the object of study is, and what tools have historically been brought to bear on it, and these are communicated and taught via notation. But once you've internalized those concepts, the notation doesn't usually play a significant role. Yes, you may trial your ideas with some calculations, and once you're convinced of something you need to prove it with some degree of rigor. But you don't usually set out to prove something you don't already have some reason to believe in -- it's not like the math workbooks you may have encountered in school. (I second the sibling reply's mention of Lockhart's Lament!)
- t_mann 5y ago
- lallysingh 5y agoI wonder if those planning to stay in academia after grad school are more willing to invest in their own tooling like this.
- amathres_info 5y agoI'm another academic mathematician. I'm not really convinced that all this would be a time-saver for me as far as research productivity; maybe I'm just old-fashioned but I just have a few folders for paper notes and that's it. But certainly this could vary from person to person. To me, the place for the real time savings is organizing your teaching workflow. If you're a grad student, make sure to get on top of that ASAP. A lot of it is very repetitive both within a given semester and also from year to year. I have a ton of scripts built up over the years for things like organizing lecture notes (especially if you are teaching a class you have taught before, you don't want to have to rewrite all your lectures), creating problem sets / solutions, inputting grades into the LMS,... I even have automatic solution generators for a few rote calculations that I assign many problems about (Gaussian elimination, for example).
- mistrial9 5y ago> maybe I'm just old-fashioned but I just have a few folders for paper notes paper, like.. pieces of paper.. yes, that is old-fashioned! however, in deep math, maybe this is something.. I was told after attending a world-class lecture week in pure math, that it is common for PhDs and post-docs in math to have very little to talk about between each other.. since their interest and subject area is almost certainly deeply buried in some specialty. Aside from the quip "all roads lead to cryptography" perhaps just an excuse for certain people, I can see how this "different worlds" problem in post-doc math might be real.. The fellow writing this post is first-year however.. maybe its different.. Also I just cloned and built pdfgrep .. I am definitely going to try that out immediately .. thx!
- mhh__ 5y agoFor me at least my reasoning for trying new things to make notes with is that I very very rarely actually read them again, so I need to get as much learning done from writing the notes, and to do that I need to write more notes e.g. make writing the notes fun.
- evanb 5y agoAfter I taught a few semesters ago I took the material I had prepared and turned the skeleton into a github template https://github.com/evanberkowitz/course-base https://github.com/evanberkowitz/course-base I keep questions, slides, written notes, etc. controlled and semester-specific things in a directory that isn't tracked.
- jzer0cool 5y agoCould you share a type of math with 1 or 2 concepts that would be good for computer science or solving problems in general. Reference to something not too difficult, but a "good to know" kind of thing. For example, something from upper division math. Let's say in undergraduate I would say: Calculus I - understand what is derivative. Calculus II - understand what is an integral. Math is broad, so maybe 1 or 2 takeaways from some topics in upper division math that I might find useful.
- jules 5y agoIt's hard to capture an entire lecture series in one sentence, but one way you might categorise subjects by the type of problems they allow you to solve: - Multiple linear equations over the rationals/reals => linear algebra - Solve equations over the integers / integers mod p / factor numbers => number theory - Solve polynomial equations / factor polynomials => algebra - (Partial) differential equations => (partial) differential equations - Approximate solutions to various equations over the reals => numerical analysis - Counting the sizes of various finite sets => combinatorics - Integrate wild functions => measure theory - Formal understanding of real numbers => real analysis - General framework for differential equations => functional analysis - General framework for continuous functions and limits => point-set topology - Prove that two elastic shapes are different => algebraic topology - Prove that a knot in a circular piece of string cannot be untied without cutting the string => knot theory - Determine optimum strategy in a game with incomplete information => game theory - Describe very big sets / prove that certain things can't be proved => set theory - etc.
- jzer0cool 5y agoAppreciate the reply jules! Thank you for this list. Just picking the brains here for those who have Phds in this fields and sometimes providing retrospect helps us more junior's in math.
- kovac 5y agoIf you had to pick one, I'd say the single most important high level math topic that'd be useful for computer science is Graph theory. There are so many applications of graphs in computer science. The thing about math is that regardless of which field you work in the treatment is the same. You start by stating a set of axioms. Based on these axioms you set up definitions and then prove lemmas, corrolaries and theorems. This approach isn't really necessary or directly useful for computer science though. But it is very beautiful. For example, if you truly want to appreciate, in it's full force, why a player playing a fair game against a casino will always eventually lose (theorem called Gambler's ruin) you can study stochastic processes with full rigour (this is also a very useful area). But that full rigour isn't necessary to not blow your savings on games of chance :)
- amathres_info 5y agoAnother tip: the vast majority of ArXiv papers have the LaTeX source available under "other formats". I used to download those instead of the pdfs for better searching. Now I don't really bother keeping a personal collection of papers, however. Downloading the LaTeX source also has the advantage that you can see the comments the authors made that don't show in the pdf version. Sometimes appalling: "% Author 1: Is this lemma even true? This proof seems like bs to me % Author 2: Eh screw it who knows, it's probably true."
- podiki 5y agoA good one I saw once (and saved me tedious image->data extraction): something like "Why are you trying to copy this image for the data, find the full data tables at..."
- mr_mitm 5y agoYou just strengthened my opinion that PDF is a format of the past, considering people prefer to read the LaTeX source instead of the finished document.
- atoav 5y agoLet me quote an electrical engineer who thought me about norms: "Always use PDF because it comes accross more real, because it cannot be edited (!)". This is the perception non-IT-people have of PDF in comparison to e.g. .docx or similar editable formats those people know.
- PartiallyTyped 5y agoPersonally, I would like to see a pdf-like format with video/animations/gifs, possibly the ability to play with models and variables.
- m4lvin 5y agoPDFs can already contain videos and JavaScript. But given the security problems, I consider it a feature of most non-Adobe PDF viewers to not support that.
- fennecs 5y agoI had a similar idea that I would just add daily notes to in markdown/tex to add to a knowledge graph, but then I lost motivation. I just started using the iPad to make handwritten notes. What I really want is a way for the handwritten stuff to be integrated into a knowledge graph, or even automatically generating tex/diagrams for me. On top of that, daily scribbles don’t necessarily go anywhere, or are even wrong, so it can generate noise anyway. What was more valuable was consolidating a few weeks+ of progress into a more complete summary or set of notes. You can still explain the reasoning of how you got to something finished, but it’s just all correct.
- jessriedel 5y agoI recommend two upgrades over what the OP recommends. For electronic handwritten math, use ZoomNotes on iPad, which has a quirky aestetic but also a bunch of powerful features and the extremely satisfying eponymous infinite zoom. http://www.zoom-notes.com/ http://www.zoom-notes.com/ For organizing a personal library of academic papers, use Zotero, which has a great interface for sorting the papers, annotating the PDFs, and exporting them as BibTeX. (It would presumably be harder to get the OP's single-click PDF links working, though.) https://www.zotero.org/ https://www.zotero.org/ In particular, the Scite add-on for Zotero can also tell you which other papers have cited the the paper you are reading in a supporting way vs. a disputing ("contrasting") way, which is really cool. https://medium.com/scite/introducing-the-scite-plug-in-for-zotero-61189d66120c https://medium.com/scite/introducing-the-scite-plug-in-for-z...
- aashcan 5y agoWhat no TiKz? :o