5 ms·
Keeping a Lab Notebook [pdf] (2013)
- COGlory 5y agoI have bounced around between different lab notebooks, obviously starting with paper. I then moved to a word doc. Problem with word documents is that they don't have any good hierarchy. I then tried Obsidian, which is a markdown editor. It's nice, but the table and image support is lacking. I need to be able to paste in tables from a spreadsheet because that's how I set up many experiments.
- cpach 5y agoReminds me of this post from June, which inspired me a lot: https://news.ycombinator.com/item?id=27639875 https://news.ycombinator.com/item?id=27639875
- deleted 5y ago[deleted]
- aalam 5y agoFor a good historical example, see Linus Pauling’s notebooks (with page numbers and dates): http://scarc.library.oregonstate.edu/coll/pauling/rnb/ http://scarc.library.oregonstate.edu/coll/pauling/rnb/ The blog by biologist Dr. Colin Purrington also has advice for maintaining a notebook (discussing why, backups, and what to note down): https://colinpurrington.com/tips/lab-notebooks/ https://colinpurrington.com/tips/lab-notebooks/
- ajot 5y agoI came here to add Purrington's blog. But I would also add that you should look at older versions in the Wayback Machine, it used to have a little more depth and images depicting things (e.g., a paper chromatography test of different inks).
- monkeybutton 5y agoDoes anyone here keep a log or journal at work? I'm leaving a place that I've been at for quite a few a years and I am a little regretful for not writing down some observations and predictions as I had them. It seems like nothing the business did over the long term went according to plan, but I've lost a lot of the past perspective so its hard to compare.
- selfhoster11 5y agoI did. It was valuable to be able to go back and refer to discussions about the architecture of something, or to note down obscure details. If you choose to do it on paper, make sure you photocopy regularly.
- poidos 5y agoYes, religiously. I have a list of tasks for each year which links to a file with my notes on each task, as well as a daily journal where i log my work hours, random notes from meetings, etc. It is exceedingly helpful.
- arminiusreturns 5y agoWhen I was working for scientists this was a habit I learned and loved it, but due to some other factors I became aware that in more traditional business the kind of frank statements I put in logbooks could be a potential issue, and have found myself not doing it due to the chilling effect.
- znpy 5y agoI think that rednotebook is invaluable for this purpose. It's a nice linux app that works like.. a notebook.
- bodge5000 5y agoyeh I keep digital notes, a notebook and a load of sticky notes. Theres no real system to it (just the way I like it), but generally speaking working notes go in the notebook (also for tangent tasks), important reminders on the sticky notes (pasted all over my monitors) and "knowledge" goes in the digital notes. In reality its a lot more sporadic than that, but I know where to find things
- ethangarofolo 5y agoI do, yes, and I ask my team to do the same. Even in software development it's very helpful. It helps the team stay in sync more, reducing the need to meet. It helps me stay in sync from yesterday me to today me as well. It avoids duplicated work as well. I consider doing this part of professionalism 101 at this point.
- visviva 5y agoI've always been attracted to the idea of keeping a lab notebook for my work, but since I do engineering/scientific computing, the concepts never seem to directly translate. Does anyone have any resources for keeping a similarly structured log of research/work done on non hard science projects?
- all2 5y agoIf you're in software engineering, Jupyter notebooks support a large variety of languages now. I keep handwritten notes in a notebook of recipes I particularly like. These are useful for making adjustments over many preparations. I guess the bottom line is being willing to enforce an organization on your notes, and then iterate towards a format that makes sense to you. For the recipe notes, time series (like journal entries) works well. Or inline. It depends on the note. Ingredient substitutions can be time series, but wrong measures specified in the recipe would be an inline correction. > engineering/scientific computing Definitely Jupyter notebooks or other "literate computing" methods. Emacs org-mode has literate programming stuff, but honestly Jupyter is easier to use.
- visviva 5y agoThanks - I'm not a software engineer, but I write a lot of code anyway. I've used Jupyter notebooks to good effect in the past for smaller, self-contained projects, but they don't quite seem to fit my workflow well enough for me to use them for everything. You make a good point about picking something and enforcing it - I just have a hard time even finding something to start iterating on. Maybe I just need to be more creative about how I think about/use Jupyter notebooks...
- rmnclmnt 5y agoYou can use use Jupyter Notebooks like Markdown files, with the added benefit of code blocks being executable for reproducible work. Then, just throw your notebooks into MkDocs (using a plugin) and voila, you get a statically hostable version of your notebooks! Easily coupled with Git and CI/CD practices, you have a nice, easy to use setup for prodyctive work and knowledge sharing if needed!
- refurb 5y agoThis is where electronic notebooks really shined. No longer in the lab, but many experiments are repeats with slight tweaks to the procedure. Rather that rewriting everything out we’d often just write “same procedure as XXX-YYY with the following changes”. It always felt much cleaner to just copy-paste an experiment and directly edit the changes. Plus being able to type versus write meant I put way more detail down and could easily attach data. It should be noted too that the US patent law changed from first-to-invent to first-to-file in 2013 (when this document was written). The importance of lab notebooks in defending a patent becomes much less important after that. I know defending a invention was a HUGE part of keeping a good notebook. https://en.m.wikipedia.org/wiki/First_to_file_and_first_to_invent https://en.m.wikipedia.org/wiki/First_to_file_and_first_to_i...
- poidos 5y agoI use org-journal[0] in Emacs as a very efficient lab notebook. I use the Doom[1] configuration, so this is my workflow: - launch Emacs - type `Space n j j`, which opens a journal file customized the way I like it*, inserts a date heading and timestamp, and sets me in insert mode - type my timestamped notes I can do this from any buffer in Emacs, so it's really convenient to stop in the middle of something, jot down a note, and then go right back to what I was doing. I develop iOS/macOS software right now, so the switch to Emacs from Xcode is a little more friction than I used to have, but it's so useful I don't mind it at all. * I have a weekly journal in a directory for the year, titled week number-month-day that started that week (this week's is `34_08-23`) [0]https://github.com/bastibe/org-journal https://github.com/bastibe/org-journal [1]https://github.com/hlissner/doom-emacs https://github.com/hlissner/doom-emacs
- bloopernova 5y agoVery similar to the way I use it. Ctrl-c n j makes a new entry in org journal, carrying over any TODO/PROG items from previous days if the current day file doesn't exist. I use it all the time and it's replaced my beloved hardback A4 graph paper notebook. I keep my journal files hidden from the Treemacs sidebar so it doesn't get cluttered. I keep a permanent in progress item with sprints and their start/finish dates, backlog items, etc etc.
- nataz 5y agoHow I take notes: For professional life: Pen + dot grid notepad - developed independently, but similar to the bullet journal technique. Dot grid plus pens make the whole thing ultra customizable. I can sketch engineering designs, make a calendar, track action items, take detailed notes, all in the same format. The key is to be strict with page numbers, dates, and index as much as possible. Things I occasionally miss - keyword search (I can still look things up by date or subject in the index), multimedia inserts (think dragging video/photos/sound clips into one note), never ending space (notebooks run out of pages), easy backups (thinking about digitizing with photos or scans), team collaboration (if this is necessary I use Trello). Things I like - no OS/tech stack compatibility issues, "it just works", lighter then a laptop/tablet, don't need to charge, easy to read, can bring into a secure area (where outside electronics are not permitted), travels well, hard to damage. http://bulletjournal.com/get-started/ http://bulletjournal.com/get-started/ For personal life: add Google keep for simple lists, and then a mix of Trello and dot grid for larger projects (less strict formatting than professional life project management). How I index using pen/paper: Every page has a number in the upper outside corner. Every entry into the note book has a title + subject tag, date, and the initials of a list of people linked to that entry. For easy reading and scanning I put all of this on one line. The title and subject are dark lined (thick), followed by the date MM/DD/YY, and then the initials inside a ( ). Each piece of info is separated by a ";". All of the info listed is underlined. under the intro line, I also break down actions, notes, calendar adds, etc with 3-4 different symbols. All I all this makes it clear and easy to scan quickly as you are looking for things. Each month I have 4 or 5 pages devoted to organization. I have a task list. Two bulleted columns. Old tasked are migrated over from the previous month. New tasks are added as soon as they are generated. Completed tasks get an X through the bullet. Migrated tasks get an >. Tasks that are linked to journal entries get a page number and a tag. I have a calendar page. 1 column, all dates of the month listed . Meetings, important actions and events are are listed by day, or with arrows over multiple days. Linked by tag/page number if applicable. I have a subject index. Major tags, reoccurring subjects, get a line or two. Page numbers with those subjects are added to the index. I realize this sounds complicated, but it's not once you get into a routine. The biggest this is it's okay to make "mistakes", and to get used to not having a delete key. Change is part of the notebook. Think of it like a change log. It's also important to be able to see what you change. Since I work in pen, I just make a single line through things I want to change. Note: when I finish or complete something on a task list or the calendar, I'll mark or change the symbol, I won't cross something out just because I'm done with it. Finally, I have a bunch of multi color pens I use. They are all the same brand/model, but I tend to use a different color each day. That makes it obvious as you are scanning that you are on the next day. I don't use specific colors for anything in particular, too hard to keep track of. Hope this helps. Reposted from an older thread @ https://news.ycombinator.com/item?id=17799232 https://news.ycombinator.com/item?id=17799232 edit - notebook choice is important. I use something like this (https://www.amazon.com/Dotted-Bullet-Notebook-Journal-Hardcover/dp/B07168XGHT/ref=psdc_490755011_t3_B08CZHWZ18 https://www.amazon.com/Dotted-Bullet-Notebook-Journal-Hardco...) Not an affiliate link. Its sturdy, you can't pull out or add pages (which is a feature), bound and stitched, decent quality paper, dot/grid, and normally under $15/book.
- slitdangsthroat 5y agoI keep a notebook of random HN comments that break the rules, but dang allows it. He only allows this for rich spoiled cunts for some reason, so I plan on exposing the cunt dang for his hypocrisy. I genuinely hope his family gets raped.
- nayuki 5y agoA lot of the goals/problems mentioned in the document can be solved with a "lab notebook" consisting of plain text files plus Git version control. For example: > Legal document to prove patents and defend your data against accusations of fraud > Bound/Stitched | No lost pages, legally stronger | Difficult to copy, not logically organized > Requires electronic security, corrupted files, software compatibility issues > No pages come out of the notebook | Do not take any pages out or remove any data | Do not skip pages in your notebook | Cross out any unused parts of a page > Correct mistakes, do not remove them | Cross out mistakes with a single line | Paste in corrections without covering anything | Sign and date all corrections Also, if you sign your commit hashes with a trusted timestamping service, then that could serve as watertight evidence of prior work.
- jjoonathan 5y agoProgrammers really love plaintext/markdown notebooks, but they introduce a lot of friction around graphs and "snap a picture + annotate," and that destroys their value prop for me. Snap + annotate (or sketch + annotate) is an absolutely killer workflow if you deal with artifacts in the physical world, to the point where I gladly endure poor text editing capability and version control so long as I can have snap + annotate. Heck, if I didn't have a computer with good snap + annotate support I'd use a physical lab notebook before I tried to somehow shoehorn the workflow into text.
- AlbertCory 5y agoHaving spent 3 years with lawyers in Patent Litigation: This stuff is old-school, but the lawyers all know & understand it. Courts understand it. If you do something in a way that someone else has already done and testified in court about it, you win. This is not the place to be innovative.
- cma 5y agoThis doesn't apply anymore with first to file, unless you preempt the filer by publishing it publicly.
- AlbertCory 5y agoYou still encounter old patents in litigation, though, before first-to-file was introduced. It also has other uses beyond Interference proceedings.
- jmt_ 5y agoDoes anyone have experience using something like Obsidian as a sort of lab manual for software engineering? How do you structure your notes? What gets written down? I use Obsidian and the note of the day plugin which uses a template that has a todo list and a Recap section in which I intended to summarize the work I did that day and any comments worth writing down. I used the todo list part daily but I've struggled to consistently write the recap. I think it's too vague; I'm looking for a little more structure that makes recaping the day easier and manageable. When I try to write a recap currently, it can feel overwhelming as I try to think what I should and shouldn't write, and how I should or shouldn't write it.
- tnorthcutt 5y agoI do a tiny bit, but even less structured than you're describing (and less consistently), so I'm curious to see other responses here.
- threatofrain 5y agoSlightly tangential, but does anyone have a story for how to share Obsidian notebooks in a team context? That's the one major thing I've found missing in these off-line first notebook apps.
- Cycl0ps 5y agoObsidian uses markdown files stored in a folder, so any fileshare should work fine. There's no account management or permissions needed, either you have the .md files or you don't. I use Dropbox to carry notes between my PC and laptop, but I've seen a lot of talk of hosting on GitHub or similar services as well, which would give you revision history and authoring if you needed to know who did what
- Groxx 5y agoI've had relative success with keeping it open + on all desktops. I don't fullscreen anything, so it's always visible - since I started doing that, I'm MUCH more consistent about updating it. Prior to that, I had this small script that'd open textedit to a daily-note every time I made a terminal session, which served much the same purpose: https://news.ycombinator.com/item?id=22279802 https://news.ycombinator.com/item?id=22279802 . Obsidian makes it a lot easier to jump between days though :) (as a semi-aside: I very much like Obsidian. It's one of the only "just let me use my pile of normal markdown/commonmark files like I want" apps I've found, after trying dozens. it's very very very unintrusive / doesn't impose any structure. highly recommended!)
- ChuckMcM 5y agoI have kept lab notebooks for decades now, some thoughts; Writing them, on paper, has been very helpful. The act of writing, the pace of it, the composition of what I'm going to write, combine to help make the information more durable in my head some how. I've got a ReMarkable 2 notebook which gives me infinite pages which is kind of neat, but I still like paper notebooks. They have saved me a couple of times and made me more productive. Since I often have a number of projects in parallel so that I can pick up one when the current one hits a stall (like waiting for parts, or needing different equipment), and when I come back to a project I've organized my notebook so that I can re-create my mental map from where I left off. And in one instance it torpedoed a vendor who tried to patent an idea that we had reached out to them for help in developing.
- gumby 5y agoI finally made the leap and switched to an iPad+pencil2. I’ve tried Writing in it is not as automatic as my prior tool (cheap notebook and fountain pen, or whatever pen is available). Also portrait/landscape doesn’t really work. But over time I got used to the experience and this part is adequate. There’s a property of physical book where you can flip back to some point in the past. I find this doesn’t work as well with ring bound books anyway. It doesn’t have the whole “sign the page” property but I haven’t been subject to that in years so not a problem for me. But it has several benefits: 1. It automatically converts and indexes my handwriting so I can search (!) for a note or mentions of a thing. 2. I can carry all my notes and they are with me all the time. I can even look at them on my Mac though they aren’t “live”. 3. I can connect to zoom a second time from the iPad and share a picture, or draw something in my notebook that everyone can see, and then it’s saved. It was worth the switch. I considered a ReMarkable and a Samsung tablet but am glad I sprang for the iPad. I have tried the others (friends have them) but this seems the best for me. Note: don’t use the iPad for much else. Sometimes I read rss in bed before sleeping if the iPad is in the bedroom for some reason.
- _alex_ 5y agoIm thinking about making the same switch. What app are you using on the ipad that makes your notes searchable?
- mlon_eusk 5y ago"We are living in an era of the most sophisticated technological advances possible, and yet the treatment of cancer is paleolithic." — Azra Raza
- cogburnd02 5y ago> Most importantly, your lab notebook is not yours...You should not take it home for any reason. Dafuq?