6 ms·
When I first found out about the web, early 90's, and it was "obvious" that the role of the web was to expand scientific publishing. I expected that everybody w
by dekhn 11y ago
When I first found out about the web, early 90's, and it was "obvious" that the role of the web was to expand scientific publishing. I expected that everybody would publish latex files (raw source, not PDFs) in computationally accessible formats, with raw data in easily parseable, semantic forms.
That didn't really happen as expected. In my own chosen field (biology) it happened much more slowly than I hoped- physics (with arxiv) was far better. However, just getting PDFs on biorxiv is only a small part of the long game. I did not appreciate the huge importance placed on publishing in high-profile journals has on one's career trajectory and how large a role that would play in slowing the transition to free publication and post-publication review.
The long game is to enable the vast existing resources, and the new resources, to be parsed semantically by artificial intelligence algorithms. We've already passed the point where individuals can understand the full literature in their chosen field and so eventually we will need AI just to make progress.
- TheBiv 11y agoCan you unpack what is meant by "to be parsed semantically by artificial intelligence algorithms"? I understand the words, but in this context it has me a bit confused as to what problem you see AI solving.
- dekhn 11y agoI mean, if somebody includes the name of a gene in their text, the goal is to annotate (then use the annotation) the gene in the text of the paper. It's often nontrivial to extract the meaning from the text without having a full experiment human. A typical case would be a reference to a gene by name, where the paper authors really meant the transcript or the protein product. The semantic parsing part is an annotation process. AI algorithms are required to make accurate annotations - a huge amount of context is required. So if authors instead marked up their papers such that each mentioned entity's semantic meaning was obvious, it would make it much easier to AI that scans all papers and generates hypotheses.
- TheBiv 11y agoAh, awesome!! Makes complete sense! Thank you very much for unpacking it and all the best in your career in Biology! I am in tech now, but studied Biology at Texas A&M for undergrad so hearing the words in your response reminded me of the good ol' days!
- norea-armozel 11y agoI'm thinking of a less than ambitious angle to the use of AI or at least parsing algorithms: cross referencing commonly researched subjects and methods. If say a certain method seems to yield less than ideal results it would be nice to know if someone else figured out the problem well in advance of any laboratory work. Feeding that sort of information into a computer would be dead simple since I assume most methods are easily categorized as it is.
- dekhn 11y agoNo, I don't think it's dead simple to take methods and compare them. The problem is that most of the method details are implicit and leave out a lot of the aspects that are required to replicate a study.
- eitally 11y agoWhat he/she is saying is that the pace of research & publishing is such that it's impossible for researchers & academics to stay current the only fashioned way (reading, writing and attending conferences). It would be beneficial to have an intelligent bot that could be trained to browse for content of interest as a mechanism to augment an individual human's capacity to do this manually.
- dekhn 11y agoI don't just mean that, although that is part of the goal. I want AIs to automatically find conflicting papers/hypotheses, and propose experiments that resolve the ambiguities.
- hutzlibu 11y agoBut wouldn't a different data structure/database be better suited for this approach, than LaTeX? I mean, you can still just babble but style it in LaTeX ... and the AI would have to find out, that your're saying nothing. This would require true AI. I mean, I don't know much about LaTeX, but I doubt there are Elements for "Hypthese", "Definition", "exact reference" etc. If you would have those, described in a structured, simple language - then I guess, it will be much easier to process those Information for a KI, when the context is clear.
- dekhn 11y agoTrue. I work at Google now, and my advice would be to just write standard XHTML and let Google's parsers do their best job at inferring the meaning of the text.
- hutzlibu 11y agoBut writing xhtml in plain text can be quite a pain ... you would need at least good tools, to be efficient ... Or something pythonlike (also supported by a IDE): hypothesis: (indent) blablabla link:"link_to_Element_in_paper"
- Houshalter 11y agoSomeday I'd love to feed scientific papers into AI algorithms. Watson does that, and google is starting to. But the file formats are such a mess, especially with equations and figures.
- dekhn 11y agoThere are entire companies with squadrons of contractor scientists who just read papers and convert them to their ontology/database/analysis engine (Ingenuity, for example). When I spoke to them they said if they had an AI that could do as good a job as people, they wouldn't need contractors. I think Google's approach would be to contract a bunch of scientists, have them read and interpret the papers, then use that data to train a deep net that could do it more accurately (you need some baseline humans to act as golden standards). This worked well for Google in several publicized examples, such as discriminating house numbers from numbers on cards in Street View imagery.
- imglorp 11y ago> it was "obvious" that the role of the web was to expand scientific publishing Yeah especially considering the roles CERN and NCSA played. Things might be different if they had published there immediately instead of staying on their journals.
- logicrook 11y ago> I expected that everybody would publish latex files (raw source, not PDFs) in computationally accessible formats, with raw data in easily parseable, semantic forms. Do you realize that many researchers would be ashamed if others saw their latex code? A friend worked for a journal, he kept a folder of the worst that he had ever seen, and could rant for hours one some gems. Including some papers that were beautifully typeset, about elegant combinatorics/type theory, and were coded on the latex equivalent of a spaceship cobbled with recycled plastic bottles, scraps and duct tape. Do you imagine going through thousand lines macro tex file that grew over the years, when Latex is one of the worst mess ever, with conflicting packages, absurd syntactic 'features', and legacy crippling flaws that make debugging an horrible task? Please, continue to compile your .tex.
- soperj 11y agoIt would be much easier to get better if you could view other's latex code.
- pauloday 11y agoAnd if others could contribute improvements on yours.
- anigbrowl 11y agoI will never understand why latex devotees think everyone else should be really into typesetting as a hobby. It's like sneering at photographers who don't want to mix darkroom chemicals.
- swiley 11y agoYou have obviously never used troff then.
- p4wnc6 11y agoThat's not a good comparison, because mixing your own chemicals for photo development adds more time, effort, and defect rate to the process. Becoming more proficient with TeX saves time and makes for more re-usable typesetting structures, which allow you to accurately do what you want faster and faster. It's similar to using emacs or vim. You could say, "Why should programming devotees expect others to adopt those editors?" It's about productivity. I'm a productivity devotee and when I hear people use short-term thinking to discount how valuable the up-front costs for learning TeX (or emacs/vim, etc) are, it motivates me to help them see why it's not true. Of course, I don't want to be dogmatic either. If something works for you and your personal utility function discounts the value of things like TeX or emacs, that's fine.
- haberman 11y ago> I did not appreciate the huge importance placed on publishing in high-profile journals has on one's career trajectory Who is it primarily that is concerned with such things? (Curious.) Is it fellow academics? Or university administrators? Or government agencies that control grants? Whoever it is, these are the people we need to work on, it seems.
- dekhn 11y agoIf you go the principal investigator route (professor or scientist at national lab), then your boss and granting agencies are the ones that care about your pubs. It's critical to obtaining tenure (if you don't, you're kicked out of the university) and grants.
- dekhn 11y agoI should also mention that my graduate program (top-tier in its field) unofficially required all students to publish in a top-tier journal to be allowed to graduate with a PhD. It was unofficial, but enforced by all the professor/advisors. If you didn't publish in a high enough journal, you'd end up in 7-8th year with a long thesis and have to leave with a master's degree.
- Fomite 11y ago"Is it fellow academics? Or university administrators? Or government agencies that control grants?" Yes. Fellow Academics: The people who will be discussing your tenure case, writing letters of support, nominating you for prizes, etc. University Administrators: The people who are the final word in your tenure case, and who do things like evaluate how well your department/college/etc. is performing. Grants: Be they your fellow academics in the form of reviewers, program officers, etc., the prestige of your publications will likely matter to them. Publications are the unit of currency in academia at the moment, and the incentive and evaluation structures at almost every step are oriented around that. Going your own way is a laudable step, perhaps, but largely the luxury of established researchers who have already had their prestige publications, or those willing to take the potential hit to their careers for the principled stand.
- 11y ago
- transcranial 11y agoMight be interested to check out https://science.ai https://science.ai
- return0 11y agoLatex is a terrible format that most biologists will never learn. HTML is the one uber-standard, it was actually created for that.