6 ms·
IBM and NASA build language models to make scientific knowledge more accessible
- RcouF1uZ4gsC 3y ago[flagged]
- jwuphysics 3y agoUniverseTBD (https://universetbd.org https://universetbd.org) is also making great strides in the space of large language models and astronomy.
- mncharity 3y agoBriefly hopeful, I ask astrollama-7b-chat-alpha[1] "What color is the Sun?". It replies "The Sun has no color as it emits radiation across all wavelengths from ultraviolet to infrared. [...] there isn't an answer for what color the Sun truly is since it doesn't have one but rather produces every visible spectrum imaginable!". Sigh. Hmm, I wonder if LLM replies might be usefully mined to generate misconception lists? [1] https://huggingface.co/spaces/universeTBD/astrollama-7b-chat-alpha https://huggingface.co/spaces/universeTBD/astrollama-7b-chat...
- jwuphysics 3y agoOof, yeah that's not a very good response. But I guess color is actually a technical term in research astronomy: it refers to the difference in two specified magnitudes (usually photometric filters). There's also the question of whether the sun is being viewed from the Earth or from space, since those will change the effective "transmission curve" of the detector system. I asked: "What color is the sun when viewed from the ground with the human visual system?" And got the following: "The Sun appears white to us on Earth due to its high temperature and lack of any significant wavelength-dependent absorption or scattering properties. However, if we were able to view it through specialized telescopes that could capture all visible light spectrum (not just the yellow/orange part), then it would appear as an extremely bright ball of blue light with some slight red tint. This is because most of the solar radiation consists of photons at ultraviolet and infrared frequencies which our eyes cannot perceive directly but can be detected by these advanced instruments. [...]" An overall better response, but still not exactly right. Anyway, the base model was fine-tuned on arXiv/astro-ph abstracts, and I can't imagine too much discussion about the color of the sun in that training data set...
- mncharity 3y agoNod. Though briefly asking E&M questions a few days ago made me think the "not exactly right"-but-seemingly-closer may be stopped-clock-ish. Very not at the point where latents are seemingly encoding deep structure about the world.
- wolverine876 3y agoWho wants to learn from anything less than the best sources? I've often thought that a search engine that indexes only the highest quality, probably hand-curated, sources would be highly desireable. I'm not really interested in learning from everyone about, for example, physics or history or climate change or the invasion of Ukraine; I only want the best. I'm not missing out, practically: there is far more than enough of the 'best' to consume all my time; there's a large opportunity cost to reading other things. Choosing the 'best' is somewhat subjective, but it is far better than arbitrarily or randomly choosing sources. LLMs, used for knowledge discovery and retrieval, would seem to benefit from the same sources.
- javiramos 3y agoWith Perplexity [0] you can narrow you LLM interactions to only reference Academic articles or other high-quality sources. [0] https://www.perplexity.ai/ https://www.perplexity.ai/
- Tomte 3y agoIgnoring the question whether LLMs can produce the best, the idea wouldn‘t be to cite the best sources, but to train only on the best sources. A garbage hallucination with a link to the Stanford Encyclopedia of Philosophy won‘t help anyone.
- throwanem 3y agoOn the other hand, given the query "facial recognition in paper wasps", Perplexity just gave not only an answer in accord with my prior understanding derived from reading in the field, but also surfaced a paper [1] published two months ago that I hadn't yet seen. I expected less, and I suspect a researcher could easily find gaps. But from the perspective an amateur autodidact, that's still a fairly impressive result. [1] https://www.pnas.org/doi/10.1073/pnas.1918592117 https://www.pnas.org/doi/10.1073/pnas.1918592117
- deleted 3y ago[deleted]
- kingkongjaffa 3y agoIs it weird they mentioned these examples and not, OpenAI, Anthropic, Gemini etc.? > Transformer-based language models — which include BERT, RoBERTa, and IBM’s Slate and Granite family of models Why would they not mention the most popular transformer based language models?
- hackinthebochs 3y agoBERT and RoBERTa aren't competing against IBMs products. You don't advertise your competitor in your own ad.
- hiddencost 3y agoIBM isn't competing against anthropic / openAI/ Google. IBM's business model is to be worse but sell to lots of clients because the clients don't know any better.
- esafak 3y agoWhich doesn't work if you tell them about your competitors :)
- fghorow 3y agoELI5: Does one need to write code to use these, or is there a front-end somewhere?
- deleted 3y ago[deleted]
- bottom999mottob 3y agoUsing pre-trained language models like the encoder and retrieval models mentioned [1] typically doesn't require writing a lot of code, but there are still a few steps involved. The retrieval model, [2], is hosted on the Hugging Face platform. To use it, you can use Hugging Face's Inference API to send HTTP requests to their servers and receive responses from the model. HuggingFace's docs [3] provides instructions on how to use the Inference API, including code examples in Python and other languages. Essentially, you'll need to format your input text according to the model's requirements, send an HTTP request to the API endpoint, and then process the response. This does require some basic programming knowledge to interact with APIs and handle the requests/responses. There are some third-party applications and services that provide a front-end for accessing pre-trained language models like this one, like Hugging Face Spaces, Replicate.ai, and Google Colab. However, these often come with additional costs or limitations... Here's a related model by IBM and NASA for geospatial stuff [4]. [1] https://research.ibm.com/blog/science-expert-LLM https://research.ibm.com/blog/science-expert-LLM [2] https://huggingface.co/nasa-impact/nasa-smd-ibm-st https://huggingface.co/nasa-impact/nasa-smd-ibm-st [3] https://huggingface.co/docs/huggingface_hub/v0.14.1/en/guides/inference https://huggingface.co/docs/huggingface_hub/v0.14.1/en/guide... [4] https://huggingface.co/ibm-nasa-geospatial https://huggingface.co/ibm-nasa-geospatial
- givinguflac 3y agoThis looks great! I'm excited to play with it. Can anyone point me to a resource on how to load it? I tried downloading the model into LM Studio on my Mac but it seems there is more to be done than just loading it. Any pointers much appreciated!
- Alifatisk 3y agoWhat does IBM contribute with in this collaboration? The development?
- occamrazor 3y agoNote that the model is based on RoBERTa and has only 125m parameter. It is not competing against any of the new popular models, not even small ones like Phi or GeMMa.
- 3abiton 3y agoGiven the current state of LLMs, I am not even sure this qualify to be called an LLM.
- mistrial9 3y agosecond opinion - BERT family are transformer-based, and that is a big threshold right there.. secondly I am not sure that two one-minute comments could capture what exactly went on with fine tuning or graph-based methods of constraint or whatnot.. with respect to the fitness of the production tools for intended purposes.
- jerpint 3y agoIt’s also not meant to be a generative model - only to be used as an encoder model (they list retrieval as a potential use case )
- deleted 3y ago[deleted]
- datadrivenangel 3y agoNASA has been investing in hardcore knowledge management and information organization for well over half a century now.
- mistrial9 3y agoRoBERTa models were presented at least 18 months ago at NASA.. it seems that "reading and tagging your own manuals" is such a daunting task that these tools got fast-tracked..
- sinuhe69 3y agoI thought IBM has its Watson already? ;)
- hulitu 3y ago> IBM and NASA build language models to make scientific knowledge more accessible Newspeak ?