heliophobicdude

10 ms·

61.
by heliophobicdude 3y ago
Would this be before or after inference? Is there some sort of a delegation based on the matter?
62.
by heliophobicdude 3y ago
Not yet. I just have the GPT-4 which is 8K limit
63.
by heliophobicdude 3y ago
> This is the entry level M1. 15fps at 1400x900 isn't great (or even playable), but it's very impressive that it runs at all without any changes, let alone on ultra settings. And running non-natively through Codeweavers patch a
64.
by heliophobicdude 3y ago
Do keep in mind this script was marketed as a way for game developers to judge the viability to port to using native apis and native isa. I would imagine that not running through this codeweavers patch and through rosetta would have better
65.
by heliophobicdude 3y ago
Turns out they have already [1] https://developer.apple.com/documentation/naturallanguage/nl...
66.
by heliophobicdude 3y ago
I would be interested to know of a consistent, on-board embeddings model. Trying to reduce latency and dependence on API calls for simple vector database search will go a long wag
67.
Make-Your-Video: Higher Coherence Video Generation(doubiiu.github.io)
2 points by heliophobicdude 3y ago|0 comments
68.
by heliophobicdude 3y ago
His role is Developer Relations fwiw
69.
by heliophobicdude 3y ago
The models for the api's could have not changed but the web app's might have too
70.
by heliophobicdude 3y ago
Assuming you mean the base model, no not right now. GPT-4 base model is not public.
71.
by heliophobicdude 3y ago
Supposedly the API hasn't changed. https://twitter.com/officiallogank/status/166393494793189785...
72.
by heliophobicdude 3y ago
This is great! Addressing the model limitations a bit: in the demonstration data that is provided to the base model, we should prevent computed or "looked up" answers. I've seen some of the demonstration data that people are
73.
by heliophobicdude 3y ago
Seems that they are hiring for a bunch of roles [1]. Also keep in mind that they release and reveal via large events. Hopefully next week they show us their AI strategy. 1: https://jobs.apple.com/en-us/search?location=un
74.
by heliophobicdude 3y ago
Ah! That makes sense! That's a neat strategy!
75.
by heliophobicdude 3y ago
Cheers!
76.
by heliophobicdude 3y ago
One argument is that it can contaminate training data from output of itself or other models. We have already documented evidence of the effect of this. In the GPT-4 technical report [1], they reported contamination of humaneval data in the
77.
by heliophobicdude 3y ago
I think these are two very separate concepts. What we are mostly seeing when it comes to fine-tuning is making a model promptable. Models like LLaMA or the original GPT3 weren't promptable. They were fine-tuned with demonstration data
78.
by heliophobicdude 3y ago
Assuming you would want to fine-tune over a codebase or set of documents, I would argue vector databases and fine-tuning are completely different tools. I would strongly recommend against fine-tuning over a set of documents as this is a ver
79.
by heliophobicdude 3y ago
Yes and no. Someone pointed out that some of the answers are using OpenAI's famous "As an AI...". Soooo you can roughly say that RLHF might still have had an impact here through the training data that came from an RLHF model
80.
by heliophobicdude 3y ago
https://archive.is/KkZVQ
81.
by heliophobicdude 3y ago
Coding with LLMs was easier after understanding their limitations. 1. They don't know what they are saying until they have said it. 2. Your inputs and its outputs help make the next message. 3. LLMs are not suited for information retri
82.
by heliophobicdude 3y ago
Solid state, active cooling system https://www.froresystems.com/
83.
by heliophobicdude 3y ago
I was wondering if Apple is the partner this solid state, active cooling system was referring to at CES 2023 https://www.froresystems.com/
84.
by heliophobicdude 3y ago
Couple of questions. Is Apple intending to use microOLED from Samsung after buying Sony's microOLED for this upcoming AR HMD? Also are they intending to use Samsung's new purchase of eMagine optics for the higher quality microOLED
85.
by heliophobicdude 3y ago
None so far! It hasn't even asked for my clipboard access.
86.
by heliophobicdude 3y ago
I think we need a different strategy to instruction tuning for coding LLMs. I don't think StarCoderBase is instruction-tuned off the bat but would serve as a good starting point for a new technique. RLHF is fine for things that are har
87.
by heliophobicdude 3y ago
Refined training is usually updating the weights of usually what's called a foundational model with well structured and numerous data. It's can be expensive but most importantly disturb the usefulness of having all the generalizat
88.
by heliophobicdude 3y ago
Perhaps. I don't have those issues from the direct account I have with them.
89.
by heliophobicdude 3y ago
I've been using the api in S-GPT [1]. An iOS shortcut that I use to primarily summarize the body text content of a webpage I'm on from the share-sheet. When it can fit the text in the context, I'm pretty happy with the the re
90.
by heliophobicdude 3y ago
What are some broken-down reasons why gaming on Mac didn't take off. I'm sure it's a few different reasons all together

More ›