3 ms·
/Pedantic That’s a common issue for many datasets. You can map that just fine in a relational DB either using Nulls on some columns or breaking that column dat
by Retric 7y ago
/Pedantic
That’s a common issue for many datasets. You can map that just fine in a relational DB either using Nulls on some columns or breaking that column data into a separate table. EX: (CustomerID: 50, ColumnID : 6852, Value : “Mike”)
- jostmey 7y agoHmm... I think I see the confusion with my title, which I had to shorten to meet the space requirements. It should read "Statistical Classification When Data Do Not Conform to Rows and Columns: … ". The problem is that statistical classification generally requires the data to be in tidy rows and columns, which is not the case for the T-cell data.
- tomnipotent 7y agoExcept this isn't how statistical methods on vectors and matrices work. In an ML data set, the value "Mike" may actually be one-hot encoded to one of 500 columns (one column value is 1, everything else is 0) - because you have 500 different names in your dataset, so each VALUE gets its own column. It's a very different problem/solution than NULLs in databases.
- Retric 7y agoI was referring to jacques_chester’s comment. You’re bringing up a related and still well explored topic as this situation is very common. https://link.springer.com/article/10.1007%2Fs00180-013-0468-8 https://link.springer.com/article/10.1007%2Fs00180-013-0468-...