4 ms·
But the Neuron and Connections are just metadata objects like pointers that hold arrays, I don't understand. Surely in PyTorch/TF, the ND-Arrays of NN's must a
by gavinray 6y ago
But the Neuron and Connections are just metadata objects like pointers that hold arrays, I don't understand.
Surely in PyTorch/TF, the ND-Arrays of NN's must also be associated to an object reference?
> existing frameworks (PyTorch/TensorFlow) and accelerated hardware (GPUs/TPUs) which operate on neurons arranged as arrays of the same shape.
const dot = (inputs: number[], weights: number[]) => {
let total = 0;
const length = Math.min(inputs.length, weights.length);
for (let i = 0; i < length; i++) {
total += inputs[i] * weights[i];
}
return total;
};
activate(input?: number): number {
if (!this.incoming.length) {
this.output = input;
} else {
const inputs = this.incoming.map(connection => connection.from.output)
const weights = this.incoming.map(connection => connection.weight);
this.output = squash(dot(inputs, weights) + this.bias);
}
return this.output;
}
This is on principle the same concept right?
- cs702 6y agoUnfortunately, the problem is more complex than that: https://dl.acm.org/doi/pdf/10.1145/3317550.3321441?download=true https://dl.acm.org/doi/pdf/10.1145/3317550.3321441?download=... (I oversimplified things in my comment above).