NKdeveloper

50 ms·

1. 1.▲
   by NKdeveloper 2y ago

   The request will be an S3 style API request and the contents will vary depending on the workload. For example, OpenAI trains an LLM, and for every iteration, a batch of model input data is requested from their object storage. My service wou
2. 2.▲
   by NKdeveloper 2y ago

   Perhaps the demo video was a bit confusing. You can think of it similar to how a traditional CPU memory cache works in that the client will send a request to the server (GPU memory cache in this case) which will process requests and then mo
3. 3.▲
   by NKdeveloper 2y ago

   One interesting tech fact about the initial approach is that I used CUDA unified memory to minimize the overhead of CPU to GPU data transfer.
4. 4.▲
   by NKdeveloper 2y ago

   Also I am planning to do additional performance experiments to cover a broader range of use cases and challenging workloads.
5. 5.▲
   by NKdeveloper 2y ago

   Hey! I'm working on an MVP with the more features and I hope to have it available sometime soon. The MVP will feature a GPU cache that integrates with customers' existing AWS S3 storage through S3 compatible APIs. It will be desig
6. 6.▲
   GPU Accelerated Object Storage(acceleratedcloudstorage.com)

   17 points by NKdeveloper 2y ago|7 comments