3 ms·
I'm also curious to know how people who use Python for data science and combine it with some other platform for web facing endpoints architect their apps in the
by hopia 7y ago
I'm also curious to know how people who use Python for data science and combine it with some other platform for web facing endpoints architect their apps in the cloud.
- rajamaka 7y agoPython web server triggering lambda functions to process jobs
- hopia 7y agoWhere do you put the web server? What's the purpose of it? Or you mean to use Python as the client facing API server? I meant how to architect if you use some other platform for the publicly exposed API. Would you build an internal Python API at the lambdas that run the actual data science computation, and invoke that from the client facing API/app?
- trufas 7y agoI haven't done this specifically but it seems like a perfect use case for a smaller separate service. You'd probably submit jobs through an internal API (REST, gRPC, pick your poison) or through a job queue like Celery, if they're slower operations.
- hopia 7y agoYes that's what I thought too. Building a bunch of data analytics microservices that host a Python API and serve the results internally to the actual outwards facing API server.