7 ms·

What's this? Python? Apache? MySQL? But I thought you had to be running beta-release key value stores, esoteric web servers, and experimental programming lan

by blhack 15y ago

What's this? Python? Apache? MySQL? But I thought you had to be running beta-release key value stores, esoteric web servers, and experimental programming languages if you wanted to scale! /s

orlandu63 15y ago
Nope, you just need lots of cash.
- joering2 15y ago
  speaking of - are they profitable yet?
zmj 15y ago
Got your experimental programming language: > Vitess - a new project released by YouTube, written in Go, it’s a frontend to MySQL. It does a lot of optimization on the fly, it rewrites queries and acts as a proxy. Currently it serves every YouTube database request. It’s RPC based.
- maukdaddy 15y ago
  Ah yes, but it's using a ~30 year old technology (RPC).
  - simonw 15y ago
    Is RPC an actual technology? I thought it was more of a protocol design pattern.
    - old-gregg 15y ago
      man callrpc
      - tav 15y ago
        When Youtube refers to Vitess as being RPC-based, they are not referring to Sun RPC (callrpc), but rather to the generic design pattern of exposing service calls over the network. In particular, Vitess makes services callable [-] using either BSON or JSON serialisation over HTTP CONNECT calls. [-] http://code.google.com/p/vitess/source/browse/go/rpcwrap/ http://code.google.com/p/vitess/source/browse/go/rpcwrap/
    - ajross 15y ago
      Remote Procedure Call is a design paradigm for synchronous call-and-response network communication. The Sun RPC protocol is an actual technology defined in RFC1057: http://www.ietf.org/rfc/rfc1057.txt http://www.ietf.org/rfc/rfc1057.txt It's not insane, though not terribly relevant in the modern world. The only common technology still using it is NFS.
      - m0th87 15y ago
        If you look at the original RPC work by Bruce Nelson [1], it's pretty clear that there's no strict definition of it. I think most would argue that SOAP would be included, which is still pretty common. 1: http://nd.edu/~dthain/courses/cse598z/fall2004/papers/birrell-rpc.pdf http://nd.edu/~dthain/courses/cse598z/fall2004/papers/birrel...
        ajross 15y ago
        No, that's the ambiguity I was addressing. RPC means two things. The protocol is used, for the most part, only by NFS. The concept is pervasive.
      - cbsmith 15y ago
        That's ONC RPC. Not the only implementation. XDR is still used in places, though you're right that it isn't widely used.
j2labs 15y ago
I know the rage is async & nonblocking, but putting Python behind Apache is a good way to get predictable performance without concerns for calls that block, since they're mitigated via threads. Also, it helps to have money since this approach requires more boxes. But as I said, it's very reliable.
peterwwillis 15y ago
Fast, cheap, scalable: pick two. The fastest, easiest, arguably most reliable way to scale is throwing money at it. And apparently it's easier to hire good people who know 20-year old tech rather than 3-year old.

by blhack 15y ago

What's this? Python? Apache? MySQL? But I thought you had to be running beta-release key value stores, esoteric web servers, and experimental programming languages if you wanted to scale! /s

orlandu63 15y ago

Nope, you just need lots of cash.

joering2 15y ago
speaking of - are they profitable yet?

zmj 15y ago

Got your experimental programming language: > Vitess - a new project released by YouTube, written in Go, it’s a frontend to MySQL. It does a lot of optimization on the fly, it rewrites queries and acts as a proxy. Currently it serves every YouTube database request. It’s RPC based.

maukdaddy 15y ago
Ah yes, but it's using a ~30 year old technology (RPC).
- simonw 15y ago
  Is RPC an actual technology? I thought it was more of a protocol design pattern.
  - old-gregg 15y ago
    man callrpc
    - tav 15y ago
      When Youtube refers to Vitess as being RPC-based, they are not referring to Sun RPC (callrpc), but rather to the generic design pattern of exposing service calls over the network. In particular, Vitess makes services callable [-] using either BSON or JSON serialisation over HTTP CONNECT calls. [-] http://code.google.com/p/vitess/source/browse/go/rpcwrap/ http://code.google.com/p/vitess/source/browse/go/rpcwrap/
  - ajross 15y ago
    Remote Procedure Call is a design paradigm for synchronous call-and-response network communication. The Sun RPC protocol is an actual technology defined in RFC1057: http://www.ietf.org/rfc/rfc1057.txt http://www.ietf.org/rfc/rfc1057.txt It's not insane, though not terribly relevant in the modern world. The only common technology still using it is NFS.
    - m0th87 15y ago
      If you look at the original RPC work by Bruce Nelson [1], it's pretty clear that there's no strict definition of it. I think most would argue that SOAP would be included, which is still pretty common. 1: http://nd.edu/~dthain/courses/cse598z/fall2004/papers/birrell-rpc.pdf http://nd.edu/~dthain/courses/cse598z/fall2004/papers/birrel...
      - ajross 15y ago
        No, that's the ambiguity I was addressing. RPC means two things. The protocol is used, for the most part, only by NFS. The concept is pervasive.
    - cbsmith 15y ago
      That's ONC RPC. Not the only implementation. XDR is still used in places, though you're right that it isn't widely used.

j2labs 15y ago

I know the rage is async & nonblocking, but putting Python behind Apache is a good way to get predictable performance without concerns for calls that block, since they're mitigated via threads. Also, it helps to have money since this approach requires more boxes. But as I said, it's very reliable.

peterwwillis 15y ago

Fast, cheap, scalable: pick two. The fastest, easiest, arguably most reliable way to scale is throwing money at it. And apparently it's easier to hire good people who know 20-year old tech rather than 3-year old.