3 ms·

The entire #3 really hits home for me. A couple weeks ago I started using New Relic and was just horrified by how bad my code had degenerated over the last 2 y

The entire #3 really hits home for me. A couple weeks ago I started using New Relic and was just horrified by how bad my code had degenerated over the last 2 years... all those changes you make do have a cost, and in hindsight "it's fast for me" does not necessarily extend to others. I've always looked at scaling Playtomic to involve the crapton [1] of data we're processing every minute of every day - cause that's obviously where the "real work" is, handling a huge stream of data that needs processing. It turned out the web interface for heavier users was ridiculous [2], heavier users with dozens of games had in extreme cases double-digit seconds on some of the stuff which is just embarrassing. In the last couple weeks I've reduced our main server (we're still ghetto so it's database + web) cpu usage from 80% down to ~20% and made staggering improvements on the speed of reports - down to xx milliseconds in most cases, from some really ugly times [3]. [1] http://playtomic.com/blog/post/64-whats-in-a-minute http://playtomic.com/blog/post/64-whats-in-a-minute [2] http://playtomic.com/blog/post/62-scaling-the-user-side-of-pla http://playtomic.com/blog/post/62-scaling-the-user-side-of-p... [3] http://i.imgur.com/bdUG4.png http://i.imgur.com/bdUG4.png

ojilles 15y ago
Tangent: How does the data transfer from your server to new relic work? There's very little data on their website that I could find...
- benologist 15y ago
  I'm not sure about the method, but it sends the data to collector.newrelic.com and collector0 through 8., pretty much the whole thing was completely automatic and zero configuration except for double clicking the installer exe. Edit, actually here we go (about 1/2 way down): http://support.newrelic.com/help/kb/docs/security http://support.newrelic.com/help/kb/docs/security By default, data is transmitted in the clear from your site to our site. There is an option flag (ssl) in the newrelic.yml file to enable the use of HTTPS. We don't do host authentication with HTTPS, just communication encryption. Under Java, .NET and PHP we use JSON to serialize data. The Ruby agent uses Ruby marshaling to send data to New Relic and we marshal return codes back. We believe the risk exposure from marshaling is low. The Agent communicates with two hosts: collector.newrelic.com and one of collector[0-8].newrelic.com, where the numbered host is fixed for your account. Which numbered host your account uses is displayed in the log/newrelic_agent.log at startup.
  - ojilles 15y ago
    Sounds great! But still, I'd love some more information before installing this on production. Thanks anyways for the pointer, hadn't come across them before! Edit: Thanks for that too! :-)
    - benologist 15y ago
      Chat with their live support - it really is an incredible platform.

ojilles 15y ago

Tangent: How does the data transfer from your server to new relic work? There's very little data on their website that I could find...

benologist 15y ago
I'm not sure about the method, but it sends the data to collector.newrelic.com and collector0 through 8., pretty much the whole thing was completely automatic and zero configuration except for double clicking the installer exe. Edit, actually here we go (about 1/2 way down): http://support.newrelic.com/help/kb/docs/security http://support.newrelic.com/help/kb/docs/security By default, data is transmitted in the clear from your site to our site. There is an option flag (ssl) in the newrelic.yml file to enable the use of HTTPS. We don't do host authentication with HTTPS, just communication encryption. Under Java, .NET and PHP we use JSON to serialize data. The Ruby agent uses Ruby marshaling to send data to New Relic and we marshal return codes back. We believe the risk exposure from marshaling is low. The Agent communicates with two hosts: collector.newrelic.com and one of collector[0-8].newrelic.com, where the numbered host is fixed for your account. Which numbered host your account uses is displayed in the log/newrelic_agent.log at startup.
- ojilles 15y ago
  Sounds great! But still, I'd love some more information before installing this on production. Thanks anyways for the pointer, hadn't come across them before! Edit: Thanks for that too! :-)
  - benologist 15y ago
    Chat with their live support - it really is an incredible platform.