5 ms·

MongoDB 1.4 Production Release

80 points by rit 17y ago

pibefision 17y ago
Just a question: mongo uses some kind of memory cache like memcached? or I need to implement it aside to get faster-faster performance? I'm thinking on a small app (10K visitors a day).
- javery 17y ago
  Mongo should be fast enough that you don't need to use memcached. It uses memory mapped files (which is also important to know since by default it only flushes data to disk every 60 seconds)
  - antirez 17y ago
    Memory mapped files are nice, but once the mapped file starts to get much bigger than the physical memory pages the operating system can allocate, it starts to be asymptotically the same as accessing the filesystem from the point of view of latency, so indeed for datasets considerably bigger than RAM it is not possible to be as fast as memcached. Not a MongoDB limit, but a nature-imposed limit :)
    - amix 17y ago
      I have had some bad experiences with memory mapped databases (particularly Berkeley DB and Tokyo Tyrant) - both these seem to be very greedy with IO writes when one starts to have lots of data and lots of updates. I think Reddit experienced a similar problem (as memcachedb is based on Berkeley DB). Does anybody know what Cassandra does?
      - uggedal 17y ago
        Take a look at http://wiki.apache.org/cassandra/MemtableThresholds http://wiki.apache.org/cassandra/MemtableThresholds and http://wiki.apache.org/cassandra/ArchitectureOverview#Write_path http://wiki.apache.org/cassandra/ArchitectureOverview#Write_... for the specifics.
- dm_mongodb 17y ago
  this blog post talks a bit about a real world implementation and when they do and do not use memcached with mongodb: http://www.businessinsider.com/how-we-use-mongodb-2009-11 http://www.businessinsider.com/how-we-use-mongodb-2009-11
  - ccarpenterg 17y ago
    I've tried MongoDB with the C++ API. I had a lot of problems in particular with the BSON objects and then switched to Memcached (+ MySQL). Do you think that the "production" version is working ok for all API's?
    - pibefision 17y ago
      What problems?
    - rit 17y ago
      Sluggy.com has been using MongoDB in production (with Python as it's main API interface) since ~July '09. We haven't had a single problem with Mongo or API interfaces. This replaced MySQL + Memcache and was a MASSIVE difference in system load and performance. Your mileage may vary, but it's very, very rare that I can say I haven't had a single real problem with a third party package (especially one as complicated as a database-type system), more so with early adoption. (I'm still using Memcache for a few legacy pieces, but in general things I was having Beaker stuff in Memcache such as sessions and Pylons template caches are going into the Mongo Beaker plugin I wrote - http://bitbucket.org/bwmcadams/mongodb_beaker/ http://bitbucket.org/bwmcadams/mongodb_beaker/ )
      - ccarpenterg 17y ago
        Yeah, It works for me too with the Python API. But I have to develop some backend app with C++. Anyway I think I'll try again in the future.
        mathias_10gen 17y ago
aaronbrethorst 17y ago
I am incredibly excited about the inclusion of geospatial indexing and searching (http://www.mongodb.org/display/DOCS/Geospatial+Indexing http://www.mongodb.org/display/DOCS/Geospatial+Indexing), especially with the impending release of full-text search next quarter (http://jira.mongodb.org/browse/SERVER-380 http://jira.mongodb.org/browse/SERVER-380).
- pibefision 17y ago
  full-text search would be amazing.
  - mark_l_watson 17y ago
    I wrote about how easy it is to do some form of index and search: http://markwatson.com/blog/2009/11/mongodb-has-good-support-for-indexing.html http://markwatson.com/blog/2009/11/mongodb-has-good-support-...
- thibaut_barrere 17y ago
  Same here - I've been using Sphinx quite a lot for geospatial stuff before. This feature was the only reason why I was still using it instead of MongoDB for some projects. I'm already gone :)
mark_l_watson 17y ago
Sweet, I am installing it right now on my MacBook (I always have it running) and if everything looks good I'll also install it on my 2 MongoDB servers. I really like MongoDB for its ease of use with Ruby and its rich query support. I am unlikely to ever need the scalability of Cassandra, and MongoDB's features fit my needs. The new geo location support looks good.
barmstrong 17y ago
Anyone found some simple steps to upgrade? Surprised they didn't include it in the post. I installed the previous version using these instructions: http://shiftcommathree.com/articles/how-to-install-mongodb-on-os-x http://shiftcommathree.com/articles/how-to-install-mongodb-o... EDIT: Figured it out. The release notes provide a few more details. http://www.mongodb.org/display/DOCS/1.4+Release+Notes http://www.mongodb.org/display/DOCS/1.4+Release+Notes I pasted the steps I used here: http://www.pastie.org/887556 http://www.pastie.org/887556
pointernil 17y ago
Am I the only one a little disturbed by the "name" of this product? At least in german speaking countries "mongo" is usually only used as insulting calling for people with Down-Syndrom...
- nex3 17y ago
  According to http://en.wikipedia.org/wiki/Mongo http://en.wikipedia.org/wiki/Mongo, there are a wide variety of uses of the word "Mongo".
  - pointernil 17y ago
    Yes, I completly understand that (which is as well true for many other words like "ass" and "behind" f.e.)... Just wanted to point out this little maybe unknown "fact". cheers
MartinMond 17y ago
Where would one use MongoDB? Without durability I'm not really sure I see much applications using it.
- MartinMond 17y ago
  Replying to myself (since I found out about this just now): Once MongoDB solves http://jira.mongodb.org/browse/SERVER-467 http://jira.mongodb.org/browse/SERVER-467 durability won't be an issue any more

80 points by rit 17y ago

Just a question: mongo uses some kind of memory cache like memcached? or I need to implement it aside to get faster-faster performance? I'm thinking on a small app (10K visitors a day).

javery 17y ago
Mongo should be fast enough that you don't need to use memcached. It uses memory mapped files (which is also important to know since by default it only flushes data to disk every 60 seconds)
- antirez 17y ago
  Memory mapped files are nice, but once the mapped file starts to get much bigger than the physical memory pages the operating system can allocate, it starts to be asymptotically the same as accessing the filesystem from the point of view of latency, so indeed for datasets considerably bigger than RAM it is not possible to be as fast as memcached. Not a MongoDB limit, but a nature-imposed limit :)
  - amix 17y ago
    I have had some bad experiences with memory mapped databases (particularly Berkeley DB and Tokyo Tyrant) - both these seem to be very greedy with IO writes when one starts to have lots of data and lots of updates. I think Reddit experienced a similar problem (as memcachedb is based on Berkeley DB). Does anybody know what Cassandra does?
    - uggedal 17y ago
      Take a look at http://wiki.apache.org/cassandra/MemtableThresholds http://wiki.apache.org/cassandra/MemtableThresholds and http://wiki.apache.org/cassandra/ArchitectureOverview#Write_path http://wiki.apache.org/cassandra/ArchitectureOverview#Write_... for the specifics.
dm_mongodb 17y ago
this blog post talks a bit about a real world implementation and when they do and do not use memcached with mongodb: http://www.businessinsider.com/how-we-use-mongodb-2009-11 http://www.businessinsider.com/how-we-use-mongodb-2009-11
- ccarpenterg 17y ago
  I've tried MongoDB with the C++ API. I had a lot of problems in particular with the BSON objects and then switched to Memcached (+ MySQL). Do you think that the "production" version is working ok for all API's?
  - pibefision 17y ago
    What problems?
  - rit 17y ago
    Sluggy.com has been using MongoDB in production (with Python as it's main API interface) since ~July '09. We haven't had a single problem with Mongo or API interfaces. This replaced MySQL + Memcache and was a MASSIVE difference in system load and performance. Your mileage may vary, but it's very, very rare that I can say I haven't had a single real problem with a third party package (especially one as complicated as a database-type system), more so with early adoption. (I'm still using Memcache for a few legacy pieces, but in general things I was having Beaker stuff in Memcache such as sessions and Pylons template caches are going into the Mongo Beaker plugin I wrote - http://bitbucket.org/bwmcadams/mongodb_beaker/ http://bitbucket.org/bwmcadams/mongodb_beaker/ )
    - ccarpenterg 17y ago
      Yeah, It works for me too with the Python API. But I have to develop some backend app with C++. Anyway I think I'll try again in the future.
      - mathias_10gen 17y ago

aaronbrethorst 17y ago

I am incredibly excited about the inclusion of geospatial indexing and searching (http://www.mongodb.org/display/DOCS/Geospatial+Indexing http://www.mongodb.org/display/DOCS/Geospatial+Indexing), especially with the impending release of full-text search next quarter (http://jira.mongodb.org/browse/SERVER-380 http://jira.mongodb.org/browse/SERVER-380).

pibefision 17y ago
full-text search would be amazing.
- mark_l_watson 17y ago
  I wrote about how easy it is to do some form of index and search: http://markwatson.com/blog/2009/11/mongodb-has-good-support-for-indexing.html http://markwatson.com/blog/2009/11/mongodb-has-good-support-...
thibaut_barrere 17y ago
Same here - I've been using Sphinx quite a lot for geospatial stuff before. This feature was the only reason why I was still using it instead of MongoDB for some projects. I'm already gone :)

mark_l_watson 17y ago

Sweet, I am installing it right now on my MacBook (I always have it running) and if everything looks good I'll also install it on my 2 MongoDB servers. I really like MongoDB for its ease of use with Ruby and its rich query support. I am unlikely to ever need the scalability of Cassandra, and MongoDB's features fit my needs. The new geo location support looks good.

barmstrong 17y ago

Anyone found some simple steps to upgrade? Surprised they didn't include it in the post. I installed the previous version using these instructions: http://shiftcommathree.com/articles/how-to-install-mongodb-on-os-x http://shiftcommathree.com/articles/how-to-install-mongodb-o... EDIT: Figured it out. The release notes provide a few more details. http://www.mongodb.org/display/DOCS/1.4+Release+Notes http://www.mongodb.org/display/DOCS/1.4+Release+Notes I pasted the steps I used here: http://www.pastie.org/887556 http://www.pastie.org/887556

pointernil 17y ago

Am I the only one a little disturbed by the "name" of this product? At least in german speaking countries "mongo" is usually only used as insulting calling for people with Down-Syndrom...

nex3 17y ago
According to http://en.wikipedia.org/wiki/Mongo http://en.wikipedia.org/wiki/Mongo, there are a wide variety of uses of the word "Mongo".
- pointernil 17y ago
  Yes, I completly understand that (which is as well true for many other words like "ass" and "behind" f.e.)... Just wanted to point out this little maybe unknown "fact". cheers

MartinMond 17y ago

Where would one use MongoDB? Without durability I'm not really sure I see much applications using it.

MartinMond 17y ago
Replying to myself (since I found out about this just now): Once MongoDB solves http://jira.mongodb.org/browse/SERVER-467 http://jira.mongodb.org/browse/SERVER-467 durability won't be an issue any more