4 ms·

This is an unbelievable waste of a comment and the OP should not even consider this as feedback. You completely ignore the question, make a comment about "reli

This is an unbelievable waste of a comment and the OP should not even consider this as feedback. You completely ignore the question, make a comment about "religious adoptions of mongo" and then do an about-face by showing your OWN religious zeal AGAINST mongo. Mongo is not killing his business. Your comment should be deleted. To the OPs question: can you post any more specifics? 1M documents with an index shouldn't be an issue for the aggregation pipeline. What are the specs of the machine? What are your indexes? I think it would be tough to help without having that info, and sadly a question requiring that type of info may be best suited for something like Stack Overflow.

Iftheshoefits 12y ago
I don't know, it may not address the OP's specific question but it may, in a very circuitous way, address a need the OP doesn't recognize he has. It is hardly arguable that there is a segment of the developer population that has a religious zeal for their "stack" or against others (just pick any random topic on functional programming or PHP for examples of each). It is entirely appropriate to discuss and address that in topics like this on HN, in my opinion.
- baq 12y ago
  this religious thing works the other way, too. e.g. i, after reading a couple dozen articles about mongo across the years, most of them linked from this site, have a religious zeal against mongo.
  - MichaelGG 12y ago
    A database that had a server-wide lock (and highly trumpeted when they got the feature of only being database-wide) and had the amazingly in-depth IO strategy of mmap, defaulted to losing people's data, silently destroyed data on 32-bit, had a Java client that shipped with "catch { if rnd() > 0.1 then .... }", and spends a lot on money trying to be "webscale"? Perhaps it's a deserved attitude.
  - Iftheshoefits 12y ago
    That may well be the case. HN has a community of zealots for just about any programming or tech related thing (pro-Apple, anti-PHP, anti-C++, pro-functional, pro-javascript, you name it). That doesn't mean criticism (or support) automatically comes from a place of zealotry. In this particular case the parent comment in this thread didn't read at all like religious zealotry against mongoDB to me. I suppose one might infer from it notion of a default assumption that developers are all zealots about their particular technology choices. I'm not sure such an assumption itself is terribly bad to have, honestly. Sometimes I think that if my only insight into the world of technology came from startup job postings and HN, I ought to be forgiven for thinking that the entire industry is a kind of elaborate and humorous play on role-playing game mechanics ("Ruby Dev" <==> "Developer/Ruby" class/skill combo), which are notorious for producing fanatical devotees of one combination or another.
danpalmer 12y ago
I mean this as honest feedback, and please don't take it as a personal attack, but I think you are being unreasonably critical of the comment, and I suggest you take time to consider why that is. The comment raised an interesting way of thinking about the problem that many developers would not consider, and while it might have had a fair bit of religious zeal, that is very common here and not worthy of comments like "unbelievable waste of a comment" and "your comment should be deleted".
- mikegioia 12y ago
  Aye yai yai. Ya know, your response is part of the problem here. This may be a general shift in the way this site is going, and that may be fine, but what I expect from the comments in HN posts is far greater than what SFjulie1 posted. It's incoherent, off-topic, and filled with the anti-{%database%} mentality prevalent when something about MongoDB comes up. The comment raised an interesting way of thinking about the problem that many developers would not consider Fantastic! Why can we not have an actual discussion about scaling MongoDB when the post is about scaling MongoDB! You want to have a conversation about different database engine solutions to the problem, go start a post about that. But this post was about MongoDB scaling. I may have been critical of the GP here, but you fail to appreciate the need and desire to keep HN to the level it should be.
  - danpalmer 12y ago
    The comment was not 'incoherent', to say so suggests that the actual points made no sense. Rather, the comment was simply written in poor English. I think your comment only needed to be a polite "can we keep the conversation on the topic of MongoDB scaling" rather than a quite personal attack on the author. Also, personally, I thought the main point raised about viewing the database choice from a business rather than development point of view was interesting and well worth discussion.
  - brown9-2 12y ago
    Why can we not have an actual discussion about scaling MongoDB when the post is about scaling MongoDB! Because it might be more helpful to think about scaling your data needs than scaling with only a certain product.
Ronaldo777 12y ago
SFjulie1's comment is a good one, mikegioia. Taking a look at the economics of a technology that's being used is a very sensible thing to do, especially for a business. If this analysis shows that one solution is inferior to another, it does not mean that the analyst has a "religious zeal" against the economically-inferior technology.
- mikegioia 12y ago
  My entire point in this entire thread is to for once keep the conversation on topic about MongoDB without everyone going into a tangent on switching to Postgres or something else. I just want one post where we can actually talk about MongoDB scaling.
  - Ronaldo777 12y ago
    Somebody came here asking for help with a real world problem. It would be doing this person a disservice to not mention alternative technologies that have solved very similar problems that have affected many other people/organizations. It is total absurdity to avoid bringing up these solutions to the problem merely in order to maintain some vague purity of the discussion, or to otherwise keep the discussion unnecessarily and unhelpfully focused.
    - mikegioia 12y ago
      I feel like you're just ignoring what I'm saying. It is NOT helpful to suggest alternative technologies all the time, especially in this specific post. If I asked on a forum for help with the engine on my Dodge Dart, and you posted "Just buy a Prius", that would not be helpful. Do you see how that isn't helpful? That's what I'm trying to say, that I would like to see, for once a post stay on topic when it's about MongoDB (heck, even PHP for that matter!).
      - Ronaldo777 12y ago
        If using a Prius instead of a Dart would very likely solve the problem(s) being experienced, then it is a perfectly reasonable thing to suggest. It would be wrong not to suggest it. This submission is about a problem involving MongoDB. It is not about MongoDB itself. The submitter clearly wants a variety of ideas here. That's why the submission says, and I quote, "Any tips, stories, suggestions are welcome!" "Any" means "any", including the suggestion that some other technology be used.

Iftheshoefits 12y ago

I don't know, it may not address the OP's specific question but it may, in a very circuitous way, address a need the OP doesn't recognize he has. It is hardly arguable that there is a segment of the developer population that has a religious zeal for their "stack" or against others (just pick any random topic on functional programming or PHP for examples of each). It is entirely appropriate to discuss and address that in topics like this on HN, in my opinion.

baq 12y ago
this religious thing works the other way, too. e.g. i, after reading a couple dozen articles about mongo across the years, most of them linked from this site, have a religious zeal against mongo.
- MichaelGG 12y ago
  A database that had a server-wide lock (and highly trumpeted when they got the feature of only being database-wide) and had the amazingly in-depth IO strategy of mmap, defaulted to losing people's data, silently destroyed data on 32-bit, had a Java client that shipped with "catch { if rnd() > 0.1 then .... }", and spends a lot on money trying to be "webscale"? Perhaps it's a deserved attitude.
- Iftheshoefits 12y ago
  That may well be the case. HN has a community of zealots for just about any programming or tech related thing (pro-Apple, anti-PHP, anti-C++, pro-functional, pro-javascript, you name it). That doesn't mean criticism (or support) automatically comes from a place of zealotry. In this particular case the parent comment in this thread didn't read at all like religious zealotry against mongoDB to me. I suppose one might infer from it notion of a default assumption that developers are all zealots about their particular technology choices. I'm not sure such an assumption itself is terribly bad to have, honestly. Sometimes I think that if my only insight into the world of technology came from startup job postings and HN, I ought to be forgiven for thinking that the entire industry is a kind of elaborate and humorous play on role-playing game mechanics ("Ruby Dev" <==> "Developer/Ruby" class/skill combo), which are notorious for producing fanatical devotees of one combination or another.

danpalmer 12y ago

I mean this as honest feedback, and please don't take it as a personal attack, but I think you are being unreasonably critical of the comment, and I suggest you take time to consider why that is. The comment raised an interesting way of thinking about the problem that many developers would not consider, and while it might have had a fair bit of religious zeal, that is very common here and not worthy of comments like "unbelievable waste of a comment" and "your comment should be deleted".

mikegioia 12y ago
Aye yai yai. Ya know, your response is part of the problem here. This may be a general shift in the way this site is going, and that may be fine, but what I expect from the comments in HN posts is far greater than what SFjulie1 posted. It's incoherent, off-topic, and filled with the anti-{%database%} mentality prevalent when something about MongoDB comes up. The comment raised an interesting way of thinking about the problem that many developers would not consider Fantastic! Why can we not have an actual discussion about scaling MongoDB when the post is about scaling MongoDB! You want to have a conversation about different database engine solutions to the problem, go start a post about that. But this post was about MongoDB scaling. I may have been critical of the GP here, but you fail to appreciate the need and desire to keep HN to the level it should be.
- danpalmer 12y ago
  The comment was not 'incoherent', to say so suggests that the actual points made no sense. Rather, the comment was simply written in poor English. I think your comment only needed to be a polite "can we keep the conversation on the topic of MongoDB scaling" rather than a quite personal attack on the author. Also, personally, I thought the main point raised about viewing the database choice from a business rather than development point of view was interesting and well worth discussion.
- brown9-2 12y ago
  Why can we not have an actual discussion about scaling MongoDB when the post is about scaling MongoDB! Because it might be more helpful to think about scaling your data needs than scaling with only a certain product.

Ronaldo777 12y ago

SFjulie1's comment is a good one, mikegioia. Taking a look at the economics of a technology that's being used is a very sensible thing to do, especially for a business. If this analysis shows that one solution is inferior to another, it does not mean that the analyst has a "religious zeal" against the economically-inferior technology.

mikegioia 12y ago
My entire point in this entire thread is to for once keep the conversation on topic about MongoDB without everyone going into a tangent on switching to Postgres or something else. I just want one post where we can actually talk about MongoDB scaling.
- Ronaldo777 12y ago
  Somebody came here asking for help with a real world problem. It would be doing this person a disservice to not mention alternative technologies that have solved very similar problems that have affected many other people/organizations. It is total absurdity to avoid bringing up these solutions to the problem merely in order to maintain some vague purity of the discussion, or to otherwise keep the discussion unnecessarily and unhelpfully focused.
  - mikegioia 12y ago
    I feel like you're just ignoring what I'm saying. It is NOT helpful to suggest alternative technologies all the time, especially in this specific post. If I asked on a forum for help with the engine on my Dodge Dart, and you posted "Just buy a Prius", that would not be helpful. Do you see how that isn't helpful? That's what I'm trying to say, that I would like to see, for once a post stay on topic when it's about MongoDB (heck, even PHP for that matter!).
    - Ronaldo777 12y ago
      If using a Prius instead of a Dart would very likely solve the problem(s) being experienced, then it is a perfectly reasonable thing to suggest. It would be wrong not to suggest it. This submission is about a problem involving MongoDB. It is not about MongoDB itself. The submitter clearly wants a variety of ideas here. That's why the submission says, and I quote, "Any tips, stories, suggestions are welcome!" "Any" means "any", including the suggestion that some other technology be used.