webvet

8 ms·

1. 31.▲
   by webvet 13y ago

   >Do you really need all that data in real time? Are you querying all of it in your app? Yes and yes. ALL the data records could potentially be queried via site navigation.
2. 32.▲
   by webvet 13y ago

   Cool !! Is it robots.txt compliant? If not, it might be a good idea to make this available as an option/parameter. For 'quick and dirty' tasks, wget -r can come in handy too.
3. 33.▲
   by webvet 13y ago

   Thanks. We'll check out TokuDB.
4. 34.▲
   by webvet 13y ago

   Regardless of your English syntax (rusty or not), what would you define as 'huge' for a MySQL app?
5. 35.▲
   by webvet 13y ago

   > 150GB and 100M records is not huge, not even close. Close to what, if I may ask?
6. 36.▲
   by webvet 13y ago

   >Database optimization needs to generally take into account YOUR data and usage patterns. I'd say this is quite true. >I've found that an unfortunate number of people aren't aware of "EXPLAIN" and its use to h
7. 37.▲
   by webvet 13y ago

   1) Yes, and no 2) Both (3 servers) 3) We've analyzed/optimized this to the max (of our abilities)
8. 38.▲
   by webvet 13y ago

   I believe we did tune and tweak the heck out of my.cfg, but will investigate thread_dcache_size all the same. I also believe we're archiving at least some logs (and such) to flat files already, but will re-visit this soon too. Thanks f
9. 39.▲
   by webvet 13y ago

   Thanks for your input - and no, we're not webvet.com
10. 40.▲
    by webvet 13y ago

    Hey, I'll have to check with the others here, but I think we have not been aware of 1. !!! Will certainly investigate this ASAP - thanks. 2. and 3. - already implemented to the max (of our abilities :)).
11. 41.▲
    by webvet 13y ago

    We did use a tool (perl script) called mysqltuner.pl on this sometime last year and it did give us some useful/actionable insight. Will check out what you've suggested too. Thanks. :)
12. 42.▲
    by webvet 13y ago

    Development froze almost 2 years ago :) Since then, just the data volume keeps growing.
13. 43.▲
    by webvet 13y ago

    Will get the book and check out the blog soon. Thanks. :)
14. 44.▲
    by webvet 13y ago

    [1] Been doing already and [2] Will re-visit soon Thanks :)
15. 45.▲
    by webvet 13y ago

    Thanks. 1) and 2) - we've done to the max. 4) already in place, with some differences.
16. 46.▲
    by webvet 13y ago

    Thanks - 4) has been on the cards, I just forgot to mention it.
17. 47.▲
    by webvet 13y ago

    Yes, we enable slow query logs from time to time, look at those and try to optimize for those. MyISAM tables. We've been cycling frequently (and painfully) through (2) (and less frequently through (1)) for the best part of three years
18. 48.▲
    by webvet 13y ago

    Please let me know what more info would be helpful and I'll be happy to provide the same.
19. 49.▲
    by webvet 13y ago

    Hey, thanks :) We are actually considering this, but it skipped my mind while making the post.
20. 50.▲
    by webvet 13y ago

    Let me try to answer: Slow - as in average Top loads (on CentOS) staying between 1 and 2 pretty much throughout the day; closer to 2 rather than to 1, peaking ALL the way up to 10 and even beyond several times a day, for periods as long as
21. 51.▲
    by webvet 13y ago

    We don't have Memcache (or anything similar) presently, though I do believe we looked at it sometime last year. Will get a re-check done on this - thanks. :)
22. 52.▲
    Ask HN: Dealing with a huge MySQL database - help

    32 points by webvet 13y ago|62 comments
23. 53.▲
    by webvet 13y ago

    The primary reason we didn't use them was the lack of several features we needed. We're not really concerned about the existing services adding the missing features - what we really wish to find out is whether or not there exist (
24. 54.▲
    by webvet 13y ago

    Nothing that we'd really know of, because we never actually used any. :) Having said that, I must admit that we did study the specs of some of those and found a few gaps here and there (at least so far as our requirement was concerned)
25. 55.▲
    Ask HN: Is there a market for a Screenshot capture service?

    1 points by webvet 13y ago|4 comments
26. 56.▲
    by webvet 13y ago

    Nice idea - nice project. IMO, it could really thrive once it gets good traction - congrats. One (small) suggestion: Change your tag line from: 'Build a Shyahi profile to showcase your developer contributions and social activity.&#x27
27. 57.▲
    by webvet 13y ago

    Here is one that is almost 'Ready to Go'... HTH http://openoffice.apache.org/get-involved.html
28. 58.▲
    by webvet 13y ago

    Yes, I'd be interested to hear about this too. FWIW, here is a somewhat related, recent experience we've had: During May/June this year we created a freeware app (for Win), made it available for download via our website and t