7 ms·

Managed Redis on Google Cloud Platform

140 points by deesix 8y ago

nivertech 8y ago
Too bad you still need to provision instance and reserve max capacity. They had a chance to outcompete AWS by providing a truly serverless Redis-like service with no upfront commitment and pay-per-use. That’s what I expected when I first heard that GCP is working on “Serverless Redis” a year ago.
- jjeaff 8y ago
  Ya, that's not serverless by any definition of the word. It's "managed" redis.
- tpetry 8y ago
  Where do you read you have to provision instances? I have to choose between Basic and Standard. But there‘s no clear indication that i have to select an instance based on my storage requirements. The pricing information does not indicate different instances for the different storage requirements, it could be, but would not really fit how the rest of gcp works.
  - nivertech 8y ago
    The lowest tier says min 1GB. So I guess it starts from $35.77/mo, even if your app doesn’t need the whole 1GB.
    - tpetry 8y ago
      Yes, but that‘s no indication you have to provision an instance (not serverless). Google just decided that their granularity for billing is 1GB, like aws lambda and google cloud functions are billed in second granularity and not milliseconds.
      - nivertech 8y ago
        According to your definition Heroku is serverless. Serverless widely understood as: 1. not having to deal with instances/dynos/droplets/etc. 2. Pay-per-use, no upfront payment for unused capacity Some calling AWS DynamoDB - serverless, but having to pay for reserved capacity for each table and index, make it a bad fit for the rest of serverless stack like AWS lambda or API Gateway or even S3.
        tpetry 8y ago
        The Google redis service will be serverless if the pricing table is not mapped to „subscriptions“ you choose from but instead automatically chooses the pricing layer each hour based on your stored amount (like automated discounts for vms). Thats what i am saying: We still dont know if you have to choose first which pricing layer you want or if google automatically seitches you to the one fitting the amount you store. Both requirements would be fullfilled on automatic selection of pricing layer: 1. You sinply store data, google handles the price/gb-hour depending on your stored amount 2. You only store data and you are only billed the stored amount (in 1GB increments) I just wanted to say we just dont know yet whether its serverless (instance type changed automatically) or you have to choose the instant type first.
        gcbirzan 8y ago
        You have to pick the instance type beforehand. Back when I asked about this in the alpha, I was told changing the size of the instance flushes the cache on the basic instance and has some downtime. I can confirm this happens now that resizing is available. For standard, it should be relatively seamless (no flush, minimal downtime), but I'm not gonna test right now. :-)
nodesocket 8y ago
Great. Does this support persisting to disk RDB[1] or AOF[2]? Pricing seems reasonable? 1GB of Redis data is $0.049 per GB hour. 730 hours in a month = $0.049 * 1 * 730 = $35.77/mo. 5GB of Redis data is $0.027 per GB hour. 730 hours in a month = $0.027 * 5 * 730 = $98.55/mo. [1][2] https://redis.io/topics/persistence https://redis.io/topics/persistence
- jkaplowitz 8y ago
  Those prices are not per hour, but per GB-hour. So multiply your second monthly price by 5. Not cheaper for more data, but definitely cheaper per GB.
  - nodesocket 8y ago
    Oops. Duh, that makes more sense. Updated.
- siscia 8y ago
  I don't think this is Redis, this is something that fully supports the Redis protocol. I wouldn't be that much surprised if underneath use a custom implentation. Said so, arguably, RDB and AOF are not a concern of the user but of the administrator so I wouldn't expect them...
- threeseed 8y ago
  Amazon Elasticache by comparison: 1.5GB is $0.034 per hour = $24.82/mo. 6GB is $0.182 per hour = $132.82/mo. They just run Redis on stock EC2 hardware hence the odd GB numbers. But one advantage of AWS is that with Reserved Instance pricing you could get those numbers down by 2/3.
- gcbirzan 8y ago
  The standard tier is supposed to persist data (and it did, during maintenance events - it was an alpha, so yeah - there was no data loss), but not sure what they use as the logs are not yet available.
  - 8y ago
hesdeadjim 8y ago
Huge fan of RedisLabs, but I'm all for more managed Redis options.
- squid3 8y ago
  NodeChef Redis Hosting is another option that makes it easy to deploy, operate, and scale Redis in the cloud. https://nodechef.com/redis-hosting https://nodechef.com/redis-hosting
  - manigandham 8y ago
    Please use a disclaimer that this is your company if you're going to advertise
    - always_good 8y ago
      It isn't their company...
      - manigandham 8y ago
        Yes it is, did you bother checking? https://news.ycombinator.com/item?id=13523349 https://news.ycombinator.com/item?id=13523349 > coupdejarnac on Jan 30, 2017 > Are you a nodechef cofounder by any chance? I host with nodechef and am happy with them so far. > squid3 on Jan 30, 2017 > Yes, I am one of the co-founders. Thanks for hosting with us.
- sterwill 8y ago
  I used RedisLabs in a project about 3 years ago where I wanted durable storage, and the service was excellent. Latency in us-east-1 was low, the management interface was snappy, and scaling up storage took just a couple of clicks. I'd probably use a "locally managed" Redis service (ElastiCache in AWS, Google's service in GCP, etc.) for volatile caching in the future, since it's one less vendor to manage, but I'd recommend RedisLabs to anyone who is considering it.
pcx 8y ago
> Compatibility with the Redis protocol means you can migrate your applications with zero code changes. Does this mean they don't actually use Redis, but have an alternate implementation of the protocol? In such a case, wouldn't it be different it terms of performance when compared to the original one. Also, keeping up with new versions should be a major overhead. If Google is still doing an alternate implementation, I wonder what could be the reason.
- jkaplowitz 8y ago
  It's probably built on top of Google's standard production software and hardware stack, the same thing they use to run most of their standard services like search and Gmail. This tech stack tends to have evolved earlier than and separately from the public equivalent. It generally scales and performs better than normal tech stacks, but its components are so different and so mutually interdependent that it's bad at directly running normal software. The protocol, however, can be implemented just fine. To be clear: Even though I worked at Google in the past, I don't now, am not speaking for Google, and know nothing secret about this product. I'm extrapolating from widely known general knowledge about Google's technical infrastructure.
- mk89 8y ago
  It's the same with Aws elasticache. There is redis underneath, still, if you want to have all the features that they provide - scale in/out, replicas, etc, you'll need to have some tools around. I would say yes, it's still different than using the original one, but that's the way it is when you use any managed service.
- paxys 8y ago
  Will be different, yes, but in the same way any two instances of "real" Redis will be different. Hardware, networking, routing, load balancing, memory and disk IO, number of instances, backups/failovers etc. are going to be deciding overall performance rather than the Redis binary itself.
- Lunatic666 8y ago
  We have a Redis+Memcached frontend with an Apache Ignite Backend. Now we can re-use existing functionality in the clients and have new features like read-through based on a MySQL database or an automatically updated near cache on the instances themselves.
wasd 8y ago
> Reach out to us to let us know what kinds of managed database services you’d like us to offer next. Hey Google friends, I'm not ready to move over to GCloud but I'm interested in prototyping a few applications. Here's a few things on my wishlist: * Wrapping the cli tool for common db tasks in the way heroku does (ex: heroku pg:push - push local database to production database, heroku pg:pull - pulls production database to local). * Simpler integration of Cloud SQL with AppEngine flex. It's not a lot of work (https://cloud.google.com/appengine/docs/flexible/python/using-cloud-sql https://cloud.google.com/appengine/docs/flexible/python/usin...) but it would be cool to build a flex environment / provision a sql database / setup connection strings in one swoop. * While you're at it, better AppEngine flex introductory pricing ($40 / mo for 1 vcpu, 512 mb ram) :) Not related to managed databases but hopefully helpful. TLDR Heroku but on GCloud.
sandGorgon 8y ago
will this support the new upcoming Streams datastructure in redis ? I'm looking forward to a lightweight, hosted kafka replacement using redis streams.
- manigandham 8y ago
  https://RedisLabs.com https://RedisLabs.com probably will, if you just want a managed offering. They are cheaper, and the official sponsor of the redis project now with support for the latest releases.
- gcbirzan 8y ago
  Currently, the only available version is 3.2, so that's a no.
wiradikusuma 8y ago
I'm an GAE user, and I use Memcached there. Implementation aside, how does this different than GAE's Memcached? (from perspective of running on Google Cloud)

140 points by deesix 8y ago

Too bad you still need to provision instance and reserve max capacity. They had a chance to outcompete AWS by providing a truly serverless Redis-like service with no upfront commitment and pay-per-use. That’s what I expected when I first heard that GCP is working on “Serverless Redis” a year ago.

jjeaff 8y ago
Ya, that's not serverless by any definition of the word. It's "managed" redis.
tpetry 8y ago
Where do you read you have to provision instances? I have to choose between Basic and Standard. But there‘s no clear indication that i have to select an instance based on my storage requirements. The pricing information does not indicate different instances for the different storage requirements, it could be, but would not really fit how the rest of gcp works.
- nivertech 8y ago
  The lowest tier says min 1GB. So I guess it starts from $35.77/mo, even if your app doesn’t need the whole 1GB.
  - tpetry 8y ago
    Yes, but that‘s no indication you have to provision an instance (not serverless). Google just decided that their granularity for billing is 1GB, like aws lambda and google cloud functions are billed in second granularity and not milliseconds.
    - nivertech 8y ago
      According to your definition Heroku is serverless. Serverless widely understood as: 1. not having to deal with instances/dynos/droplets/etc. 2. Pay-per-use, no upfront payment for unused capacity Some calling AWS DynamoDB - serverless, but having to pay for reserved capacity for each table and index, make it a bad fit for the rest of serverless stack like AWS lambda or API Gateway or even S3.
      - tpetry 8y ago
        The Google redis service will be serverless if the pricing table is not mapped to „subscriptions“ you choose from but instead automatically chooses the pricing layer each hour based on your stored amount (like automated discounts for vms). Thats what i am saying: We still dont know if you have to choose first which pricing layer you want or if google automatically seitches you to the one fitting the amount you store. Both requirements would be fullfilled on automatic selection of pricing layer: 1. You sinply store data, google handles the price/gb-hour depending on your stored amount 2. You only store data and you are only billed the stored amount (in 1GB increments) I just wanted to say we just dont know yet whether its serverless (instance type changed automatically) or you have to choose the instant type first.
        gcbirzan 8y ago
        You have to pick the instance type beforehand. Back when I asked about this in the alpha, I was told changing the size of the instance flushes the cache on the basic instance and has some downtime. I can confirm this happens now that resizing is available. For standard, it should be relatively seamless (no flush, minimal downtime), but I'm not gonna test right now. :-)

nodesocket 8y ago

Great. Does this support persisting to disk RDB[1] or AOF[2]? Pricing seems reasonable? 1GB of Redis data is $0.049 per GB hour. 730 hours in a month = $0.049 * 1 * 730 = $35.77/mo. 5GB of Redis data is $0.027 per GB hour. 730 hours in a month = $0.027 * 5 * 730 = $98.55/mo. [1][2] https://redis.io/topics/persistence https://redis.io/topics/persistence

jkaplowitz 8y ago
Those prices are not per hour, but per GB-hour. So multiply your second monthly price by 5. Not cheaper for more data, but definitely cheaper per GB.
- nodesocket 8y ago
  Oops. Duh, that makes more sense. Updated.
siscia 8y ago
I don't think this is Redis, this is something that fully supports the Redis protocol. I wouldn't be that much surprised if underneath use a custom implentation. Said so, arguably, RDB and AOF are not a concern of the user but of the administrator so I wouldn't expect them...
threeseed 8y ago
Amazon Elasticache by comparison: 1.5GB is $0.034 per hour = $24.82/mo. 6GB is $0.182 per hour = $132.82/mo. They just run Redis on stock EC2 hardware hence the odd GB numbers. But one advantage of AWS is that with Reserved Instance pricing you could get those numbers down by 2/3.
gcbirzan 8y ago
The standard tier is supposed to persist data (and it did, during maintenance events - it was an alpha, so yeah - there was no data loss), but not sure what they use as the logs are not yet available.
- 8y ago

hesdeadjim 8y ago

Huge fan of RedisLabs, but I'm all for more managed Redis options.

squid3 8y ago
NodeChef Redis Hosting is another option that makes it easy to deploy, operate, and scale Redis in the cloud. https://nodechef.com/redis-hosting https://nodechef.com/redis-hosting
- manigandham 8y ago
  Please use a disclaimer that this is your company if you're going to advertise
  - always_good 8y ago
    It isn't their company...
    - manigandham 8y ago
      Yes it is, did you bother checking? https://news.ycombinator.com/item?id=13523349 https://news.ycombinator.com/item?id=13523349 > coupdejarnac on Jan 30, 2017 > Are you a nodechef cofounder by any chance? I host with nodechef and am happy with them so far. > squid3 on Jan 30, 2017 > Yes, I am one of the co-founders. Thanks for hosting with us.
sterwill 8y ago
I used RedisLabs in a project about 3 years ago where I wanted durable storage, and the service was excellent. Latency in us-east-1 was low, the management interface was snappy, and scaling up storage took just a couple of clicks. I'd probably use a "locally managed" Redis service (ElastiCache in AWS, Google's service in GCP, etc.) for volatile caching in the future, since it's one less vendor to manage, but I'd recommend RedisLabs to anyone who is considering it.

pcx 8y ago

> Compatibility with the Redis protocol means you can migrate your applications with zero code changes. Does this mean they don't actually use Redis, but have an alternate implementation of the protocol? In such a case, wouldn't it be different it terms of performance when compared to the original one. Also, keeping up with new versions should be a major overhead. If Google is still doing an alternate implementation, I wonder what could be the reason.

jkaplowitz 8y ago
It's probably built on top of Google's standard production software and hardware stack, the same thing they use to run most of their standard services like search and Gmail. This tech stack tends to have evolved earlier than and separately from the public equivalent. It generally scales and performs better than normal tech stacks, but its components are so different and so mutually interdependent that it's bad at directly running normal software. The protocol, however, can be implemented just fine. To be clear: Even though I worked at Google in the past, I don't now, am not speaking for Google, and know nothing secret about this product. I'm extrapolating from widely known general knowledge about Google's technical infrastructure.
mk89 8y ago
It's the same with Aws elasticache. There is redis underneath, still, if you want to have all the features that they provide - scale in/out, replicas, etc, you'll need to have some tools around. I would say yes, it's still different than using the original one, but that's the way it is when you use any managed service.
paxys 8y ago
Will be different, yes, but in the same way any two instances of "real" Redis will be different. Hardware, networking, routing, load balancing, memory and disk IO, number of instances, backups/failovers etc. are going to be deciding overall performance rather than the Redis binary itself.
Lunatic666 8y ago
We have a Redis+Memcached frontend with an Apache Ignite Backend. Now we can re-use existing functionality in the clients and have new features like read-through based on a MySQL database or an automatically updated near cache on the instances themselves.

wasd 8y ago

> Reach out to us to let us know what kinds of managed database services you’d like us to offer next. Hey Google friends, I'm not ready to move over to GCloud but I'm interested in prototyping a few applications. Here's a few things on my wishlist: * Wrapping the cli tool for common db tasks in the way heroku does (ex: heroku pg:push - push local database to production database, heroku pg:pull - pulls production database to local). * Simpler integration of Cloud SQL with AppEngine flex. It's not a lot of work (https://cloud.google.com/appengine/docs/flexible/python/using-cloud-sql https://cloud.google.com/appengine/docs/flexible/python/usin...) but it would be cool to build a flex environment / provision a sql database / setup connection strings in one swoop. * While you're at it, better AppEngine flex introductory pricing ($40 / mo for 1 vcpu, 512 mb ram) :) Not related to managed databases but hopefully helpful. TLDR Heroku but on GCloud.

sandGorgon 8y ago

will this support the new upcoming Streams datastructure in redis ? I'm looking forward to a lightweight, hosted kafka replacement using redis streams.

manigandham 8y ago
https://RedisLabs.com https://RedisLabs.com probably will, if you just want a managed offering. They are cheaper, and the official sponsor of the redis project now with support for the latest releases.
gcbirzan 8y ago
Currently, the only available version is 3.2, so that's a no.

wiradikusuma 8y ago

I'm an GAE user, and I use Memcached there. Implementation aside, how does this different than GAE's Memcached? (from perspective of running on Google Cloud)