Full disclosure: I am a Google employee, but I don't work on GCE, and this post does not reflect the views of my employer.
Last year I made a post about Amazon's spot instances, which allows you to buy their spare compute capacity for much cheaper than their normal prices. In exchange, they are allowed to kill your VM at any time.
I used that for a bit, but found that while it's a cheap way to get a lot of compute capacity, setup is a pain in the rear end because they don't allow using a persistent disk as root volume, and insist on having spot instances start from fixed machine images (AMIs). The bidding process is also annoying, and the price you pay can change minute by minute. These problems can be worked around through clever scripting, but it takes quite a bit of work to set up.
I just realize that Google Compute Engine also offers a similar service called pre-emptible instances. The idea is the same - they sell you their unused compute capacity for cheap, in return for the right to kill your instance at any time when they need the capacity back (with 30 seconds notice through an ACPI event).
It's much nicer than Amazon spot instances though, because they work just like normal instances otherwise, and you can use persistent disks with them as root volumes. There is also no bidding. The price is fixed.
I also found the web interface much more intuitive to use, but that may not be a fair comparison because I'm already familiar with another VM service (AWS) when I started to explore it.
The only downside is they enforce a runtime limit of 24 hours for pre-emptible instances, meaning your VM will be killed at least every 24 hours. In my experience, instances do run to 24 hours most of the time (but not always).
Prices: https://cloud.google.com/products/calculator/
For 16 cores/32 threads (32 vCPU) and 28.8GB RAM and 50GB disk, it's about $0.24 per hour or $177/month if it's on all the time.
Matthew
Google Compute Engine pre-emptible instances
Moderators: hgm, Rebel, chrisw
-
- Posts: 793
- Joined: Sun Aug 03, 2014 4:48 am
- Location: London, UK
Google Compute Engine pre-emptible instances
Disclosure: I work for DeepMind on the AlphaZero project, but everything I say here is personal opinion and does not reflect the views of DeepMind / Alphabet.
-
- Posts: 7220
- Joined: Mon May 27, 2013 10:31 am
Re: Google Compute Engine pre-emptible instances
$177/month means no money left for a Holiday.
-
- Posts: 1334
- Joined: Sun Jul 17, 2011 11:14 am
Re: Google Compute Engine pre-emptible instances
Thus why I get somebody else to pay for a DigitalOcean droplet for $20 a month.
Some believe in the almighty dollar.
I believe in the almighty printf statement.
I believe in the almighty printf statement.
-
- Posts: 793
- Joined: Sun Aug 03, 2014 4:48 am
- Location: London, UK
Re: Google Compute Engine pre-emptible instances
That gets you 2 cores. I would just run experiments locally in that case.ZirconiumX wrote:Thus why I get somebody else to pay for a DigitalOcean droplet for $20 a month.
Disclosure: I work for DeepMind on the AlphaZero project, but everything I say here is personal opinion and does not reflect the views of DeepMind / Alphabet.
-
- Posts: 1334
- Joined: Sun Jul 17, 2011 11:14 am
Re: Google Compute Engine pre-emptible instances
Not everybody can sleep with the sound of a fan running at full pelt. I'm fine with my single testing core. It does what I need it to do. Nothing more, nothing less.matthewlai wrote:That gets you 2 cores. I would just run experiments locally in that case.ZirconiumX wrote:Thus why I get somebody else to pay for a DigitalOcean droplet for $20 a month.
Some believe in the almighty dollar.
I believe in the almighty printf statement.
I believe in the almighty printf statement.
-
- Posts: 793
- Joined: Sun Aug 03, 2014 4:48 am
- Location: London, UK
Re: Google Compute Engine pre-emptible instances
Sure, if that works for you.ZirconiumX wrote:Not everybody can sleep with the sound of a fan running at full pelt. I'm fine with my single testing core. It does what I need it to do. Nothing more, nothing less.matthewlai wrote:That gets you 2 cores. I would just run experiments locally in that case.ZirconiumX wrote:Thus why I get somebody else to pay for a DigitalOcean droplet for $20 a month.
Many people want more compute power because 10 Elo changes require thousands of games to verify. If you have a lot of patience or you are still at a stage where your changes are 50+ Elo, a single core can be enough.
Disclosure: I work for DeepMind on the AlphaZero project, but everything I say here is personal opinion and does not reflect the views of DeepMind / Alphabet.
-
- Posts: 2204
- Joined: Sat Jan 18, 2014 10:24 am
- Location: Andorra
Re: Google Compute Engine pre-emptible instances
Someone understands the prices from the new Oracle compute service? I mean for example a 16 cores server/month like the one commented here.
I found this:
https://cloud.oracle.com/en_US/compute/compute/pricing
But $75.00 for only 1 OCPU/month does not seems very comparable Maybe I'm not understanding something...
Thanks
I found this:
https://cloud.oracle.com/en_US/compute/compute/pricing
But $75.00 for only 1 OCPU/month does not seems very comparable Maybe I'm not understanding something...
Thanks
Daniel José - http://www.andscacs.com
-
- Posts: 292
- Joined: Tue Jul 07, 2009 4:56 am
Re: Google Compute Engine pre-emptible instances
I don't think Oracle cares about selling to anyone who isn't spending millions of dollars. Computer chess hobbyists aren't really their target market
-
- Posts: 793
- Joined: Sun Aug 03, 2014 4:48 am
- Location: London, UK
Re: Google Compute Engine pre-emptible instances
The main difference is they are not pre-emptible I think. Google and Amazon can offer those low prices because they are selling their spare capacity (that they wouldn't otherwise be able to sell).cdani wrote:Someone understands the prices from the new Oracle compute service? I mean for example a 16 cores server/month like the one commented here.
I found this:
https://cloud.oracle.com/en_US/compute/compute/pricing
But $75.00 for only 1 OCPU/month does not seems very comparable Maybe I'm not understanding something...
Thanks
Regular offerings from both Google and Amazon cost much more, too.
Disclosure: I work for DeepMind on the AlphaZero project, but everything I say here is personal opinion and does not reflect the views of DeepMind / Alphabet.
-
- Posts: 2204
- Joined: Sat Jan 18, 2014 10:24 am
- Location: Andorra
Re: Google Compute Engine pre-emptible instances
Thanks! I hope AMD sells cheap some of his new big cpus soon
Daniel José - http://www.andscacs.com