nexus, index source, cloud index source
cloud
“Cloud” in the context of research computing refers to commercial clouds, particularly AWS, GCP and Azure,
where Virtual Machines are available on a pay-as-you-go basis. The content of this repo does not however
concern “cloud” consumer services like iCloud and Google Drive.
Essay: Is cloud computing a good idea for you?
children
references
Cloud computing for research comes at a dollar cost. We are interested in optimizing spend.
- Preemptible instance use on the cloud (70-90% savings)
open topic: access control
- subnet masks and so on
cloud clinics
- 23-JAN-2025 11:30AM PDT Checkpointing methods: Getting $3.33 of cloud compute for $1.00
- [connect link], [recording link]
- Abstract: In today’s busy world we can lose track of small details that have a big impact.
Suppose you have a cloud budget of $10,000 but your computations could be scaled up beyond
that limitation to produce better research. What you need is access to immutable storage (easy),
access to cheap preemptible cloud VM instances (easy) and a reliable method of checkpointing
your progress (easy? hard?). This one-two-three punch means you can purchase $33,333 worth of
cloud computing for a mere $10,000 and get better research results as a consequence. This cloud
clinic will catch you up on the how-tos and other small details of such a substantial gain in
compute power. We use a CNN as our example implementation of a compute-intensive research task.
gpu instances on AWS