'Using multiple GPUs for training gpt-neox
with 2 nvidia GPUs in my server, I am trying to train gpt-neox -- trying to find a way to use the 2 GPUs simultaneously to do the training. Any suggestions on how I may enable both the GPUs for this task?
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|