A Small TPU Guide
A guide to using TPUs with Levanter with a few general tips and tricks
TPU research cloud is an amazing resource to get a scientific grant for a lof of compute. However, working with TPUs could be complicated and the official PyTorch support for TPUs is pretty terrible. In this guide, we'll share some of the practices of using TPUs.
Read More