Ways to use torch.compile
The dream which we sold with torch.compile is that you could slap it on the top of your model and get a speed up. This turns out to… not quite be true? But the fact remains that if you’re willing to put in some work, there is almost always performance waiting at the end of the road for you. Some tips