Automatic mixed precision

PyTorch Developer Podcast - A podcast by Edward Yang, Team PyTorch

Categories:

Technology

What is automatic mixed precision? How is it implemented? What does it have to do with mode dispatch keys, fallthrough kernels? What are AMP policies? How is its cast caching implemented? How does torchvision also support AMP? What's up with Intel's CPU autocast implementation?