1. What TensorBoard Is TensorBoard is mainly used to monitor how a model’s various metrics change — accuracy, loss, the weight distributions of each layer, and so on. TensorBoard is a visualization tool from TensorFlow that supports visualizing scalar, text, image, audio, video, and embedding data, among other types. But PyTorch can use TensorBoard too.