Hi, I’m using the PyTorch Profiler to optimize the GPU training time of my neural network.
I realize that each operation performed requires long traceback calls except for the first one (a Fourier transform, if that helps) for each epoch.

The corresponding part in the profiler looks like this:

https://preview.redd.it/w4kemi8w89id1.png?width=1303&format=png&auto=webp&s=f7ba069ea53506c0ed292d28df18b3f3680799a0

https://preview.redd.it/htwp9r9x89id1.png?width=1378&format=png&auto=webp&s=5c3934253fceb68395f837dc5130fc4db0c55bb9

https://preview.redd.it/r3twt49y89id1.png?width=1411&format=png&auto=webp&s=fc3a307435ef93d3d5733f91faea5bc78923ad14

Has anyone experienced this before and does anyone know what it means or how to fix it?