FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  575.58         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.3294         	|167            	|  556.02         	|  96.601         	|
run_training_batch                 	|  0.24027        	|1000           	|  240.27         	|  41.743         	|
optimizer_step_with_closure_0      	|  0.2381         	|1000           	|  238.1          	|  41.367         	|
training_step_and_backward         	|  0.17887        	|1000           	|  178.87         	|  31.076         	|
model_forward                      	|  0.092247       	|1000           	|  92.247         	|  16.027         	|
training_step                      	|  0.09207        	|1000           	|  92.07          	|  15.996         	|
backward                           	|  0.085285       	|1000           	|  85.285         	|  14.817         	|
get_train_batch                    	|  0.05387        	|1167           	|  62.866         	|  10.922         	|
fetch_next_train_batch             	|  0.053843       	|1167           	|  62.835         	|  10.917         	|
on_train_batch_end                 	|  0.0016497      	|1000           	|  1.6497         	|  0.28661        	|
zero_grad                          	|  0.0013046      	|1000           	|  1.3046         	|  0.22665        	|
training_batch_to_device           	|  0.00033666     	|1000           	|  0.33666        	|  0.05849        	|
on_train_batch_start               	|  9.5996e-05     	|1000           	|  0.095996       	|  0.016678       	|
on_batch_start                     	|  8.6839e-05     	|1000           	|  0.086839       	|  0.015087       	|
on_train_epoch_end                 	|  0.00031914     	|167            	|  0.053297       	|  0.0092596      	|
on_train_epoch_start               	|  0.00030966     	|167            	|  0.051713       	|  0.0089844      	|
on_train_end                       	|  0.043955       	|1              	|  0.043955       	|  0.0076366      	|
on_pretrain_routine_start          	|  0.021581       	|1              	|  0.021581       	|  0.0037494      	|
on_after_backward                  	|  1.946e-05      	|1000           	|  0.01946        	|  0.0033809      	|
on_before_zero_grad                	|  1.6441e-05     	|1000           	|  0.016441       	|  0.0028563      	|
on_batch_end                       	|  1.424e-05      	|1000           	|  0.01424        	|  0.002474       	|
on_before_backward                 	|  1.1822e-05     	|1000           	|  0.011822       	|  0.002054       	|
on_before_optimizer_step           	|  1.1637e-05     	|1000           	|  0.011637       	|  0.0020217      	|
configure_optimizers               	|  0.010519       	|1              	|  0.010519       	|  0.0018275      	|
training_step_end                  	|  8.0368e-06     	|1000           	|  0.0080368      	|  0.0013963      	|
on_epoch_end                       	|  1.1196e-05     	|167            	|  0.0018697      	|  0.00032484     	|
on_epoch_start                     	|  1.0672e-05     	|167            	|  0.0017823      	|  0.00030965     	|
on_train_start                     	|  0.0017369      	|1              	|  0.0017369      	|  0.00030176     	|
on_before_accelerator_backend_setup	|  4.5732e-05     	|1              	|  4.5732e-05     	|  7.9453e-06     	|
on_fit_start                       	|  4.334e-05      	|1              	|  4.334e-05      	|  7.5298e-06     	|
on_fit_end                         	|  3.7972e-05     	|1              	|  3.7972e-05     	|  6.5971e-06     	|
setup                              	|  2.3736e-05     	|1              	|  2.3736e-05     	|  4.1238e-06     	|
on_configure_sharded_model         	|  2.1365e-05     	|1              	|  2.1365e-05     	|  3.7118e-06     	|
teardown                           	|  1.7406e-05     	|1              	|  1.7406e-05     	|  3.0241e-06     	|
on_pretrain_routine_end            	|  1.4316e-05     	|1              	|  1.4316e-05     	|  2.4873e-06     	|
prepare_data                       	|  1.3912e-05     	|1              	|  1.3912e-05     	|  2.417e-06      	|
configure_callbacks                	|  1.1038e-05     	|1              	|  1.1038e-05     	|  1.9177e-06     	|
on_val_dataloader                  	|  7.3034e-06     	|1              	|  7.3034e-06     	|  1.2689e-06     	|
on_train_dataloader                	|  7.1246e-06     	|1              	|  7.1246e-06     	|  1.2378e-06     	|
configure_sharded_model            	|  5.696e-06      	|1              	|  5.696e-06      	|  9.896e-07      	|
