FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1556.8         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  9.1834         	|167            	|  1533.6         	|  98.51          	|
run_training_batch                 	|  0.18581        	|8000           	|  1486.4         	|  95.48          	|
training_step_and_backward         	|  0.17572        	|8000           	|  1405.8         	|  90.296         	|
model_forward                      	|  0.093722       	|8000           	|  749.77         	|  48.16          	|
training_step                      	|  0.093588       	|8000           	|  748.7          	|  48.092         	|
backward                           	|  0.081815       	|8000           	|  654.52         	|  42.042         	|
optimizer_step_with_closure_0      	|  0.2338         	|1000           	|  233.8          	|  15.018         	|
get_train_batch                    	|  0.0033554      	|8167           	|  27.404         	|  1.7602         	|
fetch_next_train_batch             	|  0.0033377      	|8167           	|  27.259         	|  1.7509         	|
on_train_batch_end                 	|  0.0010727      	|8000           	|  8.5816         	|  0.55122        	|
training_batch_to_device           	|  0.00021935     	|8000           	|  1.7548         	|  0.11272        	|
zero_grad                          	|  0.00132        	|1000           	|  1.32           	|  0.084786       	|
on_train_batch_start               	|  8.9353e-05     	|8000           	|  0.71482        	|  0.045916       	|
on_batch_start                     	|  1.4924e-05     	|8000           	|  0.11939        	|  0.007669       	|
on_before_backward                 	|  1.3372e-05     	|8000           	|  0.10697        	|  0.0068713      	|
on_batch_end                       	|  1.289e-05      	|8000           	|  0.10312        	|  0.0066236      	|
on_after_backward                  	|  1.1731e-05     	|8000           	|  0.093846       	|  0.006028       	|
training_step_end                  	|  6.0164e-06     	|8000           	|  0.048132       	|  0.0030917      	|
on_train_epoch_start               	|  0.00028448     	|167            	|  0.047508       	|  0.0030516      	|
on_train_epoch_end                 	|  0.00025549     	|167            	|  0.042666       	|  0.0027406      	|
on_train_end                       	|  0.026191       	|1              	|  0.026191       	|  0.0016824      	|
on_pretrain_routine_start          	|  0.022751       	|1              	|  0.022751       	|  0.0014614      	|
on_before_zero_grad                	|  1.6045e-05     	|1000           	|  0.016045       	|  0.0010306      	|
on_before_optimizer_step           	|  1.4768e-05     	|1000           	|  0.014768       	|  0.00094857     	|
configure_optimizers               	|  0.0083266      	|1              	|  0.0083266      	|  0.00053485     	|
on_epoch_end                       	|  1.1293e-05     	|167            	|  0.001886       	|  0.00012114     	|
on_epoch_start                     	|  1.0596e-05     	|167            	|  0.0017695      	|  0.00011366     	|
on_train_start                     	|  0.00072925     	|1              	|  0.00072925     	|  4.6842e-05     	|
on_fit_end                         	|  2.2602e-05     	|1              	|  2.2602e-05     	|  1.4518e-06     	|
on_before_accelerator_backend_setup	|  2.0709e-05     	|1              	|  2.0709e-05     	|  1.3302e-06     	|
on_fit_start                       	|  2.0519e-05     	|1              	|  2.0519e-05     	|  1.318e-06      	|
on_configure_sharded_model         	|  1.3886e-05     	|1              	|  1.3886e-05     	|  8.9195e-07     	|
setup                              	|  1.3686e-05     	|1              	|  1.3686e-05     	|  8.791e-07      	|
on_pretrain_routine_end            	|  1.2323e-05     	|1              	|  1.2323e-05     	|  7.9155e-07     	|
teardown                           	|  9.9288e-06     	|1              	|  9.9288e-06     	|  6.3776e-07     	|
prepare_data                       	|  8.3561e-06     	|1              	|  8.3561e-06     	|  5.3674e-07     	|
configure_callbacks                	|  6.9621e-06     	|1              	|  6.9621e-06     	|  4.472e-07      	|
on_val_dataloader                  	|  4.6289e-06     	|1              	|  4.6289e-06     	|  2.9733e-07     	|
configure_sharded_model            	|  4.3681e-06     	|1              	|  4.3681e-06     	|  2.8058e-07     	|
on_train_dataloader                	|  4.028e-06      	|1              	|  4.028e-06      	|  2.5873e-07     	|
