FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1430.1         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  2.8209         	|500            	|  1410.4         	|  98.625         	|
run_training_batch                 	|  0.3917         	|1000           	|  391.7          	|  27.39          	|
optimizer_step_with_closure_0      	|  0.38811        	|1000           	|  388.11         	|  27.139         	|
training_step_and_backward         	|  0.28396        	|1000           	|  283.96         	|  19.856         	|
get_train_batch                    	|  0.10892        	|1500           	|  163.38         	|  11.425         	|
fetch_next_train_batch             	|  0.10888        	|1500           	|  163.32         	|  11.42          	|
model_forward                      	|  0.15339        	|1000           	|  153.39         	|  10.726         	|
training_step                      	|  0.15316        	|1000           	|  153.16         	|  10.71          	|
backward                           	|  0.12899        	|1000           	|  128.99         	|  9.0197         	|
on_train_batch_end                 	|  0.002352       	|1000           	|  2.352          	|  0.16446        	|
zero_grad                          	|  0.0015375      	|1000           	|  1.5375         	|  0.10751        	|
training_batch_to_device           	|  0.00069146     	|1000           	|  0.69146        	|  0.04835        	|
on_train_epoch_end                 	|  0.00036044     	|500            	|  0.18022        	|  0.012602       	|
on_train_epoch_start               	|  0.00033379     	|500            	|  0.16689        	|  0.01167        	|
on_train_batch_start               	|  0.00011004     	|1000           	|  0.11004        	|  0.0076943      	|
on_train_end                       	|  0.076931       	|1              	|  0.076931       	|  0.0053794      	|
on_batch_start                     	|  4.5413e-05     	|1000           	|  0.045413       	|  0.0031755      	|
on_after_backward                  	|  2.3865e-05     	|1000           	|  0.023865       	|  0.0016687      	|
on_pretrain_routine_start          	|  0.022952       	|1              	|  0.022952       	|  0.0016049      	|
on_before_zero_grad                	|  2.2043e-05     	|1000           	|  0.022043       	|  0.0015413      	|
on_before_optimizer_step           	|  1.7244e-05     	|1000           	|  0.017244       	|  0.0012058      	|
on_before_backward                 	|  1.6771e-05     	|1000           	|  0.016771       	|  0.0011727      	|
on_batch_end                       	|  1.6218e-05     	|1000           	|  0.016218       	|  0.001134       	|
configure_optimizers               	|  0.010564       	|1              	|  0.010564       	|  0.00073869     	|
training_step_end                  	|  8.7156e-06     	|1000           	|  0.0087156      	|  0.00060944     	|
on_epoch_start                     	|  1.1808e-05     	|500            	|  0.005904       	|  0.00041284     	|
on_epoch_end                       	|  1.1319e-05     	|500            	|  0.0056594      	|  0.00039573     	|
on_train_start                     	|  0.0024997      	|1              	|  0.0024997      	|  0.00017479     	|
on_fit_end                         	|  6.4725e-05     	|1              	|  6.4725e-05     	|  4.5259e-06     	|
on_fit_start                       	|  4.1334e-05     	|1              	|  4.1334e-05     	|  2.8903e-06     	|
on_before_accelerator_backend_setup	|  2.4593e-05     	|1              	|  2.4593e-05     	|  1.7196e-06     	|
setup                              	|  2.2091e-05     	|1              	|  2.2091e-05     	|  1.5447e-06     	|
on_configure_sharded_model         	|  2.1895e-05     	|1              	|  2.1895e-05     	|  1.531e-06      	|
on_pretrain_routine_end            	|  1.6263e-05     	|1              	|  1.6263e-05     	|  1.1372e-06     	|
teardown                           	|  1.4685e-05     	|1              	|  1.4685e-05     	|  1.0269e-06     	|
prepare_data                       	|  9.1977e-06     	|1              	|  9.1977e-06     	|  6.4315e-07     	|
on_val_dataloader                  	|  7.8753e-06     	|1              	|  7.8753e-06     	|  5.5068e-07     	|
configure_callbacks                	|  7.7821e-06     	|1              	|  7.7821e-06     	|  5.4417e-07     	|
on_train_dataloader                	|  7.6126e-06     	|1              	|  7.6126e-06     	|  5.3231e-07     	|
configure_sharded_model            	|  6.754e-06      	|1              	|  6.754e-06      	|  4.7227e-07     	|
