FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1540.5         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  72.25          	|21             	|  1517.3         	|  98.49          	|
run_training_batch                 	|  0.1859         	|8000           	|  1487.2         	|  96.537         	|
training_step_and_backward         	|  0.1759         	|8000           	|  1407.2         	|  91.347         	|
model_forward                      	|  0.093666       	|8000           	|  749.33         	|  48.641         	|
training_step                      	|  0.093535       	|8000           	|  748.28         	|  48.573         	|
backward                           	|  0.082055       	|8000           	|  656.44         	|  42.611         	|
optimizer_step_with_closure_0      	|  0.23321        	|1000           	|  233.21         	|  15.138         	|
get_train_batch                    	|  0.001834       	|8021           	|  14.71          	|  0.95489        	|
fetch_next_train_batch             	|  0.0018176      	|8021           	|  14.579         	|  0.94637        	|
on_train_batch_end                 	|  0.0010601      	|8000           	|  8.481          	|  0.55053        	|
training_batch_to_device           	|  0.00021158     	|8000           	|  1.6927         	|  0.10988        	|
zero_grad                          	|  0.0013198      	|1000           	|  1.3198         	|  0.085673       	|
on_train_batch_start               	|  8.9181e-05     	|8000           	|  0.71345        	|  0.046312       	|
on_batch_start                     	|  1.4828e-05     	|8000           	|  0.11863        	|  0.0077004      	|
on_before_backward                 	|  1.305e-05      	|8000           	|  0.1044         	|  0.0067767      	|
on_batch_end                       	|  1.2919e-05     	|8000           	|  0.10335        	|  0.0067089      	|
on_after_backward                  	|  1.1855e-05     	|8000           	|  0.094839       	|  0.0061562      	|
training_step_end                  	|  6.149e-06      	|8000           	|  0.049192       	|  0.0031932      	|
on_train_end                       	|  0.025155       	|1              	|  0.025155       	|  0.0016329      	|
on_pretrain_routine_start          	|  0.022562       	|1              	|  0.022562       	|  0.0014645      	|
on_before_zero_grad                	|  1.4295e-05     	|1000           	|  0.014295       	|  0.00092794     	|
on_before_optimizer_step           	|  1.1155e-05     	|1000           	|  0.011155       	|  0.00072412     	|
configure_optimizers               	|  0.0082019      	|1              	|  0.0082019      	|  0.00053241     	|
on_train_epoch_start               	|  0.00029012     	|21             	|  0.0060925      	|  0.00039548     	|
on_train_epoch_end                 	|  0.00026505     	|21             	|  0.005566       	|  0.00036131     	|
on_train_start                     	|  0.00071177     	|1              	|  0.00071177     	|  4.6203e-05     	|
on_epoch_start                     	|  1.0569e-05     	|21             	|  0.00022194     	|  1.4407e-05     	|
on_epoch_end                       	|  1.0408e-05     	|21             	|  0.00021857     	|  1.4188e-05     	|
on_fit_end                         	|  2.2192e-05     	|1              	|  2.2192e-05     	|  1.4405e-06     	|
on_before_accelerator_backend_setup	|  2.139e-05      	|1              	|  2.139e-05      	|  1.3885e-06     	|
on_fit_start                       	|  1.7052e-05     	|1              	|  1.7052e-05     	|  1.1069e-06     	|
setup                              	|  1.4006e-05     	|1              	|  1.4006e-05     	|  9.0916e-07     	|
on_configure_sharded_model         	|  1.3205e-05     	|1              	|  1.3205e-05     	|  8.5717e-07     	|
teardown                           	|  1.0139e-05     	|1              	|  1.0139e-05     	|  6.5814e-07     	|
on_pretrain_routine_end            	|  9.4371e-06     	|1              	|  9.4371e-06     	|  6.1259e-07     	|
prepare_data                       	|  7.855e-06      	|1              	|  7.855e-06      	|  5.0989e-07     	|
configure_callbacks                	|  6.442e-06      	|1              	|  6.442e-06      	|  4.1817e-07     	|
configure_sharded_model            	|  4.9791e-06     	|1              	|  4.9791e-06     	|  3.2321e-07     	|
on_val_dataloader                  	|  4.539e-06      	|1              	|  4.539e-06      	|  2.9464e-07     	|
on_train_dataloader                	|  3.8669e-06     	|1              	|  3.8669e-06     	|  2.5101e-07     	|
