FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  520.01         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  0.99385        	|500            	|  496.92         	|  95.56          	|
run_training_batch                 	|  0.34335        	|1000           	|  343.35         	|  66.028         	|
optimizer_step_with_closure_0      	|  0.34065        	|1000           	|  340.65         	|  65.509         	|
training_step_and_backward         	|  0.25495        	|1000           	|  254.95         	|  49.027         	|
model_forward                      	|  0.15842        	|1000           	|  158.42         	|  30.464         	|
training_step                      	|  0.15825        	|1000           	|  158.25         	|  30.432         	|
backward                           	|  0.095144       	|1000           	|  95.144         	|  18.297         	|
get_train_batch                    	|  0.029482       	|1500           	|  44.224         	|  8.5043         	|
fetch_next_train_batch             	|  0.029449       	|1500           	|  44.173         	|  8.4946         	|
zero_grad                          	|  0.0013556      	|1000           	|  1.3556         	|  0.26069        	|
on_train_batch_end                 	|  0.0013168      	|1000           	|  1.3168         	|  0.25323        	|
training_batch_to_device           	|  0.00059707     	|1000           	|  0.59707        	|  0.11482        	|
on_train_epoch_start               	|  0.00027157     	|500            	|  0.13578        	|  0.026112       	|
on_train_epoch_end                 	|  0.00026983     	|500            	|  0.13491        	|  0.025945       	|
on_train_batch_start               	|  0.00010496     	|1000           	|  0.10496        	|  0.020184       	|
on_batch_start                     	|  3.4949e-05     	|1000           	|  0.034949       	|  0.0067209      	|
on_train_end                       	|  0.023723       	|1              	|  0.023723       	|  0.004562       	|
on_pretrain_routine_start          	|  0.022563       	|1              	|  0.022563       	|  0.0043389      	|
on_before_zero_grad                	|  2.1539e-05     	|1000           	|  0.021539       	|  0.0041421      	|
on_batch_end                       	|  1.3461e-05     	|1000           	|  0.013461       	|  0.0025886      	|
on_before_backward                 	|  1.2391e-05     	|1000           	|  0.012391       	|  0.0023829      	|
on_before_optimizer_step           	|  1.2328e-05     	|1000           	|  0.012328       	|  0.0023706      	|
on_after_backward                  	|  1.1635e-05     	|1000           	|  0.011635       	|  0.0022374      	|
configure_optimizers               	|  0.0086337      	|1              	|  0.0086337      	|  0.0016603      	|
training_step_end                  	|  7.7928e-06     	|1000           	|  0.0077928      	|  0.0014986      	|
on_epoch_start                     	|  1.1079e-05     	|500            	|  0.0055394      	|  0.0010652      	|
on_epoch_end                       	|  1.0371e-05     	|500            	|  0.0051857      	|  0.00099724     	|
on_train_start                     	|  0.00073451     	|1              	|  0.00073451     	|  0.00014125     	|
on_fit_end                         	|  2.2863e-05     	|1              	|  2.2863e-05     	|  4.3966e-06     	|
on_before_accelerator_backend_setup	|  1.9276e-05     	|1              	|  1.9276e-05     	|  3.7068e-06     	|
on_fit_start                       	|  1.7032e-05     	|1              	|  1.7032e-05     	|  3.2753e-06     	|
on_configure_sharded_model         	|  1.3956e-05     	|1              	|  1.3956e-05     	|  2.6838e-06     	|
setup                              	|  1.2784e-05     	|1              	|  1.2784e-05     	|  2.4584e-06     	|
teardown                           	|  1.106e-05      	|1              	|  1.106e-05      	|  2.1269e-06     	|
on_pretrain_routine_end            	|  1.047e-05      	|1              	|  1.047e-05      	|  2.0134e-06     	|
prepare_data                       	|  7.1339e-06     	|1              	|  7.1339e-06     	|  1.3719e-06     	|
configure_callbacks                	|  5.179e-06      	|1              	|  5.179e-06      	|  9.9593e-07     	|
on_train_dataloader                	|  4.609e-06      	|1              	|  4.609e-06      	|  8.8633e-07     	|
configure_sharded_model            	|  4.538e-06      	|1              	|  4.538e-06      	|  8.7267e-07     	|
on_val_dataloader                  	|  4.418e-06      	|1              	|  4.418e-06      	|  8.4959e-07     	|
