VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  447.34         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  5.3006         	|63             	|  333.94         	|  74.65          	|
run_training_batch                 	|  0.31069        	|1000           	|  310.69         	|  69.454         	|
optimizer_step_with_closure_0      	|  0.30798        	|1000           	|  307.98         	|  68.846         	|
training_step_and_backward         	|  0.23145        	|1000           	|  231.45         	|  51.739         	|
model_forward                      	|  0.1436         	|1000           	|  143.6          	|  32.101         	|
training_step                      	|  0.14346        	|1000           	|  143.46         	|  32.07          	|
backward                           	|  0.086553       	|1000           	|  86.553         	|  19.348         	|
run_validate_evaluation            	|  70.224         	|1              	|  70.224         	|  15.698         	|
evaluation_step_and_end            	|  0.21928        	|313            	|  68.635         	|  15.343         	|
validation_step                    	|  0.21923        	|313            	|  68.619         	|  15.339         	|
get_train_batch                    	|  0.0074465      	|1063           	|  7.9156         	|  1.7695         	|
fetch_next_train_batch             	|  0.0074277      	|1063           	|  7.8956         	|  1.765          	|
zero_grad                          	|  0.0012713      	|1000           	|  1.2713         	|  0.28419        	|
on_train_batch_end                 	|  0.0011992      	|1000           	|  1.1992         	|  0.26808        	|
get_validate_batch                 	|  0.0019158      	|314            	|  0.60156        	|  0.13448        	|
fetch_next_validate_batch          	|  0.0019016      	|314            	|  0.5971         	|  0.13348        	|
training_batch_to_device           	|  0.00022604     	|1000           	|  0.22604        	|  0.050529       	|
on_train_batch_start               	|  9.1278e-05     	|1000           	|  0.091278       	|  0.020405       	|
evaluation_batch_to_device         	|  0.00022791     	|313            	|  0.071337       	|  0.015947       	|
on_train_end                       	|  0.024625       	|1              	|  0.024625       	|  0.0055047      	|
on_pretrain_routine_start          	|  0.022441       	|1              	|  0.022441       	|  0.0050166      	|
on_train_epoch_end                 	|  0.0002925      	|63             	|  0.018427       	|  0.0041193      	|
on_train_epoch_start               	|  0.000288       	|63             	|  0.018144       	|  0.004056       	|
on_batch_start                     	|  1.5798e-05     	|1000           	|  0.015798       	|  0.0035315      	|
on_batch_end                       	|  1.3567e-05     	|1000           	|  0.013567       	|  0.0030328      	|
on_before_zero_grad                	|  1.3331e-05     	|1000           	|  0.013331       	|  0.0029801      	|
on_after_backward                  	|  1.1981e-05     	|1000           	|  0.011981       	|  0.0026784      	|
on_before_optimizer_step           	|  1.0205e-05     	|1000           	|  0.010205       	|  0.0022813      	|
on_before_backward                 	|  1.0153e-05     	|1000           	|  0.010153       	|  0.0022697      	|
configure_optimizers               	|  0.0080799      	|1              	|  0.0080799      	|  0.0018062      	|
on_validation_batch_end            	|  1.9459e-05     	|313            	|  0.0060908      	|  0.0013616      	|
training_step_end                  	|  5.7321e-06     	|1000           	|  0.0057321      	|  0.0012814      	|
on_validation_model_eval           	|  0.0039977      	|1              	|  0.0039977      	|  0.00089365     	|
on_validation_batch_start          	|  9.5991e-06     	|313            	|  0.0030045      	|  0.00067164     	|
validation_step_end                	|  4.824e-06      	|313            	|  0.0015099      	|  0.00033753     	|
on_train_start                     	|  0.000728       	|1              	|  0.000728       	|  0.00016274     	|
on_epoch_end                       	|  1.0789e-05     	|64             	|  0.00069048     	|  0.00015435     	|
on_epoch_start                     	|  1.0539e-05     	|64             	|  0.00067449     	|  0.00015078     	|
on_validation_start                	|  0.00030884     	|1              	|  0.00030884     	|  6.9039e-05     	|
on_validation_end                  	|  0.00010786     	|1              	|  0.00010786     	|  2.4112e-05     	|
on_before_accelerator_backend_setup	|  1.7417e-05     	|2              	|  3.4835e-05     	|  7.7871e-06     	|
on_validation_epoch_end            	|  3.4475e-05     	|1              	|  3.4475e-05     	|  7.7067e-06     	|
teardown                           	|  1.5143e-05     	|2              	|  3.0287e-05     	|  6.7705e-06     	|
setup                              	|  1.4928e-05     	|2              	|  2.9856e-05     	|  6.6741e-06     	|
on_configure_sharded_model         	|  1.3831e-05     	|2              	|  2.7662e-05     	|  6.1837e-06     	|
on_fit_end                         	|  1.9867e-05     	|1              	|  1.9867e-05     	|  4.4411e-06     	|
on_fit_start                       	|  1.6641e-05     	|1              	|  1.6641e-05     	|  3.72e-06       	|
on_val_dataloader                  	|  5.6055e-06     	|2              	|  1.1211e-05     	|  2.5061e-06     	|
prepare_data                       	|  5.5556e-06     	|2              	|  1.1111e-05     	|  2.4838e-06     	|
configure_sharded_model            	|  4.919e-06      	|2              	|  9.838e-06      	|  2.1992e-06     	|
on_validation_epoch_start          	|  9.749e-06      	|1              	|  9.749e-06      	|  2.1793e-06     	|
on_pretrain_routine_end            	|  9.699e-06      	|1              	|  9.699e-06      	|  2.1682e-06     	|
configure_callbacks                	|  4.729e-06      	|2              	|  9.458e-06      	|  2.1143e-06     	|
on_train_dataloader                	|  4.438e-06      	|1              	|  4.438e-06      	|  9.9208e-07     	|
