VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  672.43         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  1.1183         	|500            	|  559.15         	|  83.154         	|
run_training_batch                 	|  0.40911        	|1000           	|  409.11         	|  60.84          	|
optimizer_step_with_closure_0      	|  0.40637        	|1000           	|  406.37         	|  60.433         	|
training_step_and_backward         	|  0.30943        	|1000           	|  309.43         	|  46.016         	|
model_forward                      	|  0.18739        	|1000           	|  187.39         	|  27.868         	|
training_step                      	|  0.18722        	|1000           	|  187.22         	|  27.843         	|
backward                           	|  0.12063        	|1000           	|  120.63         	|  17.94          	|
run_validate_evaluation            	|  70.221         	|1              	|  70.221         	|  10.443         	|
evaluation_step_and_end            	|  0.21916        	|313            	|  68.598         	|  10.201         	|
validation_step                    	|  0.21911        	|313            	|  68.58          	|  10.199         	|
get_train_batch                    	|  0.029621       	|1500           	|  44.431         	|  6.6076         	|
fetch_next_train_batch             	|  0.029587       	|1500           	|  44.38          	|  6.5999         	|
on_train_batch_end                 	|  0.001376       	|1000           	|  1.376          	|  0.20463        	|
zero_grad                          	|  0.0013648      	|1000           	|  1.3648         	|  0.20297        	|
training_batch_to_device           	|  0.00060991     	|1000           	|  0.60991        	|  0.090702       	|
get_validate_batch                 	|  0.0018731      	|314            	|  0.58814        	|  0.087465       	|
fetch_next_validate_batch          	|  0.0018584      	|314            	|  0.58352        	|  0.086778       	|
on_train_epoch_start               	|  0.0002863      	|500            	|  0.14315        	|  0.021289       	|
on_train_epoch_end                 	|  0.0002782      	|500            	|  0.1391         	|  0.020686       	|
on_train_batch_start               	|  0.000108       	|1000           	|  0.108          	|  0.01606        	|
evaluation_batch_to_device         	|  0.00024088     	|313            	|  0.075397       	|  0.011213       	|
on_batch_start                     	|  3.4986e-05     	|1000           	|  0.034986       	|  0.0052028      	|
on_train_end                       	|  0.023863       	|1              	|  0.023863       	|  0.0035487      	|
on_pretrain_routine_start          	|  0.022963       	|1              	|  0.022963       	|  0.0034149      	|
on_before_zero_grad                	|  2.1784e-05     	|1000           	|  0.021784       	|  0.0032396      	|
on_batch_end                       	|  1.3792e-05     	|1000           	|  0.013792       	|  0.002051       	|
on_before_optimizer_step           	|  1.1962e-05     	|1000           	|  0.011962       	|  0.0017789      	|
on_after_backward                  	|  1.1126e-05     	|1000           	|  0.011126       	|  0.0016547      	|
on_before_backward                 	|  1.0987e-05     	|1000           	|  0.010987       	|  0.001634       	|
training_step_end                  	|  9.5809e-06     	|1000           	|  0.0095809      	|  0.0014248      	|
configure_optimizers               	|  0.0077403      	|1              	|  0.0077403      	|  0.0011511      	|
on_validation_batch_end            	|  2.346e-05      	|313            	|  0.007343       	|  0.001092       	|
on_epoch_start                     	|  1.0741e-05     	|501            	|  0.0053811      	|  0.00080025     	|
on_epoch_end                       	|  1.0159e-05     	|501            	|  0.0050897      	|  0.00075691     	|
on_validation_model_eval           	|  0.0044892      	|1              	|  0.0044892      	|  0.0006676      	|
on_validation_batch_start          	|  1.1184e-05     	|313            	|  0.0035006      	|  0.00052058     	|
validation_step_end                	|  5.3306e-06     	|313            	|  0.0016685      	|  0.00024812     	|
on_train_start                     	|  0.00071045     	|1              	|  0.00071045     	|  0.00010565     	|
on_validation_start                	|  0.00033934     	|1              	|  0.00033934     	|  5.0465e-05     	|
on_validation_end                  	|  0.00010577     	|1              	|  0.00010577     	|  1.5729e-05     	|
on_before_accelerator_backend_setup	|  1.9682e-05     	|2              	|  3.9363e-05     	|  5.8538e-06     	|
setup                              	|  1.5599e-05     	|2              	|  3.1198e-05     	|  4.6396e-06     	|
teardown                           	|  1.5369e-05     	|2              	|  3.0737e-05     	|  4.571e-06      	|
on_validation_epoch_end            	|  2.9676e-05     	|1              	|  2.9676e-05     	|  4.4132e-06     	|
on_configure_sharded_model         	|  1.3741e-05     	|2              	|  2.7482e-05     	|  4.0869e-06     	|
on_fit_end                         	|  2.4225e-05     	|1              	|  2.4225e-05     	|  3.6026e-06     	|
on_fit_start                       	|  1.7142e-05     	|1              	|  1.7142e-05     	|  2.5493e-06     	|
prepare_data                       	|  6.247e-06      	|2              	|  1.2494e-05     	|  1.858e-06      	|
on_val_dataloader                  	|  6.2466e-06     	|2              	|  1.2493e-05     	|  1.8579e-06     	|
on_validation_epoch_start          	|  1.0279e-05     	|1              	|  1.0279e-05     	|  1.5286e-06     	|
on_pretrain_routine_end            	|  1.0099e-05     	|1              	|  1.0099e-05     	|  1.5019e-06     	|
configure_callbacks                	|  4.9845e-06     	|2              	|  9.969e-06      	|  1.4825e-06     	|
configure_sharded_model            	|  4.819e-06      	|2              	|  9.638e-06      	|  1.4333e-06     	|
on_train_dataloader                	|  4.2979e-06     	|1              	|  4.2979e-06     	|  6.3916e-07     	|
