VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  585.83         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  8.1424         	|63             	|  512.97         	|  87.563         	|
run_training_batch                 	|  0.37555        	|1000           	|  375.55         	|  64.107         	|
optimizer_step_with_closure_0      	|  0.3729         	|1000           	|  372.9          	|  63.654         	|
training_step_and_backward         	|  0.26604        	|1000           	|  266.04         	|  45.412         	|
model_forward                      	|  0.13784        	|1000           	|  137.84         	|  23.529         	|
training_step                      	|  0.13767        	|1000           	|  137.67         	|  23.5           	|
backward                           	|  0.12662        	|1000           	|  126.62         	|  21.614         	|
get_train_batch                    	|  0.029605       	|1063           	|  31.47          	|  5.3719         	|
fetch_next_train_batch             	|  0.029582       	|1063           	|  31.446         	|  5.3677         	|
run_validate_evaluation            	|  30.885         	|1              	|  30.885         	|  5.272          	|
evaluation_step_and_end            	|  0.22083        	|125            	|  27.604         	|  4.712          	|
validation_step                    	|  0.22073        	|125            	|  27.591         	|  4.7097         	|
on_train_batch_end                 	|  0.0018265      	|1000           	|  1.8265         	|  0.31179        	|
zero_grad                          	|  0.0015396      	|1000           	|  1.5396         	|  0.26281        	|
get_validate_batch                 	|  0.0065274      	|126            	|  0.82245        	|  0.14039        	|
fetch_next_validate_batch          	|  0.0065012      	|126            	|  0.81915        	|  0.13983        	|
training_batch_to_device           	|  0.00025966     	|1000           	|  0.25966        	|  0.044324       	|
on_train_batch_start               	|  9.5141e-05     	|1000           	|  0.095141       	|  0.01624        	|
on_train_end                       	|  0.04453        	|1              	|  0.04453        	|  0.0076013      	|
evaluation_batch_to_device         	|  0.00028172     	|125            	|  0.035215       	|  0.0060112      	|
on_pretrain_routine_start          	|  0.024762       	|1              	|  0.024762       	|  0.0042268      	|
on_train_epoch_start               	|  0.00035547     	|63             	|  0.022394       	|  0.0038227      	|
on_train_epoch_end                 	|  0.00034755     	|63             	|  0.021896       	|  0.0037376      	|
on_after_backward                  	|  2.1071e-05     	|1000           	|  0.021071       	|  0.0035968      	|
on_batch_start                     	|  2.1011e-05     	|1000           	|  0.021011       	|  0.0035866      	|
on_before_zero_grad                	|  1.5771e-05     	|1000           	|  0.015771       	|  0.0026921      	|
on_batch_end                       	|  1.5623e-05     	|1000           	|  0.015623       	|  0.0026668      	|
on_before_optimizer_step           	|  1.2571e-05     	|1000           	|  0.012571       	|  0.0021459      	|
on_before_backward                 	|  1.2565e-05     	|1000           	|  0.012565       	|  0.0021448      	|
configure_optimizers               	|  0.01236        	|1              	|  0.01236        	|  0.0021098      	|
training_step_end                  	|  6.7124e-06     	|1000           	|  0.0067124      	|  0.0011458      	|
on_validation_batch_end            	|  3.8825e-05     	|125            	|  0.0048531      	|  0.00082842     	|
on_validation_model_eval           	|  0.0044567      	|1              	|  0.0044567      	|  0.00076075     	|
on_validation_batch_start          	|  1.7271e-05     	|125            	|  0.0021589      	|  0.00036852     	|
on_train_start                     	|  0.0019919      	|1              	|  0.0019919      	|  0.00034001     	|
validation_step_end                	|  9.5378e-06     	|125            	|  0.0011922      	|  0.00020351     	|
on_epoch_end                       	|  1.2065e-05     	|64             	|  0.00077216     	|  0.00013181     	|
on_epoch_start                     	|  1.0938e-05     	|64             	|  0.00070003     	|  0.00011949     	|
on_validation_start                	|  0.00055642     	|1              	|  0.00055642     	|  9.498e-05      	|
on_validation_end                  	|  0.00017411     	|1              	|  0.00017411     	|  2.972e-05      	|
on_fit_start                       	|  0.0001375      	|1              	|  0.0001375      	|  2.3471e-05     	|
teardown                           	|  3.6165e-05     	|2              	|  7.233e-05      	|  1.2347e-05     	|
setup                              	|  2.9686e-05     	|2              	|  5.9372e-05     	|  1.0135e-05     	|
on_before_accelerator_backend_setup	|  2.8521e-05     	|2              	|  5.7042e-05     	|  9.7369e-06     	|
on_configure_sharded_model         	|  2.3998e-05     	|2              	|  4.7997e-05     	|  8.193e-06      	|
on_val_dataloader                  	|  1.6823e-05     	|2              	|  3.3647e-05     	|  5.7435e-06     	|
on_validation_epoch_end            	|  2.9309e-05     	|1              	|  2.9309e-05     	|  5.003e-06      	|
on_fit_end                         	|  2.4715e-05     	|1              	|  2.4715e-05     	|  4.2189e-06     	|
on_pretrain_routine_end            	|  2.0254e-05     	|1              	|  2.0254e-05     	|  3.4574e-06     	|
configure_sharded_model            	|  9.7472e-06     	|2              	|  1.9494e-05     	|  3.3277e-06     	|
prepare_data                       	|  8.4089e-06     	|2              	|  1.6818e-05     	|  2.8708e-06     	|
configure_callbacks                	|  6.9002e-06     	|2              	|  1.38e-05       	|  2.3557e-06     	|
on_validation_epoch_start          	|  1.3275e-05     	|1              	|  1.3275e-05     	|  2.266e-06      	|
on_train_dataloader                	|  1.0839e-05     	|1              	|  1.0839e-05     	|  1.8502e-06     	|
