VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  767.65         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.5737         	|200            	|  714.74         	|  93.107         	|
run_training_batch                 	|  0.31483        	|1000           	|  314.83         	|  41.012         	|
optimizer_step_with_closure_0      	|  0.31118        	|1000           	|  311.18         	|  40.537         	|
training_step_and_backward         	|  0.24071        	|1000           	|  240.71         	|  31.357         	|
model_forward                      	|  0.12059        	|1000           	|  120.59         	|  15.708         	|
training_step                      	|  0.12037        	|1000           	|  120.37         	|  15.68          	|
backward                           	|  0.11834        	|1000           	|  118.34         	|  15.416         	|
get_train_batch                    	|  0.061255       	|1200           	|  73.506         	|  9.5755         	|
fetch_next_train_batch             	|  0.061224       	|1200           	|  73.468         	|  9.5706         	|
run_validate_evaluation            	|  16.944         	|1              	|  16.944         	|  2.2073         	|
evaluation_step_and_end            	|  0.10283        	|139            	|  14.294         	|  1.862          	|
validation_step                    	|  0.10271        	|139            	|  14.276         	|  1.8597         	|
on_train_batch_end                 	|  0.0023813      	|1000           	|  2.3813         	|  0.31021        	|
zero_grad                          	|  0.001751       	|1000           	|  1.751          	|  0.22809        	|
get_validate_batch                 	|  0.005636       	|140            	|  0.78905        	|  0.10279        	|
fetch_next_validate_batch          	|  0.0056097      	|140            	|  0.78536        	|  0.10231        	|
training_batch_to_device           	|  0.00041773     	|1000           	|  0.41773        	|  0.054417       	|
on_train_batch_start               	|  0.00010742     	|1000           	|  0.10742        	|  0.013993       	|
on_train_end                       	|  0.078657       	|1              	|  0.078657       	|  0.010247       	|
on_train_epoch_end                 	|  0.0003396      	|200            	|  0.06792        	|  0.0088478      	|
on_train_epoch_start               	|  0.00031247     	|200            	|  0.062494       	|  0.008141       	|
evaluation_batch_to_device         	|  0.00034954     	|139            	|  0.048586       	|  0.0063291      	|
configure_optimizers               	|  0.043415       	|1              	|  0.043415       	|  0.0056555      	|
on_batch_start                     	|  3.1851e-05     	|1000           	|  0.031851       	|  0.0041491      	|
on_after_backward                  	|  2.8959e-05     	|1000           	|  0.028959       	|  0.0037724      	|
on_pretrain_routine_start          	|  0.02495        	|1              	|  0.02495        	|  0.0032502      	|
on_before_zero_grad                	|  2.1212e-05     	|1000           	|  0.021212       	|  0.0027632      	|
on_batch_end                       	|  1.6639e-05     	|1000           	|  0.016639       	|  0.0021675      	|
on_before_optimizer_step           	|  1.4225e-05     	|1000           	|  0.014225       	|  0.0018531      	|
on_before_backward                 	|  1.3642e-05     	|1000           	|  0.013642       	|  0.0017771      	|
training_step_end                  	|  8.6081e-06     	|1000           	|  0.0086081      	|  0.0011214      	|
on_validation_batch_end            	|  4.5868e-05     	|139            	|  0.0063757      	|  0.00083055     	|
on_validation_model_eval           	|  0.0040182      	|1              	|  0.0040182      	|  0.00052344     	|
on_epoch_end                       	|  1.2785e-05     	|201            	|  0.0025698      	|  0.00033476     	|
on_validation_batch_start          	|  1.8026e-05     	|139            	|  0.0025056      	|  0.0003264      	|
on_epoch_start                     	|  1.1594e-05     	|201            	|  0.0023304      	|  0.00030358     	|
validation_step_end                	|  9.171e-06      	|139            	|  0.0012748      	|  0.00016606     	|
on_train_start                     	|  0.0010716      	|1              	|  0.0010716      	|  0.00013959     	|
on_validation_start                	|  0.00048544     	|1              	|  0.00048544     	|  6.3237e-05     	|
on_validation_end                  	|  0.00031273     	|1              	|  0.00031273     	|  4.0739e-05     	|
teardown                           	|  3.789e-05      	|2              	|  7.578e-05      	|  9.8717e-06     	|
setup                              	|  3.2324e-05     	|2              	|  6.4649e-05     	|  8.4216e-06     	|
on_configure_sharded_model         	|  3.184e-05      	|2              	|  6.368e-05      	|  8.2955e-06     	|
on_fit_end                         	|  6.1646e-05     	|1              	|  6.1646e-05     	|  8.0305e-06     	|
on_before_accelerator_backend_setup	|  2.6554e-05     	|2              	|  5.3108e-05     	|  6.9182e-06     	|
on_validation_epoch_end            	|  4.5428e-05     	|1              	|  4.5428e-05     	|  5.9178e-06     	|
on_fit_start                       	|  4.2055e-05     	|1              	|  4.2055e-05     	|  5.4784e-06     	|
configure_sharded_model            	|  1.0522e-05     	|2              	|  2.1044e-05     	|  2.7414e-06     	|
on_val_dataloader                  	|  8.5793e-06     	|2              	|  1.7159e-05     	|  2.2352e-06     	|
configure_callbacks                	|  8.4527e-06     	|2              	|  1.6905e-05     	|  2.2022e-06     	|
on_pretrain_routine_end            	|  1.5188e-05     	|1              	|  1.5188e-05     	|  1.9785e-06     	|
prepare_data                       	|  7.0073e-06     	|2              	|  1.4015e-05     	|  1.8256e-06     	|
on_validation_epoch_start          	|  1.1452e-05     	|1              	|  1.1452e-05     	|  1.4918e-06     	|
on_train_dataloader                	|  7.8958e-06     	|1              	|  7.8958e-06     	|  1.0286e-06     	|
