VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  706.6          	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.9348         	|167            	|  657.11         	|  92.996         	|
run_training_batch                 	|  0.28           	|1000           	|  280.0          	|  39.627         	|
optimizer_step_with_closure_0      	|  0.27603        	|1000           	|  276.03         	|  39.064         	|
training_step_and_backward         	|  0.20841        	|1000           	|  208.41         	|  29.494         	|
model_forward                      	|  0.11181        	|1000           	|  111.81         	|  15.824         	|
training_step                      	|  0.11162        	|1000           	|  111.62         	|  15.797         	|
backward                           	|  0.095034       	|1000           	|  95.034         	|  13.45          	|
get_train_batch                    	|  0.068175       	|1167           	|  79.56          	|  11.26          	|
fetch_next_train_batch             	|  0.068148       	|1167           	|  79.528         	|  11.255         	|
run_validate_evaluation            	|  16.826         	|1              	|  16.826         	|  2.3813         	|
evaluation_step_and_end            	|  0.10774        	|125            	|  13.468         	|  1.906          	|
validation_step                    	|  0.10766        	|125            	|  13.457         	|  1.9045         	|
on_train_batch_end                 	|  0.0020083      	|1000           	|  2.0083         	|  0.28422        	|
zero_grad                          	|  0.0015248      	|1000           	|  1.5248         	|  0.21579        	|
get_validate_batch                 	|  0.0069879      	|126            	|  0.88048        	|  0.12461        	|
fetch_next_validate_batch          	|  0.0069671      	|126            	|  0.87785        	|  0.12424        	|
training_batch_to_device           	|  0.000355       	|1000           	|  0.355          	|  0.05024        	|
on_train_batch_start               	|  0.0001011      	|1000           	|  0.1011         	|  0.014308       	|
on_train_epoch_start               	|  0.00033211     	|167            	|  0.055463       	|  0.0078493      	|
on_train_epoch_end                 	|  0.00031726     	|167            	|  0.052982       	|  0.0074982      	|
on_train_end                       	|  0.050576       	|1              	|  0.050576       	|  0.0071576      	|
evaluation_batch_to_device         	|  0.00028904     	|125            	|  0.036131       	|  0.0051133      	|
on_batch_start                     	|  2.8007e-05     	|1000           	|  0.028007       	|  0.0039636      	|
on_pretrain_routine_start          	|  0.022054       	|1              	|  0.022054       	|  0.0031211      	|
on_after_backward                  	|  2.1591e-05     	|1000           	|  0.021591       	|  0.0030556      	|
on_before_zero_grad                	|  1.7206e-05     	|1000           	|  0.017206       	|  0.0024351      	|
on_batch_end                       	|  1.5654e-05     	|1000           	|  0.015654       	|  0.0022154      	|
configure_optimizers               	|  0.012911       	|1              	|  0.012911       	|  0.0018272      	|
on_before_optimizer_step           	|  1.2278e-05     	|1000           	|  0.012278       	|  0.0017377      	|
on_before_backward                 	|  1.181e-05      	|1000           	|  0.01181        	|  0.0016714      	|
training_step_end                  	|  7.0453e-06     	|1000           	|  0.0070453      	|  0.00099707     	|
on_validation_model_eval           	|  0.0051099      	|1              	|  0.0051099      	|  0.00072317     	|
on_epoch_end                       	|  2.8909e-05     	|168            	|  0.0048566      	|  0.00068733     	|
on_validation_batch_end            	|  3.2157e-05     	|125            	|  0.0040197      	|  0.00056887     	|
on_epoch_start                     	|  1.0877e-05     	|168            	|  0.0018274      	|  0.00025861     	|
on_validation_batch_start          	|  1.394e-05      	|125            	|  0.0017425      	|  0.0002466      	|
on_train_start                     	|  0.0016844      	|1              	|  0.0016844      	|  0.00023838     	|
validation_step_end                	|  7.0311e-06     	|125            	|  0.00087889     	|  0.00012438     	|
on_validation_start                	|  0.00054997     	|1              	|  0.00054997     	|  7.7834e-05     	|
on_validation_end                  	|  0.00021527     	|1              	|  0.00021527     	|  3.0466e-05     	|
on_fit_end                         	|  6.8393e-05     	|1              	|  6.8393e-05     	|  9.6791e-06     	|
setup                              	|  2.9413e-05     	|2              	|  5.8826e-05     	|  8.3252e-06     	|
on_before_accelerator_backend_setup	|  2.6861e-05     	|2              	|  5.3722e-05     	|  7.6029e-06     	|
on_configure_sharded_model         	|  2.2942e-05     	|2              	|  4.5884e-05     	|  6.4937e-06     	|
teardown                           	|  2.2222e-05     	|2              	|  4.4445e-05     	|  6.2899e-06     	|
on_fit_start                       	|  4.1731e-05     	|1              	|  4.1731e-05     	|  5.9058e-06     	|
on_validation_epoch_end            	|  3.0899e-05     	|1              	|  3.0899e-05     	|  4.373e-06      	|
on_val_dataloader                  	|  1.3667e-05     	|2              	|  2.7334e-05     	|  3.8684e-06     	|
prepare_data                       	|  9.3561e-06     	|2              	|  1.8712e-05     	|  2.6482e-06     	|
configure_callbacks                	|  9.2965e-06     	|2              	|  1.8593e-05     	|  2.6313e-06     	|
configure_sharded_model            	|  8.4871e-06     	|2              	|  1.6974e-05     	|  2.4022e-06     	|
on_pretrain_routine_end            	|  1.2392e-05     	|1              	|  1.2392e-05     	|  1.7538e-06     	|
on_validation_epoch_start          	|  1.0312e-05     	|1              	|  1.0312e-05     	|  1.4593e-06     	|
on_train_dataloader                	|  8.0038e-06     	|1              	|  8.0038e-06     	|  1.1327e-06     	|
