VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  419.84         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  14.55          	|25             	|  363.75         	|  86.64          	|
run_training_batch                 	|  0.30735        	|1000           	|  307.35         	|  73.206         	|
optimizer_step_with_closure_0      	|  0.30351        	|1000           	|  303.51         	|  72.292         	|
training_step_and_backward         	|  0.23676        	|1000           	|  236.76         	|  56.393         	|
backward                           	|  0.12062        	|1000           	|  120.62         	|  28.731         	|
model_forward                      	|  0.11449        	|1000           	|  114.49         	|  27.27          	|
training_step                      	|  0.11428        	|1000           	|  114.28         	|  27.221         	|
run_validate_evaluation            	|  16.803         	|1              	|  16.803         	|  4.0022         	|
evaluation_step_and_end            	|  0.10182        	|139            	|  14.152         	|  3.3709         	|
validation_step                    	|  0.10169        	|139            	|  14.135         	|  3.3668         	|
get_train_batch                    	|  0.012049       	|1025           	|  12.35          	|  2.9417         	|
fetch_next_train_batch             	|  0.012025       	|1025           	|  12.326         	|  2.9358         	|
on_train_batch_end                 	|  0.0023931      	|1000           	|  2.3931         	|  0.57           	|
zero_grad                          	|  0.0016067      	|1000           	|  1.6067         	|  0.3827         	|
get_validate_batch                 	|  0.0054156      	|140            	|  0.75818        	|  0.18059        	|
fetch_next_validate_batch          	|  0.0053896      	|140            	|  0.75454        	|  0.17972        	|
training_batch_to_device           	|  0.00029235     	|1000           	|  0.29235        	|  0.069634       	|
on_train_batch_start               	|  0.00010043     	|1000           	|  0.10043        	|  0.02392        	|
on_train_end                       	|  0.044601       	|1              	|  0.044601       	|  0.010623       	|
evaluation_batch_to_device         	|  0.00030363     	|139            	|  0.042205       	|  0.010053       	|
on_after_backward                  	|  3.0251e-05     	|1000           	|  0.030251       	|  0.0072054      	|
on_pretrain_routine_start          	|  0.029495       	|1              	|  0.029495       	|  0.0070253      	|
on_batch_start                     	|  2.0806e-05     	|1000           	|  0.020806       	|  0.0049556      	|
on_before_zero_grad                	|  1.9647e-05     	|1000           	|  0.019647       	|  0.0046796      	|
on_batch_end                       	|  1.6177e-05     	|1000           	|  0.016177       	|  0.0038533      	|
on_before_optimizer_step           	|  1.4621e-05     	|1000           	|  0.014621       	|  0.0034824      	|
on_before_backward                 	|  1.3858e-05     	|1000           	|  0.013858       	|  0.0033008      	|
on_train_epoch_start               	|  0.00043026     	|25             	|  0.010756       	|  0.002562       	|
configure_optimizers               	|  0.010362       	|1              	|  0.010362       	|  0.0024681      	|
on_train_epoch_end                 	|  0.00041087     	|25             	|  0.010272       	|  0.0024466      	|
training_step_end                  	|  7.558e-06      	|1000           	|  0.007558       	|  0.0018002      	|
on_validation_batch_end            	|  4.2328e-05     	|139            	|  0.0058835      	|  0.0014014      	|
on_validation_model_eval           	|  0.0047203      	|1              	|  0.0047203      	|  0.0011243      	|
on_validation_batch_start          	|  1.88e-05       	|139            	|  0.0026132      	|  0.00062243     	|
on_train_start                     	|  0.0018263      	|1              	|  0.0018263      	|  0.000435       	|
validation_step_end                	|  1.0328e-05     	|139            	|  0.0014355      	|  0.00034193     	|
on_validation_start                	|  0.00070595     	|1              	|  0.00070595     	|  0.00016815     	|
on_epoch_end                       	|  1.3177e-05     	|26             	|  0.00034261     	|  8.1604e-05     	|
on_epoch_start                     	|  1.2504e-05     	|26             	|  0.00032511     	|  7.7437e-05     	|
on_validation_end                  	|  0.00019189     	|1              	|  0.00019189     	|  4.5705e-05     	|
on_fit_start                       	|  0.00011915     	|1              	|  0.00011915     	|  2.838e-05      	|
teardown                           	|  4.9827e-05     	|2              	|  9.9653e-05     	|  2.3736e-05     	|
on_fit_end                         	|  7.1818e-05     	|1              	|  7.1818e-05     	|  1.7106e-05     	|
setup                              	|  3.3083e-05     	|2              	|  6.6167e-05     	|  1.576e-05      	|
on_before_accelerator_backend_setup	|  2.8733e-05     	|2              	|  5.7466e-05     	|  1.3688e-05     	|
on_configure_sharded_model         	|  2.6638e-05     	|2              	|  5.3275e-05     	|  1.2689e-05     	|
configure_sharded_model            	|  1.9306e-05     	|2              	|  3.8613e-05     	|  9.197e-06      	|
on_validation_epoch_end            	|  3.5536e-05     	|1              	|  3.5536e-05     	|  8.4641e-06     	|
on_val_dataloader                  	|  1.6641e-05     	|2              	|  3.3282e-05     	|  7.9273e-06     	|
on_pretrain_routine_end            	|  2.0763e-05     	|1              	|  2.0763e-05     	|  4.9455e-06     	|
prepare_data                       	|  9.2704e-06     	|2              	|  1.8541e-05     	|  4.4162e-06     	|
on_validation_epoch_start          	|  1.7781e-05     	|1              	|  1.7781e-05     	|  4.2352e-06     	|
configure_callbacks                	|  8.3549e-06     	|2              	|  1.671e-05      	|  3.9801e-06     	|
on_train_dataloader                	|  1.4085e-05     	|1              	|  1.4085e-05     	|  3.3549e-06     	|
