VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  443.33         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  5.2354         	|63             	|  329.83         	|  74.397         	|
run_training_batch                 	|  0.30668        	|1000           	|  306.68         	|  69.175         	|
optimizer_step_with_closure_0      	|  0.30406        	|1000           	|  304.06         	|  68.584         	|
training_step_and_backward         	|  0.22855        	|1000           	|  228.55         	|  51.553         	|
model_forward                      	|  0.14087        	|1000           	|  140.87         	|  31.775         	|
training_step                      	|  0.14073        	|1000           	|  140.73         	|  31.744         	|
backward                           	|  0.086343       	|1000           	|  86.343         	|  19.476         	|
run_validate_evaluation            	|  70.31          	|1              	|  70.31          	|  15.859         	|
evaluation_step_and_end            	|  0.21945        	|313            	|  68.689         	|  15.494         	|
validation_step                    	|  0.2194         	|313            	|  68.672         	|  15.49          	|
get_train_batch                    	|  0.0073216      	|1063           	|  7.7828         	|  1.7555         	|
fetch_next_train_batch             	|  0.0073027      	|1063           	|  7.7627         	|  1.751          	|
zero_grad                          	|  0.0013138      	|1000           	|  1.3138         	|  0.29635        	|
on_train_batch_end                 	|  0.0011882      	|1000           	|  1.1882         	|  0.26801        	|
get_validate_batch                 	|  0.0018917      	|314            	|  0.59401        	|  0.13399        	|
fetch_next_validate_batch          	|  0.0018776      	|314            	|  0.58957        	|  0.13299        	|
training_batch_to_device           	|  0.00021493     	|1000           	|  0.21493        	|  0.04848        	|
on_train_batch_start               	|  9.2709e-05     	|1000           	|  0.092709       	|  0.020912       	|
evaluation_batch_to_device         	|  0.00022692     	|313            	|  0.071026       	|  0.016021       	|
on_train_end                       	|  0.02497        	|1              	|  0.02497        	|  0.0056324      	|
on_pretrain_routine_start          	|  0.022935       	|1              	|  0.022935       	|  0.0051732      	|
on_train_epoch_end                 	|  0.00029899     	|63             	|  0.018837       	|  0.0042488      	|
on_train_epoch_start               	|  0.0002981      	|63             	|  0.01878        	|  0.0042361      	|
on_batch_start                     	|  1.6343e-05     	|1000           	|  0.016343       	|  0.0036865      	|
on_before_zero_grad                	|  1.3919e-05     	|1000           	|  0.013919       	|  0.0031395      	|
on_batch_end                       	|  1.3057e-05     	|1000           	|  0.013057       	|  0.0029452      	|
on_after_backward                  	|  1.1271e-05     	|1000           	|  0.011271       	|  0.0025423      	|
on_before_backward                 	|  1.0415e-05     	|1000           	|  0.010415       	|  0.0023492      	|
on_before_optimizer_step           	|  1.0233e-05     	|1000           	|  0.010233       	|  0.0023082      	|
configure_optimizers               	|  0.008065       	|1              	|  0.008065       	|  0.0018192      	|
on_validation_batch_end            	|  1.9378e-05     	|313            	|  0.0060654      	|  0.0013681      	|
training_step_end                  	|  5.9549e-06     	|1000           	|  0.0059549      	|  0.0013432      	|
on_validation_model_eval           	|  0.0040842      	|1              	|  0.0040842      	|  0.00092126     	|
on_validation_batch_start          	|  9.9857e-06     	|313            	|  0.0031255      	|  0.000705       	|
validation_step_end                	|  4.8379e-06     	|313            	|  0.0015143      	|  0.00034156     	|
on_train_start                     	|  0.00073365     	|1              	|  0.00073365     	|  0.00016549     	|
on_epoch_start                     	|  1.0266e-05     	|64             	|  0.00065705     	|  0.00014821     	|
on_epoch_end                       	|  1.0253e-05     	|64             	|  0.00065618     	|  0.00014801     	|
on_validation_start                	|  0.00031172     	|1              	|  0.00031172     	|  7.0312e-05     	|
on_validation_end                  	|  0.00010943     	|1              	|  0.00010943     	|  2.4684e-05     	|
on_before_accelerator_backend_setup	|  1.7633e-05     	|2              	|  3.5266e-05     	|  7.9547e-06     	|
teardown                           	|  1.6992e-05     	|2              	|  3.3983e-05     	|  7.6653e-06     	|
on_validation_epoch_end            	|  3.2971e-05     	|1              	|  3.2971e-05     	|  7.4371e-06     	|
setup                              	|  1.5083e-05     	|2              	|  3.0166e-05     	|  6.8043e-06     	|
on_configure_sharded_model         	|  1.4376e-05     	|2              	|  2.8753e-05     	|  6.4856e-06     	|
on_fit_end                         	|  2.0749e-05     	|1              	|  2.0749e-05     	|  4.6802e-06     	|
on_fit_start                       	|  1.6401e-05     	|1              	|  1.6401e-05     	|  3.6994e-06     	|
on_val_dataloader                  	|  5.9815e-06     	|2              	|  1.1963e-05     	|  2.6984e-06     	|
prepare_data                       	|  5.5006e-06     	|2              	|  1.1001e-05     	|  2.4815e-06     	|
configure_sharded_model            	|  5.1645e-06     	|2              	|  1.0329e-05     	|  2.3298e-06     	|
on_pretrain_routine_end            	|  9.858e-06      	|1              	|  9.858e-06      	|  2.2236e-06     	|
configure_callbacks                	|  4.794e-06      	|2              	|  9.588e-06      	|  2.1627e-06     	|
on_validation_epoch_start          	|  9.1169e-06     	|1              	|  9.1169e-06     	|  2.0564e-06     	|
on_train_dataloader                	|  4.388e-06      	|1              	|  4.388e-06      	|  9.8978e-07     	|
