VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  452.51         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  5.3818         	|63             	|  339.06         	|  74.927         	|
run_training_batch                 	|  0.31579        	|1000           	|  315.79         	|  69.786         	|
optimizer_step_with_closure_0      	|  0.31308        	|1000           	|  313.08         	|  69.187         	|
training_step_and_backward         	|  0.23547        	|1000           	|  235.47         	|  52.037         	|
model_forward                      	|  0.14605        	|1000           	|  146.05         	|  32.276         	|
training_step                      	|  0.14592        	|1000           	|  145.92         	|  32.246         	|
backward                           	|  0.088099       	|1000           	|  88.099         	|  19.469         	|
run_validate_evaluation            	|  70.27          	|1              	|  70.27          	|  15.529         	|
evaluation_step_and_end            	|  0.21942        	|313            	|  68.68          	|  15.177         	|
validation_step                    	|  0.21937        	|313            	|  68.664         	|  15.174         	|
get_train_batch                    	|  0.0072958      	|1063           	|  7.7554         	|  1.7139         	|
fetch_next_train_batch             	|  0.0072759      	|1063           	|  7.7342         	|  1.7092         	|
zero_grad                          	|  0.0012949      	|1000           	|  1.2949         	|  0.28615        	|
on_train_batch_end                 	|  0.0011899      	|1000           	|  1.1899         	|  0.26296        	|
get_validate_batch                 	|  0.0018128      	|314            	|  0.56921        	|  0.12579        	|
fetch_next_validate_batch          	|  0.0017987      	|314            	|  0.56481        	|  0.12482        	|
training_batch_to_device           	|  0.00022652     	|1000           	|  0.22652        	|  0.050059       	|
on_train_batch_start               	|  9.1711e-05     	|1000           	|  0.091711       	|  0.020267       	|
evaluation_batch_to_device         	|  0.00022216     	|313            	|  0.069538       	|  0.015367       	|
on_train_end                       	|  0.024792       	|1              	|  0.024792       	|  0.0054788      	|
on_pretrain_routine_start          	|  0.022453       	|1              	|  0.022453       	|  0.0049618      	|
on_train_epoch_start               	|  0.00028594     	|63             	|  0.018014       	|  0.0039809      	|
on_train_epoch_end                 	|  0.00028348     	|63             	|  0.017859       	|  0.0039467      	|
on_batch_start                     	|  1.575e-05      	|1000           	|  0.01575        	|  0.0034807      	|
on_batch_end                       	|  1.4526e-05     	|1000           	|  0.014526       	|  0.0032101      	|
on_before_zero_grad                	|  1.3349e-05     	|1000           	|  0.013349       	|  0.00295        	|
on_after_backward                  	|  1.1361e-05     	|1000           	|  0.011361       	|  0.0025106      	|
on_before_optimizer_step           	|  1.0509e-05     	|1000           	|  0.010509       	|  0.0023223      	|
on_before_backward                 	|  1.0195e-05     	|1000           	|  0.010195       	|  0.0022529      	|
configure_optimizers               	|  0.0084281      	|1              	|  0.0084281      	|  0.0018625      	|
on_validation_batch_end            	|  1.9315e-05     	|313            	|  0.0060457      	|  0.001336       	|
training_step_end                  	|  5.8925e-06     	|1000           	|  0.0058925      	|  0.0013022      	|
on_validation_model_eval           	|  0.0040181      	|1              	|  0.0040181      	|  0.00088795     	|
on_validation_batch_start          	|  1.0092e-05     	|313            	|  0.0031586      	|  0.00069802     	|
validation_step_end                	|  4.9121e-06     	|313            	|  0.0015375      	|  0.00033976     	|
on_train_start                     	|  0.00072405     	|1              	|  0.00072405     	|  0.00016001     	|
on_epoch_end                       	|  1.0818e-05     	|64             	|  0.00069232     	|  0.000153       	|
on_epoch_start                     	|  1.0622e-05     	|64             	|  0.00067978     	|  0.00015022     	|
on_validation_start                	|  0.00031402     	|1              	|  0.00031402     	|  6.9395e-05     	|
on_validation_end                  	|  0.00010227     	|1              	|  0.00010227     	|  2.2601e-05     	|
on_before_accelerator_backend_setup	|  1.8289e-05     	|2              	|  3.6578e-05     	|  8.0833e-06     	|
teardown                           	|  1.565e-05      	|2              	|  3.1299e-05     	|  6.9167e-06     	|
on_validation_epoch_end            	|  3.0688e-05     	|1              	|  3.0688e-05     	|  6.7817e-06     	|
setup                              	|  1.4252e-05     	|2              	|  2.8504e-05     	|  6.2991e-06     	|
on_configure_sharded_model         	|  1.329e-05      	|2              	|  2.658e-05      	|  5.8739e-06     	|
on_fit_end                         	|  2.0028e-05     	|1              	|  2.0028e-05     	|  4.4259e-06     	|
on_fit_start                       	|  1.6672e-05     	|1              	|  1.6672e-05     	|  3.6843e-06     	|
on_val_dataloader                  	|  5.941e-06      	|2              	|  1.1882e-05     	|  2.6258e-06     	|
prepare_data                       	|  5.6211e-06     	|2              	|  1.1242e-05     	|  2.4844e-06     	|
configure_sharded_model            	|  4.9045e-06     	|2              	|  9.809e-06      	|  2.1677e-06     	|
on_validation_epoch_start          	|  9.688e-06      	|1              	|  9.688e-06      	|  2.1409e-06     	|
configure_callbacks                	|  4.7485e-06     	|2              	|  9.497e-06      	|  2.0987e-06     	|
on_pretrain_routine_end            	|  9.4679e-06     	|1              	|  9.4679e-06     	|  2.0923e-06     	|
on_train_dataloader                	|  4.1281e-06     	|1              	|  4.1281e-06     	|  9.1226e-07     	|
