VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  771.4          	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.5728         	|200            	|  714.55         	|  92.631         	|
run_training_batch                 	|  0.30867        	|1000           	|  308.67         	|  40.015         	|
optimizer_step_with_closure_0      	|  0.30487        	|1000           	|  304.87         	|  39.522         	|
training_step_and_backward         	|  0.23707        	|1000           	|  237.07         	|  30.732         	|
model_forward                      	|  0.11902        	|1000           	|  119.02         	|  15.43          	|
training_step                      	|  0.11879        	|1000           	|  118.79         	|  15.399         	|
backward                           	|  0.11638        	|1000           	|  116.38         	|  15.087         	|
get_train_batch                    	|  0.065396       	|1200           	|  78.475         	|  10.173         	|
fetch_next_train_batch             	|  0.065361       	|1200           	|  78.433         	|  10.168         	|
run_validate_evaluation            	|  16.505         	|1              	|  16.505         	|  2.1396         	|
evaluation_step_and_end            	|  0.098928       	|139            	|  13.751         	|  1.7826         	|
validation_step                    	|  0.098817       	|139            	|  13.736         	|  1.7806         	|
on_train_batch_end                 	|  0.0027223      	|1000           	|  2.7223         	|  0.3529         	|
zero_grad                          	|  0.001621       	|1000           	|  1.621          	|  0.21014        	|
get_validate_batch                 	|  0.0056484      	|140            	|  0.79078        	|  0.10251        	|
fetch_next_validate_batch          	|  0.0056225      	|140            	|  0.78716        	|  0.10204        	|
training_batch_to_device           	|  0.00044989     	|1000           	|  0.44989        	|  0.058321       	|
on_train_batch_start               	|  0.00022934     	|1000           	|  0.22934        	|  0.029731       	|
on_train_epoch_end                 	|  0.00042027     	|200            	|  0.084055       	|  0.010896       	|
on_train_end                       	|  0.081981       	|1              	|  0.081981       	|  0.010628       	|
on_train_epoch_start               	|  0.00039323     	|200            	|  0.078647       	|  0.010195       	|
evaluation_batch_to_device         	|  0.00029426     	|139            	|  0.040902       	|  0.0053023      	|
on_batch_start                     	|  3.5886e-05     	|1000           	|  0.035886       	|  0.004652       	|
on_after_backward                  	|  3.1323e-05     	|1000           	|  0.031323       	|  0.0040605      	|
on_pretrain_routine_start          	|  0.024277       	|1              	|  0.024277       	|  0.0031472      	|
configure_optimizers               	|  0.023851       	|1              	|  0.023851       	|  0.0030919      	|
on_before_zero_grad                	|  2.1048e-05     	|1000           	|  0.021048       	|  0.0027285      	|
on_batch_end                       	|  1.7104e-05     	|1000           	|  0.017104       	|  0.0022172      	|
on_before_optimizer_step           	|  1.558e-05      	|1000           	|  0.01558        	|  0.0020197      	|
on_before_backward                 	|  1.461e-05      	|1000           	|  0.01461        	|  0.001894       	|
training_step_end                  	|  9.4651e-06     	|1000           	|  0.0094651      	|  0.001227       	|
on_validation_batch_end            	|  4.1309e-05     	|139            	|  0.0057419      	|  0.00074435     	|
on_validation_model_eval           	|  0.0045571      	|1              	|  0.0045571      	|  0.00059076     	|
on_validation_end                  	|  0.0034437      	|1              	|  0.0034437      	|  0.00044642     	|
on_epoch_end                       	|  1.264e-05      	|201            	|  0.0025407      	|  0.00032936     	|
on_validation_batch_start          	|  1.7747e-05     	|139            	|  0.0024669      	|  0.00031979     	|
on_epoch_start                     	|  1.1793e-05     	|201            	|  0.0023704      	|  0.00030729     	|
on_train_start                     	|  0.0014272      	|1              	|  0.0014272      	|  0.00018502     	|
validation_step_end                	|  9.163e-06      	|139            	|  0.0012737      	|  0.00016511     	|
on_validation_start                	|  0.00071183     	|1              	|  0.00071183     	|  9.2278e-05     	|
teardown                           	|  5.0268e-05     	|2              	|  0.00010054     	|  1.3033e-05     	|
on_before_accelerator_backend_setup	|  4.0508e-05     	|2              	|  8.1016e-05     	|  1.0502e-05     	|
on_fit_end                         	|  7.7028e-05     	|1              	|  7.7028e-05     	|  9.9855e-06     	|
on_configure_sharded_model         	|  2.791e-05      	|2              	|  5.582e-05      	|  7.2362e-06     	|
setup                              	|  2.776e-05      	|2              	|  5.552e-05      	|  7.1973e-06     	|
on_fit_start                       	|  4.424e-05      	|1              	|  4.424e-05      	|  5.735e-06      	|
on_validation_epoch_end            	|  4.318e-05      	|1              	|  4.318e-05      	|  5.5976e-06     	|
on_val_dataloader                  	|  1.478e-05      	|2              	|  2.956e-05      	|  3.832e-06      	|
configure_callbacks                	|  1.0543e-05     	|2              	|  2.1085e-05     	|  2.7334e-06     	|
configure_sharded_model            	|  9.8394e-06     	|2              	|  1.9679e-05     	|  2.5511e-06     	|
on_pretrain_routine_end            	|  1.7518e-05     	|1              	|  1.7518e-05     	|  2.271e-06      	|
prepare_data                       	|  8.4694e-06     	|2              	|  1.6939e-05     	|  2.1959e-06     	|
on_validation_epoch_start          	|  1.1809e-05     	|1              	|  1.1809e-05     	|  1.5309e-06     	|
on_train_dataloader                	|  9.3076e-06     	|1              	|  9.3076e-06     	|  1.2066e-06     	|
