VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1465.4         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  2.7943         	|500            	|  1397.1         	|  95.343         	|
run_training_batch                 	|  0.39362        	|1000           	|  393.62         	|  26.861         	|
optimizer_step_with_closure_0      	|  0.39027        	|1000           	|  390.27         	|  26.632         	|
training_step_and_backward         	|  0.28393        	|1000           	|  283.93         	|  19.376         	|
get_train_batch                    	|  0.11523        	|1500           	|  172.85         	|  11.796         	|
fetch_next_train_batch             	|  0.11519        	|1500           	|  172.79         	|  11.791         	|
model_forward                      	|  0.14807        	|1000           	|  148.07         	|  10.104         	|
training_step                      	|  0.14784        	|1000           	|  147.84         	|  10.089         	|
backward                           	|  0.13428        	|1000           	|  134.28         	|  9.1632         	|
run_validate_evaluation            	|  30.911         	|1              	|  30.911         	|  2.1094         	|
evaluation_step_and_end            	|  0.22037        	|125            	|  27.546         	|  1.8798         	|
validation_step                    	|  0.22025        	|125            	|  27.531         	|  1.8788         	|
on_train_batch_end                 	|  0.002436       	|1000           	|  2.436          	|  0.16623        	|
zero_grad                          	|  0.0015409      	|1000           	|  1.5409         	|  0.10515        	|
get_validate_batch                 	|  0.0064309      	|126            	|  0.81029        	|  0.055295       	|
fetch_next_validate_batch          	|  0.0064069      	|126            	|  0.80727        	|  0.055089       	|
training_batch_to_device           	|  0.00067455     	|1000           	|  0.67455        	|  0.046032       	|
on_train_epoch_end                 	|  0.00038085     	|500            	|  0.19043        	|  0.012995       	|
on_train_epoch_start               	|  0.00035969     	|500            	|  0.17985        	|  0.012273       	|
on_train_batch_start               	|  0.00011516     	|1000           	|  0.11516        	|  0.007859       	|
on_train_end                       	|  0.10871        	|1              	|  0.10871        	|  0.0074184      	|
on_batch_start                     	|  4.5179e-05     	|1000           	|  0.045179       	|  0.003083       	|
evaluation_batch_to_device         	|  0.00030278     	|125            	|  0.037848       	|  0.0025828      	|
on_after_backward                  	|  2.6562e-05     	|1000           	|  0.026562       	|  0.0018126      	|
on_before_zero_grad                	|  2.4859e-05     	|1000           	|  0.024859       	|  0.0016964      	|
on_pretrain_routine_start          	|  0.023884       	|1              	|  0.023884       	|  0.0016299      	|
on_before_optimizer_step           	|  1.824e-05      	|1000           	|  0.01824        	|  0.0012447      	|
on_batch_end                       	|  1.6866e-05     	|1000           	|  0.016866       	|  0.0011509      	|
on_before_backward                 	|  1.6573e-05     	|1000           	|  0.016573       	|  0.001131       	|
configure_optimizers               	|  0.012941       	|1              	|  0.012941       	|  0.00088312     	|
training_step_end                  	|  8.882e-06      	|1000           	|  0.008882       	|  0.00060612     	|
on_epoch_end                       	|  1.1546e-05     	|501            	|  0.0057846      	|  0.00039475     	|
on_epoch_start                     	|  1.1541e-05     	|501            	|  0.005782       	|  0.00039457     	|
on_validation_batch_end            	|  4.3126e-05     	|125            	|  0.0053907      	|  0.00036787     	|
on_validation_model_eval           	|  0.0039168      	|1              	|  0.0039168      	|  0.00026729     	|
on_train_start                     	|  0.0028672      	|1              	|  0.0028672      	|  0.00019566     	|
on_validation_batch_start          	|  1.6036e-05     	|125            	|  0.0020045      	|  0.00013679     	|
validation_step_end                	|  9.2517e-06     	|125            	|  0.0011565      	|  7.8919e-05     	|
on_validation_start                	|  0.00056071     	|1              	|  0.00056071     	|  3.8264e-05     	|
on_validation_end                  	|  0.00022812     	|1              	|  0.00022812     	|  1.5567e-05     	|
on_fit_end                         	|  9.4179e-05     	|1              	|  9.4179e-05     	|  6.4269e-06     	|
on_before_accelerator_backend_setup	|  3.6395e-05     	|2              	|  7.279e-05      	|  4.9673e-06     	|
on_configure_sharded_model         	|  2.8685e-05     	|2              	|  5.7369e-05     	|  3.915e-06      	|
teardown                           	|  2.4782e-05     	|2              	|  4.9563e-05     	|  3.3823e-06     	|
setup                              	|  2.4455e-05     	|2              	|  4.8909e-05     	|  3.3376e-06     	|
on_fit_start                       	|  4.7134e-05     	|1              	|  4.7134e-05     	|  3.2165e-06     	|
on_validation_epoch_end            	|  3.534e-05      	|1              	|  3.534e-05      	|  2.4116e-06     	|
configure_callbacks                	|  1.4963e-05     	|2              	|  2.9925e-05     	|  2.0421e-06     	|
prepare_data                       	|  1.0594e-05     	|2              	|  2.1188e-05     	|  1.4459e-06     	|
on_val_dataloader                  	|  8.6362e-06     	|2              	|  1.7272e-05     	|  1.1787e-06     	|
on_pretrain_routine_end            	|  1.6659e-05     	|1              	|  1.6659e-05     	|  1.1369e-06     	|
configure_sharded_model            	|  7.9218e-06     	|2              	|  1.5844e-05     	|  1.0812e-06     	|
on_validation_epoch_start          	|  9.8422e-06     	|1              	|  9.8422e-06     	|  6.7165e-07     	|
on_train_dataloader                	|  9.4026e-06     	|1              	|  9.4026e-06     	|  6.4165e-07     	|
