FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  342.34         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  15.694         	|21             	|  329.56         	|  96.27          	|
run_training_batch                 	|  0.31529        	|1000           	|  315.29         	|  92.098         	|
optimizer_step_with_closure_0      	|  0.31247        	|1000           	|  312.47         	|  91.276         	|
training_step_and_backward         	|  0.23932        	|1000           	|  239.32         	|  69.909         	|
backward                           	|  0.12035        	|1000           	|  120.35         	|  35.155         	|
model_forward                      	|  0.1174         	|1000           	|  117.4          	|  34.294         	|
training_step                      	|  0.1172         	|1000           	|  117.2          	|  34.236         	|
get_train_batch                    	|  0.0047138      	|1021           	|  4.8128         	|  1.4059         	|
fetch_next_train_batch             	|  0.0046923      	|1021           	|  4.7908         	|  1.3994         	|
on_train_batch_end                 	|  0.0018832      	|1000           	|  1.8832         	|  0.5501         	|
zero_grad                          	|  0.0015451      	|1000           	|  1.5451         	|  0.45135        	|
training_batch_to_device           	|  0.00028718     	|1000           	|  0.28718        	|  0.083887       	|
on_train_batch_start               	|  0.00011278     	|1000           	|  0.11278        	|  0.032945       	|
on_pretrain_routine_start          	|  0.025924       	|1              	|  0.025924       	|  0.0075727      	|
on_train_end                       	|  0.02552        	|1              	|  0.02552        	|  0.0074546      	|
on_after_backward                  	|  2.162e-05      	|1000           	|  0.02162        	|  0.0063154      	|
on_batch_start                     	|  1.9475e-05     	|1000           	|  0.019475       	|  0.0056888      	|
on_before_zero_grad                	|  1.5564e-05     	|1000           	|  0.015564       	|  0.0045463      	|
on_batch_end                       	|  1.5003e-05     	|1000           	|  0.015003       	|  0.0043825      	|
on_before_optimizer_step           	|  1.4001e-05     	|1000           	|  0.014001       	|  0.0040898      	|
on_before_backward                 	|  1.2832e-05     	|1000           	|  0.012832       	|  0.0037483      	|
on_train_epoch_start               	|  0.00044012     	|21             	|  0.0092425      	|  0.0026998      	|
configure_optimizers               	|  0.0091954      	|1              	|  0.0091954      	|  0.0026861      	|
on_train_epoch_end                 	|  0.00042873     	|21             	|  0.0090033      	|  0.00263        	|
training_step_end                  	|  7.7161e-06     	|1000           	|  0.0077161      	|  0.002254       	|
on_train_start                     	|  0.0012836      	|1              	|  0.0012836      	|  0.00037496     	|
on_epoch_start                     	|  1.1084e-05     	|21             	|  0.00023277     	|  6.7995e-05     	|
on_epoch_end                       	|  1.0956e-05     	|21             	|  0.00023009     	|  6.7211e-05     	|
on_fit_end                         	|  2.5842e-05     	|1              	|  2.5842e-05     	|  7.5487e-06     	|
setup                              	|  2.3055e-05     	|1              	|  2.3055e-05     	|  6.7346e-06     	|
on_before_accelerator_backend_setup	|  2.1804e-05     	|1              	|  2.1804e-05     	|  6.3692e-06     	|
on_fit_start                       	|  1.9107e-05     	|1              	|  1.9107e-05     	|  5.5814e-06     	|
on_configure_sharded_model         	|  1.7812e-05     	|1              	|  1.7812e-05     	|  5.2031e-06     	|
on_pretrain_routine_end            	|  1.4916e-05     	|1              	|  1.4916e-05     	|  4.3571e-06     	|
teardown                           	|  1.0624e-05     	|1              	|  1.0624e-05     	|  3.1034e-06     	|
prepare_data                       	|  9.778e-06      	|1              	|  9.778e-06      	|  2.8563e-06     	|
on_val_dataloader                  	|  7.617e-06      	|1              	|  7.617e-06      	|  2.225e-06      	|
on_train_dataloader                	|  7.508e-06      	|1              	|  7.508e-06      	|  2.1932e-06     	|
configure_sharded_model            	|  7.258e-06      	|1              	|  7.258e-06      	|  2.1201e-06     	|
configure_callbacks                	|  6.163e-06      	|1              	|  6.163e-06      	|  1.8003e-06     	|
