FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  448.86         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  0.85208        	|500            	|  426.04         	|  94.915         	|
run_training_batch                 	|  0.27523        	|1000           	|  275.23         	|  61.317         	|
optimizer_step_with_closure_0      	|  0.27255        	|1000           	|  272.55         	|  60.721         	|
training_step_and_backward         	|  0.20962        	|1000           	|  209.62         	|  46.7           	|
model_forward                      	|  0.12614        	|1000           	|  126.14         	|  28.101         	|
training_step                      	|  0.12598        	|1000           	|  125.98         	|  28.065         	|
backward                           	|  0.082102       	|1000           	|  82.102         	|  18.291         	|
get_train_batch                    	|  0.028725       	|1500           	|  43.088         	|  9.5993         	|
fetch_next_train_batch             	|  0.028692       	|1500           	|  43.038         	|  9.5882         	|
zero_grad                          	|  0.0013509      	|1000           	|  1.3509         	|  0.30096        	|
on_train_batch_end                 	|  0.0012948      	|1000           	|  1.2948         	|  0.28846        	|
training_batch_to_device           	|  0.0005969      	|1000           	|  0.5969         	|  0.13298        	|
on_train_epoch_start               	|  0.00028207     	|500            	|  0.14103        	|  0.03142        	|
on_train_epoch_end                 	|  0.00027339     	|500            	|  0.1367         	|  0.030454       	|
on_train_batch_start               	|  0.00010479     	|1000           	|  0.10479        	|  0.023345       	|
on_batch_start                     	|  3.597e-05      	|1000           	|  0.03597        	|  0.0080136      	|
on_train_end                       	|  0.023681       	|1              	|  0.023681       	|  0.0052758      	|
on_pretrain_routine_start          	|  0.022695       	|1              	|  0.022695       	|  0.0050561      	|
on_before_zero_grad                	|  2.1554e-05     	|1000           	|  0.021554       	|  0.0048019      	|
on_batch_end                       	|  1.3087e-05     	|1000           	|  0.013087       	|  0.0029157      	|
on_before_optimizer_step           	|  1.1955e-05     	|1000           	|  0.011955       	|  0.0026635      	|
on_after_backward                  	|  1.1343e-05     	|1000           	|  0.011343       	|  0.0025271      	|
on_before_backward                 	|  1.0655e-05     	|1000           	|  0.010655       	|  0.0023739      	|
configure_optimizers               	|  0.0083682      	|1              	|  0.0083682      	|  0.0018643      	|
training_step_end                  	|  7.6065e-06     	|1000           	|  0.0076065      	|  0.0016946      	|
on_epoch_start                     	|  1.0253e-05     	|500            	|  0.0051266      	|  0.0011421      	|
on_epoch_end                       	|  1.0244e-05     	|500            	|  0.005122       	|  0.0011411      	|
on_train_start                     	|  0.00071765     	|1              	|  0.00071765     	|  0.00015988     	|
on_fit_end                         	|  2.4065e-05     	|1              	|  2.4065e-05     	|  5.3613e-06     	|
on_before_accelerator_backend_setup	|  1.8354e-05     	|1              	|  1.8354e-05     	|  4.089e-06      	|
on_fit_start                       	|  1.7352e-05     	|1              	|  1.7352e-05     	|  3.8658e-06     	|
setup                              	|  1.4788e-05     	|1              	|  1.4788e-05     	|  3.2945e-06     	|
on_configure_sharded_model         	|  1.4538e-05     	|1              	|  1.4538e-05     	|  3.2388e-06     	|
teardown                           	|  1.089e-05      	|1              	|  1.089e-05      	|  2.4261e-06     	|
on_pretrain_routine_end            	|  9.708e-06      	|1              	|  9.708e-06      	|  2.1628e-06     	|
prepare_data                       	|  7.5441e-06     	|1              	|  7.5441e-06     	|  1.6807e-06     	|
configure_sharded_model            	|  4.939e-06      	|1              	|  4.939e-06      	|  1.1003e-06     	|
configure_callbacks                	|  4.818e-06      	|1              	|  4.818e-06      	|  1.0734e-06     	|
on_val_dataloader                  	|  4.388e-06      	|1              	|  4.388e-06      	|  9.7759e-07     	|
on_train_dataloader                	|  4.0381e-06     	|1              	|  4.0381e-06     	|  8.9963e-07     	|
