FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1740.1         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.4309         	|500            	|  1715.5         	|  98.587         	|
run_training_batch                 	|  0.20324        	|8000           	|  1625.9         	|  93.44          	|
training_step_and_backward         	|  0.19213        	|8000           	|  1537.0         	|  88.331         	|
model_forward                      	|  0.10778        	|8000           	|  862.21         	|  49.551         	|
training_step                      	|  0.10764        	|8000           	|  861.12         	|  49.488         	|
backward                           	|  0.084161       	|8000           	|  673.29         	|  38.693         	|
optimizer_step_with_closure_0      	|  0.24868        	|1000           	|  248.68         	|  14.292         	|
get_train_batch                    	|  0.0068883      	|8500           	|  58.55          	|  3.3648         	|
fetch_next_train_batch             	|  0.0068682      	|8500           	|  58.38          	|  3.355          	|
on_train_batch_end                 	|  0.0011028      	|8000           	|  8.8228         	|  0.50704        	|
training_batch_to_device           	|  0.00023501     	|8000           	|  1.8801         	|  0.10805        	|
zero_grad                          	|  0.0013719      	|1000           	|  1.3719         	|  0.078839       	|
on_train_batch_start               	|  9.3078e-05     	|8000           	|  0.74463        	|  0.042793       	|
on_train_epoch_start               	|  0.00028437     	|500            	|  0.14219        	|  0.0081713      	|
on_batch_start                     	|  1.7302e-05     	|8000           	|  0.13842        	|  0.0079548      	|
on_train_epoch_end                 	|  0.00025946     	|500            	|  0.12973        	|  0.0074555      	|
on_batch_end                       	|  1.3601e-05     	|8000           	|  0.10881        	|  0.0062531      	|
on_before_backward                 	|  1.2875e-05     	|8000           	|  0.103          	|  0.0059195      	|
on_after_backward                  	|  1.2185e-05     	|8000           	|  0.097477       	|  0.0056019      	|
training_step_end                  	|  6.4452e-06     	|8000           	|  0.051562       	|  0.0029632      	|
on_train_end                       	|  0.024234       	|1              	|  0.024234       	|  0.0013927      	|
on_pretrain_routine_start          	|  0.022268       	|1              	|  0.022268       	|  0.0012797      	|
on_before_zero_grad                	|  2.0453e-05     	|1000           	|  0.020453       	|  0.0011754      	|
on_before_optimizer_step           	|  1.9461e-05     	|1000           	|  0.019461       	|  0.0011184      	|
configure_optimizers               	|  0.0083022      	|1              	|  0.0083022      	|  0.00047712     	|
on_epoch_start                     	|  1.131e-05      	|500            	|  0.0056549      	|  0.00032498     	|
on_epoch_end                       	|  1.0197e-05     	|500            	|  0.0050984      	|  0.000293       	|
on_train_start                     	|  0.00046043     	|1              	|  0.00046043     	|  2.6461e-05     	|
on_fit_end                         	|  2.2833e-05     	|1              	|  2.2833e-05     	|  1.3122e-06     	|
on_before_accelerator_backend_setup	|  2.0799e-05     	|1              	|  2.0799e-05     	|  1.1953e-06     	|
setup                              	|  2.0268e-05     	|1              	|  2.0268e-05     	|  1.1648e-06     	|
on_fit_start                       	|  1.617e-05      	|1              	|  1.617e-05      	|  9.2928e-07     	|
on_configure_sharded_model         	|  1.566e-05      	|1              	|  1.566e-05      	|  8.9997e-07     	|
teardown                           	|  1.096e-05      	|1              	|  1.096e-05      	|  6.2986e-07     	|
on_pretrain_routine_end            	|  9.638e-06      	|1              	|  9.638e-06      	|  5.5389e-07     	|
prepare_data                       	|  7.1831e-06     	|1              	|  7.1831e-06     	|  4.128e-07      	|
configure_callbacks                	|  6.0811e-06     	|1              	|  6.0811e-06     	|  3.4947e-07     	|
configure_sharded_model            	|  4.719e-06      	|1              	|  4.719e-06      	|  2.712e-07      	|
on_val_dataloader                  	|  4.5879e-06     	|1              	|  4.5879e-06     	|  2.6366e-07     	|
on_train_dataloader                	|  4.248e-06      	|1              	|  4.248e-06      	|  2.4413e-07     	|
