====================op compute time====================
op_name       compute_time(ms) stream_id
------------  ---------------  ---------
Default/AssignAdd-op142 0.00219  519
Default/TransData-op118 0.047035  519
Default/network-TrainOneStepCell/network-WithLossCell/_loss_fn-SoftmaxCrossEntropyWithLogits/OneHot-op3 0.00176  519
Default/network-TrainOneStepCell/optimizer-Momentum/learning_rate-_IteratorLearningRate/GatherV2-op32 0.00153  519
Default/network-TrainOneStepCell/optimizer-Momentum/AssignAdd-op31 0.00125  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv1-Conv2d/Cast-op91 0.00804  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/Cast-op110 0.00932  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv5-Conv2d/Cast-op111 0.00773  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv2-Conv2d/Cast-op115 0.00696  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv3-Conv2d/Cast-op116 0.00781  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv1-Conv2d/Cast-op117 0.00514  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv1-Conv2d/Conv2D-op5 0.06913  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv1-Conv2d/Cast-op108 0.00652  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/ReLUV2-op119 0.0094  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/Cast-op98 0.00588  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/MaxPool-op7 0.00591  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv2-Conv2d/Conv2D-op8 0.02412  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv2-Conv2d/Cast-op109 0.00515  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/ReLUV2-op120 0.0067  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/Cast-op99 0.00559  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/MaxPool-op10 0.00335  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv3-Conv2d/Conv2D-op11 0.16997  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv3-Conv2d/Cast-op106 0.00419  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/ReLUV2-op121 0.00624  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/Cast-op95 0.0047  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/Conv2D-op13 0.09617  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/Cast-op107 0.00372  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/ReLUV2-op122 0.00626  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv5-Conv2d/Cast-op97 0.00435  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv5-Conv2d/Conv2D-op15 0.10168  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv5-Conv2d/Cast-op114 0.00465  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/ReLUV2-op123 0.00468  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/Cast-op112 0.00376  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/MaxPool-op17 0.00297  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/Cast-op105 0.00399  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/TransData-op124 0.08231  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/MatMul-op19 9.17408  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/ReLU-op21 0.00256  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/MatMul-op22 4.04837  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/ReLU-op24 0.00221  519
Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/MatMul-op25 0.00348  519
Default/network-TrainOneStepCell/network-WithLossCell/_loss_fn-SoftmaxCrossEntropyWithLogits/SoftmaxCrossEntropyWithLogits-op27 0.00364  519
Default/AtomicAddrClean-op145 0.00128  519
Default/network-TrainOneStepCell/network-WithLossCell/_loss_fn-SoftmaxCrossEntropyWithLogits/ReduceMean-op87 0.00139  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_loss_fn-SoftmaxCrossEntropyWithLogits/gradSoftmaxCrossEntropyWithLogits/Mul-op29 0.00132  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradMatMul/MatMul-op37 0.00278  519
Default/AtomicAddrClean-op146 0.00113  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradBiasAdd/BiasAddGrad-op30 0.00139  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradMatMul/MatMul-op40 0.00247  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/gradReLU/ReluGrad-op41 0.00426  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradMatMul/MatMul-op45 0.22636  519
Default/AtomicAddrClean-op147 0.00143  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradBiasAdd/BiasAddGrad-op42 0.00182  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradMatMul/MatMul-op48 2.61685  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/gradReLU/ReluGrad-op49 0.00424  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradMatMul/MatMul-op53 0.33999  519
Default/AtomicAddrClean-op148 0.00144  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradBiasAdd/BiasAddGrad-op50 0.00183  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/fc3-Dense/gradMatMul/MatMul-op56 4.24336  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/flatten-Flatten/gradReshape/TransData-op125 0.06442  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/gradMaxPool/Cast-op113 0.00313  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/gradMaxPool/MaxPoolGrad-op58 0.00567  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/gradMaxPool/Cast-op104 0.0042  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/gradReLU/ReluGradV2-op126 0.00532  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv5-Conv2d/gradConv2D/Cast-op96 0.00377  519
Default/AtomicAddrClean-op149 0.00546  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv5-Conv2d/gradConv2D/Conv2DBackpropFilter-op60 0.01194  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv5-Conv2d/gradConv2D/Conv2DBackpropInput-op63 0.01106  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv5-Conv2d/gradConv2D/Cast-op103 0.00397  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/gradReLU/ReluGradV2-op127 0.00526  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/gradConv2D/Cast-op94 0.0045  519
Default/AtomicAddrClean-op150 0.00615  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/gradConv2D/Conv2DBackpropFilter-op65 0.01301  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/gradConv2D/Conv2DBackpropInput-op68 0.01392  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/gradConv2D/Cast-op102 0.00387  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/gradReLU/ReluGradV2-op128 0.005  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/gradConv2D/Cast-op93 0.00438  519
Default/AtomicAddrClean-op151 0.00506  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/gradConv2D/Conv2DBackpropFilter-op70 0.01246  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv4-Conv2d/gradConv2D/Conv2DBackpropInput-op73 0.02185  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/gradMaxPool/MaxPoolGrad-op74 0.01593  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/gradMaxPool/Cast-op101 0.00524  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/gradReLU/ReluGradV2-op129 0.00653  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv2-Conv2d/gradConv2D/Cast-op92 0.00546  519
Default/AtomicAddrClean-op152 0.00523  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv2-Conv2d/gradConv2D/Conv2DBackpropFilter-op76 0.02361  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv2-Conv2d/gradConv2D/Conv2DBackpropInput-op79 0.03911  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/gradMaxPool/MaxPoolGrad-op80 0.03258  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/gradMaxPool/Cast-op100 0.00633  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/relu-ReLU/gradReLU/ReluGradV2-op130 0.00868  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv1-Conv2d/gradConv2D/Cast-op90 0.00574  519
Default/AtomicAddrClean-op153 0.00294  519
Gradients/Default/network-TrainOneStepCell/network-WithLossCell/_backbone-AlexNet/conv1-Conv2d/gradConv2D/Conv2DBackpropFilter-op82 0.04572  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op38 0.00303  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op35 0.00162  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op46 0.34771  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op43 0.0028  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op54 0.78189  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op51 0.00276  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op61 0.02337  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op66 0.0318  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op71 0.02209  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op77 0.01652  519
Default/network-TrainOneStepCell/optimizer-Momentum/ApplyMomentum-op83 0.00769  519
Default/AssignAdd-op138 0.00148  519
total op  23.088094999999996 0
