Commit 77fd6ed8 authored by David Peter's avatar David Peter
Browse files

Small change

parent 07f9f005
No preview for this file type
......@@ -62,7 +62,7 @@ Next, we look at knowledge distillation to improve the accuracy of multi-exit mo
\label{fig:multi_exit_opt_exit_model_with_without_dist.png}
\end{figure}
Finally, we look at the resource consumption of the multi-exit model. Of course, adding exit layers to an existing \gls{dnn} increases the memory requirements. In our case, the exits alone need \SI{123.92}{\kilo\nothing} parameters while the model itself without exits uses only \SI{75.71}{\kilo\nothing} parameters. This results in an increase in memory consumption of more than 2.5 times. This may be detrimental for some applications. However, with an increase in memory consumption comes more flexibility during the forward pass at runtime. \Fref{tab:exit_params_ops} shows the number of parameters and \gls{madds} for every exit as well as the cumulative number \gls{madds} to compute a prediction at certain exits. In the ideal case, more than two times the number of \gls{madds} can be save by using the prediction at exit 1 instead of passing the input through the whole model up to the final exit.
Finally, we look at the resource consumption of the multi-exit model. Of course, adding exit layers to an existing \gls{dnn} increases the memory requirements. In our case, the exits alone need \SI{123.92}{\kilo\nothing} parameters while the model itself without exits uses only \SI{75.71}{\kilo\nothing} parameters. This results in an increase in memory consumption of more than 2.5 times. This may be detrimental for some applications. However, with an increase in memory consumption comes more flexibility during the forward pass at runtime. \Fref{tab:exit_params_ops} shows the number of parameters and \gls{madds} for every exit as well as the cumulative number of \gls{madds} to compute a prediction at certain exits. In the ideal case, more than two times the number of \gls{madds} can be save by using the prediction at exit 1 instead of passing the input through the whole model up to the final exit.
\begin{table}
\begin{center}
\begin{tabular}{lccc}
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment