Changing from two columns to one and back always start new page. Consequently using them usually introduce a lot of empty space at changing document formatting. Better is (to my opinion) manually split table in two (approximately equal) parts and inserts them successive into document as table*.
With use of the package stfloats is possible to put first part of table to the bottom of page (by use of the placement option [b] and second part to the top of the next page by the placement option [t] .
To make tables parts captions consistent, i.e. with the same figure number, use in the second table part before \caption the command \ContinuedFloattdefined in thecaption` package.
Beside this I recommend to use S column type (defined in sinuntx package) for coulns with numbers and for table environment use a tabularx by which is possible to prescribe beside table also column width. For the later is in the following MWE defined new command:
\newcolumntype{C}{>{\centering\arraybackslash}X} % centered version of "X" type
\newcommand\mcx[1]{\multicolumn{1}{C}{#1}}
for use in columns' headers:
\documentclass[conference]{IEEEtran}
\usepackage{booktabs, makecell, tabularx}
\newcolumntype{C}{>{\centering\arraybackslash}X} % centered version of "X" type
\newcommand\mcx[1]{\multicolumn{1}{C}{#1}}
\setlength{\extrarowheight}{1pt}
\usepackage{stfloats}
\usepackage{siunitx}
\usepackage{caption}
\usepackage{lipsum}
\begin{document}
\lipsum[1] % filler text
\begin{table*}[b]
\centering
\caption{My huge table}
\label{tab:hugetable}
\begin{tabularx}{\linewidth}{l *{10}{S[table-format=3.0]} c}
\toprule
labels
& \mcx{airplane} & \mcx{automobile} & \mcx{bird} & \mcx{cat} & \mcx{deer}
& \mcx{dog} & \mcx{frog} & \mcx{horse} & \mcx{ship} & \mcx{truck}
& accuracy \\
\midrule
airplane & 915 & 4 & 17 & 19 & 3 & 1 & 0 & 2 & 27 & 12 & 91.50\% \\
automobile & 8 & 934 & 3 & 4 & 0 & 0 & 3 & 0 & 10 & 38 & 93.40\% \\
bird & 60 & 1 & 813 & 37 & 19 & 23 & 30 & 10 & 7 & 0 & 81.30\% \\
cat & 18 & 1 & 34 & 746 & 25 & 113 & 37 & 18 & 8 & 0 & 74.60\% \\
deer & 24 & 1 & 38 & 33 & 809 & 19 & 44 & 29 & 2 & 1 & 80.90\% \\
\addlinespace
dog & 4 & 0 & 37 & 106 & 23 & 792 & 9 & 26 & 2 & 1 & 79.20\% \\
frog & 2 & 5 & 19 & 35 & 1 & 20 & 912 & 2 & 3 & 1 & 91.20\% \\
horse & 14 & 0 & 26 & 20 & 18 & 28 & 4 & 886 & 3 & 1 & 88.60\% \\
ship & 35 & 10 & 3 & 2 & 0 & 2 & 1 & 0 & 936 & 11 & 93.60\% \\
truck & 23 & 37 & 4 & 10 & 1 & 2 & 2 & 0 & 15 & 906 & 90.60\% \\
airplane & 915 & 4 & 17 & 19 & 3 & 1 & 0 & 2 & 27 & 12 & 91.50\% \\
automobile & 8 & 934 & 3 & 4 & 0 & 0 & 3 & 0 & 10 & 38 & 93.40\% \\
bird & 60 & 1 & 813 & 37 & 19 & 23 & 30 & 10 & 7 & 0 & 81.30\% \\
cat & 18 & 1 & 34 & 746 & 25 & 113 & 37 & 18 & 8 & 0 & 74.60\% \\
deer & 24 & 1 & 38 & 33 & 809 & 19 & 44 & 29 & 2 & 1 & 80.90\% \\
\addlinespace
dog & 4 & 0 & 37 & 106 & 23 & 792 & 9 & 26 & 2 & 1 & 79.20\% \\
frog & 2 & 5 & 19 & 35 & 1 & 20 & 912 & 2 & 3 & 1 & 91.20\% \\
horse & 14 & 0 & 26 & 20 & 18 & 28 & 4 & 886 & 3 & 1 & 88.60\% \\
ship & 35 & 10 & 3 & 2 & 0 & 2 & 1 & 0 & 936 & 11 & 93.60\% \\
truck & 23 & 37 & 4 & 10 & 1 & 2 & 2 & 0 & 15 & 906 & 90.60\% \\
airplane & 915 & 4 & 17 & 19 & 3 & 1 & 0 & 2 & 27 & 12 & 91.50\% \\
automobile & 8 & 934 & 3 & 4 & 0 & 0 & 3 & 0 & 10 & 38 & 93.40\% \\
bird & 60 & 1 & 813 & 37 & 19 & 23 & 30 & 10 & 7 & 0 & 81.30\% \\
cat & 18 & 1 & 34 & 746 & 25 & 113 & 37 & 18 & 8 & 0 & 74.60\% \\
deer & 24 & 1 & 38 & 33 & 809 & 19 & 44 & 29 & 2 & 1 & 80.90\% \\
\bottomrule
\multicolumn{12}{>{\footnotesize\itshape}r}{Continue on the next page}
\end{tabularx}
\end{table*}%
%
\begin{table*}[t]
\ContinuedFloat
\centering
\caption{My huge table (cont.)}
\begin{tabularx}{\linewidth}{l *{10}{S[table-format=3.0]} c}
\toprule
labels
& \mcx{airplane} & \mcx{automobile} & \mcx{bird} & \mcx{cat} & \mcx{deer}
& \mcx{dog} & \mcx{frog} & \mcx{horse} & \mcx{ship} & \mcx{truck}
& accuracy \\
\midrule
dog & 4 & 0 & 37 & 106 & 23 & 792 & 9 & 26 & 2 & 1 & 79.20\% \\
frog & 2 & 5 & 19 & 35 & 1 & 20 & 912 & 2 & 3 & 1 & 91.20\% \\
horse & 14 & 0 & 26 & 20 & 18 & 28 & 4 & 886 & 3 & 1 & 88.60\% \\
ship & 35 & 10 & 3 & 2 & 0 & 2 & 1 & 0 & 936 & 11 & 93.60\% \\
truck & 23 & 37 & 4 & 10 & 1 & 2 & 2 & 0 & 15 & 906 & 90.60\% \\
airplane & 915 & 4 & 17 & 19 & 3 & 1 & 0 & 2 & 27 & 12 & 91.50\% \\
automobile & 8 & 934 & 3 & 4 & 0 & 0 & 3 & 0 & 10 & 38 & 93.40\% \\
bird & 60 & 1 & 813 & 37 & 19 & 23 & 30 & 10 & 7 & 0 & 81.30\% \\
cat & 18 & 1 & 34 & 746 & 25 & 113 & 37 & 18 & 8 & 0 & 74.60\% \\
deer & 24 & 1 & 38 & 33 & 809 & 19 & 44 & 29 & 2 & 1 & 80.90\% \\
\addlinespace
dog & 4 & 0 & 37 & 106 & 23 & 792 & 9 & 26 & 2 & 1 & 79.20\% \\
frog & 2 & 5 & 19 & 35 & 1 & 20 & 912 & 2 & 3 & 1 & 91.20\% \\
horse & 14 & 0 & 26 & 20 & 18 & 28 & 4 & 886 & 3 & 1 & 88.60\% \\
ship & 35 & 10 & 3 & 2 & 0 & 2 & 1 & 0 & 936 & 11 & 93.60\% \\
truck & 23 & 37 & 4 & 10 & 1 & 2 & 2 & 0 & 15 & 906 & 90.60\% \\
airplane & 915 & 4 & 17 & 19 & 3 & 1 & 0 & 2 & 27 & 12 & 91.50\% \\
automobile & 8 & 934 & 3 & 4 & 0 & 0 & 3 & 0 & 10 & 38 & 93.40\% \\
bird & 60 & 1 & 813 & 37 & 19 & 23 & 30 & 10 & 7 & 0 & 81.30\% \\
cat & 18 & 1 & 34 & 746 & 25 & 113 & 37 & 18 & 8 & 0 & 74.60\% \\
deer & 24 & 1 & 38 & 33 & 809 & 19 & 44 & 29 & 2 & 1 & 80.90\% \\
\addlinespace
dog & 4 & 0 & 37 & 106 & 23 & 792 & 9 & 26 & 2 & 1 & 79.20\% \\
frog & 2 & 5 & 19 & 35 & 1 & 20 & 912 & 2 & 3 & 1 & 91.20\% \\
horse & 14 & 0 & 26 & 20 & 18 & 28 & 4 & 886 & 3 & 1 & 88.60\% \\
ship & 35 & 10 & 3 & 2 & 0 & 2 & 1 & 0 & 936 & 11 & 93.60\% \\
truck & 23 & 37 & 4 & 10 & 1 & 2 & 2 & 0 & 15 & 906 & 90.60\% \\
airplane & 915 & 4 & 17 & 19 & 3 & 1 & 0 & 2 & 27 & 12 & 91.50\% \\
automobile & 8 & 934 & 3 & 4 & 0 & 0 & 3 & 0 & 10 & 38 & 93.40\% \\
bird & 60 & 1 & 813 & 37 & 19 & 23 & 30 & 10 & 7 & 0 & 81.30\% \\
cat & 18 & 1 & 34 & 746 & 25 & 113 & 37 & 18 & 8 & 0 & 74.60\% \\
deer & 24 & 1 & 38 & 33 & 809 & 19 & 44 & 29 & 2 & 1 & 80.90\% \\
\addlinespace
dog & 4 & 0 & 37 & 106 & 23 & 792 & 9 & 26 & 2 & 1 & 79.20\% \\
frog & 2 & 5 & 19 & 35 & 1 & 20 & 912 & 2 & 3 & 1 & 91.20\% \\
horse & 14 & 0 & 26 & 20 & 18 & 28 & 4 & 886 & 3 & 1 & 88.60\% \\
ship & 35 & 10 & 3 & 2 & 0 & 2 & 1 & 0 & 936 & 11 & 93.60\% \\
truck & 23 & 37 & 4 & 10 & 1 & 2 & 2 & 0 & 15 & 906 & 90.60\% \\
\bottomrule
\end{tabularx}
\end{table*}
\lipsum % more filler text
\end{document}
