Loading the nicematrix
package, the code
\begin{bNiceMatrix}[last-col,nullify-dots, margin]
& & & \\
\Cdots & A_j & \Cdots & i\\
& & &
\end{bNiceMatrix}
generates this:
Can I get the dotted lines to be replaced with solid lines to get something analogous to the following?