The adiabatic interchange of the non-Abelian anyons is essential for performing topological quantum computation. The evolution of the system under such processes is governed by the non-Abelian Berry phase (matrix). This paper is primarily a study about the numerical calculation of the Berry matrix resulting from the adiabatic interchange of the non-Abelian anyons of the Kitaev honeycomb lattice model. The numerical results show strong agreement with the indirect predictions based on the effective field theory. The approach to the non-Abelian statistics presented here is direct and it allows to investigate the braiding properties of anyons for any configurations including those which may not be accessible through the effective theory. Moreover, the numerical method that we developed here is general enough to be used to study non-Abelian anyons in other models including the Yao-Kivelson model, square-octagon model and any other system with quadratic fermionic Hamiltonian.