On the numerical solution of a new type nonlinear matrix equation