Searches for transverse momentum dependent flow vector fluctuations in Pb-Pb and p-Pb collisions at the LHC