Some finite p-groups with central automorphism group of non-minimal order

We characterize finite p-groups of order up to p7 whose central automorphisms fixing the center element-wise are all inner.