The main reason u think this way is you are ignoring Swaping .
Take example = 6, 5, 4, 3, 2 ,1
since u find correct place using inersion sort then when u have to swap n-1 element in worst case.
place 6
place 5, 6 here one comparision and 1 swap
place 4, 5, 6 here two comparision and 2 swap( 5 comes at place of 6 and 65 shift right)
place 3, 4, 5, 6 here two comparision and 3 swap ...
in this way have to swap n-1 element for every insersion which take 1 + 2+3+4+5...= $n^2$
So total time = swap time + comparision
= $n^2$ + $nlogn$
= O($n^2$)