Yeah, you may be right.
What my thought is Memory overhead(in term of space) is the amount of main memory is wasted, which we could use for the process to fit in that memory part.
As the page table should present in main memory, which we use to find the frame no. So the size of the page table is total wastage for main memory space, hence memory overhead(in term of space).
But if we don't take page size correctly, then there could be internal fragmentation. Suppose if our process size is 12KB+1 Byte(extra) and page size = 1KB then, in this case, We have to give 1KB page to 1B of the process, and when this page goes in main memory we have total wastage of (1KB - 1B) of main memory space which we could use, this is also wastage and it is also memory overhead(in term of space).
But if see the overhead(in term of time) the whole paging process is overhead.