No, you got it right: COM files were raw binary dumps of code and data, a legacy from CP/M, whereas EXE files had the MZ magic number (for Mark Zbikowski) and enough data in the header to allow relocation.

Also, COM files in VMS are the equivalent of BAT files in MS-DOS and shell scripts in Unix-like OSes.