[comp.os.os2.programmer] LONGNAMES

tholen@uhccux.uhcc.Hawaii.Edu (David Tholen) (02/07/91)

Does somebody have detailed information about the contents of an OS/2 EXE
header?  Microsoft LINK version 5.03 (bundled with FORTRAN version 5.0)
does not support the LONGNAMES statement in the module definition file.  To
enable long filename support for HPFS, I've considered two options:  (1) use
the OS/2 version 1.2 linker, or (2) continue using the Microsoft linker and
edit the executable file header to flip the necessary bits.  I'm a little
reluctant to use option (1) routinely, partly because the OS/2 version 1.2
documentation doesn't have anything for LINK (either on paper or in the
on-line command reference), and partly because of the possibility of some
subtle incompatibility with the FORTRAN version 5.0 .OBJ files (or should I
not be concerned about this possibility?).

To use option (2), I need to know which bits to flip.  I tried to determine
this information on my own by comparing the output from the Microsoft and
IBM linkers, but the .EXE files were of different sizes.  Next, I tried
comparing the .EXE files produced by only the IBM linker, one done with
LONGNAMES in a .DEF file and the other done without a .DEF file.  Four bytes
were different:  offset 20 (hex) went from 0 to 1, offset B7 went from 0 to
1, offset 88 went from CE to CF, and offset 8B went from F to 10 (an increase
of 1 in each case).  Whereas the 20 and B7 bytes were the same in the output
from the Microsoft linker, bytes 88 and 8B were not, so I don't know what to
change (other than to try simply incrementing those bytes by 1).  A little
bit of experimentation showed that I could get a FORTRAN program to accept
a long filename by changing only the B7 byte, but now I'm wondering what
effect the other three bytes have and whether I need not bother with them?

Can somebody advise me in this matter?

Dave Tholen
tholen@uhifa.ifa.hawaii.edu

jwh@bodwin.ifs.umich.edu (Jim Howe) (02/07/91)

In article <11355@uhccux.uhcc.Hawaii.Edu> tholen@uhccux.uhcc.Hawaii.Edu (David Tholen) writes:
>Does somebody have detailed information about the contents of an OS/2 EXE
>header?  

I can't completely answer your question but hopefully I can point you
in the right direction.  The bytes that hold the module flags are found
at offset 0Ch from the start of the New EXE header.  The location of the
New EXE header is a long value found at offset 3Ch from the start of the
file.  The module flags are contained in the two bytes at 0Ch past the
value found at 3Ch.  The value found at offset 8h from the start of the
New EXE header is the files CRC value.  When you change the module flags
this value will also change.  My linker (IBM v5.05) doesn't want to
accept LONGNAMES or NEWFILES (which is what my documentation says to use)
so I can't determine which bit in the module flags gets set when that
option is selected.  What version of the IBM linker are you using?

James W. Howe			   internet: jwh@ifs.umich.edu
University of Michigan             uucp:     uunet!mailrus!ifs.umich.edu!jwh
Ann Arbor, MI   48103-4943         

towfiq@FTP.COM (Mark Towfiq) (02/08/91)

In article <11355@uhccux.uhcc.Hawaii.Edu>
tholen@uhccux.uhcc.Hawaii.Edu (David Tholen) writes:

   Does somebody have detailed information about the contents of an OS/2 EXE
   header?

Yes...newexe.h is appended.

   To enable long filename support for HPFS, I've considered two options:
   (1) use the OS/2 version 1.2 linker

A good idea.

  (2) continue using the Microsoft linker and edit the executable file
  header to flip the necessary bits.

An OK idea.

And there is another option:

  (3) use an existing utility, usually called MARKEXE.EXE, to mark said bits.
  This is availble in the PMSDK, and also with the Hamilton C-Shell.

   I'm a little reluctant to use option (1) routinely,
   partly because the OS/2 version 1.2 documentation doesn't have
   anything for LINK (either on paper or in the on-line command
   reference), and partly because of the possibility of some subtle
   incompatibility with the FORTRAN version 5.0 .OBJ files (or should I
   not be concerned about this possibility?).

I would not be concerned about this, but I wouldn't delete the 5.03
linker either, in case you do find such a difference.

   To use option (2), I need to know which bits to flip.
   [Description of agonizing, but diligent and clever,
   reverse-engineering deleted].

Dave, this header file should straighten you out; I obtained it from
Microsoft OnLine.

/* newexe.h
 *	(C) Copyright Microsoft Corp 1984-1987
 *
 */

#define EMAGIC		0x5A4D		/* Old magic number */
#define ENEWEXE 	sizeof(struct exe_hdr)
					/* Value of E_LFARLC for new .EXEs */
#define ENEWHDR 	0x003C		/* Offset in old hdr. of ptr. to new */
#define ERESWDS 	0x0010		/* No. of reserved words (OLD) */
#define ERES2WDS	0x000A		/* No. of reserved words in e_res2 */
#define ECP		0x0004		/* Offset in struct of E_CP */
#define ECBLP		0x0002		/* Offset in struct of E_CBLP */
#define EMINALLOC	0x000A		/* Offset in struct of E_MINALLOC */
#define EKNOWEAS	0x0001		/* e_flags -program understands EAs */

struct exe_hdr				/* DOS 1, 2, 3 .EXE header */
  {
    unsigned short	e_magic;	/* Magic number */
    unsigned short	e_cblp; 	/* Bytes on last page of file */
    unsigned short	e_cp;		/* Pages in file */
    unsigned short	e_crlc; 	/* Relocations */
    unsigned short	e_cparhdr;	/* Size of header in paragraphs */
    unsigned short	e_minalloc;	/* Minimum extra paragraphs needed */
    unsigned short	e_maxalloc;	/* Maximum extra paragraphs needed */
    unsigned short	e_ss;		/* Initial (relative) SS value */
    unsigned short	e_sp;		/* Initial SP value */
    unsigned short	e_csum; 	/* Checksum */
    unsigned short	e_ip;		/* Initial IP value */
    unsigned short	e_cs;		/* Initial (relative) CS value */
    unsigned short	e_lfarlc;	/* File address of relocation table */
    unsigned short	e_ovno; 	/* Overlay number */
    unsigned long	e_sym_tab;	/* offset of symbol table file */
    unsigned short	e_flags;	/* old exe header flags  */
    unsigned short	e_res;		/* Reserved words */
    unsigned short	e_oemid;	/* OEM identifier (for e_oeminfo) */
    unsigned short	e_oeminfo;	/* OEM information; e_oemid specific */
    unsigned short	e_res2[ERES2WDS];/* Reserved words */
    long		e_lfanew;	/* File address of new exe header */
  };

#define E_MAGIC(x)	(x).e_magic
#define E_CBLP(x)	(x).e_cblp
#define E_CP(x) 	(x).e_cp
#define E_CRLC(x)	(x).e_crlc
#define E_CPARHDR(x)	(x).e_cparhdr
#define E_MINALLOC(x)	(x).e_minalloc
#define E_MAXALLOC(x)	(x).e_maxalloc
#define E_SS(x) 	(x).e_ss
#define E_SP(x) 	(x).e_sp
#define E_CSUM(x)	(x).e_csum
#define E_IP(x) 	(x).e_ip
#define E_CS(x) 	(x).e_cs
#define E_LFARLC(x)	(x).e_lfarlc
#define E_OVNO(x)	(x).e_ovno
#define E_SYM_TAB(x)	(x).e_sym_tab
#define E_FLAGS(x)	(x).e_flags
#define E_RES(x)	(x).e_res
#define E_OEMID(x)	(x).e_oemid
#define E_OEMINFO(x)	(x).e_oeminfo
#define E_RES2(x)	(x).e_res2
#define E_LFANEW(x)	(x).e_lfanew

#define NEMAGIC 	0x454E		/* New magic number */
#define NERESBYTES	8		/* Nine bytes reserved (now) */
#define NECRC		8		/* Offset into new header of NE_CRC */


struct new_exe				/* New .EXE header */
  {
    unsigned short	ne_magic;	/* Magic number NE_MAGIC */
    unsigned char	ne_ver; 	/* Version number */
    unsigned char	ne_rev; 	/* Revision number */
    unsigned short	ne_enttab;	/* Offset of Entry Table */
    unsigned short	ne_cbenttab;	/* Number of bytes in Entry Table */
    long		ne_crc; 	/* Checksum of whole file */
    unsigned short	ne_flags;	/* Flag word */
    unsigned short	ne_autodata;	/* Automatic data segment number */
    unsigned short	ne_heap;	/* Initial heap allocation */
    unsigned short	ne_stack;	/* Initial stack allocation */
    long		ne_csip;	/* Initial CS:IP setting */
    long		ne_sssp;	/* Initial SS:SP setting */
    unsigned short	ne_cseg;	/* Count of file segments */
    unsigned short	ne_cmod;	/* Entries in Module Reference Table */
    unsigned short	ne_cbnrestab;	/* Size of non-resident name table */
    unsigned short	ne_segtab;	/* Offset of Segment Table */
    unsigned short	ne_rsrctab;	/* Offset of Resource Table */
    unsigned short	ne_restab;	/* Offset of resident name table */
    unsigned short	ne_modtab;	/* Offset of Module Reference Table */
    unsigned short	ne_imptab;	/* Offset of Imported Names Table */
    long		ne_nrestab;	/* Offset of Non-resident Names Table */
    unsigned short	ne_cmovent;	/* Count of movable ent */
    unsigned short	ne_align;	/* Segment alignment shift count */
    unsigned short	ne_cres;	/* Count of resource entries */
    unsigned char	ne_exetyp;	/* Target operating system */
    unsigned char	ne_flagsothers; /* Other .EXE flags */
    char		ne_res[NERESBYTES];
					/* Pad structure to 64 bytes */
  };

#define NE_MAGIC(x)	    (x).ne_magic
#define NE_VER(x)	    (x).ne_ver
#define NE_REV(x)	    (x).ne_rev
#define NE_ENTTAB(x)	    (x).ne_enttab
#define NE_CBENTTAB(x)	    (x).ne_cbenttab
#define NE_CRC(x)	    (x).ne_crc
#define NE_FLAGS(x)	    (x).ne_flags
#define NE_AUTODATA(x)	    (x).ne_autodata
#define NE_HEAP(x)	    (x).ne_heap
#define NE_STACK(x)	    (x).ne_stack
#define NE_CSIP(x)	    (x).ne_csip
#define NE_SSSP(x)	    (x).ne_sssp
#define NE_CSEG(x)	    (x).ne_cseg
#define NE_CMOD(x)	    (x).ne_cmod
#define NE_CBNRESTAB(x)     (x).ne_cbnrestab
#define NE_SEGTAB(x)	    (x).ne_segtab
#define NE_RSRCTAB(x)	    (x).ne_rsrctab
#define NE_RESTAB(x)	    (x).ne_restab
#define NE_MODTAB(x)	    (x).ne_modtab
#define NE_IMPTAB(x)	    (x).ne_imptab
#define NE_NRESTAB(x)	    (x).ne_nrestab
#define NE_CMOVENT(x)	    (x).ne_cmovent
#define NE_ALIGN(x)	    (x).ne_align
#define NE_CRES(x)	    (x).ne_cres
#define NE_RES(x)	    (x).ne_res
#define NE_EXETYP(x)	    (x).ne_exetyp
#define NE_FLAGSOTHERS(x)   (x).ne_flagsothers

#define NE_USAGE(x)	(WORD)*((WORD *)(x)+1)
#define NE_PNEXTEXE(x)	(WORD)(x).ne_cbenttab
#define NE_ONEWEXE(x)	(WORD)(x).ne_crc
#define NE_PFILEINFO(x) (WORD)((DWORD)(x).ne_crc >> 16)


/*
 *  Target operating systems
 */

#define NE_UNKNOWN	0x0		/* Unknown (any "new-format" OS) */
#define NE_OS2		0x1		/* Microsoft/IBM OS/2 (default)  */
#define NE_WINDOWS	0x2		/* Microsoft Windows */
#define NE_DOS4 	0x3		/* Microsoft MS-DOS 4.x */
#define NE_DEV386	0x4		/* Microsoft Windows 386 */


/*
 *  Format of NE_FLAGS(x):
 *
 *  p					Not-a-process
 *   x					Unused
 *    e 				Errors in image
 *     x				Unused
 *	b				Bound as family app
 *	 ttt				Application type
 *	    f				Floating-point instructions
 *	     3				386 instructions
 *	      2 			286 instructions
 *	       0			8086 instructions
 *		P			Protected mode only
 *		 p			Per-process library initialization
 *		  i			Instance data
 *		   s			Solo data
 */
#define NENOTP		0x8000		/* Not a process */
#define NEIERR		0x2000		/* Errors in image */
#define NEBOUND 	0x0800		/* Bound as family app */
#define NEAPPTYP	0x0700		/* Application type mask */
#define NENOTWINCOMPAT	0x0100		/* Not compatible with P.M. Windowing */
#define NEWINCOMPAT	0x0200		/* Compatible with P.M. */
#define NEWINAPI	0x0300		/* Uses P.M. Windowing API */
#define NEFLTP		0x0080		/* Floating-point instructions */
#define NEI386		0x0040		/* 386 instructions */
#define NEI286		0x0020		/* 286 instructions */
#define NEI086		0x0010		/* 8086 instructions */
#define NEPROT		0x0008		/* Runs in protected mode only */
#define NEPPLI		0x0004		/* Per-Process Library Initialization */
#define NEINST		0x0002		/* Instance data */
#define NESOLO		0x0001		/* Solo data */


/*
 *  Format of NE_FLAGSOTHERS(x):
 *
 *	7 6 5 4 3 2 1 0  - bit no
 *		| | | |
 *		| | | +---------------- Support for EAs and Long filenames
 *		| | +------------------ Reserved for Win30
 *		| +-------------------- Reserved for Win30
 *		+---------------------- Reserved for Win30
 */

#define NENEWFILES	0x01	/* os/2 app understands eas and longnames */
#define NELONGNAMES	NENEWFILES
#define NEINFONT	0x02	/* 2.x app gets proportional font */
#define NEINPROT	0x04	/* 2.x app runs in 3.x prot mode  */
#define NEGANGLOAD 0x08 /* */

struct new_seg				/* New .EXE segment table entry */
  {
    unsigned short	ns_sector;	/* File sector of start of segment */
    unsigned short	ns_cbseg;	/* Number of bytes in file */
    unsigned short	ns_flags;	/* Attribute flags */
    unsigned short	ns_minalloc;	/* Minimum allocation in bytes */
  };

#define NS_SECTOR(x)	(x).ns_sector
#define NS_CBSEG(x)	(x).ns_cbseg
#define NS_FLAGS(x)	(x).ns_flags
#define NS_MINALLOC(x)	(x).ns_minalloc

/*
 *  Format of NS_FLAGS(x):
 *
 *  x				Unused
 *   h				Huge segment
 *    c 			32-bit code segment
 *     d			Discardable segment
 *	DD			I/O privilege level (286 DPL bits)
 *	  c			Conforming segment
 *	   r			Segment has relocations
 *	    e			Execute/read only
 *	     p			Preload segment
 *	      P 		Pure segment
 *	       m		Movable segment
 *		i		Iterated segment
 *		 ttt		Segment type
 */
#define NSTYPE		0x0007		/* Segment type mask */
#define NSCODE		0x0000		/* Code segment */
#define NSDATA		0x0001		/* Data segment */
#define NSITER		0x0008		/* Iterated segment flag */
#define NSMOVE		0x0010		/* Movable segment flag */
#define NSSHARED	0x0020		/* Shared segment flag */
#define NSPRELOAD	0x0040		/* Preload segment flag */
#define NSEXRD		0x0080		/* Execute-only (code segment), or
					*  read-only (data segment)
					*/
#define NSRELOC 	0x0100		/* Segment has relocations */
#define NSCONFORM	0x0200		/* Conforming segment */
#define NSEXPDOWN	0x0200		/* Data segment is expand down */
#define NSDPL		0x0C00		/* I/O privilege level (286 DPL bits) */
#define SHIFTDPL	10		/* Left shift count for */
#define NSDISCARD	0x1000		/* Segment is discardable */
#define NS32BIT 	0x2000		/* 32-bit code segment */
#define NSHUGE		0x4000		/* Huge memory segment, length of
					 * segment and minimum allocation
					 * size are in segment sector units
					 */
#define NSPURE		NSSHARED	/* For compatibility */

#define NSALIGN 9	/* Segment data aligned on 512 byte boundaries */

#define NSLOADED    0x0004	/* ns_sector field contains memory addr */

struct new_segdata			/* Segment data */
  {
    union
      {
	struct
	  {
	    unsigned short	ns_niter;	/* number of iterations */
	    unsigned short	ns_nbytes;	/* number of bytes */
	    char		ns_iterdata;	/* iterated data bytes */
	  } ns_iter;
	struct
	  {
	    char		ns_data;	/* data bytes */
	  } ns_noniter;
      } ns_union;
  };

struct new_rlcinfo			/* Relocation info */
  {
    unsigned short	nr_nreloc;	/* number of relocation items that */
  };					/* follow */

struct new_rlc				/* Relocation item */
  {
    char		nr_stype;	/* Source type */
    char		nr_flags;	/* Flag byte */
    unsigned short	nr_soff;	/* Source offset */
    union
      {
	struct
	  {
	    char	nr_segno;	/* Target segment number */
	    char	nr_res; 	/* Reserved */
	    unsigned short nr_entry;	/* Target Entry Table offset */
	  }		nr_intref;	/* Internal reference */
	struct
	  {
	    unsigned short nr_mod;	/* Index into Module Reference Table */
	    unsigned short nr_proc;	/* Procedure ordinal or name offset */
	  }		nr_import;	/* Import */
	struct
	  {
	    unsigned short nr_ostype;	/* OSFIXUP type */
	    unsigned short nr_osres;	/* reserved */
	  }		nr_osfix;	/* Operating system fixup */
      } 		nr_union;	/* Union */
  };

#define NR_STYPE(x)	(x).nr_stype
#define NR_FLAGS(x)	(x).nr_flags
#define NR_SOFF(x)	(x).nr_soff
#define NR_SEGNO(x)	(x).nr_union.nr_intref.nr_segno
#define NR_RES(x)	(x).nr_union.nr_intref.nr_res
#define NR_ENTRY(x)	(x).nr_union.nr_intref.nr_entry
#define NR_MOD(x)	(x).nr_union.nr_import.nr_mod
#define NR_PROC(x)	(x).nr_union.nr_import.nr_proc
#define NR_OSTYPE(x)	(x).nr_union.nr_osfix.nr_ostype
#define NR_OSRES(x)	(x).nr_union.nr_osfix.nr_osres

/*
 *  Format of NR_STYPE(x):
 *
 *  xxxxx				Unused
 *	 sss				Source type
 */
#define NRSTYP		0x0f		/* Source type mask */
#define NRSBYT		0x00		/* lo byte */
#define NRSSEG		0x02		/* 16-bit segment */
#define NRSPTR		0x03		/* 32-bit pointer */
#define NRSOFF		0x05		/* 16-bit offset */
#define NRSPTR48	0x0B		/* 48-bit pointer */
#define NRSOFF32	0x0D		/* 32-bit offset */

/*
 *  Format of NR_FLAGS(x):
 *
 *  xxxxx				Unused
 *	 a				Additive fixup
 *	  rr				Reference type
 */
#define NRADD		0x04		/* Additive fixup */
#define NRRTYP		0x03		/* Reference type mask */
#define NRRINT		0x00		/* Internal reference */
#define NRRORD		0x01		/* Import by ordinal */
#define NRRNAM		0x02		/* Import by name */
#define NRROSF		0x03		/* Operating system fixup */


/* Resource type or name string */
struct rsrc_string
    {
    char rs_len;	    /* number of bytes in string */
    char rs_string[ 1 ];    /* text of string */
    };

#define RS_LEN( x )    (x).rs_len
#define RS_STRING( x ) (x).rs_string

/* Resource type information block */
struct rsrc_typeinfo
    {
    unsigned short rt_id;
    unsigned short rt_nres;
    long rt_proc;
    };

#define RT_ID( x )   (x).rt_id
#define RT_NRES( x ) (x).rt_nres
#define RT_PROC( x ) (x).rt_proc

/* Resource name information block */
struct rsrc_nameinfo
    {
    /* The following two fields must be shifted left by the value of  */
    /* the rs_align field to compute their actual value.  This allows */
    /* resources to be larger than 64k, but they do not need to be    */
    /* aligned on 512 byte boundaries, the way segments are	      */
    unsigned short rn_offset;	/* file offset to resource data */
    unsigned short rn_length;	/* length of resource data */
    unsigned short rn_flags;	/* resource flags */
    unsigned short rn_id;	/* resource name id */
    unsigned short rn_handle;	/* If loaded, then global handle */
    unsigned short rn_usage;	/* Initially zero.  Number of times */
				/* the handle for this resource has */
				/* been given out */
    };

#define RN_OFFSET( x ) (x).rn_offset
#define RN_LENGTH( x ) (x).rn_length
#define RN_FLAGS( x )  (x).rn_flags
#define RN_ID( x )     (x).rn_id
#define RN_HANDLE( x ) (x).rn_handle
#define RN_USAGE( x )  (x).rn_usage

#define RSORDID     0x8000	/* if high bit of ID set then integer id */
				/* otherwise ID is offset of string from
				   the beginning of the resource table */

				/* Ideally these are the same as the */
				/* corresponding segment flags */
#define RNMOVE	    0x0010	/* Moveable resource */
#define RNPURE	    0x0020	/* Pure (read-only) resource */
#define RNPRELOAD   0x0040	/* Preloaded resource */
#define RNDISCARD   0xF000	/* Discard priority level for resource */

/* Resource table */
struct new_rsrc
    {
    unsigned short rs_align;	/* alignment shift count for resources */
    struct rsrc_typeinfo rs_typeinfo;
    };

#define RS_ALIGN( x ) (x).rs_align
--
Mark Towfiq, FTP Software, Inc.                                  towfiq@FTP.COM
Work No.: +1 617 246 0900			      Home No.: +1 617 488 2818

  "The Earth is but One Country, and Mankind its Citizens" -- Baha'u'llah