page@swan.ulowell.edu (Bob Page) (03/15/89)
Submitted-by: grwalter@watcgl.waterloo.edu (Fred Walter) Posting-number: Volume 89, Issue 44 Archive-name: editors/stevie35a.5 # This is a shell archive. # Remove everything above and including the cut line. # Then run the rest of the file through sh. #----cut here-----cut here-----cut here-----cut here----# #!/bin/sh # shar: Shell Archiver # Run the following text with /bin/sh to create: # regexp.c # search.c # This archive created: Tue Mar 14 14:42:24 1989 cat << \SHAR_EOF > regexp.c /* * NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE * * This is NOT the original regular expression code as written by * Henry Spencer. This code has been modified specifically for use * with the STEVIE editor, and should not be used apart from compiling * STEVIE. If you want a good regular expression library, get the * original code. The copyright notice that follows is from the * original. * * NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE * * * regcomp and regexec -- regsub and regerror are elsewhere * * Copyright (c) 1986 by University of Toronto. * Written by Henry Spencer. Not derived from licensed software. * * Permission is granted to anyone to use this software for any * purpose on any computer system, and to redistribute it freely, * subject to the following restrictions: * * 1. The author is not responsible for the consequences of use of * this software, no matter how awful, even if they arise * from defects in it. * * 2. The origin of this software must not be misrepresented, either * by explicit claim or by omission. * * 3. Altered versions must be plainly marked as such, and must not * be misrepresented as being the original software. * * Beware that some of this code is subtly aware of the way operator * precedence is structured in regular expressions. Serious changes in * regular-expression syntax might require a total rethink. * * $Log: regexp.c,v $ * Revision 1.2 88/04/28 08:09:45 tony * First modification of the regexp library. Added an external variable * 'reg_ic' which can be set to indicate that case should be ignored. * Added a new parameter to regexec() to indicate that the given string * comes from the beginning of a line and is thus eligible to match * 'beginning-of-line'. * */ #include "env.h" #ifdef MEGAMAX overlay "regexp" #endif #include <stdio.h> #include "regexp.h" #include "regmagic.h" /* * The "internal use only" fields in regexp.h are present to pass info from * compile to execute that permits the execute phase to run lots faster on * simple cases. They are: * * regstart char that must begin a match; '\0' if none obvious * reganch is the match anchored (at beginning-of-line only)? * regmust string (pointer into program) that match must include, or NULL * regmlen length of regmust string * * Regstart and reganch permit very fast decisions on suitable starting points * for a match, cutting down the work a lot. Regmust permits fast rejection * of lines that cannot possibly match. The regmust tests are costly enough * that regcomp() supplies a regmust only if the r.e. contains something * potentially expensive (at present, the only such thing detected is * or + * at the start of the r.e., which can involve a lot of backup). Regmlen is * supplied because the test in regexec() needs it and regcomp() is computing * it anyway. */ /* * Structure for regexp "program". This is essentially a linear encoding * of a nondeterministic finite-state machine (aka syntax charts or * "railroad normal form" in parsing technology). Each node is an opcode * plus a "next" pointer, possibly plus an operand. "Next" pointers of * all nodes except BRANCH implement concatenation; a "next" pointer with * a BRANCH on both ends of it is connecting two alternatives. (Here we * have one of the subtle syntax dependencies: an individual BRANCH (as * opposed to a collection of them) is never concatenated with anything * because of operator precedence.) The operand of some types of node is * a literal string; for others, it is a node leading into a sub-FSM. In * particular, the operand of a BRANCH node is the first node of the branch. * (NB this is *not* a tree structure: the tail of the branch connects * to the thing following the set of BRANCHes.) The opcodes are: */ /* definition number opnd? meaning */ #define END 0 /* no End of program. */ #define BOL 1 /* no Match "" at beginning of line. */ #define EOL 2 /* no Match "" at end of line. */ #define ANY 3 /* no Match any one character. */ #define ANYOF 4 /* str Match any character in this string. */ #define ANYBUT 5 /* str Match any character not in this * string. */ #define BRANCH 6 /* node Match this alternative, or the * next... */ #define BACK 7 /* no Match "", "next" ptr points backward. */ #define EXACTLY 8 /* str Match this string. */ #define NOTHING 9 /* no Match empty string. */ #define STAR 10 /* node Match this (simple) thing 0 or more * times. */ #define PLUS 11 /* node Match this (simple) thing 1 or more * times. */ #define OPEN 20 /* no Mark this point in input as start of * #n. */ /* OPEN+1 is number 1, etc. */ #define CLOSE 30 /* no Analogous to OPEN. */ /* * Opcode notes: * * BRANCH The set of branches constituting a single choice are hooked * together with their "next" pointers, since precedence prevents * anything being concatenated to any individual branch. The * "next" pointer of the last BRANCH in a choice points to the * thing following the whole choice. This is also where the * final "next" pointer of each individual branch points; each * branch starts with the operand node of a BRANCH node. * * BACK Normal "next" pointers all implicitly point forward; BACK * exists to make loop structures possible. * * STAR,PLUS '?', and complex '*' and '+', are implemented as circular * BRANCH structures using BACK. Simple cases (one character * per match) are implemented with STAR and PLUS for speed * and to minimize recursive plunges. * * OPEN,CLOSE ...are numbered at compile time. */ /* * A node is one char of opcode followed by two chars of "next" pointer. * "Next" pointers are stored as two 8-bit pieces, high order first. The * value is a positive offset from the opcode of the node containing it. * An operand, if any, simply follows the node. (Note that much of the * code generation knows about this implicit relationship.) * * Using two bytes for the "next" pointer is vast overkill for most things, * but allows patterns to get big without disasters. */ #define OP(p) (*(p)) #define NEXT(p) (((*((p)+1)&0377)<<8) + (*((p)+2)&0377)) #define OPERAND(p) ((p) + 3) /* * See regmagic.h for one further detail of program structure. */ /* * Utility definitions. */ #ifndef CHARBITS #define UCHARAT(p) ((int)*(unsigned char *)(p)) #else #define UCHARAT(p) ((int)*(p)&CHARBITS) #endif #define FAIL(m) { regerror(m); return(NULL); } #define ISMULT(c) ((c) == '*' || (c) == '+' || (c) == '?') #define META "^$.[()|?+*\\" /* * Flags to be passed up and down. */ #define HASWIDTH 01 /* Known never to match null string. */ #define SIMPLE 02 /* Simple enough to be STAR/PLUS operand. */ #define SPSTART 04 /* Starts with * or +. */ #define WORST 0 /* Worst case. */ #ifndef ORIGINAL /* * The following supports the ability to ignore case in searches. */ #include <ctype.h> int reg_ic = 0; /* set by callers to ignore case */ /* * mkup - convert to upper case IF we're doing caseless compares */ #define mkup(c) ((islower(c) && reg_ic) ? toupper(c) : (c)) #endif /* * Global work variables for regcomp(). */ static char *regparse; /* Input-scan pointer. */ static int regnpar; /* () count. */ static char regdummy; static char *regcode; /* Code-emit pointer; ®dummy = don't. */ static long regsize; /* Code size. */ /* * Forward declarations for regcomp()'s friends. */ #ifndef STATIC #define STATIC static #endif STATIC char *reg(); STATIC char *regbranch(); STATIC char *regpiece(); STATIC char *regatom(); STATIC char *regnode(); STATIC char *regnext(); STATIC void regc(); STATIC void reginsert(); STATIC void regtail(); STATIC void regoptail(); #ifdef STRCSPN STATIC int strcspn(); #endif /* - regcomp - compile a regular expression into internal code * * We can't allocate space until we know how big the compiled form will be, * but we can't compile it (and thus know how big it is) until we've got a * place to put the code. So we cheat: we compile it twice, once with code * generation turned off and size counting turned on, and once "for real". * This also means that we don't allocate space until we are sure that the * thing really will compile successfully, and we never have to move the * code and thus invalidate pointers into it. (Note that it has to be in * one piece because free() must be able to free it all.) * * Beware that the optimization-preparation code in here knows about some * of the structure of the compiled regexp. */ regexp * regcomp(exp) char *exp; { register regexp *r; register char *scan; register char *longest; register int len; int flags; /* extern char *malloc();*/ extern char *alloc(); if (exp == NULL) FAIL("NULL argument"); /* First pass: determine size, legality. */ regparse = exp; regnpar = 1; regsize = 0L; regcode = ®dummy; regc(MAGIC); if (reg(0, &flags) == NULL) return (NULL); /* Small enough for pointer-storage convention? */ if (regsize >= 32767L) /* Probably could be 65535L. */ FAIL("regexp too big"); /* Allocate space. */ /* r = (regexp *) malloc((unsigned) (sizeof(regexp) + regsize));*/ r = (regexp *) alloc((unsigned) (sizeof(regexp) + regsize)); if (r == NULL) FAIL("out of space"); /* Second pass: emit code. */ regparse = exp; regnpar = 1; regcode = r->program; regc(MAGIC); if (reg(0, &flags) == NULL) return (NULL); /* Dig out information for optimizations. */ r->regstart = '\0'; /* Worst-case defaults. */ r->reganch = 0; r->regmust = NULL; r->regmlen = 0; scan = r->program + 1; /* First BRANCH. */ if (OP(regnext(scan)) == END) { /* Only one top-level choice. */ scan = OPERAND(scan); /* Starting-point info. */ if (OP(scan) == EXACTLY) r->regstart = *OPERAND(scan); else if (OP(scan) == BOL) r->reganch++; /* * If there's something expensive in the r.e., find the longest * literal string that must appear and make it the regmust. Resolve * ties in favor of later strings, since the regstart check works * with the beginning of the r.e. and avoiding duplication * strengthens checking. Not a strong reason, but sufficient in the * absence of others. */ if (flags & SPSTART) { longest = NULL; len = 0; for (; scan != NULL; scan = regnext(scan)) if (OP(scan) == EXACTLY && strlen(OPERAND(scan)) >= len) { longest = OPERAND(scan); len = strlen(OPERAND(scan)); } r->regmust = longest; r->regmlen = len; } } return (r); } /* - reg - regular expression, i.e. main body or parenthesized thing * * Caller must absorb opening parenthesis. * * Combining parenthesis handling with the base level of regular expression * is a trifle forced, but the need to tie the tails of the branches to what * follows makes it hard to avoid. */ static char * reg(paren, flagp) int paren; /* Parenthesized? */ int *flagp; { register char *ret; register char *br; register char *ender; register int parno; int flags; *flagp = HASWIDTH; /* Tentatively. */ /* Make an OPEN node, if parenthesized. */ if (paren) { if (regnpar >= NSUBEXP) FAIL("too many ()"); parno = regnpar; regnpar++; ret = regnode(OPEN + parno); } else ret = NULL; /* Pick up the branches, linking them together. */ br = regbranch(&flags); if (br == NULL) return (NULL); if (ret != NULL) regtail(ret, br); /* OPEN -> first. */ else ret = br; if (!(flags & HASWIDTH)) *flagp &= ~HASWIDTH; *flagp |= flags & SPSTART; while (*regparse == '|') { regparse++; br = regbranch(&flags); if (br == NULL) return (NULL); regtail(ret, br); /* BRANCH -> BRANCH. */ if (!(flags & HASWIDTH)) *flagp &= ~HASWIDTH; *flagp |= flags & SPSTART; } /* Make a closing node, and hook it on the end. */ ender = regnode((paren) ? CLOSE + parno : END); regtail(ret, ender); /* Hook the tails of the branches to the closing node. */ for (br = ret; br != NULL; br = regnext(br)) regoptail(br, ender); /* Check for proper termination. */ if (paren && *regparse++ != ')') { FAIL("unmatched ()"); } else if (!paren && *regparse != '\0') { if (*regparse == ')') { FAIL("unmatched ()"); } else FAIL("junk on end");/* "Can't happen". */ /* NOTREACHED */ } return (ret); } /* - regbranch - one alternative of an | operator * * Implements the concatenation operator. */ static char * regbranch(flagp) int *flagp; { register char *ret; register char *chain; register char *latest; int flags; *flagp = WORST; /* Tentatively. */ ret = regnode(BRANCH); chain = NULL; while (*regparse != '\0' && *regparse != '|' && *regparse != ')') { latest = regpiece(&flags); if (latest == NULL) return (NULL); *flagp |= flags & HASWIDTH; if (chain == NULL) /* First piece. */ *flagp |= flags & SPSTART; else regtail(chain, latest); chain = latest; } if (chain == NULL) /* Loop ran zero times. */ (void) regnode(NOTHING); return (ret); } /* - regpiece - something followed by possible [*+?] * * Note that the branching code sequences used for ? and the general cases * of * and + are somewhat optimized: they use the same NOTHING node as * both the endmarker for their branch list and the body of the last branch. * It might seem that this node could be dispensed with entirely, but the * endmarker role is not redundant. */ static char * regpiece(flagp) int *flagp; { register char *ret; register char op; register char *next; int flags; ret = regatom(&flags); if (ret == NULL) return (NULL); op = *regparse; if (!ISMULT(op)) { *flagp = flags; return (ret); } if (!(flags & HASWIDTH) && op != '?') FAIL("*+ operand could be empty"); *flagp = (op != '+') ? (WORST | SPSTART) : (WORST | HASWIDTH); if (op == '*' && (flags & SIMPLE)) reginsert(STAR, ret); else if (op == '*') { /* Emit x* as (x&|), where & means "self". */ reginsert(BRANCH, ret); /* Either x */ regoptail(ret, regnode(BACK)); /* and loop */ regoptail(ret, ret); /* back */ regtail(ret, regnode(BRANCH)); /* or */ regtail(ret, regnode(NOTHING)); /* null. */ } else if (op == '+' && (flags & SIMPLE)) reginsert(PLUS, ret); else if (op == '+') { /* Emit x+ as x(&|), where & means "self". */ next = regnode(BRANCH); /* Either */ regtail(ret, next); regtail(regnode(BACK), ret); /* loop back */ regtail(next, regnode(BRANCH)); /* or */ regtail(ret, regnode(NOTHING)); /* null. */ } else if (op == '?') { /* Emit x? as (x|) */ reginsert(BRANCH, ret); /* Either x */ regtail(ret, regnode(BRANCH)); /* or */ next = regnode(NOTHING);/* null. */ regtail(ret, next); regoptail(ret, next); } regparse++; if (ISMULT(*regparse)) FAIL("nested *?+"); return (ret); } /* - regatom - the lowest level * * Optimization: gobbles an entire sequence of ordinary characters so that * it can turn them into a single node, which is smaller to store and * faster to run. Backslashed characters are exceptions, each becoming a * separate node; the code is simpler that way and it's not worth fixing. */ static char * regatom(flagp) int *flagp; { register char *ret; int flags; *flagp = WORST; /* Tentatively. */ switch (*regparse++) { case '^': ret = regnode(BOL); break; case '$': ret = regnode(EOL); break; case '.': ret = regnode(ANY); *flagp |= HASWIDTH | SIMPLE; break; case '[':{ register int class; register int classend; if (*regparse == '^') { /* Complement of range. */ ret = regnode(ANYBUT); regparse++; } else ret = regnode(ANYOF); if (*regparse == ']' || *regparse == '-') regc(*regparse++); while (*regparse != '\0' && *regparse != ']') { if (*regparse == '-') { regparse++; if (*regparse == ']' || *regparse == '\0') regc('-'); else { class = UCHARAT(regparse - 2) + 1; classend = UCHARAT(regparse); if (class > classend + 1) FAIL("invalid [] range"); for (; class <= classend; class++) regc(class); regparse++; } } else regc(*regparse++); } regc('\0'); if (*regparse != ']') FAIL("unmatched []"); regparse++; *flagp |= HASWIDTH | SIMPLE; } break; case '(': ret = reg(1, &flags); if (ret == NULL) return (NULL); *flagp |= flags & (HASWIDTH | SPSTART); break; case '\0': case '|': case ')': FAIL("internal urp"); /* Supposed to be caught earlier. */ /* break; Not Reached */ case '?': case '+': case '*': FAIL("?+* follows nothing"); /* break; Not Reached */ case '\\': if (*regparse == '\0') FAIL("trailing \\"); ret = regnode(EXACTLY); regc(*regparse++); regc('\0'); *flagp |= HASWIDTH | SIMPLE; break; default:{ register int len; register char ender; regparse--; len = strcspn(regparse, META); if (len <= 0) FAIL("internal disaster"); ender = *(regparse + len); if (len > 1 && ISMULT(ender)) len--; /* Back off clear of ?+* operand. */ *flagp |= HASWIDTH; if (len == 1) *flagp |= SIMPLE; ret = regnode(EXACTLY); while (len > 0) { regc(*regparse++); len--; } regc('\0'); } break; } return (ret); } /* - regnode - emit a node */ static char * /* Location. */ regnode(op) char op; { register char *ret; register char *ptr; ret = regcode; if (ret == ®dummy) { regsize += 3; return (ret); } ptr = ret; *ptr++ = op; *ptr++ = '\0'; /* Null "next" pointer. */ *ptr++ = '\0'; regcode = ptr; return (ret); } /* - regc - emit (if appropriate) a byte of code */ static void regc(b) char b; { if (regcode != ®dummy) *regcode++ = b; else regsize++; } /* - reginsert - insert an operator in front of already-emitted operand * * Means relocating the operand. */ static void reginsert(op, opnd) char op; char *opnd; { register char *src; register char *dst; register char *place; if (regcode == ®dummy) { regsize += 3; return; } src = regcode; regcode += 3; dst = regcode; while (src > opnd) *--dst = *--src; place = opnd; /* Op node, where operand used to be. */ *place++ = op; *place++ = '\0'; *place++ = '\0'; } /* - regtail - set the next-pointer at the end of a node chain */ static void regtail(p, val) char *p; char *val; { register char *scan; register char *temp; register int offset; if (p == ®dummy) return; /* Find last node. */ scan = p; for (;;) { temp = regnext(scan); if (temp == NULL) break; scan = temp; } if (OP(scan) == BACK) offset = scan - val; else offset = val - scan; *(scan + 1) = (char) ((offset >> 8) & 0377); *(scan + 2) = (char) (offset & 0377); } /* - regoptail - regtail on operand of first argument; nop if operandless */ static void regoptail(p, val) char *p; char *val; { /* "Operandless" and "op != BRANCH" are synonymous in practice. */ if (p == NULL || p == ®dummy || OP(p) != BRANCH) return; regtail(OPERAND(p), val); } /* * regexec and friends */ /* * Global work variables for regexec(). */ static char *reginput; /* String-input pointer. */ static char *regbol; /* Beginning of input, for ^ check. */ static char **regstartp; /* Pointer to startp array. */ static char **regendp; /* Ditto for endp. */ /* * Forwards. */ STATIC int regtry(); STATIC int regmatch(); STATIC int regrepeat(); #ifdef DEBUG int regnarrate = 0; void regdump(); STATIC char *regprop(); #endif /* - regexec - match a regexp against a string */ int regexec(prog, string, at_bol) register regexp *prog; register char *string; int at_bol; { register char *s; extern char *cstrchr(); /* Be paranoid... */ if (prog == NULL || string == NULL) { regerror("NULL parameter"); return (0); } /* Check validity of program. */ if (UCHARAT(prog->program) != MAGIC) { regerror("corrupted program"); return (0); } /* If there is a "must appear" string, look for it. */ if (prog->regmust != NULL) { s = string; while ((s = cstrchr(s, prog->regmust[0])) != NULL) { if (cstrncmp(s, prog->regmust, prog->regmlen) == 0) break; /* Found it. */ s++; } if (s == NULL) /* Not present. */ return (0); } /* Mark beginning of line for ^ . */ if (at_bol) regbol = string; /* is possible to match bol */ else regbol = NULL; /* we aren't there, so don't match it */ /* Simplest case: anchored match need be tried only once. */ if (prog->reganch) return (regtry(prog, string)); /* Messy cases: unanchored match. */ s = string; if (prog->regstart != '\0') /* We know what char it must start with. */ while ((s = cstrchr(s, prog->regstart)) != NULL) { if (regtry(prog, s)) return (1); s++; } else /* We don't -- general case. */ do { if (regtry(prog, s)) return (1); } while (*s++ != '\0'); /* Failure. */ return (0); } /* - regtry - try match at specific point */ static int /* 0 failure, 1 success */ regtry(prog, string) regexp *prog; char *string; { register int i; register char **sp; register char **ep; reginput = string; regstartp = prog->startp; regendp = prog->endp; sp = prog->startp; ep = prog->endp; for (i = NSUBEXP; i > 0; i--) { *sp++ = NULL; *ep++ = NULL; } if (regmatch(prog->program + 1)) { prog->startp[0] = string; prog->endp[0] = reginput; return (1); } else return (0); } /* - regmatch - main matching routine * * Conceptually the strategy is simple: check to see whether the current * node matches, call self recursively to see whether the rest matches, * and then act accordingly. In practice we make some effort to avoid * recursion, in particular by going through "ordinary" nodes (that don't * need to know whether the rest of the match failed) by a loop instead of * by recursion. */ static int /* 0 failure, 1 success */ regmatch(prog) char *prog; { register char *scan; /* Current node. */ char *next; /* Next node. */ extern char *strchr(); scan = prog; #ifdef DEBUG if (scan != NULL && regnarrate) fprintf(stderr, "%s(\n", regprop(scan)); #endif while (scan != NULL) { #ifdef DEBUG if (regnarrate) fprintf(stderr, "%s...\n", regprop(scan)); #endif next = regnext(scan); switch (OP(scan)) { case BOL: if (reginput != regbol) return (0); break; case EOL: if (*reginput != '\0') return (0); break; case ANY: if (*reginput == '\0') return (0); reginput++; break; case EXACTLY:{ register int len; register char *opnd; opnd = OPERAND(scan); /* Inline the first character, for speed. */ if (mkup(*opnd) != mkup(*reginput)) return (0); len = strlen(opnd); if (len > 1 && cstrncmp(opnd, reginput, len) != 0) return (0); reginput += len; } break; case ANYOF: if (*reginput == '\0' || strchr(OPERAND(scan), *reginput) == NULL) return (0); reginput++; break; case ANYBUT: if (*reginput == '\0' || strchr(OPERAND(scan), *reginput) != NULL) return (0); reginput++; break; case NOTHING: break; case BACK: break; case OPEN + 1: case OPEN + 2: case OPEN + 3: case OPEN + 4: case OPEN + 5: case OPEN + 6: case OPEN + 7: case OPEN + 8: case OPEN + 9:{ register int no; register char *save; no = OP(scan) - OPEN; save = reginput; if (regmatch(next)) { /* * Don't set startp if some later invocation of the same * parentheses already has. */ if (regstartp[no] == NULL) regstartp[no] = save; return (1); } else return (0); } /* break; Not Reached */ case CLOSE + 1: case CLOSE + 2: case CLOSE + 3: case CLOSE + 4: case CLOSE + 5: case CLOSE + 6: case CLOSE + 7: case CLOSE + 8: case CLOSE + 9:{ register int no; register char *save; no = OP(scan) - CLOSE; save = reginput; if (regmatch(next)) { /* * Don't set endp if some later invocation of the same * parentheses already has. */ if (regendp[no] == NULL) regendp[no] = save; return (1); } else return (0); } /* break; Not Reached */ case BRANCH:{ register char *save; if (OP(next) != BRANCH) /* No choice. */ next = OPERAND(scan); /* Avoid recursion. */ else { do { save = reginput; if (regmatch(OPERAND(scan))) return (1); reginput = save; scan = regnext(scan); } while (scan != NULL && OP(scan) == BRANCH); return (0); /* NOTREACHED */ } } break; case STAR: case PLUS:{ register char nextch; register int no; register char *save; register int min; /* * Lookahead to avoid useless match attempts when we know * what character comes next. */ nextch = '\0'; if (OP(next) == EXACTLY) nextch = *OPERAND(next); min = (OP(scan) == STAR) ? 0 : 1; save = reginput; no = regrepeat(OPERAND(scan)); while (no >= min) { /* If it could work, try it. */ if (nextch == '\0' || *reginput == nextch) if (regmatch(next)) return (1); /* Couldn't or didn't -- back up. */ no--; reginput = save + no; } return (0); } /* break; Not Reached */ case END: return (1); /* Success! */ /* break; Not Reached */ default: regerror("memory corruption"); return (0); /* break; Not Reached */ } scan = next; } /* * We get here only if there's trouble -- normally "case END" is the * terminating point. */ regerror("corrupted pointers"); return (0); } /* - regrepeat - repeatedly match something simple, report how many */ static int regrepeat(p) char *p; { register int count = 0; register char *scan; register char *opnd; scan = reginput; opnd = OPERAND(p); switch (OP(p)) { case ANY: count = strlen(scan); scan += count; break; case EXACTLY: while (mkup(*opnd) == mkup(*scan)) { count++; scan++; } break; case ANYOF: while (*scan != '\0' && strchr(opnd, *scan) != NULL) { count++; scan++; } break; case ANYBUT: while (*scan != '\0' && strchr(opnd, *scan) == NULL) { count++; scan++; } break; default: /* Oh dear. Called inappropriately. */ regerror("internal foulup"); count = 0; /* Best compromise. */ break; } reginput = scan; return (count); } /* - regnext - dig the "next" pointer out of a node */ static char * regnext(p) register char *p; { register int offset; if (p == ®dummy) return (NULL); offset = NEXT(p); if (offset == 0) return (NULL); if (OP(p) == BACK) return (p - offset); else return (p + offset); } #ifdef DEBUG STATIC char *regprop(); /* - regdump - dump a regexp onto stdout in vaguely comprehensible form */ void regdump(r) regexp *r; { register char *s; register char op = EXACTLY; /* Arbitrary non-END op. */ register char *next; extern char *strchr(); s = r->program + 1; while (op != END) { /* While that wasn't END last time... */ op = OP(s); printf("%2d%s", s - r->program, regprop(s)); /* Where, what. */ next = regnext(s); if (next == NULL) /* Next ptr. */ printf("(0)"); else printf("(%d)", (s - r->program) + (next - s)); s += 3; if (op == ANYOF || op == ANYBUT || op == EXACTLY) { /* Literal string, where present. */ while (*s != '\0') { putchar(*s); s++; } s++; } putchar('\n'); } /* Header fields of interest. */ if (r->regstart != '\0') printf("start `%c' ", r->regstart); if (r->reganch) printf("anchored "); if (r->regmust != NULL) printf("must have \"%s\"", r->regmust); printf("\n"); } /* - regprop - printable representation of opcode */ static char * regprop(op) char *op; { register char *p; static char buf[50]; (void) strcpy(buf, ":"); switch (OP(op)) { case BOL: p = "BOL"; break; case EOL: p = "EOL"; break; case ANY: p = "ANY"; break; case ANYOF: p = "ANYOF"; break; case ANYBUT: p = "ANYBUT"; break; case BRANCH: p = "BRANCH"; break; case EXACTLY: p = "EXACTLY"; break; case NOTHING: p = "NOTHING"; break; case BACK: p = "BACK"; break; case END: p = "END"; break; case OPEN + 1: case OPEN + 2: case OPEN + 3: case OPEN + 4: case OPEN + 5: case OPEN + 6: case OPEN + 7: case OPEN + 8: case OPEN + 9: sprintf(buf + strlen(buf), "OPEN%d", OP(op) - OPEN); p = NULL; break; case CLOSE + 1: case CLOSE + 2: case CLOSE + 3: case CLOSE + 4: case CLOSE + 5: case CLOSE + 6: case CLOSE + 7: case CLOSE + 8: case CLOSE + 9: sprintf(buf + strlen(buf), "CLOSE%d", OP(op) - CLOSE); p = NULL; break; case STAR: p = "STAR"; break; case PLUS: p = "PLUS"; break; default: regerror("corrupted opcode"); break; } if (p != NULL) (void) strcat(buf, p); return (buf); } #endif /* * The following is provided for those people who do not have strcspn() in * their C libraries. They should get off their butts and do something * about it; at least one public-domain implementation of those (highly * useful) string routines has been published on Usenet. */ #ifdef STRCSPN /* * strcspn - find length of initial segment of s1 consisting entirely * of characters not from s2 */ static int strcspn(s1, s2) char *s1; char *s2; { register char *scan1; register char *scan2; register int count; count = 0; for (scan1 = s1; *scan1 != '\0'; scan1++) { for (scan2 = s2; *scan2 != '\0';) /* ++ moved down. */ if (*scan1 == *scan2++) return (count); count++; } return (count); } #endif int cstrncmp(s1, s2, n) char *s1, *s2; int n; { char *p, *S1, *S2, *strsave(); int rval; if (!reg_ic) return (strncmp(s1, s2, n)); S1 = strsave(s1); S2 = strsave(s2); for (p = S1; *p; p++) if (islower(*p)) *p = toupper(*p); for (p = S2; *p; p++) if (islower(*p)) *p = toupper(*p); rval = strncmp(S1, S2, n); free(S1); free(S2); return rval; } char * cstrchr(s, c) char *s; char c; { char *p; for (p = s; *p; p++) { if (mkup(*p) == mkup(c)) return p; } return NULL; } SHAR_EOF cat << \SHAR_EOF > search.c /* * STEVIE - Simply Try this Editor for VI Enthusiasts * * Code Contributions By : Tim Thompson twitch!tjt * Tony Andrews onecom!wldrdg!tony * G. R. (Fred) Walter watmath!watcgl!grwalter */ #include "stevie.h" /* modified Henry Spencer's regular expression routines */ #include "regexp.h" #ifdef MEGAMAX overlay "search" #endif /* * This file contains various searching-related routines. These fall into * three groups: string searches (for /, ?, n, and N), character searches * within a single line (for f, F, t, T, etc), and "other" kinds of searches * like the '%' command, and 'word' searches. */ /* * String searches * * The actual searches are done using Henry Spencer's regular expression * library. */ #define BEGWORD "([^a-zA-Z0-9_]|^)" /* replaces "\<" in search strings */ #define ENDWORD "([^a-zA-Z0-9_]|$)" /* likewise replaces "\>" */ bool_t begword; /* does the search include a 'begin word' * match */ /* * mapstring(s) - map special backslash sequences */ static char * mapstring(s) register char *s; { static char ns[MAX_COLUMNS + 1]; register char *p; begword = FALSE; for (p = ns; *s; s++) { if ((*s == '(') || (*s == ')')) { *p++ = '\\'; *p++ = *s; continue; } if (*s != '\\') { /* not an escape */ *p++ = *s; continue; } switch (*++s) { case '/': *p++ = '/'; break; case '<': strcpy(p, BEGWORD); p += strlen(BEGWORD); begword = TRUE; break; case '>': strcpy(p, ENDWORD); p += strlen(ENDWORD); break; default: *p++ = '\\'; *p++ = *s; break; } } *p++ = NUL; return ns; } static LPtr * bcksearch(str) char *str; { static LPtr infile; register LPtr *p; regexp *prog; register char *s; register int i; bool_t want_start = (*str == '^'); /* looking for start of line? */ register char *match; /* make sure str isn't empty */ if (str == NULL || *str == NUL) return NULL; if ((prog = regcomp(str)) == NULL) { emsg("Invalid search string"); return NULL; } p = Curschar; dec(p); if (begword) /* so we don't get stuck on one match */ dec(p); i = (want_start) ? 0 : p->index; do { s = p->linep->s; if (regexec(prog, s, TRUE)) { /* match somewhere on line */ if (want_start) { /* could only have been one */ infile.linep = p->linep; infile.index = (int) (prog->startp[0] - s); free((char *) prog); return (&infile); } /* * Now, if there are multiple matches on this line, we have to * get the last one. Or the last one before the cursor, if we're * on that line. */ match = prog->startp[0]; while (regexec(prog, prog->endp[0], FALSE)) { if ((i >= 0) && ((prog->startp[0] - s) > i)) break; match = prog->startp[0]; } if ((i >= 0) && ((match - s) > i)) { i = -1; continue; } infile.linep = p->linep; infile.index = (int) (match - s); free((char *) prog); return (&infile); } i = -1; } while ((p = prevline(p)) != NULL); /* * If wrapscan isn't set, bag the search now */ if (!P(P_WS)) { free((char *) prog); return NULL; } /* search backward from the end of the file */ p = prevline(Fileend); do { s = p->linep->s; if (regexec(prog, s, TRUE)) { /* match somewhere on line */ if (want_start) { /* could only have been one */ infile.linep = p->linep; infile.index = (int) (prog->startp[0] - s); free((char *) prog); return (&infile); } /* * Now, if there are multiple matches on this line, we have to * get the last one. */ match = prog->startp[0]; while (regexec(prog, prog->endp[0], FALSE)) match = prog->startp[0]; infile.linep = p->linep; infile.index = (int) (match - s); free((char *) prog); return (&infile); } if (p->linep == Curschar->linep) break; } while ((p = prevline(p)) != NULL); free((char *) prog); return NULL; } static LPtr * fwdsearch(str) char *str; { static LPtr infile; LPtr *p; regexp *prog; bool_t want_start = (*str == '^'); /* looking for start of line? */ char *s; int i; if ((prog = regcomp(str)) == NULL) { emsg("Invalid search string"); return NULL; } p = Curschar; i = Curschar->index + 1; do { s = p->linep->s + i; i = 0; if (regexec(prog, s, i == 0)) { /* got a match */ /* * If we wanted the start of a line and we aren't really there, * then a match doesn't count. */ if (want_start && (s != p->linep->s)) continue; infile.linep = p->linep; infile.index = (int) (prog->startp[0] - p->linep->s); free((char *) prog); return (&infile); } } while ((p = nextline(p)) != NULL); /* * If wrapscan isn't set, then don't scan from the beginning of the file. * Just return failure here. */ if (!P(P_WS)) { free((char *) prog); return NULL; } /* search from the beginning of the file to Curschar */ for (p = Filemem; p != NULL; p = nextline(p)) { s = p->linep->s; if (regexec(prog, s, TRUE)) { /* got a match */ infile.linep = p->linep; infile.index = (int) (prog->startp[0] - s); free((char *) prog); return (&infile); } if (p->linep == Curschar->linep) break; } free((char *) prog); return (NULL); } static char *laststr = NULL; static int lastsdir; static LPtr * ssearch(dir, str) int dir; /* FORWARD or BACKWARD */ char *str; { LPtr *pos; reg_ic = P(P_IC); /* tell the regexp routines how to search */ if (laststr != str) { if (laststr != NULL) free(laststr); laststr = strsave(str); } lastsdir = dir; if (dir == BACKWARD) pos = bcksearch(mapstring(str)); else pos = fwdsearch(mapstring(str)); /* * This is kind of a kludge, but its needed to make 'beginning of word' * searches land on the right place. */ if (pos != NULL && begword) { if (pos->index != 0) pos->index += 1; } return pos; } bool_t dosearch(dir, str) int dir; char *str; { LPtr *p; if ((p = ssearch(dir, str)) == NULL) { msg("Pattern not found"); return (FALSE); } else { LPtr savep; cursupdate(); /* if we're backing up, we make sure the line we're on */ /* is on the screen. */ setpcmark(); *Curschar = savep = *p; cursupdate(); return (TRUE); } } void searchagain(dir) int dir; { if (laststr == NULL) beep(); else dosearch(dir, laststr); lastsdir = dir; } #define OTHERDIR(x) (((x) == FORWARD) ? BACKWARD : FORWARD) bool_t repsearch(flag) bool_t flag; { int dir = lastsdir; bool_t found; if (laststr == NULL) { beep(); return FALSE; } found = dosearch(flag ? OTHERDIR(lastsdir) : lastsdir, laststr); /* * We have to save and restore 'lastsdir' because it gets munged by * ssearch() and winds up saving the wrong direction from here if 'flag' * is true. */ lastsdir = dir; return (found); } /* * regerror - called by regexp routines when errors are detected. */ void regerror(s) char *s; { emsg(s); } /* * dosub(lp, up, cmd) * * Perform a substitution from line 'lp' to line 'up' using the * command pointed to by 'cmd' which should be of the form: * * /pattern/substitution/g * * The trailing 'g' is optional and, if present, indicates that multiple * substitutions should be performed on each line, if applicable. * The usual escapes are supported as described in the regexp docs. */ void dosub(lp, up, cmd) LPtr *lp, *up; char *cmd; { LINE *cp; char *pat, *sub; regexp *prog; int nsubs; bool_t do_all; /* do multiple substitutions per line */ int n; /* * If no range was given, do the current line. If only one line was * given, just do that one. */ if (lp->linep == NULL) *up = *lp = *Curschar; else { if (up->linep == NULL) *up = *lp; } pat = ++cmd; /* skip the initial '/' */ while (*cmd) { if (cmd[0] == '/' && cmd[-1] != '\\') { *cmd++ = NUL; break; } cmd++; } if (*pat == NUL) { emsg("NULL pattern specified"); return; } sub = cmd; do_all = FALSE; while (*cmd) { if (cmd[0] == '/' && cmd[-1] != '\\') { do_all = (cmd[1] == 'g'); *cmd++ = NUL; break; } cmd++; } reg_ic = P(P_IC); /* set "ignore case" flag appropriately */ if ((prog = regcomp(pat)) == NULL) { emsg("Invalid search string"); return; } nsubs = 0; ResetBuffers(); n = RowNumber(lp); cp = lp->linep; for (; cp != Fileend->linep && cp != NULL; cp = cp->next, n++) { if (regexec(prog, cp->s, TRUE)) { /* a match on this line */ char *ns, *sns, *p; /* * Save the line that was last changed for the final cursor * position (just like the real vi). */ Curschar->linep = cp; /* * Get some space for a temporary buffer to do the substitution * into. */ sns = ns = alloc(2048); *sns = NUL; p = cp->s; do { for (ns = sns; *ns; ns++); /* * copy up to the part that matched */ while (p < prog->startp[0]) *ns++ = *p++; regsub(prog, sub, ns); /* * continue searching after the match */ p = prog->endp[0]; } while (regexec(prog, p, FALSE) && do_all); for (ns = sns; *ns; ns++); /* * copy the rest of the line, that didn't match */ while (*p) *ns++ = *p++; *ns = NUL; AppendPositionToUndoUndobuff(0, n); AppendPositionToUndobuff(0, n); AppendToUndoUndobuff("c$"); AppendToUndobuff("c$"); AppendToUndoUndobuff(sns); AppendToUndobuff(cp->s); AppendToUndoUndobuff(ESC_STR); AppendToUndobuff(ESC_STR); free(cp->s); /* free the original line */ cp->s = strsave(sns); /* and save the modified str */ cp->size = strlen(cp->s) + 1; free(sns); /* free the temp buffer */ nsubs++; } if (cp == up->linep) break; } if (nsubs) { CHANGED; AppendPositionToUndoUndobuff(0, 1); AppendPositionToUndobuff(0, 1); updateNextscreen(NOT_VALID); /* need this to update LineSizes */ cursupdate(); beginline(TRUE); if (nsubs >= P(P_RP)) smsg("%d substitution%c", nsubs, (nsubs > 1) ? 's' : ' '); } else msg("No match"); free((char *) prog); } /* * doglob(cmd) * * Execute a global command of the form: * * g/pattern/X * * where 'x' is a command character, currently one of the following: * * d Delete all matching lines * p Print all matching lines * * The command character (as well as the trailing slash) is optional, and * is assumed to be 'p' if missing. */ void doglob(lp, up, cmd) LPtr *lp, *up; char *cmd; { LINE *cp; char *pat; regexp *prog; int ndone; char cmdchar = NUL; /* what to do with matching lines */ int nu = 0; int nuu = 0; /* * If no range was given, do every line. If only one line was given, just * do that one. */ if (lp->linep == NULL) { *lp = *Filemem; *up = *Fileend; } else { if (up->linep == NULL) *up = *lp; } pat = ++cmd; /* skip the initial '/' */ while (*cmd) { if (cmd[0] == '/' && cmd[-1] != '\\') { cmdchar = cmd[1]; *cmd++ = NUL; break; } cmd++; } if (cmdchar == NUL) cmdchar = 'p'; reg_ic = P(P_IC); /* set "ignore case" flag appropriately */ if (cmdchar != 'd' && cmdchar != 'p') { emsg("Invalid command character"); return; } if ((prog = regcomp(pat)) == NULL) { emsg("Invalid search string"); return; } msg(""); ndone = 0; nu = RowNumber(lp); if (cmdchar == 'd') { ResetBuffers(); nuu = nu; } cp = lp->linep; for (; cp != Fileend->linep && cp != NULL; cp = cp->next, nu++) { if (regexec(prog, cp->s, TRUE)) { /* a match on this line */ Curschar->linep = cp; Curschar->index = 0; switch (cmdchar) { case 'd': /* delete the line */ AppendPositionToUndoUndobuff(0, nuu); AppendToUndoUndobuff("dd"); if (buf1line() && (ndone == 0)) { AppendToUndobuff("a"); } else if (buf1line()) { AppendToUndobuff("j"); AppendToUndobuff("I"); } else if (cp->next == Fileend->linep) { AppendPositionToUndobuff(0, nu); AppendToUndobuff("o"); } else { AppendPositionToUndobuff(0, nu); AppendToUndobuff("O"); } AppendToUndobuff(cp->s); AppendToUndobuff(ESC_STR); delline(1, FALSE); break; case 'p': /* print the line */ if (P(P_NU)) { sprintf(IObuff, "%6d ", nu); outstr(IObuff); } prt_line(cp->s); outstr("\r\n"); break; } ndone++; } else if (cmdchar == 'd') { nuu++; } if (cp == up->linep) break; } if (ndone) { switch (cmdchar) { case 'd': AppendPositionToUndobuff(0, 1); updateNextscreen(NOT_VALID); cursupdate(); if (ndone >= P(P_RP)) smsg("%d fewer line%c", ndone, (ndone > 1) ? 's' : ' '); break; case 'p': wait_return(); break; } stuffReadbuff("^"); } else msg("No match"); free((char *) prog); } /* * Character Searches */ static char lastc = NUL; /* last character searched for */ static int lastcdir; /* last direction of character search */ static int lastctype; /* last type of search ("find" or "to") */ /* * searchc(c, dir, type) * * Search for character 'c', in direction 'dir'. If type is 0, move to the * position of the character, otherwise move to just before the char. */ bool_t searchc(c, dir, type) char c; int dir; int type; { LPtr save; save = *Curschar; /* save position in case we fail */ lastc = c; lastcdir = dir; lastctype = type; /* * On 'to' searches, skip one to start with so we can repeat searches in * the same direction and have it work right. */ if (type) (dir == FORWARD) ? oneright() : oneleft(); while ((dir == FORWARD) ? oneright() : oneleft()) { if (gchar(Curschar) == c) { if (type) (dir == FORWARD) ? oneleft() : oneright(); return TRUE; } } *Curschar = save; return FALSE; } bool_t crepsearch(flag) int flag; { int dir = lastcdir; int rval; if (lastc == NUL) return FALSE; rval = searchc(lastc, flag ? OTHERDIR(lastcdir) : lastcdir, lastctype); lastcdir = dir; /* restore dir., since it may have changed */ return rval; } /* * "Other" Searches */ /* * showmatch - move the cursor to the matching paren or brace */ LPtr * showmatch() { static LPtr pos; int (*move) (), inc(), dec(); char initc = gchar(Curschar); /* initial char */ char findc; /* terminating char */ char c; int count = 0; pos = *Curschar; /* set starting point */ switch (initc) { case '(': findc = ')'; move = inc; break; case ')': findc = '('; move = dec; break; case '{': findc = '}'; move = inc; break; case '}': findc = '{'; move = dec; break; case '[': findc = ']'; move = inc; break; case ']': findc = '['; move = dec; break; default: return (LPtr *) NULL; } while ((*move) (&pos) != -1) { /* until end of file */ c = gchar(&pos); if (c == initc) count++; else if (c == findc) { if (count == 0) return &pos; count--; } } return (LPtr *) NULL; /* never found it */ } /* * findfunc(dir) - Find the next function in direction 'dir' * * Return TRUE if a function was found. */ bool_t findfunc(dir) int dir; { LPtr *curr; curr = Curschar; do { curr = (dir == FORWARD) ? nextline(curr) : prevline(curr); if (curr != NULL && curr->linep->s[0] == '{') { setpcmark(); *Curschar = *curr; return TRUE; } } while (curr != NULL); return FALSE; } /* * The following routines do the word searches performed by the 'w', 'W', * 'b', 'B', 'e', and 'E' commands. */ /* * To perform these searches, characters are placed into one of three * classes, and transitions between classes determine word boundaries. * * The classes are: * * 0 - white space 1 - letters, digits, and underscore 2 - everything else */ static int stype; /* type of the word motion being performed */ #define C0(c) (((c) == ' ') || ((c) == '\t') || ((c) == NUL)) #define C1(c) (isalpha(c) || isdigit(c) || ((c) == '_')) /* * cls(c) - returns the class of character 'c' * * The 'type' of the current search modifies the classes of characters if a 'W', * 'B', or 'E' motion is being done. In this case, chars. from class 2 are * reported as class 1 since only white space boundaries are of interest. */ static int cls(c) char c; { if (C0(c)) return 0; if (C1(c)) return 1; /* * If stype is non-zero, report these as class 1. */ return (stype == 0) ? 2 : 1; } /* * fwd_word(pos, type) - move forward one word * * Returns the resulting position, or NULL if EOF was reached. */ LPtr * fwd_word(p, type) LPtr *p; int type; { static LPtr pos; int sclass = cls(gchar(p)); /* starting class */ pos = *p; stype = type; /* * We always move at least one character. */ if (inc(&pos) == -1) return NULL; if (sclass != 0) { while (cls(gchar(&pos)) == sclass) { if (inc(&pos) == -1) return NULL; } /* * If we went from 1 -> 2 or 2 -> 1, return here. */ if (cls(gchar(&pos)) != 0) return &pos; } /* We're in white space; go to next non-white */ while (cls(gchar(&pos)) == 0) { /* * We'll stop if we land on a blank line */ if (pos.index == 0 && pos.linep->s[0] == NUL) break; if (inc(&pos) == -1) return NULL; } return &pos; } /* * bck_word(pos, type) - move backward one word * * Returns the resulting position, or NULL if top-of-file was reached. */ LPtr * bck_word(p, type) LPtr *p; int type; { static LPtr pos; int sclass = cls(gchar(p)); /* starting class */ pos = *p; stype = type; if (dec(&pos) == -1) return NULL; /* * If we're in the middle of a word, we just have to back up to the start * of it. */ if (cls(gchar(&pos)) == sclass && sclass != 0) { /* * Move backward to start of the current word */ while (cls(gchar(&pos)) == sclass) { if (dec(&pos) == -1) return NULL; } inc(&pos); /* overshot - forward one */ return &pos; } /* * We were at the start of a word. Go back to the start of the prior * word. */ while (cls(gchar(&pos)) == 0) { /* skip any white space */ /* * We'll stop if we land on a blank line */ if (pos.index == 0 && pos.linep->s[0] == NUL) return &pos; if (dec(&pos) == -1) return NULL; } sclass = cls(gchar(&pos)); /* * Move backward to start of this word. */ while (cls(gchar(&pos)) == sclass) { if (dec(&pos) == -1) return NULL; } inc(&pos); /* overshot - forward one */ return &pos; } /* * end_word(pos, type) - move to the end of the word * * There is an apparent bug in the 'e' motion of the real vi. At least on the * System V Release 3 version for the 80386. Unlike 'b' and 'w', the 'e' * motion crosses blank lines. When the real vi crosses a blank line in an * 'e' motion, the cursor is placed on the FIRST character of the next * non-blank line. The 'E' command, however, works correctly. Since this * appears to be a bug, I have not duplicated it here. * * Returns the resulting position, or NULL if EOF was reached. */ LPtr * end_word(p, type) LPtr *p; int type; { static LPtr pos; int sclass = cls(gchar(p)); /* starting class */ pos = *p; stype = type; if (inc(&pos) == -1) return NULL; /* * If we're in the middle of a word, we just have to move to the end of * it. */ if (cls(gchar(&pos)) == sclass && sclass != 0) { /* * Move forward to end of the current word */ while (cls(gchar(&pos)) == sclass) { if (inc(&pos) == -1) return NULL; } dec(&pos); /* overshot - forward one */ return &pos; } /* * We were at the end of a word. Go to the end of the next word. */ while (cls(gchar(&pos)) == 0) { /* skip any white space */ if (inc(&pos) == -1) return NULL; } sclass = cls(gchar(&pos)); /* * Move forward to end of this word. */ while (cls(gchar(&pos)) == sclass) { if (inc(&pos) == -1) return NULL; } dec(&pos); /* overshot - forward one */ return &pos; } SHAR_EOF # End of shell archive exit 0 -- Bob Page, U of Lowell CS Dept. page@swan.ulowell.edu ulowell!page Have five nice days.