912 lines
29 KiB
Plaintext
912 lines
29 KiB
Plaintext
(Message inbox:32)
|
|
Date: Mon, 03 Jul 89 21:15:32 CET
|
|
From: V61%DHDURZ1.BITNET@lbl.gov
|
|
Subject: Flex, bug fix, improvments, patches for Minix & TOS
|
|
To: vern@lbl-csam.arpa
|
|
|
|
At first I have to thank you for your wonderful program. I had ported the
|
|
old version to OS9,TOS (Atari ST) and Minix and the new version 2.1 Beta
|
|
to Minix and TOS.
|
|
|
|
While porting and using flex I detected a bug and made some improvements.
|
|
I have included a shared, compressed and uuencoded file contaning all cdiffs
|
|
and additional files (Sorry, but I'm on EBCDIC-Bitnet) and a short discussion
|
|
of the changes. Even some of the TOS specific changes might be of general
|
|
interest !
|
|
|
|
I posted these cdiffs to the minix discussion group, but I think it's up
|
|
to you to post them to the unix-sources group. If you plan to post even
|
|
the TOS compiler specific patches please contact me because there might be
|
|
further compiler (P.D.) additions. If you have an interest I could also
|
|
port the new version to OS9 -- this is a little bit more difficult, because
|
|
OS9 uses CR as end of line character (the EOL char. is coded into the
|
|
initscan.c tables,...). It is necessary to change all occurences of '\n' to
|
|
macros and variables and it's useful to add a new -n options (see commented
|
|
line in main.c)
|
|
|
|
|
|
|
|
The changes: (1.7.89 RAL)
|
|
|
|
- Bug fix: The original flex didn't like trailing spaces in exclusive start
|
|
condition lists ! If you add an trailing space to line 68 in scan.l
|
|
|
|
"%x SECT2 SECT2PROLOG SECT3 CODEBLOCK PICKUPDEF SC CARETISBOL NUM QUOTE "
|
|
|
|
you get a misleading error message:
|
|
|
|
"Syntax error at line 69: bad start condition list"
|
|
|
|
This bug can either be fixed in parse.y or in scan.l . I have chosen the
|
|
last because there the fix is minimal: Just change the rule (line 128)
|
|
|
|
"\n" to "{OPTWS}\n"
|
|
|
|
- Enhancements:
|
|
- new option "-?" that provides some help information about the other
|
|
flags (main.c)
|
|
- new option "-aTMPPATH" that allows a redefinition of the standard
|
|
path for the temporary file (this might be rather large >200k if
|
|
F,f options are selected). (main.c, flexdef.h (l.376))
|
|
- hexdump of illegal characters -- this proved to be a useful debugging
|
|
tool especialy if invisible control characters occur which weren't
|
|
covered by the rules. (scan.l fprintf statement line 129,...)
|
|
|
|
- Patches due to TOS
|
|
- General: TOS uses CR,LF as end of line char., Flex wants only a single
|
|
LF as EOL char. Therefore all I/O must be translated using f* calls.
|
|
This is done everywhere besides the YY_INPUT macro (flex.skel (scan.c),
|
|
line 31) that uses a low level 'read'. This should be definitly changed
|
|
to fread, so that all I/O calls occur on the same level.
|
|
- the short action_file_name has been "flexXXXXXX.tmp", but that's too
|
|
much for TOS,MSDOS ! I changed it to "flexXXXX.tmp" in main.c (patch
|
|
covered by the -a option additions)
|
|
- some compilers don't like external names that are ambiguous within
|
|
the first 8 characters. I defined macros that change all these long
|
|
external names to names that are unique within the first 8 characters.
|
|
Just define SHORT_EXTERNAL_NAMES to use this feature (flexdef.h)
|
|
- some statement changes that some compiler don't like:
|
|
typedef *xxx[] -> typedef **xxx (flexdef.h.,l.308)
|
|
"/*" -> '/','*' within a comment in (scan.l, l.209)
|
|
- changed short "lexyy.c" to "lex_yy.c" what's more similar to the unix
|
|
"lex.yy.c" (main.c).
|
|
- a few further really compiler dependent changes provided with
|
|
#ifdef ATARI && LATTICE res. TURBO braces.
|
|
|
|
- Additional TOS only files
|
|
- Makefile.tos: Common makefile for all TOS compilers. If you add further
|
|
ones please email me the new makefile.
|
|
- flex.lnk: Lattice - GST linker argument extension file
|
|
- flex.tlk: Turbo linker argument extension file
|
|
|
|
|
|
Additional remarks:
|
|
|
|
I didn't add a new initscan.c (= flex -ist scan.l). The current one is good
|
|
enough for a first compilation. With this first version of flex you can
|
|
rebuild your own scan.c and the final flex version !
|
|
|
|
Minix ST :
|
|
- I had to "chmem =70000 cv" (>50000) to get flex linked
|
|
- 'memset' (PC 1.3, EFTH40,...) is necessary
|
|
- chmem =90000 flex may be sufficient
|
|
|
|
Minix PC :
|
|
It should be possible to port Flex to Minix PC. The current sizes of flex
|
|
are:
|
|
Minix ST (ACK) Lattice (TOS) Turbo (TOS)
|
|
|
|
size 75300 83305 57957
|
|
compilation time 22' 15' 3'40"
|
|
flex -is scan.l 1'49" 43" 30"
|
|
|
|
The Minix ST size includes the bad generated code using only a subset of
|
|
the 68000 commands, long addresses only and a huge relocation table.
|
|
Therefore the PC size will be <64 k ! More serious is the fact that I had
|
|
to chmem =90000 flex to get scan.l converted to scan.c . But I never saw
|
|
a more complex lex source than scan.l -- so it should be possible to
|
|
reduce some array sizes without limitation for all day usage.
|
|
|
|
No one volunteered yet for a Minix PC port -- but if someone will try it
|
|
I would provide him with a new scan.c and some hints.
|
|
|
|
TOS:
|
|
Don't forget to adapt the flexskel path within flexdef.h !
|
|
|
|
|
|
Bitnet: V61@DHDURZ1 Ronald Lamprecht
|
|
UUCP: ...!unido!DHDURZ1.bitnet!V61 Theoretische Physik
|
|
ARPAnet: V61%DHDURZ1.BITNET@CUNYVM.CUNY.EDU (Heidelberg, West Germany)
|
|
(Message inbox:36)
|
|
Date: Wed, 05 Jul 89 21:16:07 CET
|
|
From: V61%DHDURZ1.BITNET@csa2.lbl.gov
|
|
Subject: Re: What is TOS
|
|
To: vern@lbl-csam.arpa
|
|
|
|
TOS is the name of the Atari ST operating system that is very similar
|
|
to MSDOS (Both use CR,LF as end of line character). Therefore I have
|
|
been astonished that no EOL convertion porblems occur within MSDOS.
|
|
|
|
I have been aware of the double buffering when changing read to fread and I
|
|
accept your argument of a possible slow down. But if you integrate the other
|
|
Atari - TOS changes, please insert a
|
|
#ifdef ATARI
|
|
fread ....
|
|
#else
|
|
read ....
|
|
#endif
|
|
in flex.skel .
|
|
|
|
Bitnet: V61@DHDURZ1 Ronald Lamprecht
|
|
UUCP: ...!unido!DHDURZ1.bitnet!V61 Theoretische Physik
|
|
ARPAnet: V61%DHDURZ1.BITNET@CUNYVM.CUNY.EDU (Heidelberg, West Germany)
|
|
|
|
|
|
|
|
|
|
echo x - Makefile_cdiff
|
|
sed '/^X/s///' > Makefile_cdiff << '/'
|
|
X*** Src_2.1/Makefile Thu Jun 28 00:06:42 1989
|
|
X--- Makefile Thu Jul 3 02:12:48 1989
|
|
X***************
|
|
X*** 5,10 ****
|
|
X--- 5,11 ----
|
|
X # Porting considerations:
|
|
X #
|
|
X # For System V Unix machines, add -DSYS_V to CFLAGS.
|
|
X+ # For Minix (ST), add -DSYS_V to CFLAGS
|
|
X # For Vax/VMS, add -DSYS_V to CFLAGS.
|
|
X # For MS-DOS, add "-DMS_DOS -DSYS_V" to CFLAGS. Create \tmp if not present.
|
|
X # You will also want to rename flex.skel to something with a three
|
|
X***************
|
|
X*** 21,28 ****
|
|
X SKELETON_DIR = /usr/local/lib
|
|
X SKELETON_FILE = flex.skel
|
|
X SKELFLAGS = -DDEFAULT_SKELETON_FILE=\"$(SKELETON_DIR)/$(SKELETON_FILE)\"
|
|
X! CFLAGS = -O
|
|
X! LDFLAGS = -s
|
|
X
|
|
X FLEX_FLAGS =
|
|
X FLEX = ./flex
|
|
X--- 22,29 ----
|
|
X SKELETON_DIR = /usr/local/lib
|
|
X SKELETON_FILE = flex.skel
|
|
X SKELFLAGS = -DDEFAULT_SKELETON_FILE=\"$(SKELETON_DIR)/$(SKELETON_FILE)\"
|
|
X! CFLAGS = -O -DSYS_V
|
|
X! LDFLAGS =
|
|
X
|
|
X FLEX_FLAGS =
|
|
X FLEX = ./flex
|
|
X***************
|
|
X*** 57,63 ****
|
|
X yylex.c
|
|
X
|
|
X flex : $(FLEXOBJS)
|
|
X! $(CC) $(CFLAGS) -o flex $(LDFLAGS) $(FLEXOBJS)
|
|
X
|
|
X first_flex:
|
|
X cp initscan.c scan.c
|
|
X--- 58,65 ----
|
|
X yylex.c
|
|
X
|
|
X flex : $(FLEXOBJS)
|
|
X! $(CC) $(CFLAGS) -o flex $(FLEXOBJS) $(LDFLAGS)
|
|
X! chmem =150000 flex
|
|
X
|
|
X first_flex:
|
|
X cp initscan.c scan.c
|
|
/
|
|
echo x - flex.skel_cdif
|
|
sed '/^X/s///' > flex.skel_cdif << '/'
|
|
X*** Src_2.1/flex.skel Thu Jun 28 00:19:20 1989
|
|
X--- flex.skel Thu Jul 2 22:18:31 1989
|
|
X***************
|
|
X*** 28,34 ****
|
|
X * is returned in "result".
|
|
X */
|
|
X #define YY_INPUT(buf,result,max_size) \
|
|
X! if ( (result = read( fileno(yyin), buf, max_size )) < 0 ) \
|
|
X YY_FATAL_ERROR( "read() in flex scanner failed" );
|
|
X #define YY_NULL 0
|
|
X #define yyterminate() return ( YY_NULL )
|
|
X--- 28,34 ----
|
|
X * is returned in "result".
|
|
X */
|
|
X #define YY_INPUT(buf,result,max_size) \
|
|
X! if ( (result = fread( buf,1, max_size, yyin )) < 0 ) \
|
|
X YY_FATAL_ERROR( "read() in flex scanner failed" );
|
|
X #define YY_NULL 0
|
|
X #define yyterminate() return ( YY_NULL )
|
|
/
|
|
echo x - flexdef.h_cdif
|
|
sed '/^X/s///' > flexdef.h_cdif << '/'
|
|
X*** Src_2.1/flexdef.h Thu Jun 28 00:43:27 1989
|
|
X--- flexdef.h Thu Jul 3 02:45:50 1989
|
|
X***************
|
|
X*** 26,31 ****
|
|
X--- 26,40 ----
|
|
X
|
|
X /* @(#) $Header$ (LBL) */
|
|
X
|
|
X+ #ifdef ATARI
|
|
X+ #define SYS_V
|
|
X+ #define abs(x) ((x) < 0 ? -(x) : (x))
|
|
X+ #define SHORT_FILE_NAMES
|
|
X+ #ifdef TURBO
|
|
X+ #define SHORT_EXTERNAL_NAMES
|
|
X+ #endif
|
|
X+ #endif
|
|
X+
|
|
X #ifndef FILE
|
|
X #include <stdio.h>
|
|
X #endif
|
|
X***************
|
|
X*** 41,47 ****
|
|
X #endif
|
|
X
|
|
X #ifndef VMS
|
|
X! char *memset();
|
|
X #else
|
|
X /* memset is needed for old versions of the VMS C runtime library */
|
|
X #define memset(s, c, n) \
|
|
X--- 50,58 ----
|
|
X #endif
|
|
X
|
|
X #ifndef VMS
|
|
X! #ifndef ATARI && TURBO
|
|
X! char *memset();
|
|
X! #endif
|
|
X #else
|
|
X /* memset is needed for old versions of the VMS C runtime library */
|
|
X #define memset(s, c, n) \
|
|
X***************
|
|
X*** 81,91 ****
|
|
X--- 92,129 ----
|
|
X #define true 1
|
|
X #define false 0
|
|
X
|
|
X+ #ifdef ATARI
|
|
X+ #define DEFAULT_SKELETON_FILE "D:\\include\\flexskel"
|
|
X+ #endif
|
|
X+
|
|
X
|
|
X #ifndef DEFAULT_SKELETON_FILE
|
|
X #define DEFAULT_SKELETON_FILE "flex.skel"
|
|
X #endif
|
|
X
|
|
X+ #ifdef SHORT_EXTERNAL_NAMES
|
|
X+ /* avoid long external names that are ambiguous within the first 8 characters */
|
|
X+ #define current_mns c__mns
|
|
X+ #define current_max_rules c__max_rules
|
|
X+ #define current_max_state_type c__max_state_type
|
|
X+ #define current_max_scs c__max_scs
|
|
X+ #define current_max_dfa_size c__max__size
|
|
X+ #define current_max_xpairs c__max_xpairs
|
|
X+ #define current_max_template_xpairs c__max_template_xpairs
|
|
X+ #define current_max_dfas c__max_dfas
|
|
X+ #define current_maxccls c__maxccles
|
|
X+ #define current_max_ccl_tbl_size c__max_ccl_tbl_size
|
|
X+ #define indent_puts ind_puts
|
|
X+ #define indent_put2s ind_put2s
|
|
X+ #define gen_next_compressed_state gen_n_comressed_state
|
|
X+ #define gen_next_match gen_n_match
|
|
X+ #define gen_next_state gen_n_state
|
|
X+ #define variable_trailing_context_rules var_tr_context_rules
|
|
X+ #define variable_trailing_rule var_tr_rule
|
|
X+ #define backtrack_report backtr_report
|
|
X+ #define backtrack_file backtr_file
|
|
X+ #endif
|
|
X+
|
|
X /* special chk[] values marking the slots taking by end-of-buffer and action
|
|
X * numbers
|
|
X */
|
|
X***************
|
|
X*** 305,311 ****
|
|
X int int_val;
|
|
X } ;
|
|
X
|
|
X! typedef struct hash_entry *hash_table[];
|
|
X
|
|
X #define NAME_TABLE_HASH_SIZE 101
|
|
X #define START_COND_HASH_SIZE 101
|
|
X--- 343,349 ----
|
|
X int int_val;
|
|
X } ;
|
|
X
|
|
X! typedef struct hash_entry **hash_table;
|
|
X
|
|
X #define NAME_TABLE_HASH_SIZE 101
|
|
X #define START_COND_HASH_SIZE 101
|
|
X***************
|
|
X*** 372,378 ****
|
|
X extern int datapos, dataline, linenum;
|
|
X extern FILE *skelfile, *yyin, *temp_action_file, *backtrack_file;
|
|
X extern char *infilename;
|
|
X! extern char action_file_name[];
|
|
X
|
|
X
|
|
X /* variables for stack of states having only one out-transition:
|
|
X--- 410,416 ----
|
|
X extern int datapos, dataline, linenum;
|
|
X extern FILE *skelfile, *yyin, *temp_action_file, *backtrack_file;
|
|
X extern char *infilename;
|
|
X! extern char *action_file_name;
|
|
X
|
|
X
|
|
X /* variables for stack of states having only one out-transition:
|
|
/
|
|
echo x - main.c_cdiff
|
|
sed '/^X/s///' > main.c_cdiff << '/'
|
|
X*** Src_2.1/main.c Thu Jun 28 00:30:39 1989
|
|
X--- main.c Thu Jul 3 02:27:47 1989
|
|
X***************
|
|
X*** 81,96 ****
|
|
X FILE *temp_action_file;
|
|
X FILE *backtrack_file;
|
|
X int end_of_buffer_state;
|
|
X! #ifndef SHORT_FILE_NAMES
|
|
X! char action_file_name[] = "/tmp/flexXXXXXX";
|
|
X! #else
|
|
X! char action_file_name[] = "flexXXXXXX.tmp";
|
|
X! #endif
|
|
X!
|
|
X #ifndef SHORT_FILE_NAMES
|
|
X static char outfile[] = "lex.yy.c";
|
|
X #else
|
|
X! static char outfile[] = "lexyy.c";
|
|
X #endif
|
|
X static int outfile_created = 0;
|
|
X
|
|
X--- 81,91 ----
|
|
X FILE *temp_action_file;
|
|
X FILE *backtrack_file;
|
|
X int end_of_buffer_state;
|
|
X! char *action_file_name;
|
|
X #ifndef SHORT_FILE_NAMES
|
|
X static char outfile[] = "lex.yy.c";
|
|
X #else
|
|
X! static char outfile[] = "lex_yy.c";
|
|
X #endif
|
|
X static int outfile_created = 0;
|
|
X
|
|
X***************
|
|
X*** 328,333 ****
|
|
X--- 323,329 ----
|
|
X {
|
|
X int i, sawcmpflag, use_stdout;
|
|
X char *arg, *skelname = NULL, *flex_gettime(), clower(), *mktemp();
|
|
X+ char *tmp_action =(char *)0, *malloc();
|
|
X
|
|
X printstats = syntaxerror = trace = spprdflt = interactive = caseins = false;
|
|
X backtrack_report = performance_report = ddebug = fulltbl = fullspd = false;
|
|
X***************
|
|
X*** 349,354 ****
|
|
X--- 345,355 ----
|
|
X for ( i = 1; arg[i] != '\0'; ++i )
|
|
X switch ( arg[i] )
|
|
X {
|
|
X+ case 'a':
|
|
X+ if ( i != 1 )
|
|
X+ flexerror( "-a flag must be given separately" );
|
|
X+ tmp_action = &arg[i+1];
|
|
X+ goto get_next_arg;
|
|
X case 'b':
|
|
X backtrack_report = true;
|
|
X break;
|
|
X***************
|
|
X*** 445,452 ****
|
|
X printstats = true;
|
|
X break;
|
|
X
|
|
X! default:
|
|
X! lerrif( "unknown flag %c", (int) arg[i] );
|
|
X break;
|
|
X }
|
|
X
|
|
X--- 446,458 ----
|
|
X printstats = true;
|
|
X break;
|
|
X
|
|
X! case '?':
|
|
X! flexinfo(0);
|
|
X! break;
|
|
X!
|
|
X! default:
|
|
X! fprintf(stderr,"flex : unknown flag %c\n", (int) arg[i] );
|
|
X! flexinfo(1);
|
|
X break;
|
|
X }
|
|
X
|
|
X***************
|
|
X*** 454,459 ****
|
|
X--- 460,493 ----
|
|
X ;
|
|
X }
|
|
X
|
|
X+
|
|
X+ /* if you change the default tmp file names don't forget to change the
|
|
X+ initialization for i, too !
|
|
X+
|
|
X+ */
|
|
X+ #ifndef SHORT_FILE_NAMES
|
|
X+ i = 10;
|
|
X+ if (!tmp_action) i += 5;
|
|
X+ #else
|
|
X+ i = 12;
|
|
X+ #endif
|
|
X+ if (tmp_action)
|
|
X+ i += strlen(tmp_action) + 1;
|
|
X+ if((action_file_name = malloc(i+1)) == (char *)0)
|
|
X+ flexerror("No memory for action_file_name");
|
|
X+ *action_file_name = (char) NULL;
|
|
X+ if (tmp_action)
|
|
X+ strcat(action_file_name,tmp_action);
|
|
X+ #ifndef SHORT_FILE_NAMES
|
|
X+ else
|
|
X+ strcat(action_file_name,"/tmp");
|
|
X+ strcat(action_file_name,"/flexXXXXXX");
|
|
X+ #else
|
|
X+ if (tmp_action)
|
|
X+ strcat(action_file_name,"/");
|
|
X+ strcat(action_file_name,"flexXXXX.tmp");
|
|
X+ #endif
|
|
X+
|
|
X if ( (fulltbl || fullspd) && usemecs )
|
|
X flexerror( "full table and -cm don't make sense together" );
|
|
X
|
|
X***************
|
|
X*** 520,526 ****
|
|
X if ( (skelfile = fopen( skelname, "r" )) == NULL )
|
|
X lerrsf( "can't open skeleton file %s", skelname );
|
|
X
|
|
X! (void) mktemp( action_file_name );
|
|
X
|
|
X if ( (temp_action_file = fopen( action_file_name, "w" )) == NULL )
|
|
X lerrsf( "can't open temporary action file %s", action_file_name );
|
|
X--- 554,562 ----
|
|
X if ( (skelfile = fopen( skelname, "r" )) == NULL )
|
|
X lerrsf( "can't open skeleton file %s", skelname );
|
|
X
|
|
X! #ifndef ATARI && LATTICE
|
|
X! (void) mktemp( action_file_name );
|
|
X! #endif
|
|
X
|
|
X if ( (temp_action_file = fopen( action_file_name, "w" )) == NULL )
|
|
X lerrsf( "can't open temporary action file %s", action_file_name );
|
|
X***************
|
|
X*** 566,571 ****
|
|
X--- 602,640 ----
|
|
X }
|
|
X
|
|
X
|
|
X+ flexinfo(status)
|
|
X+ int status;
|
|
X+ {
|
|
X+ fprintf(stderr,"Syntax : FLEX inp_file\n");
|
|
X+ fprintf(stderr,"Function: fast lexical analyzer generator V%s\n",flex_version);
|
|
X+ fprintf(stderr,"Options : a dir_path : directory path for temporary files\n");
|
|
X+ fprintf(stderr," - b : generate backtracking information to lex.backtrack\n");
|
|
X+ fprintf(stderr," - c : compressed table, no equiv., no meta equiv.classes\n");
|
|
X+ fprintf(stderr," e : equivalence classes\n");
|
|
X+ fprintf(stderr," F : fast table\n");
|
|
X+ fprintf(stderr," |f : full table\n");
|
|
X+ fprintf(stderr," |m : meta equivalence classes\n");
|
|
X+ fprintf(stderr," - d : generate debugging scanner\n");
|
|
X+ fprintf(stderr," - F : fast table\n");
|
|
X+ fprintf(stderr," - f : full (not compressed) table\n");
|
|
X+ fprintf(stderr," - I : generate interactive scanner\n");
|
|
X+ fprintf(stderr," - i : generate case-insensitive scanner\n");
|
|
X+ fprintf(stderr," - L : supress #line directives\n");
|
|
X+ /* fprintf(stderr," - n hexnum : generate scanner using <hexnum> as newline char.\n");*/
|
|
X+ fprintf(stderr," - p : generate performance report to stderr\n");
|
|
X+ fprintf(stderr," - S skeleton_path : file path for skeleton file\n");
|
|
X+ fprintf(stderr," - s : suppress echo of unmatched scanner input to stdout\n");
|
|
X+ fprintf(stderr," - T : run flex in trace mode\n");
|
|
X+ #ifdef ATARI
|
|
X+ fprintf(stderr," - t : place result on stdout instead of lex_yy.c\n");
|
|
X+ #else
|
|
X+ fprintf(stderr," - t : place result on stdout instead of lex.yy.c\n");
|
|
X+ #endif
|
|
X+ fprintf(stderr," - v : print statistics of generated scanner\n");
|
|
X+ fprintf(stderr," default = -cem\n");
|
|
X+ exit(status);
|
|
X+ }
|
|
X+
|
|
X /* readin - read in the rules section of the input file(s)
|
|
X *
|
|
X * synopsis
|
|
/
|
|
echo x - scan.l_cdiff
|
|
sed '/^X/s///' > scan.l_cdiff << '/'
|
|
X*** Src_2.1/scan.l Thu Jun 30 19:42:00 1989
|
|
X--- scan.l Thu Jul 2 22:19:26 1989
|
|
X***************
|
|
X*** 125,132 ****
|
|
X
|
|
X {SCNAME} RETURNNAME;
|
|
X ^{OPTWS}\n ++linenum; /* allows blank lines in section 1 */
|
|
X! \n ++linenum; return ( '\n' );
|
|
X! . synerr( "illegal character" ); BEGIN(RECOVER);
|
|
X
|
|
X
|
|
X <C_COMMENT>"*/" ECHO; BEGIN(0);
|
|
X--- 125,136 ----
|
|
X
|
|
X {SCNAME} RETURNNAME;
|
|
X ^{OPTWS}\n ++linenum; /* allows blank lines in section 1 */
|
|
X! {OPTWS}\n ++linenum; return ( '\n' );
|
|
X! . {
|
|
X! synerr( "illegal character" );
|
|
X! fprintf(stderr,"Char : $%x\n",yytext[yyleng-1]);
|
|
X! BEGIN(RECOVER);
|
|
X! }
|
|
X
|
|
X
|
|
X <C_COMMENT>"*/" ECHO; BEGIN(0);
|
|
X***************
|
|
X*** 206,212 ****
|
|
X <SECT2>^{OPTWS}\n ++linenum; /* allow blank lines in section 2 */
|
|
X
|
|
X /* this horrible mess of a rule matches indented lines which
|
|
X! * do not contain "/*". We need to make the distinction because
|
|
X * otherwise this rule will be taken instead of the rule which
|
|
X * matches the beginning of comments like this one
|
|
X */
|
|
X--- 210,216 ----
|
|
X <SECT2>^{OPTWS}\n ++linenum; /* allow blank lines in section 2 */
|
|
X
|
|
X /* this horrible mess of a rule matches indented lines which
|
|
X! * do not contain '/','*'. We need to make the distinction because
|
|
X * otherwise this rule will be taken instead of the rule which
|
|
X * matches the beginning of comments like this one
|
|
X */
|
|
/
|
|
echo x - Makefile.tos
|
|
sed '/^X/s///' > Makefile.tos << '/'
|
|
X# make file for "flex" tool
|
|
X
|
|
X# @(#) $Header$ (LBL)
|
|
X
|
|
X# Porting considerations:
|
|
X#
|
|
X# For System V Unix machines, add -DSYS_V to CFLAGS.
|
|
X# For Vax/VMS, add -DSYS_V to CFLAGS.
|
|
X# For MS-DOS, add "-DMS_DOS -DSYS_V" to CFLAGS. Create \tmp if not present.
|
|
X# You will also want to rename flex.skel to something with a three
|
|
X# character extension, change SKELETON_FILE below appropriately,
|
|
X# For Amiga, add "-DAMIGA -DSYS_V" to CFLAGS.
|
|
X#
|
|
X# A long time ago, flex was successfully built using Microsoft C and
|
|
X# the following options: /AL, /stack:10000, -LARGE, -Ml, -Mt128, -DSYS_V
|
|
X
|
|
X
|
|
X# the first time around use "make first_flex"
|
|
X
|
|
X# The following definitions must be set according to your compiler -
|
|
X# examples for a Lattice Compiler with GST assembler and TURBO C with
|
|
X# assembler are provided below and must just be updated (don't forget to
|
|
X# update the linker argument extension files (*.lnk,*.tlk), too) :
|
|
X#
|
|
X#CCPATH = path to compiler directory without trailing \
|
|
X#CHPATH = path to header files without trailing \
|
|
X#CC = filename of the compiler
|
|
X#CFLAGS = compiler option flags
|
|
X#CIEXT = extension of C sources that should be used for input filenames
|
|
X#ASMPATH = path to assembler directory without trailing \
|
|
X#ASM = filename of the assembler
|
|
X#AFLAGS = assembler option flags
|
|
X#AIEXT = extension of assembler sources that should be used for assembler
|
|
X# input filenames
|
|
X#AEXT = general assembler filename extension
|
|
X#LNKPATH = path to linker directory without trailing \
|
|
X#LINK = filename of the linker
|
|
X#LFLAG0 = first option (full pathname of C startupcode)
|
|
X#LFLAG1 = further options + option flag for argument extension filename
|
|
X#LFLAG2 = further options + option flag for output-filename
|
|
X#LNKEXT = extension of linker argument extension file
|
|
X#OIEXT = extension of objects that should be used for linker input files
|
|
X#OEXT = general object file extension
|
|
X
|
|
X# Lattice definitions
|
|
XCCPATH = d:\latt
|
|
XCHPATH = d:\latt\include
|
|
XCC = lc.ttp
|
|
XCFLAGS = -h -n -cw -cc -i$(CHPATH)\ -g$(CCPATH)\ -dLATTICE -dATARI
|
|
XCIEXT =
|
|
XASMPATH = d:\gst
|
|
XASM = assem.ttp
|
|
XAFLAGS = -nolist -errors errors.out
|
|
XAIEXT =
|
|
XAEXT = .asm
|
|
XLNKPATH = d:\gst
|
|
XLINK = ld.ttp
|
|
XLFLAG0 =
|
|
XLFLAG1 = -with
|
|
XLFLAG2 = -nolist -sec -mem 200 -prog
|
|
XLNKEXT = .lnk
|
|
XOIEXT =
|
|
XOEXT = .bin
|
|
X
|
|
X# Turbo definitions
|
|
X#CCPATH = d:\turbo
|
|
X#CHPATH = d:\turbo\include
|
|
X#CC = tcc.prg
|
|
X#CFLAGS = -GJMPRZ -H=$(CHPATH)\ -w- -DTURBO -DATARI
|
|
X#CIEXT = .c
|
|
X#ASMPATH = d:\turbo
|
|
X#ASM = mas.prg
|
|
X#AFLAGS =
|
|
X#AIEXT = .s
|
|
X#AEXT = .s
|
|
X#LNKPATH = d:\turbo
|
|
X#LINK = tlink.ttp
|
|
X#LFLAG0 = $(LNKPATH)\lib\tcstart.o
|
|
X#LFLAG1 = -I=
|
|
X#LFLAG2 = -O=
|
|
X#LNKEXT = .tlk
|
|
X#OIEXT = .o
|
|
X#OEXT = .o
|
|
X
|
|
X# Other definitions
|
|
X# (not used for Atari because of short argument string - defined in flexdef.h
|
|
X
|
|
XSKELETON_DIR = /usr/lib
|
|
XSKELETON_FILE = flex.skel
|
|
XSKELFLAGS = -DDEFAULT_SKELETON_FILE=\"$(SKELETON_DIR)/$(SKELETON_FILE)\"
|
|
X
|
|
X
|
|
XFLEX = d:\etc\flex.ttp
|
|
XFLEX_FLAGS = -is
|
|
XYACC = d:\etc\yacc.ttp
|
|
XRENAME = d:\bin\rename
|
|
XDEL = d:\bin\del
|
|
X
|
|
X# Internal definitions
|
|
XLNK = $(LNKPATH)\$(LINK)
|
|
X
|
|
XFLEXOBJS = \
|
|
X ccl$(OEXT) \
|
|
X dfa$(OEXT) \
|
|
X ecs$(OEXT) \
|
|
X gen$(OEXT) \
|
|
X main$(OEXT) \
|
|
X misc$(OEXT) \
|
|
X nfa$(OEXT) \
|
|
X parse$(OEXT) \
|
|
X scan$(OEXT) \
|
|
X sym$(OEXT) \
|
|
X tblcmp$(OEXT) \
|
|
X yylex$(OEXT)
|
|
X
|
|
XFLEX_C_SOURCES = \
|
|
X ccl.c \
|
|
X dfa.c \
|
|
X ecs.c \
|
|
X gen.c \
|
|
X main.c \
|
|
X misc.c \
|
|
X nfa.c \
|
|
X parse.c \
|
|
X scan.c \
|
|
X sym.c \
|
|
X tblcmp.c \
|
|
X yylex.c
|
|
X
|
|
Xflex : $(FLEXOBJS)
|
|
X $(LNK) $(LFLAG0) $(LFLAG1)flex$(LNKEXT) $(LFLAG2)flex.ttp
|
|
X
|
|
Xfirst_flex:
|
|
X cp initscan.c scan.c
|
|
X make $(MFLAGS) flex
|
|
X
|
|
Xparse.h parse.c : parse.y
|
|
X $(YACC) -d parse.y
|
|
X $(DEL) parse.c
|
|
X $(RENAME) y_tab.c parse.c
|
|
X $(DEL) parse.h
|
|
X $(RENAME) y_tab.h parse.h
|
|
X
|
|
Xscan.c : scan.l
|
|
X $(FLEX) $(FLEX_FLAGS) scan.l
|
|
X $(RENAME) lex_yy.c scan.c
|
|
X
|
|
Xscan$(OEXT) : scan.c parse.h flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) scan$(CIEXT)
|
|
X
|
|
Xmain$(OEXT) : main.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) main$(CIEXT)
|
|
X
|
|
Xccl$(OEXT) : ccl.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) ccl$(CIEXT)
|
|
X
|
|
Xdfa$(OEXT) : dfa.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) dfa$(CIEXT)
|
|
X
|
|
Xecs$(OEXT) : ecs.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) ecs$(CIEXT)
|
|
X
|
|
Xgen$(OEXT) : gen.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) gen$(CIEXT)
|
|
X
|
|
Xmisc$(OEXT) : misc.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) misc$(CIEXT)
|
|
X
|
|
Xnfa$(OEXT) : nfa.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) nfa$(CIEXT)
|
|
X
|
|
Xparse$(OEXT) : parse.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) parse$(CIEXT)
|
|
X
|
|
Xsym$(OEXT) : sym.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) sym$(CIEXT)
|
|
X
|
|
Xtblcmp$(OEXT) : tblcmp.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) tblcmp$(CIEXT)
|
|
X
|
|
Xyylex$(OEXT) : yylex.c flexdef.h
|
|
X $(CCPATH)\$(CC) $(CFLAGS) yylex$(CIEXT)
|
|
X
|
|
Xflex.man : flex.1
|
|
X nroff -man flex.1 >flex.man
|
|
X
|
|
Xlint : $(FLEX_C_SOURCES)
|
|
X lint $(FLEX_C_SOURCES) > flex.lint
|
|
X
|
|
Xdistrib :
|
|
X mv scan.c initscan.c
|
|
X chmod 444 initscan.c
|
|
X $(MAKE) $(MFLAGS) clean
|
|
X
|
|
Xclean :
|
|
X rm -f core errs flex *$(OEXT) parse.c *.lint parse.h flex.man tags
|
|
X
|
|
Xtags :
|
|
X ctags $(FLEX_C_SOURCES)
|
|
X
|
|
Xvms : flex.man
|
|
X $(MAKE) $(MFLAGS) distrib
|
|
X
|
|
Xtest :
|
|
X $(FLEX) $(FLEX_FLAGS) scan.l
|
|
X $(RENAME) lex_yy.c scan.ctest
|
|
X cmp scan.c scan.ctest
|
|
X
|
|
/
|
|
echo x - Readme2
|
|
sed '/^X/s///' > Readme2 << '/'
|
|
XThe changes: (1.7.89 RAL)
|
|
X
|
|
X - Bug fix: The original flex didn't like trailing spaces in exclusive start
|
|
X condition lists ! If you add an trailing space to line 68 in scan.l
|
|
X
|
|
X "%x SECT2 SECT2PROLOG SECT3 CODEBLOCK PICKUPDEF SC CARETISBOL NUM QUOTE "
|
|
X
|
|
X you get a misleading error message:
|
|
X
|
|
X "Syntax error at line 69: bad start condition list"
|
|
X
|
|
X This bug can either be fixed in parse.y or in scan.l . I have chosen the
|
|
X last because there the fix is minimal: Just change the rule (line 128)
|
|
X
|
|
X "\n" to "{OPTWS}\n"
|
|
X
|
|
X - Enhancements:
|
|
X - new option "-?" that provides some help information about the other
|
|
X flags (main.c)
|
|
X - new option "-aTMPPATH" that allows a redefinition of the standard
|
|
X path for the temporary file (this might be rather large >200k if
|
|
X F,f options are selected). (main.c, flexdef.h (l.376))
|
|
X - hexdump of illegal characters -- this proved to be a useful debugging
|
|
X tool especialy if invisible control characters occur which weren't
|
|
X covered by the rules. (scan.l fprintf statement line 129,...)
|
|
X
|
|
X - Patches due to TOS
|
|
X - General: TOS uses CR,LF as end of line char., Flex wants only a single
|
|
X LF as EOL char. Therefore all I/O must be translated using f* calls.
|
|
X This is done everywhere besides the YY_INPUT macro (flex.skel (scan.c),
|
|
X line 31) that uses a low level 'read'. This should be definitly changed
|
|
X to fread, so that all I/O calls occur on the same level.
|
|
X - the short action_file_name has been "flexXXXXXX.tmp", but that's too
|
|
X much for TOS,MSDOS ! I changed it to "flexXXXX.tmp" in main.c (patch
|
|
X covered by the -a option additions)
|
|
X - some compilers don't like external names that are ambiguous within
|
|
X the first 8 characters. I defined macros that change all these long
|
|
X external names to names that are unique within the first 8 characters.
|
|
X Just define SHORT_EXTERNAL_NAMES to use this feature (flexdef.h)
|
|
X - some statement changes that some compiler don't like:
|
|
X typedef *xxx[] -> typedef **xxx (flexdef.h.,l.308)
|
|
X "/*" -> '/','*' within a comment in (scan.l, l.209)
|
|
X - changed short "lexyy.c" to "lex_yy.c" what's more similar to the unix
|
|
X "lex.yy.c" (main.c).
|
|
X - a few further really compiler dependent changes provided with
|
|
X #ifdef ATARI && LATTICE res. TURBO braces.
|
|
X
|
|
X - Additional TOS only files
|
|
X - Makefile.tos: Common makefile for all TOS compilers. If you add further
|
|
X ones please email me the new makefile.
|
|
X - flex.lnk: Lattice - GST linker argument extension file
|
|
X - flex.tlk: Turbo linker argument extension file
|
|
X
|
|
X
|
|
XAdditional remarks:
|
|
X
|
|
XI didn't add a new initscan.c (= flex -ist scan.l). The current one is good
|
|
Xenough for a first compilation. With this first version of flex you can
|
|
Xrebuild your own scan.c and the final flex version !
|
|
X
|
|
XMinix ST :
|
|
X - I had to "chmem =70000 cv" (>50000) to get flex linked
|
|
X - 'memset' (PC 1.3, EFTH40,...) is necessary
|
|
X - chmem =90000 flex may be sufficient
|
|
X
|
|
XMinix PC :
|
|
X It should be possible to port Flex to Minix PC. The current sizes of flex
|
|
X are:
|
|
X Minix ST (ACK) Lattice (TOS) Turbo (TOS)
|
|
X
|
|
X size 75300 83305 57957
|
|
X compilation time 22' 15' 3'40"
|
|
X flex -is scan.l 1'49" 43" 30"
|
|
X
|
|
X The Minix ST size includes the bad generated code using only a subset of
|
|
X the 68000 commands, long addresses only and a huge relocation table.
|
|
X Therefore the PC size will be <64 k ! More serious is the fact that I had
|
|
X to chmem =90000 flex to get scan.l converted to scan.c . But I never saw
|
|
X a more complex lex source than scan.l -- so it should be possible to
|
|
X reduce some array sizes without limitation for all day usage.
|
|
X
|
|
X No one volunteered yet for a Minix PC port -- but if someone will try it
|
|
X I would provide him with a new scan.c and some hints.
|
|
X
|
|
XTOS:
|
|
X Don't forget to adapt the flexskel path within flexdef.h !
|
|
X
|
|
X
|
|
/
|
|
echo x - flex.lnk
|
|
sed '/^X/s///' > flex.lnk << '/'
|
|
X*
|
|
X*
|
|
X* linker control file for flex.ttp
|
|
X*
|
|
X*
|
|
X*
|
|
XINPUT d:\latt\lib\startup.bin
|
|
X*
|
|
XINPUT ccl.bin
|
|
XINPUT dfa.bin
|
|
XINPUT ecs.bin
|
|
XINPUT gen.bin
|
|
XINPUT misc.bin
|
|
XINPUT nfa.bin
|
|
XINPUT parse.bin
|
|
XINPUT sym.bin
|
|
XINPUT tblcmp.bin
|
|
XINPUT main.bin
|
|
XINPUT yylex.bin
|
|
XINPUT scan.bin
|
|
X*
|
|
XLIBRARY d:\latt\lib\clib.bin
|
|
X
|
|
/
|
|
echo x - flex.tlk
|
|
sed '/^X/s///' > flex.tlk << '/'
|
|
Xccl.o
|
|
Xdfa.o
|
|
Xecs.o
|
|
Xgen.o
|
|
Xmisc.o
|
|
Xnfa.o
|
|
Xparse.o
|
|
Xsym.o
|
|
Xtblcmp.o
|
|
Xyylex.o
|
|
Xmain.o
|
|
Xscan.o
|
|
Xd:\turbo\lib\tcstdlib.lib ; standard lib
|
|
Xd:\turbo\lib\tcextlib.lib ; extended lib
|
|
Xd:\turbo\lib\tctoslib.lib ; TOS lib
|
|
Xd:\turbo\lib\tcgemlib.lib ; AES and VDI lib
|
|
X-S=200000
|
|
/
|