[news.software.anu-news] NEWS.ITEM file going bad

JHWELCH@AMHERST.BITNET (Jonathan_Welch) (10/13/89)

Our news.item file just went bad; when news is started one gets
a RMS error message about the REF field being invalid and some
large number.
     
Unfortunately it turns out that our news stuff has been on a disk
that wasn't being backed up every day so the best we can do
is get back a .item file from a few days ago.
     
It would be nice if there were some way to tell news to build
an item file by scanning the files in the message directories.
Has anyone done (or interested in doing) something like this?
     
Jonathan Welch
VAX Systems Programmer
     
Bitnet: JHWELCH@amherst

gih900@UUNET.UU.NET (Geoff Huston) (10/13/89)

>Our news.item file just went bad; when news is started one gets
>a RMS error message about the REF field being invalid and some
>large number.
>
>Unfortunately it turns out that our news stuff has been on a disk
>that wasn't being backed up every day so the best we can do
>is get back a .item file from a few days ago.
>
>It would be nice if there were some way to tell news to build
>an item file by scanning the files in the message directories.
>Has anyone done (or interested in doing) something like this?
     
     
Oddly enough the same type of situation happened here a month ago.
Yes, you can rebuild the item file...
     
    NEWS> ADD FILE NEWS_DEVICE:[000000...]*.ITM/RETRY
     
Just be warned that this may take all day (and even much of the night).
But it does get the stuff back into the file. The dates and sequence numbers
are reset, which means that all the users will see the same stuff again (which
is not a good thing), but I'm not sure I have the time to write a better
restoration routine at the moment.
     
Geoff Huston

GLASSMANN@CCAVAX.CAMB.COM (Lenny Glassmann) (10/13/89)

> In article <ANU-NEWS%89101212592253@NDSUVM1>,
>   Jonathan_Welch <JHWELCH@AMHERST.BITNET> writes:
> It would be nice if there were some way to tell news to build
> an item file by scanning the files in the message directories.
> Has anyone done (or interested in doing) something like this?
>
I've done this by creating a program which is stolen from NEWS' ADD FILE
command.  It reads all of the ITM files in the directory tree, and creates a
new NEWS.ITEMS file.  It runs in about 2 hours on a microVAX II with all of the
comp.* and news.* groups, plus a few others.  Also, it does NOT create new
newsitems, and therefore, everyone doesn't have to read everything again.  The
only information that is lost is the time the items were added to the database,
and any local expiration time that was set.  I built the program from NEWS
V5.8a, I hope the NEWS.ITEMS layout has not changed in V5.9.  Also, this
program expects NEWS.GROUPS to be intact.  Let me know if you want a copy of
this program.

KALASTAJA@cc.helsinki.fi (Teuvo Leinonen) (10/14/89)

In article <9164@ccavax.camb.com>, GLASSMANN@CCAVAX.CAMB.COM (Lenny Glassmann) writes:
> I've done this by creating a program which is stolen from NEWS' ADD FILE
> command.  It reads all of the ITM files in the directory tree, and creates a
> new NEWS.ITEMS file.  It runs in about 2 hours on a microVAX II with all of the
> comp.* and news.* groups, plus a few others.  Also, it does NOT create new
> newsitems, and therefore, everyone doesn't have to read everything again.  The
> only information that is lost is the time the items were added to the database,
> and any local expiration time that was set.  I built the program from NEWS
> V5.8a, I hope the NEWS.ITEMS layout has not changed in V5.9.  Also, this
> program expects NEWS.GROUPS to be intact.  Let me know if you want a copy of
> this program.

I have a duplicate key in my NEWS.ITEMS file. Messages like this appear in:
NEWS_MANAGER_DEV:<SKIMLOG>NEWSSKIM.LOG;992
Add <7770@cg-atla.UUCP> rec.music.misc: JUNK (Cannot add to Newsitem index file)
Add <7770@cg-atla.uucp> junk: REJECT (Cannot add to Newsitem index file)
Add <7771@cg-atla.UUCP> rec.boats: JUNK (Cannot add to Newsitem index file)
Add <7771@cg-atla.uucp> junk: REJECT (Cannot add to Newsitem index file)
Add <1075@uop.uop.EDU> comp.sys.ibm.pc: JUNK (Cannot add to Newsitem index file)
Add <1075@uop.uop.edu> junk: REJECT (Cannot add to Newsitem index file)
Add <1075@polari.UUCP> comp.lang.c: JUNK (Cannot add to Newsitem index file)
Add <1075@polari.uucp> junk: REJECT (Cannot add to Newsitem index file)

Is the only way to correct it to create a new version of NEWS.ITEMS file ?
In that case I would be interested in your program, would you kindly send it or
post it to this group.