[news.software.b] How can I get my feed to send me a subset of the Full News Feed?.

greyham@hades.ausonics.oz.au (Greyham Stoney) (08/02/90)

Is there a "standard" method of getting a feed site to only send a subset
of a full news feed to us?. We don't want to drop full heirarchys as we
can in the 'sys' file; for example there are an awful lot of groups under
comp that we don't want, but there's an awful lot we do too.

Is there any accepted way of providing a list of groups to send/not to send
other than having a massive sys file entry?. (under C news, B news, anything?).

							Greyham.
-- 
/*  Greyham Stoney:                            Australia: (02) 428 6476
 *  greyham@hades.ausonics.oz.au - Ausonics Pty Ltd, Lane Cove, Sydney, Oz.
 *		Neurone Server: Brain Cell not Responding.
 */

henry@zoo.toronto.edu (Henry Spencer) (08/02/90)

In article <783@hades.ausonics.oz.au> greyham@hades.ausonics.oz.au (Greyham Stoney) writes:
>Is there any accepted way of providing a list of groups to send/not to send
>other than having a massive sys file entry?. (under C news, B news, anything?).

Unfortunately, basically, no.  About the only consolation is that C News
generally has no limits on line length, which means that it doesn't object
to massive sys-file entries.  It even handles them moderately efficiently.
(This could be improved, and will be, in the next patch or two.)
-- 
The 486 is to a modern CPU as a Jules  | Henry Spencer at U of Toronto Zoology
Verne reprint is to a modern SF novel. |  henry@zoo.toronto.edu   utzoo!henry

brad@looking.on.ca (Brad Templeton) (08/03/90)

Yes, there is.  I have a whole system ready to go.  Unfortunately, they're
very busy at my main feed, and I wanted to do a live test before releasing
the code to the world.  I have been waiting for them to set it up. If it
takes much longer, I will have to get somebody else to do the live test.
-- 
Brad Templeton, ClariNet Communications Corp. -- Waterloo, Ontario 519/884-7473

bob@omni.com (Bob Weissman) (08/04/90)

In article <783@hades.ausonics.oz.au> greyham@hades.ausonics.oz.au (Greyham Stoney) writes:
>Is there a "standard" method of getting a feed site to only send a subset
>of a full news feed to us?. We don't want to drop full heirarchys as we
>can in the 'sys' file [...]

Yes.  Send an electronic mail message, or pick up the telephone and
make a call, to the news administrator of your news feed.  Ask him or
her to modify that system's sys file to send you only the hierarchies
and sub-hierarchies that you want.

Note that removing a newsgroup or hierarchy from YOUR sys file just
sticks all the articles in junk.  To save connect time, CPU time, and
disk space, you should stop unwanted articles at the source.

There really is still some need for human contact in this electronic
medium.  Fortunately.

-- 
Bob Weissman
Internet:	bob@omni.com
UUCP:		...!{apple,decwrl,pyramid,sgi,uunet}!omni!bob

news@brian386.uucp (News Administrator) (08/06/90)

In article <783@hades.ausonics.oz.au> greyham@hades.ausonics.oz.au (Greyham Stoney) writes:
>Is there a "standard" method of getting a feed site to only send a subset
>of a full news feed to us?. We don't want to drop full heirarchys as we
>can in the 'sys' file [...]
>

I got most of this idea from my feed, with Bnews at his site (I think), I
modified the idea for feeding my home site.  He uses a script file which
uses 'sed' to remove unwanted articles.  I used a script sorta like:
	sed -e '/\/amiga\//d' \
	    -e '/\/apple\//d' < togo > new.togo
        mv new.togo togo

This script was called local.procs and placed in the out.going/system
sub-directory.  Then all I had to do was add
	if [ -f local.procs ]
	then
		./local.procs
	fi
to the sendbatches file after the cd to the out.going/system sub-directory.
This is an easy kludge which is pretty quick, and seems to get quicker as
the sys line gets longer.  In the sys file, I now use
system:all
So no special processing is required in 'relaynews'.

	brian

marka@dmssyd.syd.dms.CSIRO.AU (Mark Andrews) (08/06/90)

In article <3372@borabora.omni.com> bob@borabora.omni.com (Bob Weissman) writes:
|In article <783@hades.ausonics.oz.au> greyham@hades.ausonics.oz.au (Greyham Stoney) writes:
|>Is there a "standard" method of getting a feed site to only send a subset
|>of a full news feed to us?. We don't want to drop full heirarchys as we
|>can in the 'sys' file [...]
|
|Yes.  Send an electronic mail message, or pick up the telephone and
|make a call, to the news administrator of your news feed.  Ask him or
|her to modify that system's sys file to send you only the hierarchies
|and sub-hierarchies that you want.
|
|Note that removing a newsgroup or hierarchy from YOUR sys file just
|sticks all the articles in junk.  To save connect time, CPU time, and
|disk space, you should stop unwanted articles at the source.
|
|There really is still some need for human contact in this electronic
|medium.  Fortunately.
|
|-- 
|Bob Weissman
|Internet:	bob@omni.com
|UUCP:		...!{apple,decwrl,pyramid,sgi,uunet}!omni!bob

Or you can post to news.software.b :-) 

I'm the news admin of the upstream site. Greyham was after someother
means than editing the sys file. Greyham was wanting to exclude some 183
newsgroups/heirachies from a full feed. I'd hate to think what my sys
file would be like if it was done there.

I'd done this sort of thing before so it was no problem, that time it
was to limit the long distance charges (Melbourne to Mackey, that's as
expensive as it comes inside Aus).

A little postprocessing with a shell script before batching works
wonders.

Mark.

jv@mh.nl (Johan Vromans) (08/06/90)

In article <1990Aug06.020843.10532@brian386.uucp> news@brian386.uucp (News Administrator) writes:

> In article <783@hades.ausonics.oz.au> greyham@hades.ausonics.oz.au (Greyham Stoney) writes:
> >Is there a "standard" method of getting a feed site to only send a subset
> >of a full news feed to us?. We don't want to drop full heirarchys as we
> >can in the 'sys' file [...]

I use a setup in which users send their .newsrc files to the server
system, and the server sends only those articles to the client for
which there are subscribed newsgroups. Effectivily cuts the amount of
data transmitted to below 10% for most sites, with a resolution per
newsgroup, not distribution.
I use this to feed some sites via UUCP.

It is one program, written in Perl, one line change to the sys file,
and a few lines in the hourly news daemon.
The current version has one bug: it does not take the "Path:" header
into account. This means you get a duplicate article for each article
you post yourself. Oh well.

Disclaimer: the program works for me, and may not do what *YOU* want
it to.

	Johan
-- 
Johan Vromans				       jv@mh.nl via internet backbones
Multihouse Automatisering bv		       uucp: ..!{uunet,hp4nl}!mh.nl!jv
Doesburgweg 7, 2803 PL Gouda, The Netherlands  phone/fax: +31 1820 62911/62500
------------------------ "Arms are made for hugging" -------------------------