3 ms·

This is my search engine for Usenet, currently only for the 1980s but I hope to have 2003 onwards searchable soon. I have about 2TB of news from 2003 which just

by zandorg 13y ago

This is my search engine for Usenet, currently only for the 1980s but I hope to have 2003 onwards searchable soon. I have about 2TB of news from 2003 which just needs indexing and uploading. http://www.dejadejadeja.com/10years/ http://www.dejadejadeja.com/10years/ My goal is to give people an alternative to 'Google Groups'. It's built on PHP and MySQL.

Steuard 13y ago
I take it you're missing the 90s? (Alas, most of my Usenet usage was between 1994 and 2003.)
- zandorg 13y ago
  It's not possible to get Usenet from the 90s, as it simply isn't archived. 80s is archived via Internet Archive and you can get 10 years worth from 2003 via Usenet king GigaNews. Google Groups has the 90s, but it's locked behind a 'Googlewall'.
  - mrottenkolber 13y ago
    > Google Groups has the 90s, but it's locked behind a 'Googlewall'. And I believe that is a crime against humanity.
  - infectoid 13y ago
    Don't know if I'm being silly here, but is it worth just asking them for it? I'm sure there is some sentimental types in Google that would be cool with what you're doing.
acuozzo 13y ago
Thanks for this. It looks awesome!!!
dredmorbius 13y ago
Once you've got this a bit more solid, I'd strongly urge you to submit this to HN.
- zandorg 13y ago
  I submitted it 2 days ago but it just dropped off the 'New' page...
  - dredmorbius 13y ago
    I'm not sure what the re-sub policy is, but do keep trying. I like this.
jliptzin 13y ago
Cool. But those are some damn ugly fonts.
acuozzo 13y ago
For his query: http://www.dejadejadeja.com/10years/query.php?body=Star+Wars&subject=&newsgroups=&email_from=&dateearly=&datelate=1983-01-01&minsize=&maxsize=&maxrows=100&orderby1=composeddate&orderby2=composedtime http://www.dejadejadeja.com/10years/query.php?body=Star+Wars... The top post is this: http://www.dejadejadeja.com/10years/getmsg.php?whichmsg=ixlpc.166 http://www.dejadejadeja.com/10years/getmsg.php?whichmsg=ixlp... It has a post date of: Wed Dec 15 10:30:01 1982, but is given as 1970-01-01 in the search results. I'm seeing lots of 1970-01-01 results. A bug, perhaps?
- zandorg 13y ago
  Yes, it can't handle all date formats, so it defaults to 0 which is Jan 1st 1970. It's easily fixable but I haven't got around to it yet.
recuter 13y ago
Where are you getting the newer Usenet archive from? Thanks for turning me on to the Archive.org's 'UTZoo archive', sadly it is only 1981-1991 and incomplete. What a shame. :(
- zandorg 13y ago
  I get the news from 2003 to present from GigaNews. I have about 2TB of it. That period is not indexed, so you can only search 1981-1991. When I get a 4TB drive (soon I hope) I'll make the 2003 stuff searchable.
tomphoolery 13y ago
> It's built on PHP and MySQL. And Comic Sans... :P
glanch 13y ago
Kind of random, but I just checked out your site, typed in the first "1980s" thing that came to mind (Walter Payton) and really enjoyed reading this New England Patriots fan's post sizing up his teams chances against the Chicago Bears in the upcoming Super Bowl: http://www.dejadejadeja.com/10years/getmsg.php?whichmsg=%3C417@decwrl.DEC.COM%3E http://www.dejadejadeja.com/10years/getmsg.php?whichmsg=%3C4... The Bears would crush the Patriots and win that game easily. I guess this might seem weird to some of you, but I grew up in the 90s and this game was one of the only iconic 80s moments that stood out to me. Thanks for building the site. It's neat.

by zandorg 13y ago

Steuard 13y ago

I take it you're missing the 90s? (Alas, most of my Usenet usage was between 1994 and 2003.)

zandorg 13y ago
It's not possible to get Usenet from the 90s, as it simply isn't archived. 80s is archived via Internet Archive and you can get 10 years worth from 2003 via Usenet king GigaNews. Google Groups has the 90s, but it's locked behind a 'Googlewall'.
- mrottenkolber 13y ago
  > Google Groups has the 90s, but it's locked behind a 'Googlewall'. And I believe that is a crime against humanity.
- infectoid 13y ago
  Don't know if I'm being silly here, but is it worth just asking them for it? I'm sure there is some sentimental types in Google that would be cool with what you're doing.

acuozzo 13y ago

Thanks for this. It looks awesome!!!

dredmorbius 13y ago

Once you've got this a bit more solid, I'd strongly urge you to submit this to HN.

zandorg 13y ago
I submitted it 2 days ago but it just dropped off the 'New' page...
- dredmorbius 13y ago
  I'm not sure what the re-sub policy is, but do keep trying. I like this.

jliptzin 13y ago

Cool. But those are some damn ugly fonts.

acuozzo 13y ago

For his query: http://www.dejadejadeja.com/10years/query.php?body=Star+Wars&subject=&newsgroups=&email_from=&dateearly=&datelate=1983-01-01&minsize=&maxsize=&maxrows=100&orderby1=composeddate&orderby2=composedtime http://www.dejadejadeja.com/10years/query.php?body=Star+Wars... The top post is this: http://www.dejadejadeja.com/10years/getmsg.php?whichmsg=ixlpc.166 http://www.dejadejadeja.com/10years/getmsg.php?whichmsg=ixlp... It has a post date of: Wed Dec 15 10:30:01 1982, but is given as 1970-01-01 in the search results. I'm seeing lots of 1970-01-01 results. A bug, perhaps?

zandorg 13y ago
Yes, it can't handle all date formats, so it defaults to 0 which is Jan 1st 1970. It's easily fixable but I haven't got around to it yet.

recuter 13y ago

Where are you getting the newer Usenet archive from? Thanks for turning me on to the Archive.org's 'UTZoo archive', sadly it is only 1981-1991 and incomplete. What a shame. :(

zandorg 13y ago
I get the news from 2003 to present from GigaNews. I have about 2TB of it. That period is not indexed, so you can only search 1981-1991. When I get a 4TB drive (soon I hope) I'll make the 2003 stuff searchable.

tomphoolery 13y ago

> It's built on PHP and MySQL. And Comic Sans... :P

glanch 13y ago

Kind of random, but I just checked out your site, typed in the first "1980s" thing that came to mind (Walter Payton) and really enjoyed reading this New England Patriots fan's post sizing up his teams chances against the Chicago Bears in the upcoming Super Bowl: http://www.dejadejadeja.com/10years/getmsg.php?whichmsg=%3C417@decwrl.DEC.COM%3E http://www.dejadejadeja.com/10years/getmsg.php?whichmsg=%3C4... The Bears would crush the Patriots and win that game easily. I guess this might seem weird to some of you, but I grew up in the 90s and this game was one of the only iconic 80s moments that stood out to me. Thanks for building the site. It's neat.