5 ms·

I work for the LoC. I think I'd of heard of this. Edit: It is my considered opinion that a lot of what the LoC does is excessively ambitious. The project I'm c

by astine 17y ago

I work for the LoC. I think I'd of heard of this. Edit: It is my considered opinion that a lot of what the LoC does is excessively ambitious. The project I'm currently working in is called the Born Digital project, which is an attempt to allow major broadcasters like PBS and CNN to submit broadcast material to the Library in real-time. The tools to do this, do not currently exist.

rufo 17y ago
What's wrong with ambitious? Also - I'd thought real-time capture of video sources was something the DVR solved a long time ago... if you can talk about it, what's different about your project?
- deleted 17y ago
  [deleted]
jonknee 17y ago
> The tools to do this, do not currently exist. Considering that all the major networks beam their broadcasts all over the world in real time I don't see what the challenge is other than storage space. Startups like Justin.tv have figured out how to not only capture but stream thousands of simultaneous live streams, so the tools certainly exist.
- astine 17y ago
  The primary difficulty is that the Library is attempting more than just live-capture of video streams. They are going for full archival quality. They're not simply saving streams to tape but but running extensive qc processes on everything and transcoding coding the material into multiple formats. Technically, the technology exists, but the Library does not have the hardware to run the software. (Unless someone knows of some efficient, off the shelf content-validation program that we don't know of...) Other problems include, yes, storage. The projected aggregation rate will outstrip, not only the Libraries current physical facilities, but all planned new facilities, by 2013 (at which point we will be looking at 250PB of storage.) The rate of growth will continue to increase from there. Unless tape technology improves at an exponential rate, this seem unavoidable.
  - jonknee 17y ago
    Are you storing everything or just their unique content? Commercials and what not make up a large percentage (30%) and then re-runs (unknown percentage, but huge). And why multiple formats? Unless you're distributing the content it seems more efficient to transcode it when you need it.
    - astine 17y ago
      I really don't know. I don't make those decisions.
  - dustingetz 17y ago
    so, you're saying, right now its too expensive.
DenisM 17y ago
> I think I'd of heard of this. Two things are wrong with this statement. The second one is the presumption that just because you work on one project you would know about all the rest: http://www.loc.gov/tweet/how-tweet-it-is.html http://www.loc.gov/tweet/how-tweet-it-is.html
- astine 17y ago
  Actually, considering how things run around here, it's amazing that I've heard of it at all.

by astine 17y ago

rufo 17y ago

What's wrong with ambitious? Also - I'd thought real-time capture of video sources was something the DVR solved a long time ago... if you can talk about it, what's different about your project?

deleted 17y ago
[deleted]

jonknee 17y ago

> The tools to do this, do not currently exist. Considering that all the major networks beam their broadcasts all over the world in real time I don't see what the challenge is other than storage space. Startups like Justin.tv have figured out how to not only capture but stream thousands of simultaneous live streams, so the tools certainly exist.

astine 17y ago
The primary difficulty is that the Library is attempting more than just live-capture of video streams. They are going for full archival quality. They're not simply saving streams to tape but but running extensive qc processes on everything and transcoding coding the material into multiple formats. Technically, the technology exists, but the Library does not have the hardware to run the software. (Unless someone knows of some efficient, off the shelf content-validation program that we don't know of...) Other problems include, yes, storage. The projected aggregation rate will outstrip, not only the Libraries current physical facilities, but all planned new facilities, by 2013 (at which point we will be looking at 250PB of storage.) The rate of growth will continue to increase from there. Unless tape technology improves at an exponential rate, this seem unavoidable.
- jonknee 17y ago
  Are you storing everything or just their unique content? Commercials and what not make up a large percentage (30%) and then re-runs (unknown percentage, but huge). And why multiple formats? Unless you're distributing the content it seems more efficient to transcode it when you need it.
  - astine 17y ago
    I really don't know. I don't make those decisions.
- dustingetz 17y ago
  so, you're saying, right now its too expensive.

DenisM 17y ago

> I think I'd of heard of this. Two things are wrong with this statement. The second one is the presumption that just because you work on one project you would know about all the rest: http://www.loc.gov/tweet/how-tweet-it-is.html http://www.loc.gov/tweet/how-tweet-it-is.html

astine 17y ago
Actually, considering how things run around here, it's amazing that I've heard of it at all.