6 ms·
I know very little about genomics and biology and would love it if someone who knows more could answer my silly questions to help me understand this more: - Th
by breck 15y ago
I know very little about genomics and biology and would love it if someone who knows more could answer my silly questions to help me understand this more:
- This has genome data from 1,700 people. In theory could a company build a machine that read one of these "files" as input and made a baby as output?
- It says the dataset is 200TB. If 1 person has 3 billion dna bases(which I understand can be 1 of 4 values or 2 bits), it seems that even uncompressed the dataset would be 6billion bits (<1GB per person) and so only ~ 1.7TB uncompressed for 1,700 people. What am I missing?
- tomkinstinch 15y agoI haven't looked at the data yet, but I suspect the large data size is due to full sequencer output. Next-gen sequencing methods produce a LOT of noisy overlapping data that can later be reduced to high quality contiguous sequences. When compressed relative to a reference sequence, a ~3.3Gbp human genome can be reduced to ~3.3MiB of data[1]. For more information about the methods currently being used, check out these videos from the WUSTL Genome Center: http://gep.wustl.edu/curriculum/course_materials_WU/introduction_to_genomics/nextgen_video_tour http://gep.wustl.edu/curriculum/course_materials_WU/introduc... 1. http://dhruvbird.com/genome_compression.pdf http://dhruvbird.com/genome_compression.pdf
- deleted 15y ago[deleted]
- skosuri 15y ago1000 genomes includes many datasets including sequencing. That said, I'm sure most of this is sequencing data. The way sequencing is done is using billions of reads (usually b/w 50-100 nucleotides long), that are mapped back to the genome. Average coverage of any individual nucleotide is usually 30-50x. What people usually shared are compressed versions of the mapped reads that show all the sequencing information. The reason why this is done is that due to the limitations of the sequencing technologies, how you call particular mutations, structural variations, and deletions depends on the algorithms you use to reconstruct the genome. Thus the raw data could be in the form of compressed reads, or the compressed mapped reads (or in this case, likely both). Even this though is a vast reduction in size for the raw data, which are usually images that are used to call each base, which are usually 1000x larger than this data set; these usually aren't stored now for obvious space constraints.
- aaronblohowiak 15y agoAn analogy is like making a panorama photograph by taking lots of individual photographs and then stitching them together at the parts that appear to overlap to make one big picture, right?
- skosuri 15y agoSort of; though there are more complications. First, you have to deal with sequencing noise, which can be as high as 1%.. Thus you need many reads to get consensus even for any individual base. Second, you have to deal with the fact that a human genome has two copies of any individual chromosome, so you have to get enough reads to tell if your mutations are diploid or haploid for instance. Third, the human genome is repetitive, so there are many mapping errors. This is dealt with by having high coverage and usually by having different size jumps between paired sequencing reads (e.g., read 100bp on each end of a 200bp, 2000bp, and 10,000bp parts of the genome) to help algorithms stitch together the proper sequence.
- tosseraccount 15y agoThere's even more complications to complicate the complications ... "you need many reads to get consensus even for any individual base" Not necessarily. If you know that the minor allele frequency it close to 50% in related populations and you only have a few reads, say 6, and three are minor allele non reference and three are "major" allele reference (and the quality is good and there's otherwise low regional noise), then it's a good bet it's HETEROZYGOUS. You don't necessarily need a lot of reads. "second, you have to deal with the fact that a human genome has two copies of any individual chromosome" Well. Sort of. Men only have one Y chromosome and one X chromosome for instance, women have zero Y's. (a nitpick, granted). Disease sample often have 0,1 and 3 or more copies of a genomic area.
- epistasis 15y agoThat works if you're only performing a few such tests. But if you have an extremely accurate test, say 99.999% correct, and you apply it at 3 billion base pairs, then you're still going to have tens of thousands of incorrect calls, and no way to distinguish the good calls from the bad calls, without more data.
- mlwarren 15y agoMaybe some of the people contributing answers to this comment thread could also suggest some literature on bioinformatics? (specifically for Software Engineers with limited biology backgrounds)
- bthomas 15y agoMore specifics about what you're interested in? I work in the space (human genetics - we analyse the output of 1000 Genomes) and happy to help, but "bioinformatics" is pretty broad. I'll also note so much of the human genetics space is so new that most knowledge is still couped up in academic papers - there aren't very good resources for the general public. A colleague helped edit a textbook in 2007 on genetic analysis (which would still be considered "new" in textbook space), and none of the tools in that book can be used with 1000 genomes data.
- mlwarren 15y agoMaybe some broad-sweeping entry level books or literature reviews would be good. For me (and possibly many others on hn), the extent of my knowledge in the field as a whole is pretty small so I think some introductory resources geared towards someone coming from a strong software or math background would be best.
- aheilbut 15y ago"Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids" by Durbin, Eddy, Krogh, and Mitchison is a classic, very readable intro to sequence analysis algorithms (dynamic programming, HMMs) that would be interesting for someone coming from a math/cs background.
- bthomas 15y ago(The following are all for genetics, others can chime in on other areas or bioinformatics in general.) -- I'm bias, but I think the best entry level book is still from 1998 - Genome by Matt Ridley [1]. It's what got me interested in genomics as a CS undergrad (I read it in 2009). Another decent one is The $1000 Genome [2], it gives a good cross section of genetics in 2010. -- Our group has a series of intro lecture videos from last academic year [3]. They are fairly up to date, and this year's videos will probably be posted soon. -- Genomes Unzipped is great if you prefer a blog [4] -- I think the best way to actually learn this stuff is to just play with the software tools. They all point to open data in the tutorials. Biopython's tutorial is particularly good - just google the biological terms as you go. Bioconductor has some good (though more targeted) tutorials too. -- Going to talks can be a great way to get a broad overview of the space. Drop me a note if you happen to be located in Boston. -- Finally, this goes without saying, but don't take articles in the mainstream media at face value. (Including, and in fact in particular, the NYT.) Every time I get together with relatives I have to argue against the latest grand prediction. [1] http://www.amazon.com/Genome-The-Autobiography-Species-Chapters/dp/0060932902 http://www.amazon.com/Genome-The-Autobiography-Species-Chapt... [2] http://www.amazon.com/The-000-Genome-Revolution-Personalized/dp/1416569596 http://www.amazon.com/The-000-Genome-Revolution-Personalized... [3] http://www.broadinstitute.org/scientific-community/science/programs/medical-and-population-genetics/primers/primer-medical-and-pop http://www.broadinstitute.org/scientific-community/science/p... [4] http://www.genomesunzipped.org/ http://www.genomesunzipped.org/
- eggdude 15y agoI'm not a biology expert, but from my understanding, they wouldn't be able to "make a baby" as output. But they could make a cell that contains the specified DNA that would grow into a baby under the right conditions. Of course, we are still a ways out from having that technology.
- hirenj 15y agoWhat I think you're alluding to is something like this: http://www.guardian.co.uk/science/2010/may/20/craig-venter-synthetic-life-form http://www.guardian.co.uk/science/2010/may/20/craig-venter-s... I haven't been following the progress for the past year and a half or so, but it was state of the art then. Long story short, we're not synthesizing de-novo babies any time soon! Well, at least not in the lab.
- biopharma_guy 15y agoThere are technological issue and then there are ethical issues. I can say we are several decades away from making a baby just by stitching raw genome data. There are 30,000 genes in human genome. Think the number of possible combinations that can arise only choosing few good genes are optimizing for a developing a tailor made human being. And the ethical challenge is huge too.
- lisper 15y ago> In theory could a company build a machine that read one of these "files" as input and made a baby as output? Not quite. We can read DNA sequences, but we can't reliably write them yet beyond a few dozen base pairs. In fact, we can't even take a fully-assembled human genome and "make a baby as output." That process is called cloning, and it is fraught will all manner of practical and ethical difficulties. But there's nothing that prevents it in principle, and given the pace at which technology is advancing "printing a baby" may well be possible within the lifetimes of some of the people reading this.
- Natsu 15y agoI also think that current technology also has problems sequencing the bp near the start of a sequence.
- lisper 15y agoSort of. Current DNA sequencing technology breaks the DNA up into short pieces, sequences the pieces, and then uses software to reassemble them by looking for places where the fragmentary sequences overlap. It's basically the mother of all DIFFs. Telomeric DNA (the DNA at the ends of chromosomes) consists of many repetitions of the same short (<10) sequence of base pairs, so there is no pattern for the reassembly process to latch on to. So it's not the ends per se that are problematic, it's any long sequence that is devoid of structure. Chimps, for example, have telomeric DNA in the middle of one of their chromosomes. This is an example of "smoking gun" evidence for macroevolution. See http://www.gate.net/~rwms/hum_ape_chrom.html http://www.gate.net/~rwms/hum_ape_chrom.html
- Natsu 15y agoI wonder if nanopore sequencing will ever be good enough to fill in those gaps?
- zeggman 15y agoIf chimps have 24 chromosomes and humans have 23, that implies 2 chromosomes have fused in humans. This fusion would put telomeric DNA in the middle of a human chromosome, not an ape/chimp chromosome.
- iang 15y ago- Could you make a baby? No, there's more to us than just DNA. For example methylation, the addition of methyl chemical groups to some bases, which isn't tracked in "normal" DNA sequencing controls which genes get expressed by which cells. Plus there's a reasonable chance of errors in the sequencing due to the need to copy the DNA repeatedly to identify. - Data size Most bioinformatics data formats are plain ASCII. So even the reference data would be 3Gb per person. But 1,000 genomes contains sequencing reads where each DNA bases is sample multiple times (20-40 is typical "read depth") so that errors in identifying bases can be minimised. Each base of each of these samples has a quality score associate (which is about a 6 bit value). Plus identifiers for all billion odd reads per person.
- onemoreact 15y agoFor fairly simple organisms we have 'cold booted' DNA and swapped a cells DNA with artificial DNA from a closely related organism and it still worked. So, while humans have a lot of Genetic information I suspect you could get it to work if your willing to accept fairly low success changes. As to read errors that effectively just a 'mutation' which are generally fairly harmless. If you stay below say 1,000 mutations, which would still take vary high accuracy, you have not significantly reduced your chances for success.
- iang 15y agoTrue, but there's also the fact we don't know the whole human genome - only about 98% of it.
- onemoreact 15y agoWe have the raw data on the actual DNA for several people which is what you need to make a copy. What we don't know is what the data means and what all the mutations are in the wild. Which is what you want to know if we are going to start making changes.
- iang 15y ago
- deleted 15y ago[deleted]