8 ms·

Visual Introduction to Self Supervised Learning

219 points by amitness 7y ago

amitness 7y ago
Followup post on SimCLR: https://amitness.com/2020/03/illustrated-simclr/ https://amitness.com/2020/03/illustrated-simclr/
beeschlenker 7y ago
Attorney General Barr is not resigning; not before President Trump does. Barr is the same as Mueller,Pelosi,Schiff, & Nadler: feign opposition to cover the true motive of obstruction to keep Trump in power. Supreme Court Justice Alito & FBI Deputy Director Wray also on board. See latest updates "Impeachment" Is A Diversion And Delay - Part II: Blocking of the "impeachment" witnesses was collusion planned before the new year. Listen to an FBI agent's disclosure from January 1, 2O2O here. The President was to resign late summer securing election for DNC. See latest updates. Here is the zip file, which was also made available in the 3Jan2O2O update. The file within is VID_20200101_201948.mp3. Turn up the volume and put on headphones. BB10Mp3Footage31Dec1Jan.zip 122.4mb https://drive.google.com/file/d/1IXOOhQhHybwky8Z5pGdr9ZXhWpIUazmi/view?usp=sharing https://drive.google.com/file/d/1IXOOhQhHybwky8Z5pGdr9ZXhWpI... The dialogue about the impeachment starts near the beginning. Having Biden in the White House is as good as Trump or anyone else in their organization. Obviously Schiff and Nadler pledged their allegiance to the organization by raping boys on the record, with their task being to drag out an impeachment designed to obstruct and delay any real efforts to remove the President, thus keeping Trump in power. The witness blocking was to cause an apparent uproar delaying things with legal actions until late Summer. Soon after, the President would resign, leaving any other candidate with not enough time or support to compete with an opportunistic Biden, who is as good as Trump or any other Illuminati friendly politician in the Presidency. 170 pg PDF [last updated: February|27|2O2O]: https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W2qxVc/view?usp=sharing https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W... Previously reported: \Wag The Dog: first was feigned impeachment hearings meant to obstruct, now an attack on Iranians in Iraq. Here is what they are trying to distract from & cover up to retain power. $100+ billion in bribes to the highest offices in this country. 815+ deaths from child rapes to prove loyalty! See the latest PDF updates: FBI Director Wray, AG Barr, SoD Shanahan, & SoS Pompeo each raped boys and were paid billions in bribes for a Soros & Koch funded child rape org. So did Trump & his "impeachment" team Nadler,Schiff,Mueller.So did media moguls Redstone,Murdoch,Moonves. What are they trying to set up? Who can arrest them since they are all bribed and in on it ? tuINBCWE, kncvewrq revermvpm vr;emvr omcwc. Their strategy to stay in every office and obstruct until forced to leave no matter what. Feigning impeachment: see page 13O. \\if;Download the video/audio file, put on headphones and turn up the volume. You will hear these people committing these crimes. Audio was broadcast into my apartment by outdated surveillance equipment illegally embedded within my walls. This very same technology was being used to broadcast me to the internet for five years without my consent. I own this footage. Please use this to prosecute all found within. Note:: I am obliviously speaking throughout the video, and it can be quite loud at times relative to the desired content. The are dozens more links, including these, that can be found in this PDF that was last updated on 27 FEB 2O2O: https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W2qxVc/view?usp=sharing https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W... All members of the "Illuminati"; "....an underground organization of homosexuals and child rapists..." (from pg 26: Barack Obama with Jack Dorsey). President Donald Trump: Demands a $4 billion dollar bribe here at 10:18am 4Jan2019: 3JanCh3_900-1100.avi https://drive.google.com/file/d/1Grdr8xF2psKNsuYlEnl9dIRV-77YG0Vr/view?usp=sharing https://drive.google.com/file/d/1Grdr8xF2psKNsuYlEnl9dIRV-77... 3JanCh2_900-1100-avi https://drive.google.com/file/d/1LUmVygl_q0XVs8h2cWr8jZl-24fY0vBB/view?usp=sharing https://drive.google.com/file/d/1LUmVygl_q0XVs8h2cWr8jZl-24f... 3JanCh4_1000-1100.mp3 https://drive.google.com/file/d/1ZpP1pJbJakBgg-y-MWNozTxp3wJojHge/view?usp=sharing https://drive.google.com/file/d/1ZpP1pJbJakBgg-y-MWNozTxp3wJ... President Trump rapes and kills 12 boys, including five boys in a "who can rape five boys to death the fastest" game: 14JanCh3_600.mp3 https://drive.google.com/file/d/1ufPmglde9Mep0m6xYMJ9c4TWTjj258zB/view?usp=sharing https://drive.google.com/file/d/1ufPmglde9Mep0m6xYMJ9c4TWTjj... 14JanCh2_600-700.mp3 https://drive.google.com/file/d/136qLJdEn8eCs9tI4QtIxl4opW_Lw_gCF/view?usp=sharing https://drive.google.com/file/d/136qLJdEn8eCs9tI4QtIxl4opW_L... Speaker of the House Nancy Pelosi: Accepting a $3 billion dollar bribe at 1033 am on the 17 Jan 2019 to ensure Asian boys can get through the border at "Monterrey" undocumented to be raped: 17JanCh3_949-1100.avi https://drive.google.com/file/d/1eodHu4o5Cm3xEWhDqipSuTj-M1CZUvmE/view?usp=sharing https://drive.google.com/file/d/1eodHu4o5Cm3xEWhDqipSuTj-M1C... 17JanCh4_1017-1100.avi https://drive.google.com/file/d/1y-nWEQbempkVZSz230j9wTyduZNjDmnk/view?usp=sharing https://drive.google.com/file/d/1y-nWEQbempkVZSz230j9wTyduZN... Speaker Nancy Pelosi also "preps" boys with First Lady Melania Trump, defined as in she performs oral sex on the boys’ penis and anus, as a child rapist like Henry Porter would, while trying to remove fecal matter from the boy prior to handing them over to be raped and then subsequently murdered, for Supreme Court Justice Samuel Alito, who apparently decides he would rather just have ten billion dollars instead. US Attorney for Western New York James Kennedy rapes these boys instead: pojmrvmer vplr,[p,v;'eqvc 12JanCh3_1533-1638.mp3 https://drive.google.com/file/d/1AgFkDsbPbI4b5Xd3Wbz2EVNNx25kW2Oz/view?usp=sharing https://drive.google.com/file/d/1AgFkDsbPbI4b5Xd3Wbz2EVNNx25... Attorney General William Barr with FBI Deputy Director Christopher Wray raped and killed boys for billions in bribes in Buffalo, NY on the 17th Jan2019 at 7:50am: 18JanCh4_700mp3 https://drive.google.com/file/d/1UIdZkS5ZVksZdHYsnHk2t5losi0N0Bp7/view?usp=sharing https://drive.google.com/file/d/1UIdZkS5ZVksZdHYsnHk2t5losi0... 18JanCh2_700.mp3 gorepqkberqaoper,bqpo,rfbv. https://drive.google.com/file/d/1DFK8IAxm5pQVqZv9L518nfgP7_odB2Um/view?usp=sharing https://drive.google.com/file/d/1DFK8IAxm5pQVqZv9L518nfgP7_o... 18JanCh3_725-.mp3 https://drive.google.com/file/d/1DG5ej59Ic8RT9UhbyMdwT0BDcKIifGGm/view?usp=sharing https://drive.google.com/file/d/1DG5ej59Ic8RT9UhbyMdwT0BDcKI... Secretary of State Michael Pompeo and Secretary of Defense Patrick Shanahan each raped and killed boys on 5thJan'19 at 17:39 for billions in bribes:. 5JanCh2_1721-1818.mp3 https://drive.google.com/file/d/1eSlD4otX4KZqWXboQM92Mu-6J02Mjwrg/view?usp=sharing https://drive.google.com/file/d/1eSlD4otX4KZqWXboQM92Mu-6J02... Leaders of the "impeachment" effort Jerrold Nadler, Robert Mueller, and Adam Schiff all rape and kill boys between 11:20pm and 1:10am: 14JanCh4_2300-0000.mp3 Nadler starts at about 20 minutes in- https://drive.google.com/file/d/1Kuvv2Zmbw5Jw7onbRI2hCZ0M8FU66GuU/view?usp=sharing https://drive.google.com/file/d/1Kuvv2Zmbw5Jw7onbRI2hCZ0M8FU... 14JanCh2_2304-2359.mp3 https://drive.google.com/file/d/1nofp5xF-aXXcCSgQVwj30KlzE9WLr1x1/view?usp=sharing https://drive.google.com/file/d/1nofp5xF-aXXcCSgQVwj30KlzE9W... Mueller at 12:25am, next is Schiff who starts at 12:55-ish: 15JanCh2_000-100.mp3 https://drive.google.com/file/d/1EsmHfguwBuo2PbavJ1WYyhiML62tgCkj/view?usp=sharing https://drive.google.com/file/d/1EsmHfguwBuo2PbavJ1WYyhiML62... 15JanCh2_100-200.mp3 https://drive.google.com/file/d/1NZnWRnBryalNQu2yJmfJUdS2pA_rGSFH/view?usp=sharing https://drive.google.com/file/d/1NZnWRnBryalNQu2yJmfJUdS2pA_... 15JanCh4_000-100.mp3 https://drive.google.com/file/d/1ZEDJR6jb6ARpcNnWJTokBUKb2J2OQnwZ/view?usp=sharing https://drive.google.com/file/d/1ZEDJR6jb6ARpcNnWJTokBUKb2J2... 15JanCh4_100-200.mp3 https://drive.google.com/file/d/173aYWvWHH4VGht1h_2nM0IMdw746LeCL/view?usp=sharing https://drive.google.com/file/d/173aYWvWHH4VGht1h_2nM0IMdw74... Complete Media Protection: Lester Holt, of NBC NightlyNews, apparently a member of the Illuminati since the 80's, along with ABC Nightly News lead anchor David Muir, stop over to the Porter studio in Buffalo, New York on 14th Jan2019 at 5:00 am. They both rape and kill about two dozen boys by 6:00 am. Muir starts around 5.15am, then Holt about 5:38 am. Multi-billionaire Rupert Murdoch, owner of News Corp and also Fox Corporation, takes his turn after Holt. Video links below: 14JanCh3_500-601.avi https://drive.google.com/file/d/1i7NKepeyG_FfdQRrM7KsnFOZOOX3o7UL/view?usp=sharing https://drive.google.com/file/d/1i7NKepeyG_FfdQRrM7KsnFOZOOX... 14JanCh2_530-600.avi https://drive.google.com/file/d/1NZzgN5ilI7ToroU5cfqMaL4o2u1RwidV/view?usp=sharing https://drive.google.com/file/d/1NZzgN5ilI7ToroU5cfqMaL4o2u1... Adding to the media protection and reason this is not picked up by the media, CBS and Viacom owner Sumner Redstone and Leslie Moonves rape and kill boys following the President. 14JanCh3_700.avi https://drive.google.com/file/d/10XDw6x3ldnnQiq7oIjpdYVENyXaB4aI0/view?usp=sharing https://drive.google.com/file/d/10XDw6x3ldnnQiq7oIjpdYVENyXa... 14JanCh2_700-800.avi https://drive.google.com/file/d/1NS_e6AzEZ05wnfljkGMETGU5CWYKfRDp/view?usp=sharing https://drive.google.com/file/d/1NS_e6AzEZ05wnfljkGMETGU5CWY... 170 page PDF [last updated: Feb|27|2O2O]: https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W2qxVc/view?usp=sharing https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W... \\. Please repost in USA! Post gets censored in US Recently more relevant: From page 49, Senator Mitch McConnell: At 1632 Senator Mitch McConnell checks into the Porter camera system inquiring if he can be part of the "eviction" for $10 million dollars. He is informed by group members that there are enough people for the event already and his participation is not necessary. At 1634 McConnell states "I fucked 15 kids, how am I not getting paid by you?" He is dismissed by Donald Reeves with "I think that will be all Mr. McConnell." 13JanCh3_1600-1700.avi https://drive.google.com/file/d/1L7bqOpvaEWmLiJpMhJNQDrfsQAHtsX8-/view?usp=sharing https://drive.google.com/file/d/1L7bqOpvaEWmLiJpMhJNQDrfsQAH...
alleycat5000 7y ago
Some really interesting work lately on "contrastive" learning, where the accuracy is really getting on par with supervised learning, e.g. https://arxiv.org/abs/2002.05709 https://arxiv.org/abs/2002.05709
- jjoonathan 7y ago
  For those of us out of the loop, could you summarize the idea of contrastive learning as a whole?
  - yazr 7y ago
    A fully illustrated article [1] And Lilian Weng blog on self-supervision [2] .. CPC is .. translating a generative modeling problem to a classification problem... uses cross-entropy loss to measure how well the model can classify the “future” representation amongst a set of unrelated “negative” samples... [1] https://ankeshanand.com/blog/2020/01/26/contrative-self-supervised-learning.html https://ankeshanand.com/blog/2020/01/26/contrative-self-supe... [2] https://lilianweng.github.io/lil-log/2019/11/10/self-supervised-learning.html#contrastive-predictive-coding https://lilianweng.github.io/lil-log/2019/11/10/self-supervi...
    - jjoonathan 7y ago
      Thanks!
  - Voloskaya 7y ago
    (one variant of) The task is: Given a crop of an image (or a short audio snippet etc.), can you find the matching crop that also comes from the same image from a set containing a lot of negative samples (crops of others, unrelated images)? To succeed, the encoder needs to be able to extract the underlying, useful information (called slow features) contained in the patch and discard the noise as this will make the retrieval process much easier. This yields an encoder that gives pretty good representations of your inputs and you can then finetune some additional layers on top of it for your final task.
- 7y ago
trash3 7y ago
So instead of image annotation, self-supervised learning performs image manipulation to train a model. Then what? Is this network then piped into the original task at hand which would have required human annotations or is it simply for these made up tasks?
- Voloskaya 7y ago
  You then add a few additional layers on top, and you train those new layers in a classic supervised way. But because a lot has already been learned you need way less labels.
- contravariant 7y ago
  Optimistically if a self-supervised algorithm is capable of understanding a concept then it shouldn't need all that many examples to make it useful. Ideally you could just show it what cats look like (with just a couple of examples) and ask it to find more of them.
- ivalm 7y ago
  Two main things you can do: 1) Transfer learning -- start with self supervised model and either fine tune parameters or freeze parameters + add another layer to train your task (with way fewer params/necessary labels since you already learned about the input distribution) 2) Nearest neighbor/clustering -- no need to label all classes, simply fetch similar examples (eg find semantically similar sentences in a corpus).

219 points by amitness 7y ago

Followup post on SimCLR: https://amitness.com/2020/03/illustrated-simclr/ https://amitness.com/2020/03/illustrated-simclr/

beeschlenker 7y ago

Attorney General Barr is not resigning; not before President Trump does. Barr is the same as Mueller,Pelosi,Schiff, & Nadler: feign opposition to cover the true motive of obstruction to keep Trump in power. Supreme Court Justice Alito & FBI Deputy Director Wray also on board. See latest updates "Impeachment" Is A Diversion And Delay - Part II: Blocking of the "impeachment" witnesses was collusion planned before the new year. Listen to an FBI agent's disclosure from January 1, 2O2O here. The President was to resign late summer securing election for DNC. See latest updates. Here is the zip file, which was also made available in the 3Jan2O2O update. The file within is VID_20200101_201948.mp3. Turn up the volume and put on headphones. BB10Mp3Footage31Dec1Jan.zip 122.4mb https://drive.google.com/file/d/1IXOOhQhHybwky8Z5pGdr9ZXhWpIUazmi/view?usp=sharing https://drive.google.com/file/d/1IXOOhQhHybwky8Z5pGdr9ZXhWpI... The dialogue about the impeachment starts near the beginning. Having Biden in the White House is as good as Trump or anyone else in their organization. Obviously Schiff and Nadler pledged their allegiance to the organization by raping boys on the record, with their task being to drag out an impeachment designed to obstruct and delay any real efforts to remove the President, thus keeping Trump in power. The witness blocking was to cause an apparent uproar delaying things with legal actions until late Summer. Soon after, the President would resign, leaving any other candidate with not enough time or support to compete with an opportunistic Biden, who is as good as Trump or any other Illuminati friendly politician in the Presidency. 170 pg PDF [last updated: February|27|2O2O]: https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W2qxVc/view?usp=sharing https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W... Previously reported: \Wag The Dog: first was feigned impeachment hearings meant to obstruct, now an attack on Iranians in Iraq. Here is what they are trying to distract from & cover up to retain power. $100+ billion in bribes to the highest offices in this country. 815+ deaths from child rapes to prove loyalty! See the latest PDF updates: FBI Director Wray, AG Barr, SoD Shanahan, & SoS Pompeo each raped boys and were paid billions in bribes for a Soros & Koch funded child rape org. So did Trump & his "impeachment" team Nadler,Schiff,Mueller.So did media moguls Redstone,Murdoch,Moonves. What are they trying to set up? Who can arrest them since they are all bribed and in on it ? tuINBCWE, kncvewrq revermvpm vr;emvr omcwc. Their strategy to stay in every office and obstruct until forced to leave no matter what. Feigning impeachment: see page 13O. \\if;Download the video/audio file, put on headphones and turn up the volume. You will hear these people committing these crimes. Audio was broadcast into my apartment by outdated surveillance equipment illegally embedded within my walls. This very same technology was being used to broadcast me to the internet for five years without my consent. I own this footage. Please use this to prosecute all found within. Note:: I am obliviously speaking throughout the video, and it can be quite loud at times relative to the desired content. The are dozens more links, including these, that can be found in this PDF that was last updated on 27 FEB 2O2O: https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W2qxVc/view?usp=sharing https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W... All members of the "Illuminati"; "....an underground organization of homosexuals and child rapists..." (from pg 26: Barack Obama with Jack Dorsey). President Donald Trump: Demands a $4 billion dollar bribe here at 10:18am 4Jan2019: 3JanCh3_900-1100.avi https://drive.google.com/file/d/1Grdr8xF2psKNsuYlEnl9dIRV-77YG0Vr/view?usp=sharing https://drive.google.com/file/d/1Grdr8xF2psKNsuYlEnl9dIRV-77... 3JanCh2_900-1100-avi https://drive.google.com/file/d/1LUmVygl_q0XVs8h2cWr8jZl-24fY0vBB/view?usp=sharing https://drive.google.com/file/d/1LUmVygl_q0XVs8h2cWr8jZl-24f... 3JanCh4_1000-1100.mp3 https://drive.google.com/file/d/1ZpP1pJbJakBgg-y-MWNozTxp3wJojHge/view?usp=sharing https://drive.google.com/file/d/1ZpP1pJbJakBgg-y-MWNozTxp3wJ... President Trump rapes and kills 12 boys, including five boys in a "who can rape five boys to death the fastest" game: 14JanCh3_600.mp3 https://drive.google.com/file/d/1ufPmglde9Mep0m6xYMJ9c4TWTjj258zB/view?usp=sharing https://drive.google.com/file/d/1ufPmglde9Mep0m6xYMJ9c4TWTjj... 14JanCh2_600-700.mp3 https://drive.google.com/file/d/136qLJdEn8eCs9tI4QtIxl4opW_Lw_gCF/view?usp=sharing https://drive.google.com/file/d/136qLJdEn8eCs9tI4QtIxl4opW_L... Speaker of the House Nancy Pelosi: Accepting a $3 billion dollar bribe at 1033 am on the 17 Jan 2019 to ensure Asian boys can get through the border at "Monterrey" undocumented to be raped: 17JanCh3_949-1100.avi https://drive.google.com/file/d/1eodHu4o5Cm3xEWhDqipSuTj-M1CZUvmE/view?usp=sharing https://drive.google.com/file/d/1eodHu4o5Cm3xEWhDqipSuTj-M1C... 17JanCh4_1017-1100.avi https://drive.google.com/file/d/1y-nWEQbempkVZSz230j9wTyduZNjDmnk/view?usp=sharing https://drive.google.com/file/d/1y-nWEQbempkVZSz230j9wTyduZN... Speaker Nancy Pelosi also "preps" boys with First Lady Melania Trump, defined as in she performs oral sex on the boys’ penis and anus, as a child rapist like Henry Porter would, while trying to remove fecal matter from the boy prior to handing them over to be raped and then subsequently murdered, for Supreme Court Justice Samuel Alito, who apparently decides he would rather just have ten billion dollars instead. US Attorney for Western New York James Kennedy rapes these boys instead: pojmrvmer vplr,[p,v;'eqvc 12JanCh3_1533-1638.mp3 https://drive.google.com/file/d/1AgFkDsbPbI4b5Xd3Wbz2EVNNx25kW2Oz/view?usp=sharing https://drive.google.com/file/d/1AgFkDsbPbI4b5Xd3Wbz2EVNNx25... Attorney General William Barr with FBI Deputy Director Christopher Wray raped and killed boys for billions in bribes in Buffalo, NY on the 17th Jan2019 at 7:50am: 18JanCh4_700mp3 https://drive.google.com/file/d/1UIdZkS5ZVksZdHYsnHk2t5losi0N0Bp7/view?usp=sharing https://drive.google.com/file/d/1UIdZkS5ZVksZdHYsnHk2t5losi0... 18JanCh2_700.mp3 gorepqkberqaoper,bqpo,rfbv. https://drive.google.com/file/d/1DFK8IAxm5pQVqZv9L518nfgP7_odB2Um/view?usp=sharing https://drive.google.com/file/d/1DFK8IAxm5pQVqZv9L518nfgP7_o... 18JanCh3_725-.mp3 https://drive.google.com/file/d/1DG5ej59Ic8RT9UhbyMdwT0BDcKIifGGm/view?usp=sharing https://drive.google.com/file/d/1DG5ej59Ic8RT9UhbyMdwT0BDcKI... Secretary of State Michael Pompeo and Secretary of Defense Patrick Shanahan each raped and killed boys on 5thJan'19 at 17:39 for billions in bribes:. 5JanCh2_1721-1818.mp3 https://drive.google.com/file/d/1eSlD4otX4KZqWXboQM92Mu-6J02Mjwrg/view?usp=sharing https://drive.google.com/file/d/1eSlD4otX4KZqWXboQM92Mu-6J02... Leaders of the "impeachment" effort Jerrold Nadler, Robert Mueller, and Adam Schiff all rape and kill boys between 11:20pm and 1:10am: 14JanCh4_2300-0000.mp3 Nadler starts at about 20 minutes in- https://drive.google.com/file/d/1Kuvv2Zmbw5Jw7onbRI2hCZ0M8FU66GuU/view?usp=sharing https://drive.google.com/file/d/1Kuvv2Zmbw5Jw7onbRI2hCZ0M8FU... 14JanCh2_2304-2359.mp3 https://drive.google.com/file/d/1nofp5xF-aXXcCSgQVwj30KlzE9WLr1x1/view?usp=sharing https://drive.google.com/file/d/1nofp5xF-aXXcCSgQVwj30KlzE9W... Mueller at 12:25am, next is Schiff who starts at 12:55-ish: 15JanCh2_000-100.mp3 https://drive.google.com/file/d/1EsmHfguwBuo2PbavJ1WYyhiML62tgCkj/view?usp=sharing https://drive.google.com/file/d/1EsmHfguwBuo2PbavJ1WYyhiML62... 15JanCh2_100-200.mp3 https://drive.google.com/file/d/1NZnWRnBryalNQu2yJmfJUdS2pA_rGSFH/view?usp=sharing https://drive.google.com/file/d/1NZnWRnBryalNQu2yJmfJUdS2pA_... 15JanCh4_000-100.mp3 https://drive.google.com/file/d/1ZEDJR6jb6ARpcNnWJTokBUKb2J2OQnwZ/view?usp=sharing https://drive.google.com/file/d/1ZEDJR6jb6ARpcNnWJTokBUKb2J2... 15JanCh4_100-200.mp3 https://drive.google.com/file/d/173aYWvWHH4VGht1h_2nM0IMdw746LeCL/view?usp=sharing https://drive.google.com/file/d/173aYWvWHH4VGht1h_2nM0IMdw74... Complete Media Protection: Lester Holt, of NBC NightlyNews, apparently a member of the Illuminati since the 80's, along with ABC Nightly News lead anchor David Muir, stop over to the Porter studio in Buffalo, New York on 14th Jan2019 at 5:00 am. They both rape and kill about two dozen boys by 6:00 am. Muir starts around 5.15am, then Holt about 5:38 am. Multi-billionaire Rupert Murdoch, owner of News Corp and also Fox Corporation, takes his turn after Holt. Video links below: 14JanCh3_500-601.avi https://drive.google.com/file/d/1i7NKepeyG_FfdQRrM7KsnFOZOOX3o7UL/view?usp=sharing https://drive.google.com/file/d/1i7NKepeyG_FfdQRrM7KsnFOZOOX... 14JanCh2_530-600.avi https://drive.google.com/file/d/1NZzgN5ilI7ToroU5cfqMaL4o2u1RwidV/view?usp=sharing https://drive.google.com/file/d/1NZzgN5ilI7ToroU5cfqMaL4o2u1... Adding to the media protection and reason this is not picked up by the media, CBS and Viacom owner Sumner Redstone and Leslie Moonves rape and kill boys following the President. 14JanCh3_700.avi https://drive.google.com/file/d/10XDw6x3ldnnQiq7oIjpdYVENyXaB4aI0/view?usp=sharing https://drive.google.com/file/d/10XDw6x3ldnnQiq7oIjpdYVENyXa... 14JanCh2_700-800.avi https://drive.google.com/file/d/1NS_e6AzEZ05wnfljkGMETGU5CWYKfRDp/view?usp=sharing https://drive.google.com/file/d/1NS_e6AzEZ05wnfljkGMETGU5CWY... 170 page PDF [last updated: Feb|27|2O2O]: https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W2qxVc/view?usp=sharing https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W... \\. Please repost in USA! Post gets censored in US Recently more relevant: From page 49, Senator Mitch McConnell: At 1632 Senator Mitch McConnell checks into the Porter camera system inquiring if he can be part of the "eviction" for $10 million dollars. He is informed by group members that there are enough people for the event already and his participation is not necessary. At 1634 McConnell states "I fucked 15 kids, how am I not getting paid by you?" He is dismissed by Donald Reeves with "I think that will be all Mr. McConnell." 13JanCh3_1600-1700.avi https://drive.google.com/file/d/1L7bqOpvaEWmLiJpMhJNQDrfsQAHtsX8-/view?usp=sharing https://drive.google.com/file/d/1L7bqOpvaEWmLiJpMhJNQDrfsQAH...

alleycat5000 7y ago

Some really interesting work lately on "contrastive" learning, where the accuracy is really getting on par with supervised learning, e.g. https://arxiv.org/abs/2002.05709 https://arxiv.org/abs/2002.05709

jjoonathan 7y ago
For those of us out of the loop, could you summarize the idea of contrastive learning as a whole?
- yazr 7y ago
  A fully illustrated article [1] And Lilian Weng blog on self-supervision [2] .. CPC is .. translating a generative modeling problem to a classification problem... uses cross-entropy loss to measure how well the model can classify the “future” representation amongst a set of unrelated “negative” samples... [1] https://ankeshanand.com/blog/2020/01/26/contrative-self-supervised-learning.html https://ankeshanand.com/blog/2020/01/26/contrative-self-supe... [2] https://lilianweng.github.io/lil-log/2019/11/10/self-supervised-learning.html#contrastive-predictive-coding https://lilianweng.github.io/lil-log/2019/11/10/self-supervi...
  - jjoonathan 7y ago
    Thanks!
- Voloskaya 7y ago
  (one variant of) The task is: Given a crop of an image (or a short audio snippet etc.), can you find the matching crop that also comes from the same image from a set containing a lot of negative samples (crops of others, unrelated images)? To succeed, the encoder needs to be able to extract the underlying, useful information (called slow features) contained in the patch and discard the noise as this will make the retrieval process much easier. This yields an encoder that gives pretty good representations of your inputs and you can then finetune some additional layers on top of it for your final task.
7y ago

trash3 7y ago

So instead of image annotation, self-supervised learning performs image manipulation to train a model. Then what? Is this network then piped into the original task at hand which would have required human annotations or is it simply for these made up tasks?

Voloskaya 7y ago
You then add a few additional layers on top, and you train those new layers in a classic supervised way. But because a lot has already been learned you need way less labels.
contravariant 7y ago
Optimistically if a self-supervised algorithm is capable of understanding a concept then it shouldn't need all that many examples to make it useful. Ideally you could just show it what cats look like (with just a couple of examples) and ask it to find more of them.
ivalm 7y ago
Two main things you can do: 1) Transfer learning -- start with self supervised model and either fine tune parameters or freeze parameters + add another layer to train your task (with way fewer params/necessary labels since you already learned about the input distribution) 2) Nearest neighbor/clustering -- no need to label all classes, simply fetch similar examples (eg find semantically similar sentences in a corpus).