Preview - AI Weekly Update - December 28th, 2020

Hey everyone, maybe this will be a fun video series to compliment the AI weekly update videos. I think it's interesting to guess at what a paper is about and why it's worth reading based on the title and abstract. With so much information overload, I think curation is an important skill to develop. I've usually selected everything for the update video by Thursday so I can study it over Friday to Sunday. Please share any early thoughts or understandings you have about this content and let me know what I've missed. Thank you for watching, see you on Monday! Content Links: Large-scale clinical interpretation of genetic variants using evolutionary data and deep learning: https://www.biorxiv.org/content/10.1101/2020.12.21.423785v1.full.pdf Pre-training a Language Model without Human Language: https://arxiv.org/pdf/2012.11995.pdf Few-Shot Text Generation with Pattern-Exploiting Training: https://arxiv.org/pdf/2012.11926.pdf Interfaces for Explaining Transformer Language Models: https://jalammar.github.io/explaining-transformers/ HuggingFace Newsletter (dataset sprint update): https://huggingface.curated.co/issues/5 Offline RL form Images with Latent Space Models: https://arxiv.org/pdf/2012.11547.pdf Evaluating Agents without Rewards: https://arxiv.org/pdf/2012.11538.pdf Ruder Newsletter: http://newsletter.ruder.io/issues/emnlp-2020-recap-minimum-viable-datasets-efficiency-roguelikes-for-rl-research-303114 Best AI Papers 2020: https://github.com/louisfb01/Best_AI_paper_2020 MSR 2020 Recap: https://note.microsoft.com/index.php/email/emailWebview When BERT Plays the Lottery, All Tickets are Winning: https://thegradient.pub/when-bert-plays-the-lottery-all-tickets-are-winning/ Data-efficient Image Transformers: https://ai.facebook.com/blog/data-efficient-image-transformers-a-promising-new-technique-for-image-classification/ HuggingFace AutoNLP: https://huggingface.typeform.com/to/FAtsVfbg DeepMind Annual Report $: https://bdtechtalks.com/2020/12/21/deepminds-annual-report-wh