Reflecting on for.ai...
Key Takeaways
The video discusses the origins and experiences of the for.ai research collaboration, a distributed research group founded by Aidan Gomez and Ivan Zhang, and its impact on the members' careers and research experiences. It highlights the importance of community, dedication, and exploration in research and development.
Full Transcript
foreign [Music] [Music] computer science slack group about like I have this idea I want to do a project on some machine translation work and people who are interested are welcome to join and I remember there's like maybe 12 15 of us came up in the first meeting and he just gave us like a small task and he put us through this like Hunger Games trial where we all had to complete this like tensorflow tutorial at the time I never even wrote a line of like tensorflow in my life so um I just remember I actually stayed up like all night doing the challenge not because I was worried about submitting it on time but it's more just like out of pure curiosity and interest and I found myself like yeah being pretty surprised that I would be this interested in something I barely knew about um so I think that was like very inspiring after he filtered that out we met up in this actual room in this was me sneaking a picture of that meeting I feel like I would want to remember this one day yeah that lack of the first research research project I've ever done and there was an article written by the university about this project um there's a there's a picture of us let me show you yeah so when we our first paper we like I I almost didn't even believe it but like our first paper it was accepted into iclr and Not only was it accepted as a as a poster it wasn't like it was like the top 20 best papers at the conference or something it was like oh my God I couldn't believe it like we were just a bunch of kids like a bunch of undergrads you know doing this on the side like it didn't feel like we belonged you know like when I was at LCL I was like had like such an events imposter syndrome you know I was in this poster Hall with all these like crazy PhD people I'm supposed to like answer questions about this paper like are you kidding me like yeah I think I think after that conference it was like uh it's like damn like this is like a real field you know like not like a we can actually do this and then after that project we decide to you know continue this work and then maybe you can invite more people especially people who are in the undergrad or don't have much um research experience to work together and that's when we created for AI I think earliest memories was I think it was me Sid Aiden and Ivan um we just sit in this little wework room and work on like whatever research project that we had at the time at the time tpus were also relatively new so I remember all the days we spent debugging those those horrible things but yeah I just really enjoyed those those like days when I was an undergrad and I was just trying to learn how to do research it was my intro into research I never had any research experience in the past I never thought about research to begin with so yeah everything was very new for me it was very fresh and I quite enjoyed it I mean so much so that switched my you know entire career path and now I'm doing my PhD and so on so hopefully I don't require any future yeah so far so good and it got me started with ML research as well which is something I continue to do every day um and yeah obviously I ended up making some of the greatest friends of my life through poor AI I don't think I've seen anything similar to what we created back then yeah I think it's just very welcoming I guess less intimidating to get into the field whenever you know is in the same boat as you it just felt like you belonged somewhere and people care about your progress and your learning um yeah I don't know that's that's just something I really liked I think it was just like irrational dedication to something because like like I think we were all weirdly motivated to work on this project but I like it's not like we were getting paid like most people already have full-time jobs and then they're like doing this on top of it um and like pretty dedicated as well so I think that that just like was really motivating for me to to do the same and to stay committed to something and mostly to stay committed to learning and developing more skills because you could never have enough as a researcher I think the best advice I've ever given to anyone is just like invest in your like workbench you know like make sure you can you can actually make mistakes really easily and then like figure out what what went wrong and then like repeat the experiment again and again again um so I'd say like invest a lot in your tooling because ultimately that that decides how fast you're learning and how fast you're getting better at this field yeah I would say just like explore a lot I think it's very easy to optimize for one thing and and have some goal and be like if I'm gonna ignore everything and only you know work on this but I think having breaths of experience and like not being afraid to fail and to struggle I think it's like really important especially as a researcher because I think most things don't work on your first try or at all sometimes I think for many of us in the original crew we got to where we are at the research industry mostly because of either project or connection we made in this group so one of my advice for the existing member of newcomers for this in this group in particular is to utilize the connection we have within this group I think people in general are pretty low ego um I think that Stouts a lot because like it's it's kind of a privilege I think to have opportunities um especially if you came from like a really good school or like had a lot of resources at your disposal I think many of four ai's members might not have come from like you know American schools mostly International and I think having a lot of people from different backgrounds like all very curious about one thing together is what kind of drove the community I definitely want to scale this access the opportunity that I had the fortune of being able to take advantage of right like you know I I dropped out of school I've never been like academically inclined really like my parents don't work in Academia so there was like really no way for me to break in right and so uh I felt like I feel like that is such an important opportunity to have for people who just want to work really hard and you know make something of themselves in this field um so I I'm hoping to provide like sort of pay it forward in a sense yeah I'm like really grateful that I happened to come across for you guys [Music]
Original Description
Did you know? Our non-profit research lab, Cohere For AI, is built on the foundation of "for.ai," a distributed research collaboration begun in part by two of Cohere's co-founders: Aidan Gomez and Ivan Zhang. Learn about it from some of for.ai's original members: Bryan Li, Winnie Xu, and Ivan Zhang.
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Cohere · Cohere · 42 of 60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
▶
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Andreas Madsen on Independent Research and Interpretability
Cohere
Plex: Towards Reliability using Pretrained Large Model Extensions
Cohere
Independent Research Panel Discussion
Cohere
The Future of ML Ops: Open Challenges and Opportunities
Cohere
C4AI Special - Grad School Applications
Cohere
Cohere For AI Fireside Chat: Samy Bengio
Cohere
Cohere For AI - Scholars Program Information Session
Cohere
Modular and Composable Transfer Learning with Jonas Pfeiffer
Cohere
Jay Alammar Presents Large Language Models for Real World Applications
Cohere
Catherine Olsson - Mechanistic Interpretability: Getting Started
Cohere
How To Prompt Engineer a Tech Interview App | TOHacks 2022 Winners
Cohere
C4AI Sparks: Samy Bengio
Cohere
BERTopic for Topic Modeling - Maarten Grootendorst - Talking Language AI Ep#1
Cohere
Exploring News Headlines With Text Clustering | Jay Alammar
Cohere
Scale TransformX | Fireside Chat: Aidan Gomez and Alexandr Wang
Cohere
Making Large Language Models Accessible | Scale AI Fireside chat with Bill MacCartney
Cohere
Intro to KeyBERT - BERTopic for Topic Modeling
Cohere
Intro to PolyFuzz - BERTopic for Topic Modeling
Cohere
API Design Philosophy - BERTopic for Topic Modeling
Cohere
Code demo of BERTopic - BERTopic for Topic Modeling
Cohere
Short texts vs long texts in BERTopic- BERTopic for Topic Modeling
Cohere
How People can help BERTopic - BERTopic for Topic Modeling
Cohere
Cohere For AI: Training Sensorimotor Agency in Cellular Automata with Bert Chan
Cohere
Cohere API Community Demos | October 2022
Cohere
Perfect Prompt Demo By Arjun Patel
Cohere
Project Idea Generator Demo By Tobechukwu Okamkpa
Cohere
SuperTransformer Demo By Amir Nagri and Team Megatron
Cohere
Cohere For AI Fireside Chat: Pablo Samuel Castro
Cohere
How Startups Can Use NLP to Build a Competitive Moat
Cohere
Build Chatbots Faster with Large Language Models
Cohere
Tools to Improve Training Data - Vincent Warmerdam - Talking Language AI Ep#2
Cohere
Utku Evci - Sparsity and Beyond Static Network Architectures
Cohere
Adding human intelligence to ML models with human-learn #shorts #machinelearning #nlp
Cohere
Iterating on your data with doubtlab - Tools to Improve Training Data
Cohere
Adding Human Intelligence to ML models with Human learn - Tools to Improve Training Data
Cohere
Scikt Learn embeddings helpers with Embetter - Tools to Improve Training Data
Cohere
Building Cohere API Demo App With Streamlit | Adrien Morisot
Cohere
Rosanne Liu - career creation for non-standard candidates
Cohere
Giving computers many human languages with Cohere's multilingual embeddings
Cohere
Learning by Distilling Context with Charlie Snell
Cohere
Sentence Transformers and Embedding Evaluation - Nils Reimers - Talking Language AI Ep#3
Cohere
Reflecting on for.ai...
Cohere
Create a Custom Language Model with Surge AI and Cohere
Cohere
Cohere API Community Demos | November 2022
Cohere
Cohere API Community Demos | December 2022
Cohere
Cohere For AI Presents: Colin Raffel
Cohere
Lucas Beyer - FlexiViT: One Model for All Patch Sizes
Cohere
What is Neural Search? Nils Reimers - Sentence Transformers and Embedding Evaluation
Cohere
Evaluating Information Retrieval with BEIR
Cohere
Evaluating Embeddings with MTEB Massive text embeddings benchmark - Nils Reimers
Cohere
High quality text classification with few training examples with SetFit
Cohere
Multilingual and cross lingual embeddings - Nils Reimers
Cohere
Developing open-source software: lessons, benefits, and challenges - Nils Reimers
Cohere
Ask Me Anything with Ed Grefenstette, Head of Machine Learning at Cohere
Cohere
HyperWrite Powers Its Generative AI Service with Cohere
Cohere
EMNLP 2022 Conference Special Edition - Talking Language AI #4
Cohere
Cohere API Community Demos | January 2023
Cohere
C4AI Sparks: Rosanne Liu on Career Creation for Non-Standard Candidates
Cohere
Michael Tschannen - Image-and-Language Understanding from Pixels Only
Cohere
How to Add AI to your App
Cohere
More on: Reading ML Papers
View skill →Related Reads
📰
📰
📰
📰
I Spent Weeks Looking for a Research Gap Before I Realized I Was Searching the Wrong Way
Medium · AI
ICMI 2026 Reviews [D]
Reddit r/MachineLearning
Workshop submission for main conference paper under review [D]
Reddit r/MachineLearning
Kept context-switching between arxiv, OpenReview, GitHub, and HuggingFace for every paper, so I built this. Chrome extension + website with everything inline, plus citation graph + SPECTER2 neighbors. 3M papers, free, feedback welcome [P]
Reddit r/MachineLearning
🎓
Tutor Explanation
DeepCamp AI