📰 Reddit r/deeplearning

There is a huge gap in open source AI accelerators, so I implemented mine . Popular and well known ones are already legacy and doesn't support contemporary oper

Hi everyone, I am training a binary image segmentation model for my final year uni project. I use a Unet architecture, with a ResNet encoder trained on ImageNet

​ This is the third in a series of seven posts on how our top AI models describe the paradise our world could be transformed into when AI does all of our work.

As far as I understand the multi head attention it's just computing different K,Q,V for the same input by passing it through different linear transformations. R

submitted by /u/Odd_Bid8616 [link] [comments]

Long story short, an 8B model in 16-bit precision is 16 GB. Every token requires a full weight transfer from HBM to on-chip SRAM. With 3.35 TB/s bandwidth: 3,35

submitted by /u/vergueirou [link] [comments]

submitted by /u/Markomkd [link] [comments]

I'm benchmarking lightweight transformers for fault detection on edge devices using three public datasets (NASA C-MAPSS, SECOM, and UCI AI4I 2020). MobileBERT s

​ The conventional narrative warns us of the dangers of very powerful AI being in the hands of one corporation. The fear is that a developer might gain such a l

submitted by /u/Danny-1257 [link] [comments]

I’m a complete beginner in cybersecurity and ML/LLMs. I’m planning to start my undergrad thesis on decentralized LLMs (DD LLMs) in about 8 months, and I want to

Reading through the Wall-OSS-0.5 report and one claim seems worth sanity checking: in their setup, flow matching is not the main learning signal reaching the VL

Hey everyone, For my bachelor’s thesis, I built a website that serves as a library for more than 200,000 research papers, with new papers being added and update

submitted by /u/markuzo1 [link] [comments]

submitted by /u/MagicaItux [link] [comments]

​ This is the second in a series of seven posts on how our top AI models describe the paradise our world could be transformed into when AI does all of our work.

I'm trying to understand the intuition behind Word2Vec training using a neural network. In Word2Vec (CBOW or Skip-gram), we often hear that the weight matrices

submitted by /u/Embarrassed-Party552 [link] [comments]

[ Removed by Reddit on account of violating the content policy . ] submitted by /u/ConditionFederal3760 [link] [comments]

submitted by /u/clutcher_cop [link] [comments]

​ Let's start with a fact that too few people are aware of, but that absolutely everyone should very well understand. In the 1800s there were people who became

For me, it’s not writing code it’s everything around it. Environment setup, managing compute resources, making sure things run consistently, and dealing with in

submitted by /u/Traditional_Ball1392 [link] [comments]