Is Jetson faster than Raspberry? Comparing speed of generation for 7B LLM!

In that video we will compare speed of generation of local 7B LLM on different microcomputers - Raspberry Pi 4b, Raspberry Pi 5 and Jetson Xavier. We will measure exact times and will draw a conclusions about with computer is faster and how to mimimaze time of generation even more. We will use OpenChat-3.5 model for our tests.