How To Fine-tune LLaVA Model (From Your Laptop!)

Follow Along: https://console.brev.dev/launchable/deploy/now?userID=p2mzt91a8&orgID=jnj0c501d&launchableID=env-2hpxJ6HArVk5jzOYgJmFDJfvNmH&instance=A10G%40g5.12xlarge&diskStorage=300&cloudID=devplane-brev-1&python=3.10&cuda=12.2.2&file=https%3A%2F%2Fgithub.com%2Fbrevdev%2Fnotebooks%2Fblob%2Fmain%2Fllava-finetune.ipynb&name=Fine-tune+and+deploy+multimodal+LLaVA-1.5 Join Our Discord: https://discord.com/invite/NVDyv7TUgJ In this guide, we fine tune the popular open sourced model, LLaVA (Large Language-and-Vision Assistant) on a dataset to be used in a visual classification application. You can perform the fine tuning yourself, regardless your level of experience, or the level of compute you have access to. Please leave any future guides you would like made below!