Heterogeneous GPU Weighting & Layer Splitting

This is what I worked on today. With local LLM of course. So if I didn't write the code, did I really work on it? Who cares. It was my idea and I simply asked it to implement it. I basically downloaded /main/ branch, which is totally broken for Windows by the way (i had to remove vision and mlx support, it basically compiles only for Darwin for some reason by default), and then change the crap for the redistribution of weights to minimize bottlenecks. Bef