VRAM isn't just used as a frame buffer (which is proportional in size to screen resolution), it also provides fast access to textures, and likely other things.