If I place potions on the " action bar " (I think this is the correct name) and use them all, there is no art change that occurs to inform me I am out of potions for that specific slot.
I would expect the icon to change to indicate I no longer have anymore of that potion so that I can either resupply or replace it with something else.