fix(index): make IVF buffer setter safe (#8602)