Track the dirty status of individual elements in `AtomicSparseBufferVec`. (#24078)