Convert remaining Vec usage to TryVec

Also, reduce the unsafe footprint for several C API functions by splitting
out the small unsafe portion.

Author: baumanj