Remove RTD envs.

This removes some duplication of environments (potentially relevant) to
an incoming PR. Previously we needed this because of type hinting but I
think that RTD has moved to 3.5 so we should be fine.

Author: drvinceknight