[ty] Don't track inferability via different `Type` variants #55406

Job	Run time
cargo fmt	19s
Determine changes	19s
pre-commit	2m 13s
mkdocs	2m 51s
python package	1m 27s
cargo build (release)	0s
cargo test (linux)	3m 39s
cargo clippy	1m 53s
cargo test (linux, release)	6m 57s
cargo test (windows)	7m 25s
cargo fuzz build	3m 58s
cargo test (wasm)	3m 30s
cargo build (msrv)	1m 54s
cargo shear	20s
ty completion evaluation	1m 34s
benchmarks walltime (medium\|multithreaded)	8m 30s
test scripts	1m 2s
benchmarks instrumented (ty)	9m 39s
benchmarks instrumented (ruff)	0s
check playground	0s
benchmarks walltime (small\|large)	8m 7s
formatter instabilities and black similarity	0s
ecosystem	50s
test ruff-lsp	44s
Fuzz for new ty panics	16m 59s
fuzz parser	0s
	1h 24m 10s

Provide feedback