Silver Canyon is a direct, albeit rather steep gravel downhill option to Bishop, making for a sweet loop if climbing up White Mountain Road. After a mile a short detour gravel road runs up to Silver Peak, though views are about the same from here.
If continuing up to White Mountain summit first, it can be interesting to return on Wyman Creek Road, which runs parallel and comes out here.