There is currently a construction site here in the city center (as of August 2023). A big mosque to visit is the Ulu Mosque. Around the square of the mosque there are many small shops.
Bitlis is in a deep valley, so the 10km descent is a dream. But you should also think carefully about the way back, since you can only drive out the same way again.