Do GPUs hold their value over time?

Often, yes. Some GPUs (e.g., consumer cards) have sold for 100% above MSRP months and years after their original release date.

Enterprise GPUs often retain ~80% of value after 2 years of full use. Though this will vary depending on each model type.