I only need accommodation for part of my trip
You'll enjoy the cafes and monuments in Toyoshina. You might want to make time for a stop at Toyoshina Museum of Modern Art or Iinuma Pilot Memorial.