This is the ideal location for the history buff.
Check out underground caverns with guided tours from Plain Road in the Golden Bay. It made things much easier if you speak their languages, hence a private guided Taiwan easy and complimentary tour is generally recommended.