Hey @dustycatbc, thanks for joining the Dropbox Community!
At the moment, there's no option to un-star multiple files at a time.
A workaround would be to go to your "starred" page on dropbox.com, where all your starred items are, and remove the stars from there.
I hope this helps, but let me know if you have any questions.