Tyler Sticka digs in here in the best possible way: by making a test page and literally measuring performance.
https://css-tricks.com/which-svg-technique-performs-best-for-way-too-many-icons/