You'll be hard-pressed to find a network engineering analysis showing that priority flows on a packet network have higher latency than generic flows on a lower-bandwidth packet network. The Internet is a packet-switched network, not a telegraph network.