Won’t this cause cat to iterate through all files in the cwd once zcat encounters an issue, instead of just the specific file?

Yeah, it’s a pain. Leads to bad one liners:

for i in $(ls); do zcat $i || cat $i; done

Is that Har Mar Superstar?