I just had the same problem installing Panther. To downgrade, I went to the original Jaguar intall disks and chose the “restore and archive” option (I think that’s what it was called).
That took me back to square one — but of course there were some small issues of various utilities and things not reinstalling over the newer versions. I had to go back and correct those things individually.
Hope this helps.