Actually, there was no TRUE limit to how much an N64 cart could hold. It just came down to a price issue. They could always use some sort or bank-switching method, like NES games did, to get around the address space limits, but throwing more and more ROM chips into the cartridge starts to get cost-prohibitive(as has been mentioned).