I guess you’d have to wake up to switch it over, but honestly just a power bank with a standard outlet would probably be adequate.

The CPAP model I use is meant for travel. When I bought it, it originally offered a bundle including - essentially - a power bank. It looks like that bundle is no longer offered, but now there appears to be a whole range of accessories meant to deal with loss or lack of power.