Does the app need to be open all the time?

No, the app is only needed for the initial setup of the CardioGyms module, to customize schedules, or to view usage data. You can also start a session manually by pressing the button on the device, no app required.