Will I need to be logged onto the app for the duration of the OSA?

Yes, for any additional biometric requirements and to answer the randomized security questions.