How can I set by when members must confirm/cancel?
When creating an event, you can specify various settings. Among other things also until when members have to confirm/cancel.
Create an Event under Events -> Create an Event -> scroll down to Settings -> under cancel until, you can set a time. Until this time, the members must have signed up.