No, you do not need to do that. All steps will be proceeded completely online. Rwandan government currently allows many nationalities to apply for Rwandan eVisa. Please check requirements for details.
The allowed number of entries depends on the type of Rwandan eVisa. With Rwandan e-Tourist, you can choose either single entry or multiple entries. e-Business and e-Transit visa are available for single entry only while East Africa Tourist Visa is available for multiple entries.