Contacts from your CRM can quickly be added to any of your events via the Contacts submodule of the CRM module.
There, click on the Actions menu of a contact or several contacts and select "Add to event". The contacts will be added as participants to your event.