You can unlock more weapons by completing certain levels.  For example, the first weapon is unlocked by completing level 24.