From Admin Home click on the Manage All link in the Subscription Products section. Select a Subscription Category that the Subscription Product is in. Click on the Remove link in the right hand column. This will delete the Subscription Product. Note: This is different to removing the product from a category.
If the remove link is not showing, this is because the subscription product can no longer be removed.