Unless you are a CSS expert, removing the Membership buttons is not a configurable option. They won't show if you don't have any subscription products configured, and they will show if you do.
However, depending on how your own website is set up, you may want to send them directly to the relevant WebCollect pages, rather than to the home page. E.g. "Become a member" links straight to the subscriptions page.
For those who understand CSS, you can customise your webpages using CSS rules. See here for details.