This would depend on how sales are going on. If sales are completely cut off and you are no longer selling, then yes, you may want to remove the inventory or else you will be hit with the storage fees each month they are not selling. So if you were to go forward with a seasonal item, you would want to avoid this by staying on the safe side and starting with a smaller order if possible, just to ensure you aren't stuck with any inventory after the season.
I still have winter products and it's getting warm out, what do I do?
How do I sell out of my out of season items?