Eliminating the use of plastics lowers the demand for oil and alleviates a source of persistent pollution.
However, alternatives such as glass, paper, wood, and metal have their own environmental impacts, so be thoughtful about any consumption. Reuse containers whenever possible.