Here's how to care for rosemary in winter, whether in containers or in the ground. In-ground rosemary ... Apply a few inches of an organic mulch like shredded leaves, straw, or salt hay around ...