Add thumbnail images (Recent Posts?) to sidebar

  Is there a straightforward way to put  thumbnails (featured images?) from posts or pages into a sidebar, for example into the Recent Posts menu in main sidebar. Whatever I do, I only ever seem to get just a list of post titles appear, no little thumbnails. Perhaps I need a plug-in for this?