OpenContainingFolder is a plugin for Rhythmbox. It adds an option to open the folder containing the selected track(s) to the right click context menu. This page contains information and links relating to it.
You can download the latest version here.
To install the plugin, run install.py. If you have problems, try running ‘install.py -l’ in a terminal and select the version of Rhythmbox you have installed.