Once you are in an app and want to get out again, you just press the Home-Button once.
But sometimes an app may be stuck and not respond. If that happens you can close it by quickly clicking the Home-Button twice.

Additional Information:
Pressing the Home-Button once to close an app is similar to minimizing a winow on a PC as it is not really closed but just in the background.