Unlike Google Chrome and Internet Explorer 8 Firefox does not provide any in-built private browsing mode, However you can setup Firefox for private browsing using a separate profile as demonstrated below:

1. Goto Windows Start Menu -> Run (or Use Windows Key + R).
2. Type in firefox -ProfileManager and hit enter.

3. Firefox Profile Manager should launch, click the Create Profile button as shown above.