If you want to play offline you need cached credentials, so you need to have auto-login enabled, and steam will prompt you when you don't have an internet conne

If you want to play offline you need cached credentials, so you need to have auto-login enabled, and steam will prompt you when you don't have an internet connection (or you can explicitly restart steam into offline mode while logged in). It has worked for me very recently.