Gonna need something to defend yourself with against invasions from rival gangs.

Bullets won’t protect you against an intentionally set fire to your home or base. Without laws, it won’t be gun vs gun situation.

That said, it would really depend on the type of apocalypse we’re talking about.

Massive natural disaster? Nuclear? Pandemic? “Zombies”? Global drought? A breakdown of society?

Bullets might be fine depending on the situation. You might not even survive long enough to use them.