The weapons will all be era-appropriate, so if you could conceivably find it in 1920s America, you could indeed purchase a weapon! You won't be able to stock an arsenal on your budget, but you could pick up a gun and some ammo if you so desired.