Karma is associated with a soul and not physical body. What decisions mind and body takes are part of physical world but when body and mind together constitutes and act as a responsible soul it is karmic role!
One cannot decide where to take birth in poverty and sufferings or on the prosperous part of spectrum but it can always make a choice on where to stay for rest of its life.
