You wouldn't need to have exterior load bearing construction inside, but I don't think that absolves all structural concerns. What about services (HVAC, electricity, plumbing)? What about interfacing with the outside world, i.e. windows?