 According to director Mitchell Leisen, since this was the last film  made by RKO, a wrecking crew followed him around during shooting  and, every time he wrapped a scene, the foreman of the wrecking crew  asked him if he was absolutely finished with that set and wouldnt  be needing it again. If Leisen said yes, the foreman called his crew  in and they demolished the set as soon as Leisen was done with it.