The Two-Way Lee Harvey Oswald's Apartment Building Is Coming Down, Dallas Declares January 7, 2013 The man who killed President Kennedy lived in Apt. No. 2 in 1962 and 1963. In the years since, the building has been falling apart. Though the city has ordered the owner to tear it down, that hasn't happened. So starting today, city crews will be on the scene to do the work.