The bustling port city across the Yellow Sea from North Korea was home to about 500 North Koreans when he was living there, Lee says.