North Korea has refused to accept U.S. President Donald Trump's letter to leader Kim Jong Un, a report said Wednesday, citing an informed high-level source.