Khloe and Lamar have jointly gone to court to dismiss their divorce case, because they want to stay husband and wife ... TMZ has learned.