I am guessing the falling out has more to do with the fact that this was going on while still dating Miri?

That'd be my blind read of the matter at least.