If Else Statement displaying wrong div

I'm trying to display a different chat bubble color per user in one conversation.

This works:

        <?php
    $chatmsgQ="SELECT * FROM ve_chat c 
               WHERE c.isActive='1' AND c.fromUserId='$loginid_session' 
               OR c.toUserId='$loginid_session'";
    $chatmsgresult=  mysqli_query($db,$chatmsgQ);
    while($chatmsg=  mysqli_fetch_array($chatmsgresult)){;?>

       <?php if($chatmsg['fromUserId']==$loginid_session):?>
       <!-- user one -->
<p class='bubble pull-left'><?=$chatmsg['message'];?></p>

 <?php elseif($chatmsg['fromUserId']!=$loginid_session):?>
   <!-- user two-->
<p class='bubbleother pull-right'><?=$chatmsg['message'];?></p>
   <?php endif;?>
    <?php } ;?>

But the previous statement is not quite what is needed. User needs to keep same bubble across conversation. The query below is correct but does not work. What am I doing wrong?

        <?php
    $chatmsgQ="SELECT * FROM ve_chat c 
     WHERE c.isActive='1' AND c.fromUserId='$loginid_session' 
     OR c.toUserId='$loginid_session'";
    $chatmsgresult=  mysqli_query($db,$chatmsgQ);
    while($chatmsg=  mysqli_fetch_array($chatmsgresult)){;?>

       <?php if($chatmsg['fromUserId']==$loginid_session OR $chatmsg['toUserId']==$loginid_session):?>
       <!-- user one -->
<p class='bubble pull-left'><?=$chatmsg['message'];?></p>

 <?php elseif($chatmsg['fromUserId']!=$loginid_session OR $chatmsg['toUserId']!=$loginid_session):?>
   <!-- user two-->
<p class='bubbleother pull-right'><?=$chatmsg['message'];?></p>
   <?php endif;?>
    <?php } ;?>