Simplify an if/else statement?

I'm trying to simplify the following:

function handleDirection(src) {
  if (src === 'left') {
    if (inverse) {
      tracker--;
    } else {
      tracker++;
    }
  } else {
    if (inverse) {
      tracker++;
    } else {
      tracker--;
    }
  }
}

to reduce the number of conditionals. The src will either be 'left' or 'right' always.