Back/Forward (CTRL-O/CTRL-I) doesn't work globally across files.

Reproduction example:

1. move cursor over identifier declared in another file
2. activate Follow Symbol Under Cursor to jump to its declaration in that file
3. activate CTRL-O mapping

Nothing happens. Should jump back in history to the original file at cursor before the jump.