The "units fighting" UI info panel is often outdated
The crossed swords panel that shows the number of units fighting and allows to jump to them is often counts previously fought units that no longer are in any way participating in battle. There were instances where it would count several units, and each of them were already in the Lair or dining in the Tavern.
Game Version:
Steam Public
Platform:
Windows
I think that's because of the new opitmisation V0id implemented.
thanks for the report