fix: guard user_speaking span end timestamps#5160

Bnowako wants to merge 2 commits intolivekit:mainlivekit/agents:mainfrom

Bnowako:fix/user-speaking-span-end-timestampsBnowako/agents:fix/user-speaking-span-end-timestampsCopy head branch name to clipboard