There's an edge of tension that drops when he recognises Number's voice, and it's less of a smile than a satisfied grimace.

"Numbers-- yes, u-uh- please, come in." He can contain himself at least until the door is shut again - and it says something about the nature of the discussion that he chooses to lock the door behind Numbers.