Lync 2013 with Exchange 2013 UM Voicemail delivery delay

We are currently having an issue where it appears that a voicemail is left for the user, but it doesn't get delivered for 20 minutes. This is not constant, but has been creeping up on a regular basis. I have some info below that seems to support this. Anyone have any ideas? I cannot understand why it would be taking 20 minutes for UM to process a voicemail and deliver it to the mailbox.

The pipeline statistics log shows that the voicemail was sent at 3:32:47 PM (We are GMT -6)

SentTime,WorkId,MessageType,TranscriptionLanguage,TranscriptionResultType,TranscriptionErrorType,TranscriptionConfidence,TranscriptionTotalWords,TranscriptionCustomWords,TranscriptionTopNWords,TranscriptionElapsedTime,AudioCodec,AudioCompressionElapsedTime,CallerName,CalleeAlias,OrganizationId
11/21/2013 21:32:47,c8d2ba82-e2cd-4b7e-b530-cee5b6e2a0da,SMTPVoiceMail,en-US,Skipped,AudioQualityPoor,0.1921112,24,2,0,00:01:02.9052573,G711,00:00:00.0090007,,person,


The message tracking log shows the SMTP receive being at 3:56:03 PM. 

RunspaceId              : ddf7889b-3e53-4b15-a42f-64bca7c8e411
Timestamp               : 11/21/2013 3:56:03 PM
ClientIp                : 2.2.2.2
ClientHostname          : SERVER02
ServerIp                : 2.2.2.2
ServerHostname          : SERVER02
SourceContext           : 08D0B391ED127EBF;2013-11-21T21:56:03.592Z;0
ConnectorId             : SERVER02\Default SERVER02
Source                  : SMTP
EventId                 : RECEIVE
InternalMessageId       : 15998753179082
MessageId               : <0e7b3f00-86fb-452d-a252-d19b5d9e5423@SERVER01>
Recipients              : {person@domain.com}
RecipientStatus         : {}
TotalBytes              : 128569
RecipientCount          : 1
RelatedRecipientAddress :
Reference               :
MessageSubject          : Voice Mail (15 seconds)
Sender                  : MicrosoftExchange329e71ec88ae4615bbc36ab6ce41109e@domain.com
ReturnPath              : MicrosoftExchange329e71ec88ae4615bbc36ab6ce41109e@domain.com
Directionality          : Undefined
TenantId                :
OriginalClientIp        : 1.1.1.1
MessageInfo             : 0cI:
MessageLatency          :
MessageLatencyType      : None
EventData               : {[FirstForestHop, SERVER02], [ProxiedClientIPAddress, 1.1.1.1],
                          [ProxiedClientHostname, SERVER01], [ProxyHop1,
                          SERVER02(3.3.3.3)], [DeliveryPriority, Normal]}




The message tracking log shows that the message was sent to the mailbox at 3:56:04 PM. Note the timestamp on the SourceContext line for ClientSubmitTime. It shows 21:32:47 (3:32:47).

RunspaceId              : ddf7889b-3e53-4b15-a42f-64bca7c8e411
Timestamp               : 11/21/2013 3:56:04 PM
ClientIp                :
ClientHostname          : SERVER01
ServerIp                :
ServerHostname          : SERVER01
SourceContext           : 08D0B396BCB6EF39;2013-11-21T21:56:04.361Z;ClientSubmitTime:2013-11-21T21:32:47.582Z
ConnectorId             :
Source                  : STOREDRIVER
EventId                 : DELIVER
InternalMessageId       : 15998753179082
MessageId               : <0e7b3f00-86fb-452d-a252-d19b5d9e5423@SERVER01>
Recipients              : {person@domain.com}
RecipientStatus         : {}
TotalBytes              : 129788
RecipientCount          : 1
RelatedRecipientAddress :
Reference               :
MessageSubject          : Voice Mail (15 seconds)
Sender                  : MicrosoftExchange329e71ec88ae4615bbc36ab6ce41109e@domain.com
ReturnPath              : MicrosoftExchange329e71ec88ae4615bbc36ab6ce41109e@domain.com
Directionality          : Undefined
TenantId                :
OriginalClientIp        : 2.2.2.2
MessageInfo             : 2013-11-21T21:56:03.576Z;SRV=SERVER02:TOTAL=0;SRV=SERVER02
                          :TOTAL=0;SRV=SERVER01:TOTAL=0
MessageLatency          : 00:00:01.1690000
MessageLatencyType      : EndToEnd
EventData               : {[MailboxDatabaseName, MN-EX-DB1], [E2ELatency, 1], [DeliveryPriority, Normal]}