DFSR - Constant 1726 Events and large files do not replicate.


hi,

we have dfsr hub , spoke topology 50 members across 45 sites connected mixture of ipsec vpn & mpls. 1 hub server running server 2012 standard, others either server 2008 r2 standard or enterprise.

all servers have latest patchlevel
servers in 1 domain
theres no problem normal ad-replication
no obvious errors dcdiag or netdiag
1 namespace
61 replicated folders containing mixture of office documents, images , videos

problem:
there large backlogs reported dfsr diag
large files replicate extremely or not @ (for example 984mb file created 32 days ago has still not reached 40 out of 50 sites.)
many dfsr event id 5014 warnings logged on members ('error: 1726 (the remote procedure call failed.) 
hub server's dfsr debug logs contain many entries stating 'failed reserve file transfer server context, no more contexts available'. these messages seem corrospond dfsr event 5014 messages.

example debug log:

20131201 18:03:46.908 3696 srtr  2772 initializefiletransferasyncstate::processiocompletion 0000003401a87920
20131201 18:03:46.908 3696 rpcn  1889 [warn] networkglobals::reservefiletransfer failed reserve file transfer server context, no more contexts available. updatename:removedfilename.ods uid:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1665723 gvsn:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1665723 connid:{1f655f11-0101-4833-805e-680361c778fe} csid:{acf6e46c-09ce-4e7d-85f5-10206356c231} totalcontexts:128
20131201 18:03:46.908 3696 srtr  3011 [warn] initializefiletransferasyncstate::processiocompletion failed initialize file transfer. connid:{1f655f11-0101-4833-805e-680361c778fe} rdc:1 uid:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1665723 gsvn:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1665723 completion:0 ptr:0000003401a87920 error:[error:9078(0x2376) initializefiletransferasyncstate::processiocompletion servertransport.cpp:2884 3696 c server file transfer contexts busy] 
20131201 18:03:46.908 3696 srtr  2701 initializefiletransferasyncstate::~initializefiletransferasyncstate this:0000003401a87920
20131201 18:03:46.908 3696 srtr  2772 initializefiletransferasyncstate::processiocompletion 0000003401a85d00
20131201 18:03:46.908 3696 rpcn  1889 [warn] networkglobals::reservefiletransfer failed reserve file transfer server context, no more contexts available. updatename:removedfilename.xls uid:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1608783 gvsn:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1608783 connid:{1f655f11-0101-4833-805e-680361c778fe} csid:{acf6e46c-09ce-4e7d-85f5-10206356c231} totalcontexts:128
20131201 18:03:46.908 3696 srtr  3011 [warn] initializefiletransferasyncstate::processiocompletion failed initialize file transfer. connid:{1f655f11-0101-4833-805e-680361c778fe} rdc:1 uid:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1608783 gsvn:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1608783 completion:0 ptr:0000003401a85d00 error:[error:9078(0x2376) initializefiletransferasyncstate::processiocompletion servertransport.cpp:2884 3696 c server file transfer contexts busy] 
20131201 18:03:46.908 3696 srtr  2701 initializefiletransferasyncstate::~initializefiletransferasyncstate this:0000003401a85d00
20131201 18:03:46.908 3696 srtr  2772 initializefiletransferasyncstate::processiocompletion 0000003401a87530
20131201 18:03:46.908 3696 rpcn  1889 [warn] networkglobals::reservefiletransfer failed reserve file transfer server context, no more contexts available. updatename:removedfilename.pdf uid:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1665542 gvsn:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1665542 connid:{1f655f11-0101-4833-805e-680361c778fe} csid:{acf6e46c-09ce-4e7d-85f5-10206356c231} totalcontexts:128
20131201 18:03:46.908 3696 srtr  3011 [warn] initializefiletransferasyncstate::processiocompletion failed initialize file transfer. connid:{1f655f11-0101-4833-805e-680361c778fe} rdc:1 uid:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1665542 gsvn:{80eba14c-e68b-438f-ac8f-22d9b32bf51d}-v1665542 completion:0 ptr:0000003401a87530 error:[error:9078(0x2376) initializefiletransferasyncstate::processiocompletion servertransport.cpp:2884 3696 c server file transfer contexts busy] 
20131201 18:03:46.908 3696 srtr  2701 initializefiletransferasyncstate::~initializefiletransferasyncstate this:0000003401a87530
20131201 18:03:46.908 3696 srtr  2772 initializefiletransferasyncstate::processiocompletion 0000003401a83510
20131201 18:03:46.908 3696 rpcn  1889 [warn] networkglobals::reservefiletransfer failed reserve file transfer server context, no more contexts available. updatename:removedfilename.doc uid:{1da51289-c37e-4a07-a625-90933a0f808d}-v1412159 gvsn:{1da51289-c37e-4a07-a625-90933a0f808d}-v1412159 connid:{4344f679-9507-4d15-9730-dfc73efad456} csid:{acf6e46c-09ce-4e7d-85f5-10206356c231} totalcontexts:128
20131201 18:03:46.924 3696 srtr  3011 [warn] initializefiletransferasyncstate::processiocompletion failed initialize file transfer. connid:{4344f679-9507-4d15-9730-dfc73efad456} rdc:1 uid:{1da51289-c37e-4a07-a625-90933a0f808d}-v1412159 gsvn:{1da51289-c37e-4a07-a625-90933a0f808d}-v1412159 completion:0 ptr:0000003401a83510 error:[error:9078(0x2376) initializefiletransferasyncstate::processiocompletion servertransport.cpp:2884 3696 c server file transfer contexts busy] 
20131201 18:03:46.924 3696 srtr  2701 initializefiletransferasyncstate::~initializefiletransferasyncstate this:0000003401a83510
20131201 18:03:46.924 3696 srtr  2772 initializefiletransferasyncstate::processiocompletion 0000003401a864e0

i have tried following solutions:

installed latest nic-drivers on each server
installed latest dfsr binaries
no teaming @ nics
disabled task offloading 
increased size of staging folder 16gb
excluded dfsrs.exe antivirus
excluded 'system volume information' directory antivirus
no backups running
increased bandwidth allocation
tried rdc disabled & enabled - no difference
removed fsrm screens
members pre-staged using robocopy method
reviewed http://blogs.technet.com/b/askds/archive/2007/10/05/top-10-common-causes-of-slow-replication-with-dfsr.aspx
reviewed http://support.microsoft.com/default.aspx?scid=kb%3ben-us%3b958802 latest dfs-files

any suggestions please?




Windows Server  >  File Services and Storage



Comments

Popular posts from this blog

Error: 0x80073701 when trying to add Print Services Role in Windows 2012 Standard

Disconnecting from a Windows Server 2012 R2 file sharing session on a Windows 7,8,10 machine

Event ID 64,77,1008 Certificates Events Windows Server 2008, 2008R2