Job processor can sometimes display this error
"This file is only available from the following sites which are not accessible at this time: <AVFSServer>."
Looking in the Vault log files on the AVFS server there's no messages at this time.
On the server requesting the file, the ADMS server, the AVFS log message corresponds to the following.
07/02/2014 13:21:55 Replicating resource '<filename>.iam' version 20 from Site <AVFS>. Located in the file store at D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam.
07/02/2014 13:22:29 Acquired license(339425792) for username(<JPUsername>), userId(31), host(<IPADDRESS>). 07/02/2014 13:22:31 ******************************************************************* Resource replication: Validation Error: BadResourceRelativePath [111] Exception: BadResourceRelativePath [111] Stacktrace: at Connectivity.Server.Common.Services.FileStore.GetResourceStream(IResourceStore context, Resource source) at Connectivity.Server.Common.Services.FileStore.GetResourceChecksum(IResourceStore resContext, Resource res) at Connectivity.Filestore.Replicator.ValidateResource(SiteAccessor siteAccessor, Resource res)
Exception(Inner): The process cannot access the file 'D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam' because it is being used by another process. Stacktrace(Inner): at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options, String msgPath, Boolean bFromProxy) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Connectivity.Server.Common.Services.FileStore.GetResourceStream(IResourceStore context, Resource source)
07/02/2014 13:22:31 Replicating resource '<filename>.iam' version 20 from Site <AVFS>. Located in the file store at D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam.
07/02/2014 13:22:31 ******************************************************************* Resource replication: Failed to replicate resource. Trying next site if available. Exception: WebServiceError [8005] (http://<AVFS>:80) Stacktrace: at Connectivity.Server.Proxies.ServiceAccessor`3.Execute(String remoteServer, Action`1 action) at Connectivity.Filestore.Replicator.ReplicateResource(SiteAccessor siteAccessor, FilestoreAccessor fileAccessor, Resource res, RemoteSites sourcesites)
Exception(Inner): The process cannot access the file 'D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam' because it is being used by another process. Stacktrace(Inner): at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.File.InternalDelete(String path, Boolean checkHost) at Connectivity.Server.Proxies.FilestoreUtil.DownloadResource(ServiceContext`3 servicectx, Resource resource, Byte[] downloadTicket, String downloadloc, CompressionHeader compressionHeader) at Connectivity.Filestore.Replicator.FilestoreAccessor.<>c__DisplayClass10.<Download>b__f(ServiceContext`3 servicectx) at Connectivity.Server.Proxies.ServiceAccessor`3.tryexecute(String remoteServer, Action`1 action, Int32 attemptCount) at Connectivity.Server.Proxies.ServiceAccessor`3.Execute(String remoteServer, Action`1 action)
07/02/2014 13:22:31 Could not validate or replicate resource '<filename>.iam' version 20. Located in the file store at D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam.
07/02/2014 13:22:31 ******************************************************************* Error: Soap Exception ( mesg-id = 635273761516098382 ) Exception: CouldNotReplicate [205] (<AVFS>) Stacktrace: at Connectivity.Filestore.Replicator.OnReplicateFailure(Enum code, Resource res, String[] arguments) at Connectivity.Filestore.Replicator.ReplicateResource(SiteAccessor siteAccessor, FilestoreAccessor fileAccessor, Resource res, RemoteSites sourcesites) at Connectivity.Filestore.Replicator.UnthreadedWorker.ReplicateResource(SiteAccessor siteaccessor, Resource res) at Connectivity.Filestore.Replicator.Execute(Resource res) at Connectivity.Filestore.FilestoreServices._processdownloadticket(Byte[] downloadTicket, Boolean allowSync) at Connectivity.Web.Filestore.v18.FilestoreService.DownloadFilePart(Byte[] downloadTicket, Int64 firstByte, Int64 lastByte, Boolean allowSync) at SyncInvokeDownloadFilePart(Object , Object[] , Object[] ) at System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]& outputs) at System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc& rpc) at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc& rpc) at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage31(MessageRpc& rpc) at System.ServiceModel.Dispatcher.MessageRpc.Process(Boolean isOperationContextSet)
07/02/2014 13:22:31 Releasing license(339425792) for username(<JPUsername>), userId(31), host(<IPADDRESS>). 07/02/2014 13:22:33 Acquired license(339425792) for username(<JPUsername>), userId(31), host(<IPADDRESS>). 07/02/2014 13:22:57 Releasing license(339425792) for username(<JPUsername>), userId(31), host(<IPADDRESS>). 07/02/2014 13:22:58 Acquired license(182468256) for username(<JPUsername>), userId(31), host(<IPADDRESS>). 07/02/2014 13:23:02 ******************************************************************* Resource replication: Validation Error: BadResourceRelativePath [111] Exception: BadResourceRelativePath [111] Stacktrace: at Connectivity.Server.Common.Services.FileStore.GetResourceStream(IResourceStore context, Resource source) at Connectivity.Server.Common.Services.FileStore.GetResourceChecksum(IResourceStore resContext, Resource res) at Connectivity.Filestore.Replicator.ValidateResource(SiteAccessor siteAccessor, Resource res)
Exception(Inner): The process cannot access the file 'D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam' because it is being used by another process. Stacktrace(Inner): at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options, String msgPath, Boolean bFromProxy) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Connectivity.Server.Common.Services.FileStore.GetResourceStream(IResourceStore context, Resource source)
07/02/2014 13:23:02 Replicating resource '<filename>.iam' version 20 from Site <AVFS>. Located in the file store at D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam.
07/02/2014 13:23:02 ******************************************************************* Resource replication: Failed to replicate resource. Trying next site if available. Exception: WebServiceError [8005] (http://<AVFS>:80) Stacktrace: at Connectivity.Server.Proxies.ServiceAccessor`3.Execute(String remoteServer, Action`1 action) at Connectivity.Filestore.Replicator.ReplicateResource(SiteAccessor siteAccessor, FilestoreAccessor fileAccessor, Resource res, RemoteSites sourcesites)
Exception(Inner): The process cannot access the file 'D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam' because it is being used by another process. Stacktrace(Inner): at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.File.InternalDelete(String path, Boolean checkHost) at Connectivity.Server.Proxies.FilestoreUtil.DownloadResource(ServiceContext`3 servicectx, Resource resource, Byte[] downloadTicket, String downloadloc, CompressionHeader compressionHeader) at Connectivity.Filestore.Replicator.FilestoreAccessor.<>c__DisplayClass10.<Download>b__f(ServiceContext`3 servicectx) at Connectivity.Server.Proxies.ServiceAccessor`3.tryexecute(String remoteServer, Action`1 action, Int32 attemptCount) at Connectivity.Server.Proxies.ServiceAccessor`3.Execute(String remoteServer, Action`1 action)
07/02/2014 13:23:02 Could not validate or replicate resource '<filename>.iam' version 20. Located in the file store at D:\Autodesk\<FSLocation>\<VaultName>\000\000\000\000\001\050\1050625\1050625_1078947_20.iam.
07/02/2014 13:23:02 ******************************************************************* Error: Soap Exception ( mesg-id = 635273761829348390 ) Exception: CouldNotReplicate [205] (<AVFS>) Stacktrace: at Connectivity.Filestore.Replicator.OnReplicateFailure(Enum code, Resource res, String[] arguments) at Connectivity.Filestore.Replicator.ReplicateResource(SiteAccessor siteAccessor, FilestoreAccessor fileAccessor, Resource res, RemoteSites sourcesites) at Connectivity.Filestore.Replicator.UnthreadedWorker.ReplicateResource(SiteAccessor siteaccessor, Resource res) at Connectivity.Filestore.Replicator.Execute(Resource res) at Connectivity.Filestore.FilestoreServices._processdownloadticket(Byte[] downloadTicket, Boolean allowSync) at Connectivity.Web.Filestore.v18.FilestoreService.DownloadFilePart(Byte[] downloadTicket, Int64 firstByte, Int64 lastByte, Boolean allowSync) at SyncInvokeDownloadFilePart(Object , Object[] , Object[] ) at System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]& outputs) at System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc& rpc) at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc& rpc) at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage31(MessageRpc& rpc) at System.ServiceModel.Dispatcher.MessageRpc.Process(Boolean isOperationContextSet)
This was caused by an interruption in the network connectivity between the ADMS and AVFS server.
It's possible that it could also occur if the AVFS machine was restarted or suffered a power outage.
Resubmitting the Job once communication between ADMS and AVFS resolves the issue.