AutoQC "stalling" phains  2017-03-15 22:22:47
 
Hi,

we have AutoQC setup to monitor several MS with a number of different configuration files. All of them work *most* of the time. We have noticed that after a few days (we are still working out how long), AutoQC stops working for some of the configurations. If you stop the individual configuration (as opposed to the AutoQC application) and restart it, the files are successfully processed. It is possible ALL the configurations are doing this, it’s just that we haven’t noticed as those particular configurations aren’t supposed to be processing any files at this point in time. As such, it may be a global issue, or a local issue, we aren't 100% sure as yet.

We have other software running on the same PC doing a very similar thing (syncing files) and it is not experiencing any issues, so we don’t think it’s related to computer sleep issues (the PC is set to stay wake all the time, ditto the HDD).

Any ideas?

Thanks,

Peter
 
 
Vagisha Sharma responded:  2017-03-16 09:24:25
Hi Peter,

So, it sounds like AutoQC Loader stops detecting new files added to those directories? It might help if you send me the log files (AutoQC.log) from the directories where this happened. Are these on mapped network drives? How many configurations do you run simultaneously? Also, please let me know what version of AutoQC Loader you are running - you will find it in the title bar.

Thanks,
Vagisha
 
phains responded:  2017-03-16 13:26:45
Hi Vagisha,

yes, it stops detecting new files. The log file has absolutely nothing in it. It will mention the last file that was processed days ago, and then nothing. It's just waiting for new files. I'll post a log file when I next find a "non-responder."

Yes, we are monitoring a network drive and yes, it does have the annoying habit of spontaneously disconnecting. The vast majority of the time this is for a short period of time and it also reconnects without issue.

As for how many configurations, we are currently running 24. We use different configurations to monitor different peptides from the same run (we have our reasons). We are also looking at a range of different preps for QC. That number may decrease in time, but that is what we are currently employing. As for the version: 1.1.0.10005,

thanks,

Peter
 
Vagisha Sharma responded:  2017-03-16 16:09:50
Thanks, Peter. I suspect the code that is supposed to try to remap disconnected network drives is not working as expected. Let me test it out and get back to you.

-Vagisha
 
Vagisha Sharma responded:  2017-03-20 11:40:55
Hi Peter,

Are the Skyline documents associated with each configuration also on mapped network drives? I just found a bug that would cause AutoQC's attempt to remap a network drive to fail in this case. I will fix the bug and put out a release by tomorrow.

If your Skyline files are not on mapped drives then I need to keep looking for the cause.

Thanks,
Vagisha
 
phains responded:  2017-03-20 13:02:33
Hi Vagisha,

Yes, all the Skyline files are on the same network drive. Thanks for hunting this down.

Peter
 
Vagisha Sharma responded:  2017-03-22 11:05:23
Hi Peter,

I just posted a new version of AutoQC Loader (to be used with Skyline). Are you using Skyline or Skyline-daily? Let me know if you are using Skyline-daily and I will post a new version for AutoQC Loader-daily as well.

Thanks,
Vagisha
 
phains responded:  2017-03-22 13:04:28
Hi Vagisha,

brilliant, I'll update the system. I'm using Skyline for this application. I'll get back to you if we experience any other issues.

thanks again,

Peter
 
phains responded:  2017-04-18 22:09:52
Hi Vagisha,

I'm sorry to report we are still seeing the same issue (after updating AutoQC). After some time (I’m yet to narrow down the window beyond days), the system no longer detects the new files. This is remedied by stopping the configuration and restarting. As before, there is nothing in the log files. They just say waiting for new files…

thanks,

Peter
 
Vagisha Sharma responded:  2017-04-19 09:16:29
Hi Peter,

Sorry to hear that you are still seeing the problem. Would you mind sending me the program log file? It is also called AutoQC.log and is written to the folder where the application is installed. To find it you can start the Windows Start Manager. In the "Applications" tab, right-click on AutoQCLoader and select "Go To Process". This will highlight AutoQC.exe in the "Processes" tab. Right-click and select "Open File Location". This will open the folder where AutoQC is installed. You should see a AutoQC.log file in this folder. It will be great if you can send it to me.

Thanks,
Vagisha
 
phains responded:  2017-04-19 14:37:34
File attached as requested. I hope it's of some use.

Peter
 
Vagisha Sharma responded:  2017-04-19 15:11:01
Doesn't help much! I was expecting to see messages in the log from AutoQCLoader attempting to map disconnected network drives. But I don't see any. So maybe that's not the issue here.

Are the 25 configurations monitoring different folders, or are some of them looking for data in the same folder ("Folder to Watch" setting)? Do you have an idea of how many file system events (e.g. new file created) are happening on the networked drive, say per minute on average?

I might post a test release for you with additional log messages to try to figure out what is going on.

Thanks for helping me debug this issue!

-Vagisha
 
phains responded:  2017-04-19 15:25:26
All configurations are monitoring different folders (all include subfolders to monitor). I’ve set up a sync program to copy data from the MS HDDs to the local network. This runs every hour. Depending on MS usage, there could be a whole stack of files copied across, or not many. Other people also copy files to this network drive, so it’s hard for me to estimate. I’d say it’s not overstretched in anyway though.

As for the AutoQC files, we are using keywords in the filename so those files are also copied to the folders that AutoQC is monitoring. They go to the same network drive, but a different location. As I’ve said previously, our network drives do have the very annoying habit of spontaneously disconnecting, for usually short periods, at random times.

I’m happy to help where I can, this software is really helping with the MS QC and it’s all free!!

Peter