Client-core communications error: ERROR 0xc0000029

Discussion in 'Software' started by lbmest, Jan 11, 2011.

  1. lbmest

    lbmest MajorGeek

    Anybody run across this error yet?
    Everything I can find on it refers to a memory problem but my OC is pretty solid with a month of 24/7 running on -bigadv WUs.

    i7 950 @ 3990 Mhz Corsair 1600 Mhz RAM Underclocked by about 5%
    Temps in the mid 60s C

    2 2684 WUs blown up and trying a third before I do something drastic.

    Code:
    [06:42:47] Initial: 0000; - Receiving payload (expected size: 24828984)
    [06:43:07] - Downloaded at ~1212 kB/s
    [06:43:07] - Averaged speed for that direction ~953 kB/s
    [06:43:07] + Received work.
    [06:43:08] Trying to send all finished work units
    [06:43:08] + No unsent completed units remaining.
    [06:43:08] + Closed connections
    [06:43:08] 
    [06:43:08] + Processing work unit
    [06:43:08] Core required: FahCore_a3.exe
    [06:43:08] Core found.
    [06:43:08] Working on queue slot 04 [January 9 06:43:08 UTC]
    [06:43:08] + Working ...
    [06:43:08] - Calling '.\FahCore_a3.exe -dir work/ -nice 19 -suffix 04 -np 8 -checkpoint 30 -verbose -lifeline 6124 -version 630'
    
    [06:43:08] 
    [06:43:08] *------------------------------*
    [06:43:08] Folding@Home Gromacs SMP Core
    [06:43:08] Version 2.22 (Mar 12, 2010)
    [06:43:08] 
    [06:43:08] Preparing to commence simulation
    [06:43:08] - Looking at optimizations...
    [06:43:08] - Created dyn
    [06:43:08] - Files status OK
    [06:43:12] - Expanded 24828472 -> 30791309 (decompressed 124.0 percent)
    [06:43:12] Called DecompressByteArray: compressed_data_size=24828472 data_size=30791309, decompressed_data_size=30791309 diff=0
    [06:43:12] - Digital signature verified
    [06:43:12] 
    [06:43:12] Project: 2684 (Run 1, Clone 21, Gen 39)
    [06:43:12] 
    [06:43:12] Assembly optimizations on if available.
    [06:43:12] Entering M.D.
    [06:43:23] Completed 0 out of 250000 steps  (0%)
    [06:45:07] - Autosending finished units... [January 9 06:45:07 UTC]
    [06:45:07] Trying to send all finished work units
    [06:45:07] + No unsent completed units remaining.
    [06:45:07] - Autosend completed
    [07:28:18] Completed 2500 out of 250000 steps  (1%)
    [08:14:23] Completed 5000 out of 250000 steps  (2%)
    [09:01:06] Completed 7500 out of 250000 steps  (3%)
    [09:47:50] Completed 10000 out of 250000 steps  (4%)
    [10:34:25] Completed 12500 out of 250000 steps  (5%)
    [11:19:52] Completed 15000 out of 250000 steps  (6%)
    [12:05:29] Completed 17500 out of 250000 steps  (7%)
    [12:45:07] - Autosending finished units... [January 9 12:45:07 UTC]
    [12:45:07] Trying to send all finished work units
    [12:45:07] + No unsent completed units remaining.
    [12:45:07] - Autosend completed
    [12:51:52] Completed 20000 out of 250000 steps  (8%)
    [13:37:41] Completed 22500 out of 250000 steps  (9%)
    [14:23:44] Completed 25000 out of 250000 steps  (10%)
    [15:10:24] Completed 27500 out of 250000 steps  (11%)
    [15:55:31] Completed 30000 out of 250000 steps  (12%)
    [16:41:20] Completed 32500 out of 250000 steps  (13%)
    [17:26:24] Completed 35000 out of 250000 steps  (14%)
    [18:12:48] Completed 37500 out of 250000 steps  (15%)
    [18:45:07] - Autosending finished units... [January 9 18:45:07 UTC]
    [18:45:07] Trying to send all finished work units
    [18:45:07] + No unsent completed units remaining.
    [18:45:07] - Autosend completed
    [18:58:18] Completed 40000 out of 250000 steps  (16%)
    [19:43:14] Completed 42500 out of 250000 steps  (17%)
    [20:28:14] Completed 45000 out of 250000 steps  (18%)
    [21:12:55] Completed 47500 out of 250000 steps  (19%)
    [21:58:04] Completed 50000 out of 250000 steps  (20%)
    [22:43:46] Completed 52500 out of 250000 steps  (21%)
    [23:29:00] Completed 55000 out of 250000 steps  (22%)
    [00:14:24] Completed 57500 out of 250000 steps  (23%)
    [00:45:07] - Autosending finished units... [January 10 00:45:07 UTC]
    [00:45:07] Trying to send all finished work units
    [00:45:07] + No unsent completed units remaining.
    [00:45:07] - Autosend completed
    [00:59:56] Completed 60000 out of 250000 steps  (24%)
    [01:46:53] Completed 62500 out of 250000 steps  (25%)
    [02:32:36] Completed 65000 out of 250000 steps  (26%)
    [03:18:09] Completed 67500 out of 250000 steps  (27%)
    [04:03:32] Completed 70000 out of 250000 steps  (28%)
    [04:48:42] Completed 72500 out of 250000 steps  (29%)
    [05:34:03] Completed 75000 out of 250000 steps  (30%)
    [06:19:33] Completed 77500 out of 250000 steps  (31%)
    [06:45:07] - Autosending finished units... [January 10 06:45:07 UTC]
    [06:45:07] Trying to send all finished work units
    [06:45:07] + No unsent completed units remaining.
    [06:45:07] - Autosend completed
    [07:04:31] Completed 80000 out of 250000 steps  (32%)
    [07:49:12] Completed 82500 out of 250000 steps  (33%)
    [08:33:50] Completed 85000 out of 250000 steps  (34%)
    [09:18:47] Completed 87500 out of 250000 steps  (35%)
    [10:03:28] Completed 90000 out of 250000 steps  (36%)
    [10:48:07] Completed 92500 out of 250000 steps  (37%)
    [11:33:52] Completed 95000 out of 250000 steps  (38%)
    [12:18:32] Completed 97500 out of 250000 steps  (39%)
    [12:45:07] - Autosending finished units... [January 10 12:45:07 UTC]
    [12:45:07] Trying to send all finished work units
    [12:45:07] + No unsent completed units remaining.
    [12:45:07] - Autosend completed
    [13:03:25] Completed 100000 out of 250000 steps  (40%)
    [13:48:19] Completed 102500 out of 250000 steps  (41%)
    [14:33:12] Completed 105000 out of 250000 steps  (42%)
    [15:18:13] Completed 107500 out of 250000 steps  (43%)
    [16:03:24] Completed 110000 out of 250000 steps  (44%)
    [16:48:26] Completed 112500 out of 250000 steps  (45%)
    [17:33:29] Completed 115000 out of 250000 steps  (46%)
    [18:18:42] Completed 117500 out of 250000 steps  (47%)
    [18:45:07] - Autosending finished units... [January 10 18:45:07 UTC]
    [18:45:07] Trying to send all finished work units
    [18:45:07] + No unsent completed units remaining.
    [18:45:07] - Autosend completed
    [19:03:39] Completed 120000 out of 250000 steps  (48%)
    [19:48:31] Completed 122500 out of 250000 steps  (49%)
    [20:33:20] Completed 125000 out of 250000 steps  (50%)
    [21:18:27] Completed 127500 out of 250000 steps  (51%)
    [22:03:12] Completed 130000 out of 250000 steps  (52%)
    [22:48:11] Completed 132500 out of 250000 steps  (53%)
    [23:33:16] Completed 135000 out of 250000 steps  (54%)
    [00:18:08] Completed 137500 out of 250000 steps  (55%)
    
    
    --- Opening Log file [January 11 01:38:32 UTC] 
    
    
    # Windows SMP Console Edition #################################################
    ###############################################################################
    
                           Folding@Home Client Version 6.30
    
                              http://folding.stanford.edu
    
    ###############################################################################
    ###############################################################################
    
    Launch directory: C:\FAH
    Executable: C:\FAH\Folding@home-Win32-x86.exe
    Arguments: -smp 8 -verbosity 9 -bigadv 
    
    [01:38:32] - Ask before connecting: No
    [01:38:32] - User name: LBMEST (Team 12072)
    [01:38:32] - User ID: 2ED86D8546800045
    [01:38:32] - Machine ID: 1
    [01:38:32] 
    [01:38:32] Loaded queue successfully.
    [01:38:32] 
    [01:38:32] - Autosending finished units... [January 11 01:38:32 UTC]
    [01:38:32] + Processing work unit
    [01:38:32] Trying to send all finished work units
    [01:38:32] Core required: FahCore_a3.exe
    [01:38:32] + No unsent completed units remaining.
    [01:38:32] Core found.
    [01:38:32] - Autosend completed
    [01:38:32] Working on queue slot 04 [January 11 01:38:32 UTC]
    [01:38:32] + Working ...
    [01:38:32] - Calling '.\FahCore_a3.exe -dir work/ -nice 19 -suffix 04 -np 8 -checkpoint 30 -verbose -lifeline 2668 -version 630'
    
    [01:38:32] 
    [01:38:32] *------------------------------*
    [01:38:32] Folding@Home Gromacs SMP Core
    [01:38:32] Version 2.22 (Mar 12, 2010)
    [01:38:32] 
    [01:38:32] Preparing to commence simulation
    [01:38:32] - Ensuring status. Please wait.
    [01:38:42] - Looking at optimizations...
    [01:38:42] - Working with standard loops on this execution.
    [01:38:42] - Previous termination of core was improper.
    [01:38:42] - Files status OK
    [01:38:46] - Expanded 24828472 -> 30791309 (decompressed 124.0 percent)
    [01:38:46] Called DecompressByteArray: compressed_data_size=24828472 data_size=30791309, decompressed_data_size=30791309 diff=0
    [01:38:46] - Digital signature verified
    [01:38:46] 
    [01:38:46] Project: 2684 (Run 1, Clone 21, Gen 39)
    [01:38:46] 
    [01:38:46] Entering M.D.
    [01:38:52] Using Gromacs checkpoints
    [01:39:01] Resuming from checkpoint
    [01:39:01] Verified work/wudata_04.log
    [01:39:01] Verified work/wudata_04.trr
    [01:39:02] Verified work/wudata_04.xtc
    [01:39:02] Verified work/wudata_04.edr
    [01:39:03] Completed 137244 out of 250000 steps  (54%)
    [01:44:34] Completed 137500 out of 250000 steps  (55%)
    [02:33:02] Completed 140000 out of 250000 steps  (56%)
    [07:38:32] - Autosending finished units... [January 11 07:38:32 UTC]
    [07:38:32] Trying to send all finished work units
    [07:38:32] + No unsent completed units remaining.
    [07:38:32] - Autosend completed
    [09:08:14] CoreStatus = C0000029 (-1073741783)
    [09:08:14] Client-core communications error: ERROR 0xc0000029
    [09:08:14] Deleting current work unit & continuing...
    [09:08:32] Trying to send all finished work units
    [09:08:32] + No unsent completed units remaining.
    [09:08:32] - Preparing to get new work unit...
    [09:08:32] Cleaning up work directory
    [09:08:36] Killing all core threads
    [09:08:36] Could not get process id information.  Please kill core process manually
    
    Folding@Home Client Shutdown at user request.
    [09:08:36] ***** Got a SIGTERM signal (2)
    [09:08:36] Killing all core threads
    [09:08:36] Could not get process id information.  Please kill core process manually
    
    Folding@Home Client Shutdown.
    
    
    --- Opening Log file [January 11 09:08:46 UTC] 
    
    
    # Windows SMP Console Edition #################################################
    ###############################################################################
    
                           Folding@Home Client Version 6.30
    
                              http://folding.stanford.edu
    
    ###############################################################################
    ###############################################################################
    
    Launch directory: C:\FAH
    Executable: C:\FAH\Folding@home-Win32-x86.exe
    Arguments: -smp 8 -verbosity 9 -bigadv 
    
    [09:08:46] - Ask before connecting: No
    [09:08:46] - User name: LBMEST (Team 12072)
    [09:08:46] - User ID: 2ED86D8546800045
    [09:08:46] - Machine ID: 1
    [09:08:46] 
    [09:08:46] Loaded queue successfully.
    [09:08:46] - Preparing to get new work unit...
    [09:08:46] - Autosending finished units... [January 11 09:08:46 UTC]
    [09:08:46] Cleaning up work directory
    [09:08:46] Trying to send all finished work units
    [09:08:46] + No unsent completed units remaining.
    [09:08:46] - Autosend completed
    [09:08:48] + Attempting to get work packet
    [09:08:48] Passkey found
    [09:08:48] - Will indicate memory of 3000 MB
    [09:08:48] - Detect CPU. Vendor: GenuineIntel, Family: 6, Model: 10, Stepping: 5
    [09:08:48] - Connecting to assignment server
    [09:08:48] Connecting to http://assign.stanford.edu:8080/
    [09:08:49] Posted data.
    [09:08:49] Initial: 43AB; - Successful: assigned to (171.67.108.22).
    [09:08:49] + News From Folding@Home: Welcome to Folding@Home
    [09:08:49] Loaded queue successfully.
    [09:08:49] Sent data
    [09:08:49] Connecting to http://171.67.108.22:8080/
    [09:08:59] Posted data.
    [09:08:59] Initial: 0000; - Receiving payload (expected size: 24828984)
    [09:09:19] - Downloaded at ~1212 kB/s
    [09:09:19] - Averaged speed for that direction ~1004 kB/s
    [09:09:19] + Received work.
    [09:09:19] + Closed connections
    [09:09:19] 
    [09:09:19] + Processing work unit
    [09:09:19] Core required: FahCore_a3.exe
    [09:09:19] Core found.
    [09:09:19] Working on queue slot 05 [January 11 09:09:19 UTC]
    [09:09:19] + Working ...
    [09:09:19] - Calling '.\FahCore_a3.exe -dir work/ -nice 19 -suffix 05 -np 8 -checkpoint 30 -verbose -lifeline 3516 -version 630'
    
    [09:09:19] 
    [09:09:19] *------------------------------*
    [09:09:19] Folding@Home Gromacs SMP Core
    [09:09:19] Version 2.22 (Mar 12, 2010)
    [09:09:19] 
    [09:09:19] Preparing to commence simulation
    [09:09:19] - Looking at optimizations...
    [09:09:19] - Created dyn
    [09:09:19] - Files status OK
    [09:09:23] - Expanded 24828472 -> 30791309 (decompressed 124.0 percent)
    [09:09:23] Called DecompressByteArray: compressed_data_size=24828472 data_size=30791309, decompressed_data_size=30791309 diff=0
    [09:09:23] - Digital signature verified
    [09:09:23] 
    [09:09:23] Project: 2684 (Run 1, Clone 21, Gen 39)
    [09:09:23] 
    [09:09:23] Assembly optimizations on if available.
    [09:09:23] Entering M.D.
    [09:09:34] Completed 0 out of 250000 steps  (0%)
    [09:53:49] Completed 2500 out of 250000 steps  (1%)
    [15:08:46] - Autosending finished units... [January 11 15:08:46 UTC]
    [15:08:46] Trying to send all finished work units
    [15:08:46] + No unsent completed units remaining.
    [15:08:46] - Autosend completed
    [21:08:46] - Autosending finished units... [January 11 21:08:46 UTC]
    [21:08:46] Trying to send all finished work units
    [21:08:46] + No unsent completed units remaining.
    [21:08:46] - Autosend completed
    [22:03:54] CoreStatus = C0000029 (-1073741783)
    [22:03:54] Client-core communications error: ERROR 0xc0000029
    [22:03:54] Deleting current work unit & continuing...
    [22:04:10] Trying to send all finished work units
    [22:04:10] + No unsent completed units remaining.
    [22:04:10] - Preparing to get new work unit...
    [22:04:10] Cleaning up work directory
    [22:04:16] + Attempting to get work packet
    [22:04:16] Passkey found
    [22:04:16] - Will indicate memory of 3000 MB
    [22:04:16] - Connecting to assignment server
    [22:04:16] Connecting to http://assign.stanford.edu:8080/
    [22:04:17] Posted data.
    [22:04:17] Initial: 43AB; - Successful: assigned to (171.67.108.22).
    [22:04:17] + News From Folding@Home: Welcome to Folding@Home
    [22:04:17] Loaded queue successfully.
    [22:04:17] Sent data
    [22:04:17] Connecting to http://171.67.108.22:8080/
    [22:04:26] Posted data.
    [22:04:26] Initial: 0000; - Receiving payload (expected size: 24828984)
    [22:04:47] - Downloaded at ~1154 kB/s
    [22:04:47] - Averaged speed for that direction ~1034 kB/s
    [22:04:47] + Received work.
    [22:04:47] + Closed connections
    [22:04:52] 
    [22:04:52] + Processing work unit
    [22:04:52] Core required: FahCore_a3.exe
    [22:04:52] Core found.
    [22:04:52] Working on queue slot 06 [January 11 22:04:52 UTC]
    [22:04:52] + Working ...
    [22:04:52] - Calling '.\FahCore_a3.exe -dir work/ -nice 19 -suffix 06 -np 8 -checkpoint 30 -verbose -lifeline 3516 -version 630'
    
    [22:04:52] 
    [22:04:52] *------------------------------*
    [22:04:52] Folding@Home Gromacs SMP Core
    [22:04:52] Version 2.22 (Mar 12, 2010)
    [22:04:52] 
    [22:04:52] Preparing to commence simulation
    [22:04:52] - Looking at optimizations...
    [22:04:52] - Created dyn
    [22:04:52] - Files status OK
    [22:04:56] - Expanded 24828472 -> 30791309 (decompressed 124.0 percent)
    [22:04:56] Called DecompressByteArray: compressed_data_size=24828472 data_size=30791309, decompressed_data_size=30791309 diff=0
    [22:04:56] - Digital signature verified
    [22:04:56] 
    [22:04:56] Project: 2684 (Run 1, Clone 21, Gen 39)
    [22:04:56] 
    [22:04:56] Assembly optimizations on if available.
    [22:04:56] Entering M.D.
    [22:05:07] Completed 0 out of 250000 steps  (0%)
    [22:51:11] Completed 2500 out of 250000 steps  (1%)
    [00:06:19] Completed 5000 out of 250000 steps  (2%)
     
  2. noprob

    noprob Corporal

    only on XP Pro SP3 has this happened to me specifically on cpu WU's [classic and SMP WU's just last year late summer/early fall]

    I needed a few services running that I had not needed before.

    COM+ Event System

    and

    DCOM Server Process Launcher

    hope this helps,but doubtful since I believe you are on WinSeven

    fold on
     
    Last edited: Jan 12, 2011
  3. lbmest

    lbmest MajorGeek

    You're correct on the Win7.
    Both of those services are on Automatic start up type, so no problem there.
    Thanks.:)
     
  4. lbmest

    lbmest MajorGeek

    Well, losing a third 2684 is enough for me.
    Backed down the overclock to 3885 Mhz and deleted the a3 core, work files, que.dat files and unit info files.
    See what happens with this next 2684. (I would pick up another one.:()
     
  5. Merkin_Tile

    Merkin_Tile Private E-2

    Hi LBMEST, the max temp for an i7-950 is 67.9 C per this page: http://ark.intel.com/Product.aspx?id=37150

    Perhaps switching to water cooling or getting a mondo huge-o heat sink: http://www.frostytech.com/top5heatsinks.cfm

    Pulling more air out of the computer case then is pushed in, and the direction of airflow is important.

    Maybe your heat sink isn't flush with the face of the CPU? If it is, try to lap the surface of the CPU: http://www.techarp.com/showarticle.aspx?artno=433&pgno=1

    Try a different thermal paste? Sometimes too much paste hinders cooling.

    Hope these help and your back on solid:major and cool :cool 4GHz:hyperfolding legs PDQ. :)

    BTW, to answer your question from a different thread, I'm CPU folding with 3ea. Q9550's(3.5-3.7GHz, as you know not all CPU's are created equal:cry), 1ea. Q9300(3.3GHz) with Win7. GPU's are, 1ea. GTX460, 2ea. GTX285, and 1ea. GTX260. I have an AMD 5870 GPU, but it pulls 20% of CPU cycles compared to 5% with Nvidia cards, and gets about 4000ppd.:cry;)

    Take care, see you in the Folding Universe, and have a safe and worthwhile new year...........Merkin_Tile:wave
     
  6. lbmest

    lbmest MajorGeek

    That's max temp in the "good" range. Over-temp range goes to 95c Tcase overtemp / 100c Tjunction Max, that's when you get throttling and shut down. It could possibly be degrading enough to throw FAH off but I need to look at other OC settings to make sure. Check this thread for a good explanation on the 950 temps - http://www.tomshardware.com/forum/255264-29-overclocking

    Already have a Corsair H50 unit with push-pull fans exhausting out. (Lazy man's WC set up.;))

    Antec 900 case with 2 120 mm intake at front, grill on side with no fan.
    PSU, 2 vid cards, H50 fans and 200 mm on top - all exhaust.
    Cable management is decent but could be better.

    Possible but temps are in the low to mid 30s at idle. Paste may need to be changed out for something different.

    I'll do some changing around here in the near future, so no worries there.
    Nice farm and you are blowing me away here lately. WTF:major
     
  7. Merkin_Tile

    Merkin_Tile Private E-2

    Sweet setup lbmest. That H50 sounds awesome possum!:clap

    Unfortunately, my point output is not sustainable, especially during the hellish summers here in Phoenix.:(
    I may drill through my foundation a few hundred feet, and create a FAH server farm near the Mole People.;)

    Could your power supply be getting a little flaky? Especially at 4GHz, any power fluctuation to the CPU could cause IPS.(Irritable Processor Syndrome):fart

    Here's hoping you reach the big 4.0GHz,:drink ..........and don't fear the FOLD everyone, just add more cow smell! ;) :-D

    BTW, did you 'plug' up the 120mm hole on the side of the case, that has no fan? I used the motherboard CD driver disc in a paper sleeve to cover mine.
     
    Last edited: Jan 17, 2011
  8. noprob

    noprob Corporal


MajorGeeks.Com Menu

Downloads All In One Tweaks \ Android \ Anti-Malware \ Anti-Virus \ Appearance \ Backup \ Browsers \ CD\DVD\Blu-Ray \ Covert Ops \ Drive Utilities \ Drivers \ Graphics \ Internet Tools \ Multimedia \ Networking \ Office Tools \ PC Games \ System Tools \ Mac/Apple/Ipad Downloads

Other News: Top Downloads \ News (Tech) \ Off Base (Other Websites News) \ Way Off Base (Offbeat Stories and Pics)

Social: Facebook \ YouTube \ Twitter \ Tumblr \ Pintrest \ RSS Feeds