@09:04:03.43PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @09:04:06.35 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @09:04:11.24 Polling Can every 10:00 @09:04:11.40 Cleanly exited at 09:03:07PST22-Jan-20 @09:04:11.81 Clients may connect on TCP port 9999 @09:04:11.89 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @09:04:12.05 Session Begun @09:04:12.64 Woken in MAIN -- Wake up call before goMexPrecan20jan 10:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:12 21.6C, 52% humidity, 14.9psia, 13.68V, 0.21A, 0.223A avg, 2.89W @09:04:12.70
Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 10:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:12 21.6C, 52% humidity, 14.9psia, 13.68V, 0.21A, 0.223A avg, 2.89W" @09:05:31.54 -> exit @09:05:31.57 Session Ended @09:06:18.25 Instrument::ReadTimeout in startSensors -- Could not get prompt from CTD on ctd @09:06:25.40 upsync @09:06:48.60 NoMethodError in brent aborter- -- undefined method `interrupt' for nil:NilClass @09:07:00.17 upsync @09:07:19.70 Session Begun @09:07:22.64 -> bye! @09:07:27.78 Session Ended @09:07:41.12 Session Begun @09:07:51.90 -> showlog 20 @09:07:58.00 -> quit @09:07:58.01 Session Ended @09:12:12.65
Resuming Thread after Wake up call before goMexPrecan20jan 10:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:12 21.6C, 52% humidity, 14.9psia, 13.68V, 0.21A, 0.223A avg, 2.89W at 09:04:11 @09:12:12.68 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:12 @09:12:12.77 Shutdown @09:12:12.79
Asleep / Shutdown @09:12:12.83 Powering down until 10:00 @09:12:42.88 Sending Email @09:13:51.45 upsync @09:58:50.28PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @09:58:53.21 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @09:58:57.53 Polling Can every 10:00 @09:58:57.69 Cleanly exited at 09:12:12PST22-Jan-20 @09:58:58.08 Clients may connect on TCP port 9999 @09:58:58.10 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @09:58:58.34 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:12 @09:58:58.43 Waiting until 10:00 @10:00:00.07 Powering core bus @10:00:07.74 All dwarf controllers running firmware version 3.85 @10:00:24.72 Phase [at('10AM') {archive}] @10:00:24.74 Archive #3 on Wednesday @10:00:24.76 Starting initialPurge @10:00:24.77 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @10:00:39.52 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.70 @10:00:41.45 Flushing the Collection Valve::Manifold @10:00:42.96 Pulling 5ml of CSR.flush @10:01:04.15 Instrument::ReadTimeout in startSensors -- Could not get prompt from CTD on ctd @10:01:29.38 Purging external Intake @10:02:23.36 Flushing upper manifold @10:02:47.54 upsync @10:04:19.42
Garaging FlushPuck in Collection Clamp @10:04:33.55 Starting stand-alone bac WCR @10:04:33.57 bac wcr sampling at most 300ml @10:04:33.60 Whole Cell Archive sampling 300ml @10:04:33.65 Loading wcr puck from tube 4 into Collection Clamp @10:04:55.16 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.76 @10:04:58.11 collectSample 300ml w/bubble point of 55psi @10:04:58.15 Priming 7ml @10:04:59.21 Calibrating pressure and temperature sensors @10:05:31.34 Sampling 300.0ml @10:06:33.06 upsync @10:13:53.39 Sampled 300.0ml @10:13:53.43 Drying puck before fixing for 4:00 @10:15:17.36 Pumping Puck.from 4, :wcr up to 55psi... @10:15:59.09 Instrument::ReadTimeout in CTDupload -- Could not get prompt from CTD on ctd @10:16:49.49 Fix #1 of 2 (with rnal) for 2:00 @10:16:50.04 Pulling 1.999ml of CSR.rnal @10:17:19.35 Pumping Puck.from 4, :wcr up to 55psi... @10:21:39.39 Fix #2 of 2 (with rnal) for 2:00 @10:21:39.92 Pulling 2ml of CSR.rnal @10:22:09.14 Pumping Puck.from 4, :wcr up to 55psi... @10:26:29.82 Storing wcr puck in Collection Clamp to tube 3 @10:26:58.55 Starting finalPurge @10:26:58.57 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @10:27:12.54 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.73 @10:27:14.62 Flushing the Collection Valve::Manifold @10:27:15.32 Pulling 5ml of CSR.flush @10:28:01.61 Flushing lower manifold's waste2b port @10:28:42.02 Disinfecting external Intake with kill @10:28:42.71 Pulling 8ml of CSR.kill @10:29:39.17 Pulling 5ml of CSR.flush @10:30:38.45 Garaging FlushPuck in Collection Clamp @10:30:52.50 Completed [at('10AM') {archive}] begun 10:00:24 @10:30:52.68 Asleep / Shutdown @10:30:53.32 Shutdown @10:30:53.36
Powering down until 14:00 @10:30:56.36 upsync @11:48:54.92PST22-Jan-20 LoadError in MAIN_scheduler -- no such file to load -- base in base @11:48:56.21
ESP2 v3.41 I2C Gateway v3.20 for core bus @11:48:58.70 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @11:49:02.09 Polling Can every 10:00 @11:49:02.10 NameError in MAIN -- uninitialized constant ESP::Power @11:49:02.13 NameError in MAIN -- uninitialized constant ESP::CmdServer @11:49:32.25 Sending Email @11:50:54.22 upsync @11:50:54.24 NoMethodError in MAIN -- undefined method `stop!' for ESP:Module @11:50:54.27 TypeError in MAIN -- can't convert nil into String @13:52:52.29PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @13:52:54.55 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @13:52:57.82 Polling Can every 10:00 @13:52:57.84 Storage::Warning in MAIN -- Uncleanly Exited @13:52:58.17 Clients may connect on TCP port 9999 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @13:52:58.42 Woken in MAIN -- Wake up call before goMexPrecan20jan 14:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 21.3C, 58% humidity, 14.9psia, 13.68V, 0.19A, 0.193A avg, 2.64W @13:52:58.44 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 14:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 21.3C, 58% humidity, 14.9psia, 13.68V, 0.19A, 0.193A avg, 2.64W" @13:53:18.98 Session Begun @13:53:27.86 -> Clamp @13:53:30.74 -> Hand @13:54:03.16 -> exigt @13:54:05.05 -> exit @13:54:05.06 Session Ended pppd: In file /etc/ppp/peers/iridium: unrecognized option 'AT/iridium' @13:56:44.95 Session Begun @13:57:05.41 -> showlog 40 @13:57:14.62 -> go! @13:57:14.64
Resuming Thread after Wake up call before goMexPrecan20jan 14:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 21.3C, 58% humidity, 14.9psia, 13.68V, 0.19A, 0.193A avg, 2.64W at 13:52:58 @13:57:14.67 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 @13:57:14.76 Waiting until 13:57 @13:57:19.69 Powering core bus @13:57:26.93 All dwarf controllers running firmware version 3.85 @13:57:31.37 EOFError in Qmail -- end of file reached @13:57:31.39 Retry #3 of 10 after 3:00 @13:57:43.56
Phase [at('2PM') {archive}] @13:57:43.57 Archive #4 on Wednesday @13:57:43.58 Starting initialPurge @13:57:43.62 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @13:57:57.72 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.66 @13:57:59.52 Flushing the Collection Valve::Manifold @13:58:00.95 Pulling 4.999ml of CSR.flush @13:58:14.99 -> exit @13:58:15.00 Session Ended @13:58:29.36 Session Begun @13:58:47.01
Purging external Intake @13:59:40.26 Flushing upper manifold @14:01:28.31 -> quit @14:01:28.33 Session Ended @14:01:36.23
Garaging FlushPuck in Collection Clamp @14:01:49.85 Starting stand-alone bac WCR @14:01:49.86 bac wcr sampling at most 300ml @14:01:49.89 Whole Cell Archive sampling 300ml @14:01:49.90 RuntimeError in MAIN -- No Storage.srcTube defined! @14:01:49.92 Waiting to Resume from Checkpoint "Whole Cell Archive sampling 300ml" @14:02:05.08 NoMethodError in brent aborter- -- undefined method `interrupt' for nil:NilClass @14:03:29.17 Session Begun @14:03:33.63 -> startTube @14:03:36.88 -> pucks @14:03:45.14 -> exit @14:03:45.15 Session Ended @14:04:07.14 Errno::ECONNREFUSED in Qmail -- Connection refused - connect(2) @14:04:07.15 Retry #4 of 10 after 3:00 @14:05:16.59 Session Begun @14:05:28.60 -> startTube 4 @14:05:45.63 -> trouble @14:05:54.89 -> MainThread.resume @14:05:54.90
Resuming Thread (suspended since 14:01:49) @14:05:54.92 Whole Cell Archive sampling 300ml @14:05:54.95 Loading wcr puck from tube 4 into Collection Clamp @14:06:13.05 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.74 @14:06:14.99 collectSample 300ml w/bubble point of 55psi @14:06:15.00 Priming 7ml @14:06:15.25 Calibrating pressure and temperature sensors @14:06:45.48 Sampling 300.0ml @14:06:50.29 -> quit @14:06:50.30 Session Ended @14:10:38.75 Errno::ECONNREFUSED in Qmail -- Connection refused - connect(2) @14:10:38.77 Retry #5 of 10 after 3:00 @14:13:50.26 Session Begun @14:13:50.29 -> Gate.cycleModemPower! 15 @14:13:50.32 Session Ended @14:15:01.29
Sampled 300.0ml @14:15:01.30 Drying puck before fixing for 4:00 @14:16:12.68 SocketError in Qmail -- getaddrinfo: Temporary failure in name resolution @14:16:12.69 Retry #6 of 10 after 3:00 @14:16:25.29
Pumping Puck.from 4, :wcr up to 55psi... @14:17:56.56 Fix #1 of 2 (with rnal) for 2:00 @14:17:57.06 Pulling 2ml of CSR.rnal @14:18:26.26 Pumping Puck.from 4, :wcr up to 55psi... @14:22:46.24 Fix #2 of 2 (with rnal) for 2:00 @14:22:46.76 Pulling 2ml of CSR.rnal @14:23:01.74 upsync @14:23:16.18
Pumping Puck.from 4, :wcr up to 55psi... @14:23:26.11 upsync @14:23:49.96 upsync @14:25:36.21 Session Begun @14:25:45.21 -> showlog 40 @14:26:20.78 -> exit @14:26:20.79 Session Ended @14:27:37.17
Storing wcr puck in Collection Clamp to tube 3 @14:28:04.59 Starting finalPurge @14:28:04.60 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @14:28:18.72 Collection Clamp onSpring/offSpring for 8/26 samples, on/off torque 1.71 @14:28:20.57 Flushing the Collection Valve::Manifold @14:28:21.21 Pulling 5ml of CSR.flush @14:29:07.39 Flushing lower manifold's waste2b port @14:29:47.45 Disinfecting external Intake with kill @14:29:48.04 Pulling 8ml of CSR.kill @14:30:44.50 Pulling 5ml of CSR.flush @14:31:43.60 Garaging FlushPuck in Collection Clamp @14:31:56.65 Completed [at('2PM') {archive}] begun 13:57:43 @14:31:56.77 Asleep / Shutdown @14:31:57.32 Shutdown @14:31:57.34
Powering down until 16:00 @14:32:27.38 Sending Email @14:34:04.09 Uploading Logs @14:34:04.21 upsync @15:06:42.18PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @15:06:44.31 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @15:06:49.27 Polling Can every 10:00 @15:06:49.30 Cleanly exited at 14:31:57PST22-Jan-20 @15:06:49.60 Clients may connect on TCP port 9999 @15:06:49.61 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @15:06:49.97 Woken in MAIN -- Wake up call before goMexPrecan20jan 16:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:14 21.2C, 58% humidity, 14.9psia, 13.66V, 0.27A, 0.270A avg, 3.69W @15:06:49.99 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 16:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:14 21.2C, 58% humidity, 14.9psia, 13.66V, 0.27A, 0.270A avg, 3.69W" @15:06:50.16 Net::SMTPSyntaxError in Qmail -- 503 5.5.1 Error: authentication not enabled @15:06:50.17 Email::Queue::Purge in Qmail -- Purged output queue @15:07:00.20 Session Begun @15:07:07.43 -> showlog 50 @15:07:33.02 -> MainThread.exit @15:07:33.09 Session Ended @15:21:07.51PST22-Jan-20
>OVERRUN< ESP2 v3.41 I2C Gateway v3.20 for core bus @15:21:10.00 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @15:21:13.21 Polling Can every 10:00 @15:21:13.23 Cleanly exited at 15:07:33PST22-Jan-20 @15:21:13.58 Clients may connect on TCP port 9999 @15:21:13.62 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @15:21:13.76 Session Begun @15:21:14.28 Woken in MAIN -- Wake up call before goMexPrecan20jan 16:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:14 21.4C, 58% humidity, 14.9psia, 13.66V, 0.26A, 0.264A avg, 3.61W @15:21:14.31
Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 16:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:14 21.4C, 58% humidity, 14.9psia, 13.66V, 0.26A, 0.264A avg, 3.61W" @15:21:19.44 -> MainThread.exit @15:21:21.86 -> MainThread.exit @15:21:21.87
Sending Email @15:21:24.10 -> MainThread.exit @15:21:24.12 Email::Error in MAIN -- flush stuck! @15:21:24.18 ThreadError in brent -- killed thread @15:21:24.23 Session Ended @16:05:32.37PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @16:05:34.45 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @16:05:37.67 Polling Can every 10:00 @16:05:37.70 Cleanly exited at 16:03:08PST22-Jan-20 @16:05:38.03 Clients may connect on TCP port 9999 @16:05:38.04 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @16:05:38.34 Woken in MAIN -- Wake up call before goMexPrecan20jan 16:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:14 21.5C, 58% humidity, 14.9psia, 13.68V, 0.20A, 0.199A avg, 2.72W @16:05:38.36 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 16:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:14 21.5C, 58% humidity, 14.9psia, 13.68V, 0.20A, 0.199A avg, 2.72W" @16:05:51.74 Session Begun @16:05:57.83 -> go! @16:05:57.86
Resuming Thread after Wake up call before goMexPrecan20jan 16:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:14 21.5C, 58% humidity, 14.9psia, 13.68V, 0.20A, 0.199A avg, 2.72W at 16:05:38 @16:05:57.90 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:14 @16:05:58.01 Waiting until 16:06 @16:06:03.48 Powering core bus @16:06:14.66 All dwarf controllers running firmware version 3.85 @16:06:32.75 Phase [at('4PM') {archive}] @16:06:32.76 Archive #5 on Wednesday @16:06:32.79 Starting initialPurge @16:06:32.82 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @16:06:47.97 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.67 @16:06:49.98 Flushing the Collection Valve::Manifold @16:06:51.46 Pulling 5ml of CSR.flush @16:07:37.62 Purging external Intake @16:08:30.99 Flushing upper manifold @16:10:27.09 Garaging FlushPuck in Collection Clamp @16:10:40.69 Starting stand-alone bac WCR @16:10:40.71 bac wcr sampling at most 300ml @16:10:40.77 Whole Cell Archive sampling 300ml @16:10:40.83 Loading wcr puck from tube 4 into Collection Clamp @16:10:59.55 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.79 @16:11:01.86 collectSample 300ml w/bubble point of 55psi @16:11:01.88 Priming 7ml @16:11:02.13 Calibrating pressure and temperature sensors @16:11:31.17 Sampling 300.0ml @16:12:15.74 -> quit @16:12:15.75 Session Ended @16:13:29.22 upsync @16:13:57.10 upsync @16:19:46.09 Sampled 300.0ml @16:19:46.11 Drying puck before fixing for 4:00 @16:21:10.18 Pumping Puck.from 4, :wcr up to 55psi... @16:22:41.60 Fix #1 of 2 (with rnal) for 2:00 @16:22:42.10 Pulling 2ml of CSR.rnal @16:23:11.77 Pumping Puck.from 4, :wcr up to 55psi... @16:27:31.59 Fix #2 of 2 (with rnal) for 2:00 @16:27:32.09 Pulling 2ml of CSR.rnal @16:28:01.30 Pumping Puck.from 4, :wcr up to 55psi... @16:32:20.90 Storing wcr puck in Collection Clamp to tube 3 @16:32:47.55 Starting finalPurge @16:32:47.56 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @16:33:00.92 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.71 @16:33:03.25 Flushing the Collection Valve::Manifold @16:33:03.85 Pulling 5ml of CSR.flush @16:33:49.74 Flushing lower manifold's waste2b port @16:34:29.74 Disinfecting external Intake with kill @16:34:30.34 Pulling 8ml of CSR.kill @16:35:26.39 Pulling 4.999ml of CSR.flush @16:36:25.46 Garaging FlushPuck in Collection Clamp @16:36:38.77 Completed [at('4PM') {archive}] begun 16:06:32 @16:36:38.88 Asleep / Shutdown @16:36:39.44 Shutdown @16:36:39.46
Powering down until 20:00 @16:37:09.51 Sending Email @16:38:17.91 upsync @16:57:35.19PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @16:57:37.27 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @16:57:40.36 LoadError in MAIN -- no such file to load -- HAB in HAB @16:57:40.43 LoadError in MAIN -- no such file to load -- BAC in BAC @16:57:42.27 Polling Can every 10:00 @16:57:42.30 Cleanly exited at 16:36:39PST22-Jan-20 @16:57:42.61 Clients may connect on TCP port 9999 @16:57:42.62 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @16:57:43.02 Woken in MAIN -- Wake up call before goMexPrecan20jan 20:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 21.2C, 57% humidity, 14.9psia, 13.67V, 0.23A, 0.241A avg, 3.21W @16:57:43.04 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 20:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 21.2C, 57% humidity, 14.9psia, 13.67V, 0.23A, 0.241A avg, 3.21W" @16:57:43.24 Net::SMTPSyntaxError in Qmail -- 503 5.5.1 Error: authentication not enabled @16:57:43.25 Email::Queue::Purge in Qmail -- Purged output queue @16:57:45.75 Session Begun @16:57:55.56 -> MainThread.exit @16:57:55.63 Session Ended @17:07:47.13PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @17:07:49.15 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @17:07:52.23 Polling Can every 10:00 @17:07:52.26 Cleanly exited at 16:57:55PST22-Jan-20 @17:07:52.56 Clients may connect on TCP port 9999 @17:07:52.57 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @17:07:52.90 Woken in MAIN -- Wake up call before goMexPrecan20jan 20:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 21.1C, 56% humidity, 14.9psia, 13.67V, 0.23A, 0.229A avg, 3.13W @17:07:52.92 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 20:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 21.1C, 56% humidity, 14.9psia, 13.67V, 0.23A, 0.229A avg, 3.13W" @17:07:55.73 upsync @17:14:21.26 Session Begun @17:14:27.24 -> MissionLog.missionThread @17:14:27.25 NoMethodError in brent -- undefined method `missionThread' for MissionLog:Module @17:14:35.43 -> ESP.missionThread @17:15:52.91
Resuming Thread after Wake up call before goMexPrecan20jan 20:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 21.1C, 56% humidity, 14.9psia, 13.67V, 0.23A, 0.229A avg, 3.13W at 17:07:52 @17:15:52.93 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 @17:15:53.01 Shutdown @17:15:53.04
Asleep / Shutdown @17:15:53.07 Powering down until 20:00 @17:15:56.23 upsync @20:26:26.36PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @20:26:28.43 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @20:26:31.65 Polling Can every 10:00 @20:26:31.68 Cleanly exited at 17:15:53PST22-Jan-20 @20:26:32.01 Clients may connect on TCP port 9999 @20:26:32.02 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @20:26:32.30 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 @20:26:32.36 Waiting until 20:00 @20:26:32.38 Delay::Late in MAIN -- running 26:32 late @20:26:32.43 Powering core bus @20:26:36.90 Session Begun @20:26:39.11
All dwarf controllers running firmware version 3.85 @20:26:52.01 -> showlog 50 @20:26:56.63
Phase [at('8PM') {archive}] @20:26:56.87 Archive #6 on Wednesday @20:26:57.01 Starting initialPurge @20:26:57.26 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @20:27:14.59 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.63 @20:27:16.41 Flushing the Collection Valve::Manifold @20:27:17.86 Pulling 5ml of CSR.flush @20:28:03.92 Purging external Intake @20:28:57.12 Flushing upper manifold @20:30:52.95 Garaging FlushPuck in Collection Clamp @20:31:05.81 Starting stand-alone bac WCR @20:31:05.83 bac wcr sampling at most 300ml @20:31:05.86 Whole Cell Archive sampling 300ml @20:31:05.98 Loading wcr puck from tube 4 into Collection Clamp @20:31:25.38 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.76 @20:31:27.25 collectSample 300ml w/bubble point of 55psi @20:31:27.28 Priming 7ml @20:31:27.59 Calibrating pressure and temperature sensors @20:31:59.98 Sampling 300.0ml @20:33:05.26 upsync @20:40:27.33 Sampled 300.0ml @20:40:27.35 Drying puck before fixing for 4:00 @20:41:51.92 Pumping Puck.from 4, :wcr up to 55psi... @20:43:23.37 Fix #1 of 2 (with rnal) for 2:00 @20:43:23.89 Pulling 2ml of CSR.rnal @20:43:53.20 Pumping Puck.from 4, :wcr up to 55psi... @20:48:12.51 Fix #2 of 2 (with rnal) for 2:00 @20:48:13.03 Pulling 1.999ml of CSR.rnal @20:48:42.07 Pumping Puck.from 4, :wcr up to 55psi... @20:53:01.59 Storing wcr puck in Collection Clamp to tube 3 @20:53:28.42 Starting finalPurge @20:53:28.43 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @20:53:42.08 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.70 @20:53:43.86 Flushing the Collection Valve::Manifold @20:53:44.48 Pulling 5ml of CSR.flush @20:54:30.45 Flushing lower manifold's waste2b port @20:55:10.51 Disinfecting external Intake with kill @20:55:11.12 Pulling 8ml of CSR.kill @20:56:07.32 Pulling 5ml of CSR.flush @20:57:06.73 Garaging FlushPuck in Collection Clamp @20:57:19.94 Completed [at('8PM') {archive}] begun 20:26:56 @20:57:20.54 Asleep / Shutdown @20:57:21.10 Shutdown @20:57:21.13
Powering down until 23:00 @20:57:51.20 Sending Email @20:59:09.56 upsync @22:58:55.20PST22-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @22:58:57.27 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @22:59:00.40 Polling Can every 10:00 @22:59:00.43 Cleanly exited at 20:57:21PST22-Jan-20 @22:59:00.76 Clients may connect on TCP port 9999 @22:59:00.77 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @22:59:01.09 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 @22:59:01.15 Waiting until 23:00 @23:00:00.06 Powering core bus @23:00:06.73 All dwarf controllers running firmware version 3.85 @23:00:23.51 Phase [at('11PM') {archive}] @23:00:23.53 Archive #7 on Wednesday @23:00:23.54 Starting initialPurge @23:00:23.55 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @23:00:37.65 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.67 @23:00:39.53 Flushing the Collection Valve::Manifold @23:00:40.96 Pulling 5ml of CSR.flush @23:01:27.01 Purging external Intake @23:02:20.12 Flushing upper manifold @23:04:15.98 Garaging FlushPuck in Collection Clamp @23:04:29.15 Starting stand-alone bac WCR @23:04:29.17 bac wcr sampling at most 300ml @23:04:29.19 Whole Cell Archive sampling 300ml @23:04:29.22 Loading wcr puck from tube 4 into Collection Clamp @23:04:49.18 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.83 @23:04:51.08 collectSample 300ml w/bubble point of 55psi @23:04:51.10 Priming 7ml @23:04:51.37 Calibrating pressure and temperature sensors @23:05:25.29 Sampling 300.0ml @23:06:15.85 upsync @23:15:01.66 Sampled 300.0ml @23:15:01.68 Drying puck before fixing for 4:00 @23:16:25.57 Pumping Puck.from 4, :wcr up to 55psi... @23:17:56.87 Fix #1 of 2 (with rnal) for 2:00 @23:17:57.37 Pulling 2ml of CSR.rnal @23:18:26.82 Pumping Puck.from 4, :wcr up to 55psi... @23:22:46.90 Fix #2 of 2 (with rnal) for 2:00 @23:22:47.40 Pulling 1.999ml of CSR.rnal @23:23:16.66 Pumping Puck.from 4, :wcr up to 55psi... @23:27:36.35 Storing wcr puck in Collection Clamp to tube 3 @23:28:02.83 Starting finalPurge @23:28:02.84 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @23:28:16.24 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.74 @23:28:18.04 Flushing the Collection Valve::Manifold @23:28:18.64 Pulling 5ml of CSR.flush @23:29:04.54 Flushing lower manifold's waste2b port @23:29:45.07 Disinfecting external Intake with kill @23:29:45.67 Pulling 8ml of CSR.kill @23:30:41.89 Pulling 5ml of CSR.flush @23:31:40.82 Garaging FlushPuck in Collection Clamp @23:31:54.03 Completed [at('11PM') {archive}] begun 23:00:23 @23:31:54.15 Asleep / Shutdown @23:31:54.70 Shutdown @23:31:54.72
Powering down until 03:00PST23-Jan-20 @23:32:24.76 Sending Email @23:33:39.92 upsync @02:58:55.14PST23-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @02:58:57.22 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @02:59:00.43 Polling Can every 10:00 @02:59:00.47 Cleanly exited at 23:31:54PST22-Jan-20 @02:59:00.80 Clients may connect on TCP port 9999 @02:59:00.81 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @02:59:01.18 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:18 @02:59:01.24 Waiting until 03:00 @03:00:00.05 Powering core bus @03:00:06.49 All dwarf controllers running firmware version 3.85 @03:00:23.09 Phase [at('3AM') {archive}] @03:00:23.11 Archive #8 on Thursday @03:00:23.12 Starting initialPurge @03:00:23.13 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @03:00:37.46 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.68 @03:00:39.29 Flushing the Collection Valve::Manifold @03:00:40.72 Pulling 5ml of CSR.flush @03:01:26.68 Purging external Intake @03:02:19.95 Flushing upper manifold @03:04:16.09 Garaging FlushPuck in Collection Clamp @03:04:29.51 Starting stand-alone bac WCR @03:04:29.52 bac wcr sampling at most 300ml @03:04:29.54 Whole Cell Archive sampling 300ml @03:04:29.68 Loading wcr puck from tube 4 into Collection Clamp @03:04:49.52 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.73 @03:04:51.48 collectSample 300ml w/bubble point of 55psi @03:04:51.50 Priming 7ml @03:04:51.77 Calibrating pressure and temperature sensors @03:05:24.13 Sampling 300.0ml @03:06:31.97 upsync @03:13:37.64 Sampled 300.0ml @03:13:37.65 Drying puck before fixing for 4:00 @03:15:01.59 Pumping Puck.from 4, :wcr up to 55psi... @03:16:33.44 Fix #1 of 2 (with rnal) for 2:00 @03:16:33.95 Pulling 2ml of CSR.rnal @03:17:03.09 Pumping Puck.from 4, :wcr up to 55psi... @03:21:22.58 Fix #2 of 2 (with rnal) for 2:00 @03:21:23.08 Pulling 2ml of CSR.rnal @03:21:52.25 Pumping Puck.from 4, :wcr up to 55psi... @03:26:11.96 Storing wcr puck in Collection Clamp to tube 3 @03:26:38.46 Starting finalPurge @03:26:38.47 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @03:26:52.17 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.74 @03:26:54.06 Flushing the Collection Valve::Manifold @03:26:54.65 Pulling 5ml of CSR.flush @03:27:40.75 Flushing lower manifold's waste2b port @03:28:21.15 Disinfecting external Intake with kill @03:28:21.75 Pulling 7.999ml of CSR.kill @03:29:18.15 Pulling 5ml of CSR.flush @03:30:17.25 Garaging FlushPuck in Collection Clamp @03:30:30.60 Completed [at('3AM') {archive}] begun 03:00:23 @03:30:30.72 Asleep / Shutdown @03:30:31.26 Shutdown @03:30:31.28
Powering down until 05:00 @03:31:01.33 Sending Email @03:32:25.73 upsync @04:58:55.17PST23-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @04:58:57.27 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @04:59:00.51 Polling Can every 10:00 @04:59:00.56 Cleanly exited at 03:30:31PST23-Jan-20 @04:59:00.88 Clients may connect on TCP port 9999 @04:59:00.89 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @04:59:01.31 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:19 @04:59:01.37 Waiting until 05:00 @05:00:00.05 Powering core bus @05:00:06.66 All dwarf controllers running firmware version 3.85 @05:00:22.90 Phase [at('5AM') {archive}] @05:00:22.94 Archive #9 on Thursday @05:00:22.95 Starting initialPurge @05:00:22.96 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @05:00:37.14 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.67 @05:00:39.02 Flushing the Collection Valve::Manifold @05:00:40.45 Pulling 5ml of CSR.flush @05:01:26.59 Purging external Intake @05:02:20.14 Flushing upper manifold @05:04:16.21 Garaging FlushPuck in Collection Clamp @05:04:29.38 Starting stand-alone bac WCR @05:04:29.39 bac wcr sampling at most 300ml @05:04:29.41 Whole Cell Archive sampling 300ml @05:04:29.55 Loading wcr puck from tube 4 into Collection Clamp @05:04:49.38 Collection Clamp onSpring/offSpring for 10/26 samples, on/off torque 1.80 @05:04:51.29 collectSample 300ml w/bubble point of 55psi @05:04:51.30 Priming 7ml @05:04:51.57 Calibrating pressure and temperature sensors @05:05:23.81 Sampling 300.0ml @05:06:17.19 upsync @05:15:04.30 Sampled 300.0ml @05:15:04.32 Drying puck before fixing for 4:00 @05:16:28.68 Pumping Puck.from 4, :wcr up to 55psi... @05:18:00.10 Fix #1 of 2 (with rnal) for 2:00 @05:18:00.61 Pulling 2ml of CSR.rnal @05:18:29.90 Pumping Puck.from 4, :wcr up to 55psi... @05:22:49.57 Fix #2 of 2 (with rnal) for 2:00 @05:22:50.08 Pulling 2ml of CSR.rnal @05:23:19.28 Pumping Puck.from 4, :wcr up to 55psi... @05:27:39.38 Storing wcr puck in Collection Clamp to tube 3 @05:28:05.94 Starting finalPurge @05:28:05.95 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @05:28:19.76 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.77 @05:28:21.79 Flushing the Collection Valve::Manifold @05:28:22.39 Pulling 5ml of CSR.flush @05:29:08.59 Flushing lower manifold's waste2b port @05:29:48.75 Disinfecting external Intake with kill @05:29:49.34 Pulling 8ml of CSR.kill @05:30:45.64 Pulling 5ml of CSR.flush @05:31:44.84 Garaging FlushPuck in Collection Clamp @05:31:58.00 Completed [at('5AM') {archive}] begun 05:00:22 @05:31:58.53 Asleep after completing goMexPrecan20jan assays @05:31:59.45 Shutdown @05:31:59.55
Asleep / Shutdown @05:31:59.61 Shutdown @05:31:59.65 NoMethodError in MAIN -- undefined method `asShortString' for nil:NilClass @05:31:59.68
Waiting to Resume from Checkpoint "Completed [at('5AM') {archive}] begun 05:00:22" @05:33:32.53 upsync @05:33:59.70 upsync @08:40:40.86 Session Begun @08:41:04.69 -> MainThread.exception @08:41:12.76 -> backtrace @08:41:22.33 -> backtrace MainThread @08:41:32.68 -> stayUp @09:18:22.55 -> quit @09:18:22.56 Session Ended @16:27:34.68PST24-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @16:27:37.76 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @16:27:41.81 LoadError in MAIN -- no such file to load -- longmission in /home/esp/esp2/mission/long/phasecfg.rb @16:27:41.88 Polling Can every 10:00 @16:27:41.95 Cleanly exited at 16:24:07PST24-Jan-20 @16:27:42.35 Clients may connect on TCP port 9999 @16:27:42.36 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @16:27:42.39 NoMethodError in MAIN -- undefined method `mission' for Object:Class @16:27:42.40 Waiting to Resume from Checkpoint "Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission" @16:34:17.60PST24-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @16:34:20.61 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @16:34:24.41 LoadError in MAIN -- no such file to load -- longmission in /home/esp/esp2/mission/long/phasecfg.rb @16:34:24.47 Polling Can every 10:00 @16:34:24.53 Cleanly exited at 16:27:41PST24-Jan-20 @16:34:24.93 Clients may connect on TCP port 9999 @16:34:24.95 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @16:34:24.98 NoMethodError in MAIN -- undefined method `mission' for Object:Class @16:34:24.99 Waiting to Resume from Checkpoint "Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission" @17:43:48.64PST24-Jan-20
>OVERRUN< ESP2 v3.41 I2C Gateway v3.20 for core bus @17:43:51.48 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @17:43:55.80 Polling Can every 10:00 @17:43:55.87 Cleanly exited at 16:34:24PST24-Jan-20 @17:43:56.26 Clients may connect on TCP port 9999 @17:43:56.27 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @17:43:56.35 Starting goMexPrecan20jan mission in /home/esp/esp2/mission/long/goMexPrecan20jan.rb @17:43:56.80 Shutdown @17:43:56.86
Asleep / Shutdown @17:43:56.92 Powering down until 18:00 /suscript/connectNetwork: line 11: syntax error: "}" unexpected (expecting "done") @17:43:57.45 SocketError in Qmail -- getaddrinfo: Temporary failure in name resolution @17:43:57.47 Retry #1 of 10 after 3:00 @17:44:26.98
Sending Email @17:44:36.27 Session Begun @17:44:41.07 -> MainThread.exit @17:44:51.96 -> MainThread.exit @17:44:51.98
Sending Email @17:44:57.66 -> MainThread.exit @17:44:57.69 Email::Error in MAIN -- flush stuck! @17:44:57.77 Session Ended @17:50:13.07PST24-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @17:50:15.98 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @17:50:20.51 Polling Can every 10:00 @17:50:20.58 Cleanly exited at 17:44:57PST24-Jan-20 @17:50:20.98 Clients may connect on TCP port 9999 @17:50:21.01 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @17:50:21.12 Starting goMexPrecan20jan mission in /home/esp/esp2/mission/long/goMexPrecan20jan.rb @17:50:21.56 Waiting until 18:00 @17:52:20.46 upsync @18:00:00.06
Powering core bus @18:00:06.92 All dwarf controllers running firmware version 3.85 @18:00:24.17 Phase [at('1/24/20 6pm') {archive} #2nd precan QC on 1/24/2020] @18:00:24.19 Archive #1 on Friday @18:00:24.23 Starting initialPurge @18:00:24.24 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @18:00:39.10 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.69 @18:00:41.08 Flushing the Collection Valve::Manifold @18:00:42.71 Pulling 5ml of CSR.flush @18:01:28.95 Purging external Intake @18:02:22.49 Flushing upper manifold @18:04:18.83 Garaging FlushPuck in Collection Clamp @18:04:32.37 Starting stand-alone bac WCR @18:04:32.39 bac wcr sampling at most 300ml @18:04:32.43 Whole Cell Archive sampling 300ml @18:04:32.52 Loading wcr puck from tube 4 into Collection Clamp @18:04:54.19 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.77 @18:04:57.11 collectSample 300ml w/bubble point of 55psi @18:04:57.14 Priming 7ml @18:04:58.39 Calibrating pressure and temperature sensors @18:05:28.01 Sampling 300.0ml @18:07:24.10 SocketError in Qmail -- getaddrinfo: Temporary failure in name resolution @18:07:24.13 Retry #1 of 10 after 3:00 @18:15:01.14 Sampled 300.0ml @18:15:01.17 Drying puck before fixing for 4:00 @18:15:16.44 EOFError in Qmail -- end of file reached @18:15:16.46 Retry #3 of 10 after 3:00 @18:16:25.26 Pumping Puck.from 4, :wcr up to 55psi... @18:17:56.74 Fix #1 of 2 (with rnal) for 2:00 @18:17:57.31 Pulling 1.999ml of CSR.rnal @18:18:27.48 Pumping Puck.from 4, :wcr up to 55psi... @18:21:58.36 upsync rsync: connection unexpectedly closed (0 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(226) [sender=3.1.3] @18:22:50.87 Fix #2 of 2 (with rnal) for 2:00 @18:22:51.42 Pulling 1.999ml of CSR.rnal @18:23:20.76 Pumping Puck.from 4, :wcr up to 55psi... @18:27:40.97 Storing wcr puck in Collection Clamp to tube 3 @18:28:10.03 Starting finalPurge @18:28:10.04 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @18:28:24.00 Collection Clamp onSpring/offSpring for 8/26 samples, on/off torque 1.75 @18:28:26.00 Flushing the Collection Valve::Manifold @18:28:27.21 Pulling 5ml of CSR.flush @18:29:13.26 Flushing lower manifold's waste2b port @18:29:53.74 Disinfecting external Intake with kill @18:29:54.43 Pulling 8ml of CSR.kill @18:30:50.94 Pulling 5ml of CSR.flush @18:31:50.07 Garaging FlushPuck in Collection Clamp @18:32:03.96 Completed [at('1/24/20 6pm') {archive} #2nd precan QC on 1/24/2020] begun 18:00:24 @18:32:04.12 Asleep / Shutdown @18:32:04.77 Shutdown @18:32:04.81
Powering down until 21:00 @18:32:34.91 Sending Email @18:34:46.21 SocketError in Qmail -- getaddrinfo: Temporary failure in name resolution @18:34:46.24 Retry #1 of 10 after 3:00 @18:37:34.95 Email::Error in MAIN -- flush stuck! @19:10:57.79PST24-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @19:11:00.88 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @19:11:05.26 Polling Can every 10:00 @19:11:05.34 Cleanly exited at 18:32:04PST24-Jan-20 @19:11:05.73 Clients may connect on TCP port 9999 @19:11:05.74 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @19:11:05.97 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 20.5C, 56% humidity, 14.9psia, 13.67V, 0.21A, 0.205A avg, 2.80W @19:11:06.00 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 20.5C, 56% humidity, 14.9psia, 13.67V, 0.21A, 0.205A avg, 2.80W" @19:15:44.86 EOFError in Qmail -- end of file reached @19:15:44.88 Retry #2 of 10 after 3:00 @19:19:05.98
Resuming Thread after Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 20.5C, 56% humidity, 14.9psia, 13.67V, 0.21A, 0.205A avg, 2.80W at 19:11:05 @19:19:06.02 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 @19:19:06.14 Shutdown @19:19:06.17
Asleep / Shutdown @19:19:06.21 Powering down until 21:00 @19:19:36.25 Sending Email @19:21:35.79 Errno::ECONNREFUSED in Qmail -- Connection refused - connect(2) @19:21:35.81 Retry #3 of 10 after 3:00 @19:24:36.27 Email::Error in MAIN -- flush stuck! @19:34:12.64PST24-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @19:34:15.56 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @19:34:20.03 Polling Can every 10:00 @19:34:20.10 Cleanly exited at 19:19:06PST24-Jan-20 @19:34:20.50 Clients may connect on TCP port 9999 @19:34:20.52 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @19:34:20.76 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 20.7C, 56% humidity, 14.9psia, 13.67V, 0.22A, 0.217A avg, 2.97W @19:34:20.79 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 20.7C, 56% humidity, 14.9psia, 13.67V, 0.22A, 0.217A avg, 2.97W" @19:35:56.75PST24-Jan-20
>RESET< ESP2 v3.41 I2C Gateway v3.20 for core bus @19:35:59.58 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @19:36:03.88 Polling Can every 10:00 @19:36:03.96 Cleanly exited at 19:34:20PST24-Jan-20 @19:36:04.36 Clients may connect on TCP port 9999 @19:36:04.37 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @19:36:04.61 Woken in MAIN -- Reset or Power Cycled before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 20.7C, 56% humidity, 14.9psia, 13.68V, 0.18A, 0.181A avg, 2.40W @19:36:04.63 Waiting to Resume from Checkpoint "Reset or Power Cycled before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 20.7C, 56% humidity, 14.9psia, 13.68V, 0.18A, 0.181A avg, 2.40W" @19:38:12.58 upsync @19:44:04.62
Resuming Thread after Reset or Power Cycled before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 20.7C, 56% humidity, 14.9psia, 13.68V, 0.18A, 0.181A avg, 2.40W at 19:36:03 @19:44:04.64 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 @19:44:04.73 Shutdown @19:44:04.75
Asleep / Shutdown @19:44:04.78 Powering down until 21:00 @19:44:34.83 Sending Email @19:45:51.09 upsync @20:58:52.69PST24-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @20:58:55.52 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @20:58:59.88 Polling Can every 10:00 @20:58:59.96 Cleanly exited at 19:44:04PST24-Jan-20 @20:59:00.35 Clients may connect on TCP port 9999 @20:59:00.37 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @20:59:00.52 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:10 @20:59:00.60 Waiting until 21:00 @21:00:00.07 Powering core bus @21:00:07.43 All dwarf controllers running firmware version 3.85 @21:00:29.75 Phase [at('9PM') {archive}] @21:00:29.78 Archive #2 on Friday @21:00:29.79 Starting initialPurge @21:00:29.81 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @21:00:44.60 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.72 @21:00:46.70 Flushing the Collection Valve::Manifold @21:00:48.21 Pulling 5ml of CSR.flush @21:01:34.52 Purging external Intake @21:02:27.64 Flushing upper manifold @21:04:24.39 Garaging FlushPuck in Collection Clamp @21:04:37.78 Starting stand-alone bac WCR @21:04:37.79 bac wcr sampling at most 300ml @21:04:37.83 Whole Cell Archive sampling 300ml @21:04:37.98 Loading wcr puck from tube 4 into Collection Clamp @21:05:00.05 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.73 @21:05:02.26 collectSample 300ml w/bubble point of 55psi @21:05:02.32 Priming 7ml @21:05:02.94 Calibrating pressure and temperature sensors @21:05:35.79 Sampling 300.0ml @21:06:29.13 upsync @21:13:56.57 Sampled 300.0ml @21:13:56.60 Drying puck before fixing for 4:00 @21:15:20.74 Pumping Puck.from 4, :wcr up to 55psi... @21:16:52.30 Fix #1 of 2 (with rnal) for 2:00 @21:16:52.94 Pulling 2ml of CSR.rnal @21:17:02.33 Session Begun @21:17:13.81 -> showlog @21:17:22.47 Pumping Puck.from 4, :wcr up to 55psi... @21:17:24.90 -> bye! @21:17:30.79 Session Ended @21:21:45.01 Fix #2 of 2 (with rnal) for 2:00 @21:21:45.54 Pulling 2ml of CSR.rnal @21:22:14.74 Pumping Puck.from 4, :wcr up to 55psi... @21:26:34.91 Storing wcr puck in Collection Clamp to tube 3 @21:27:02.60 Starting finalPurge @21:27:02.62 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @21:27:16.47 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.76 @21:27:18.61 Flushing the Collection Valve::Manifold @21:27:19.29 Pulling 5ml of CSR.flush @21:28:06.24 Flushing lower manifold's waste2b port @21:28:46.74 Disinfecting external Intake with kill @21:28:47.42 Pulling 8ml of CSR.kill @21:29:43.79 Pulling 5ml of CSR.flush @21:30:43.08 Garaging FlushPuck in Collection Clamp @21:30:56.50 Completed [at('9PM') {archive}] begun 21:00:29 @21:30:56.67 Asleep / Shutdown @21:30:57.33 Shutdown @21:30:57.37
Powering down until 09:00PST25-Jan-20 @21:31:27.41 Sending Email pppd: In file /etc/ppp/peers/iridium: unrecognized option 'AT/iridium' @21:34:43.60 EOFError in Qmail -- end of file reached @21:34:43.62 Retry #2 of 10 after 3:00 @21:36:27.46 Email::Error in MAIN -- flush stuck! @08:58:53.68PST25-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @08:58:56.52 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @08:59:00.96 Polling Can every 10:00 @08:59:01.05 Cleanly exited at 21:30:57PST24-Jan-20 @08:59:01.46 Clients may connect on TCP port 9999 @08:59:01.47 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @08:59:01.68 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:12 @08:59:01.75 Waiting until 09:00 @09:00:00.07 Powering core bus @09:00:07.20 All dwarf controllers running firmware version 3.85 @09:00:29.71 Phase [at('9AM') {archive}] @09:00:29.74 Archive #3 on Saturday @09:00:29.75 Starting initialPurge @09:00:29.77 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @09:00:44.56 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.69 @09:00:46.50 Flushing the Collection Valve::Manifold @09:00:48.02 Pulling 5ml of CSR.flush @09:01:34.47 Purging external Intake @09:02:27.58 Flushing upper manifold @09:04:24.05 Garaging FlushPuck in Collection Clamp @09:04:37.83 Starting stand-alone bac WCR @09:04:37.85 bac wcr sampling at most 300ml @09:04:37.89 Whole Cell Archive sampling 300ml @09:04:37.93 Loading wcr puck from tube 4 into Collection Clamp @09:04:59.65 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.75 @09:05:02.18 collectSample 300ml w/bubble point of 55psi @09:05:02.27 Priming 7ml @09:05:03.86 Calibrating pressure and temperature sensors @09:05:38.85 Sampling 300.0ml @09:06:33.30 upsync @09:14:57.35 Sampled 300.0ml @09:14:57.38 Drying puck before fixing for 4:00 @09:16:21.30 Pumping Puck.from 4, :wcr up to 55psi... @09:17:53.39 Fix #1 of 2 (with rnal) for 2:00 @09:17:53.93 Pulling 2ml of CSR.rnal @09:18:23.14 Pumping Puck.from 4, :wcr up to 55psi... @09:22:43.28 Fix #2 of 2 (with rnal) for 2:00 @09:22:43.81 Pulling 1.999ml of CSR.rnal @09:23:13.02 Pumping Puck.from 4, :wcr up to 55psi... @09:27:33.37 Storing wcr puck in Collection Clamp to tube 3 @09:28:00.55 Starting finalPurge @09:28:00.57 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @09:28:14.90 Collection Clamp onSpring/offSpring for 10/26 samples, on/off torque 1.71 @09:28:16.87 Flushing the Collection Valve::Manifold @09:28:17.56 Pulling 5ml of CSR.flush @09:29:03.67 Flushing lower manifold's waste2b port @09:29:44.17 Disinfecting external Intake with kill @09:29:44.85 Pulling 8ml of CSR.kill @09:30:41.45 Pulling 5ml of CSR.flush @09:31:40.56 Garaging FlushPuck in Collection Clamp @09:31:54.21 Completed [at('9AM') {archive}] begun 09:00:29 @09:31:54.38 Asleep / Shutdown @09:31:55.01 Shutdown @09:31:55.05
Powering down until 21:00 @09:32:25.15 Sending Email @09:33:50.32 upsync @19:26:59.87PST25-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @19:27:02.76 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @19:27:07.11 Polling Can every 10:00 @19:27:07.20 Cleanly exited at 09:31:55PST25-Jan-20 @19:27:07.59 Clients may connect on TCP port 9999 @19:27:07.60 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @19:27:07.97 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 20.4C, 58% humidity, 14.9psia, 13.65V, 0.31A, 0.312A avg, 4.26W @19:27:08.01 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 20.4C, 58% humidity, 14.9psia, 13.65V, 0.31A, 0.312A avg, 4.26W" @19:29:26.05 Session Begun @19:29:39.05 -> MainThread.resume @19:29:39.09
Resuming Thread after Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 20.4C, 58% humidity, 14.9psia, 13.65V, 0.31A, 0.312A avg, 4.26W at 19:27:07 @19:29:39.15 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 @19:29:39.31 Shutdown @19:29:39.35
Asleep / Shutdown @19:29:39.43 Powering down until 21:00 @19:30:09.47 Sending Email @19:30:10.75 upsync @19:30:34.08 upsync @20:58:52.63PST25-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @20:58:54.41 LoadError in MAIN -- no such file to load -- /home/esp/esp2/lib/serialport.rb @20:58:54.89 Clients may connect on TCP port 9999 @20:58:54.91 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @20:58:54.93 NoMethodError in MAIN -- undefined method `mission' for Object:Class @20:58:54.95 Waiting to Resume from Checkpoint "Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission" @21:15:55.16 Session Begun @21:16:02.00 -> MainThread.exception @21:16:13.33 -> MainThread.exception.first.backtrace @21:17:12.92 -> ENV['RUBYLIB'] @21:19:25.62 -> exit @21:19:25.64 Session Ended @21:21:12.03PST25-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @21:21:14.87 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @21:21:19.26 Polling Can every 10:00 @21:21:19.36 Cleanly exited at 19:29:39PST25-Jan-20 @21:21:19.75 Clients may connect on TCP port 9999 @21:21:19.77 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @21:21:20.04 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:13 @21:21:20.12 Waiting until 21:00 @21:21:20.15 Delay::Late in MAIN -- running 21:19 late @21:21:20.21 Powering core bus @21:21:27.07 All dwarf controllers running firmware version 3.85 @21:21:44.07 Phase [at('9PM') {archive}] @21:21:44.10 Archive #4 on Saturday @21:21:44.12 Starting initialPurge @21:21:44.13 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @21:21:59.17 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.72 @21:22:01.14 Flushing the Collection Valve::Manifold @21:22:02.68 Pulling 5ml of CSR.flush @21:22:50.63 Purging external Intake @21:23:44.02 Flushing upper manifold @21:25:40.95 Garaging FlushPuck in Collection Clamp @21:25:54.83 Starting stand-alone bac WCR @21:25:54.85 bac wcr sampling at most 300ml @21:25:54.90 Whole Cell Archive sampling 300ml @21:25:55.07 Loading wcr puck from tube 4 into Collection Clamp @21:26:17.36 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.78 @21:26:20.31 collectSample 300ml w/bubble point of 55psi @21:26:20.38 Priming 7ml @21:26:21.41 Calibrating pressure and temperature sensors @21:26:56.29 Sampling 300.0ml @21:36:24.79 Sampled 300.0ml @21:36:24.81 Drying puck before fixing for 4:00 @21:37:48.79 Pumping wcr puck from tube 4 up to 55psi... @21:39:20.63 Fix #1 of 2 (with rnal) for 2:00 @21:39:21.18 Pulling 1.999ml of CSR.rnal @21:39:50.52 Pumping wcr puck from tube 4 up to 55psi... @21:44:10.67 Fix #2 of 2 (with rnal) for 2:00 @21:44:11.22 Pulling 2ml of CSR.rnal @21:44:40.52 Pumping wcr puck from tube 4 up to 55psi... @21:44:50.16 upsync /usr/bin/dbclient: Connection to ESPmoe@espshore:2323 exited: Error reading: Invalid argument rsync: [sender] write error: Broken pipe (32) rsync error: error in socket IO (code 10) at io.c(820) [sender=3.1.3] @21:46:32.37 Session Begun @21:46:38.35 -> stayUp @21:46:42.33 -> showlog @21:46:49.66 -> showlog 40 @21:47:49.02 -> trouble @21:48:04.10 -> Clamp @21:48:37.34 -> CC @21:48:39.55 -> CS @21:49:01.19 Storing wcr puck in Collection Clamp to tube 3 @21:49:07.47 -> stayUp false @21:49:29.02
Starting finalPurge @21:49:29.05 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @21:49:43.09 Collection Clamp onSpring/offSpring for 10/26 samples, on/off torque 1.69 @21:49:45.25 Flushing the Collection Valve::Manifold @21:49:45.96 Pulling 5ml of CSR.flush @21:50:32.13 Flushing lower manifold's waste2b port @21:51:12.55 Disinfecting external Intake with kill @21:51:13.27 Pulling 8ml of CSR.kill @21:52:09.98 Pulling 5ml of CSR.flush @21:53:09.67 Garaging FlushPuck in Collection Clamp @21:53:23.44 Completed [at('9PM') {archive}] begun 21:21:44 @21:53:23.64 Asleep / Shutdown @21:53:24.29 Shutdown @21:53:24.34
Powering down until 09:00PST26-Jan-20 @21:53:33.45 -> quit @21:53:33.50 Session Ended @21:53:54.40
Sending Email @21:55:44.85 SocketError in Qmail -- getaddrinfo: Temporary failure in name resolution @21:55:44.88 Retry #1 of 10 after 3:00 @21:58:54.43 Email::Error in MAIN -- flush stuck! @22:02:45.71PST25-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @22:02:48.57 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @22:02:53.03 Polling Can every 10:00 @22:02:53.14 Cleanly exited at 21:53:24PST25-Jan-20 @22:02:53.53 Clients may connect on TCP port 9999 @22:02:53.55 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @22:02:53.94 Woken in MAIN -- Wake up call before goMexPrecan20jan 09:00PST26-Jan-20 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 21.4C, 57% humidity, 14.9psia, 13.66V, 0.25A, 0.247A avg, 3.45W @22:02:53.99 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 09:00PST26-Jan-20 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 21.4C, 57% humidity, 14.9psia, 13.66V, 0.25A, 0.247A avg, 3.45W" @22:05:03.54 Session Begun @22:05:16.44 -> showlog @22:05:38.27 Session Ended @22:05:38.31 upsync rsync: connection unexpectedly closed (0 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(226) [sender=3.1.3] @22:10:53.95
Resuming Thread after Wake up call before goMexPrecan20jan 09:00PST26-Jan-20 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 21.4C, 57% humidity, 14.9psia, 13.66V, 0.25A, 0.247A avg, 3.45W at 22:02:53 @22:10:53.98 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 @22:10:54.07 Shutdown @22:10:54.09
Asleep / Shutdown @22:10:54.12 Powering down until 09:00PST26-Jan-20 @22:11:24.20 Sending Email @22:14:52.95 Uploading Logs @22:20:08.01 upsync rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(642) [sender=3.1.3] @23:01:24.63PST25-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @23:01:27.60 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @23:01:32.02 Polling Can every 10:00 @23:01:32.15 Cleanly exited at 22:10:54PST25-Jan-20 @23:01:33.17 Clients may connect on TCP port 9999 @23:01:33.20 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @23:01:34.15 Woken in MAIN -- Wake up call before goMexPrecan20jan 09:00PST26-Jan-20 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 20.6C, 59% humidity, 14.9psia, 13.66V, 0.26A, 0.258A avg, 3.53W @23:01:34.21 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 09:00PST26-Jan-20 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 20.6C, 59% humidity, 14.9psia, 13.66V, 0.26A, 0.258A avg, 3.53W" @23:01:56.51 Session Begun @23:02:00.48 upsync @23:02:33.57 -> stayUp @23:03:19.71 -> exit @23:03:19.73 Session Ended @23:06:29.83 Session Begun @23:06:36.76 -> missionLog @23:07:03.92 -> stayUp false @23:07:16.39 -> MainThread.resume @23:07:16.42
Resuming Thread after Wake up call before goMexPrecan20jan 09:00PST26-Jan-20 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 20.6C, 59% humidity, 14.9psia, 13.66V, 0.26A, 0.258A avg, 3.53W at 23:01:32 @23:07:16.49 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 @23:07:16.63 Shutdown @23:07:16.66
Asleep / Shutdown @23:07:16.72 Powering down until 09:00PST26-Jan-20 @23:07:20.35 upsync @00:11:21.67PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @00:11:24.58 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @00:11:29.18 Polling Can every 10:00 @00:11:29.28 Cleanly exited at 23:07:16PST25-Jan-20 @00:11:29.68 Clients may connect on TCP port 9999 @00:11:29.69 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @00:11:30.08 Woken in MAIN -- Wake up call before goMexPrecan20jan 09:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 20.4C, 60% humidity, 14.9psia, 13.67V, 0.23A, 0.235A avg, 3.21W @00:11:30.11 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 09:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 20.4C, 60% humidity, 14.9psia, 13.67V, 0.23A, 0.235A avg, 3.21W" @00:12:45.25 Session Begun @00:13:02.45 -> stayPaused @00:13:15.40 -> missionLog @00:13:32.51 -> pucks @00:13:32.79 upsync @00:14:21.67 -> MainThread.resume @00:14:21.72
Resuming Thread after Wake up call before goMexPrecan20jan 09:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 20.4C, 60% humidity, 14.9psia, 13.67V, 0.23A, 0.235A avg, 3.21W at 00:11:29 @00:14:21.75 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 @00:14:21.90 Shutdown @00:14:21.94
Asleep / Shutdown @00:14:22.00 Powering down until 09:00 @00:15:09.80 upsync @08:58:57.65PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @08:59:00.54 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @08:59:05.11 Polling Can every 10:00 @08:59:05.20 Cleanly exited at 00:14:21PST26-Jan-20 @08:59:05.60 Clients may connect on TCP port 9999 @08:59:05.61 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @08:59:05.96 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:15 @08:59:06.05 Waiting until 09:00 @09:00:00.07 Powering core bus @09:00:06.91 All dwarf controllers running firmware version 3.85 @09:00:28.62 Phase [at('9AM') {archive}] @09:00:28.65 Archive #5 on Sunday @09:00:28.66 Starting initialPurge @09:00:28.68 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @09:00:43.26 Collection Clamp onSpring/offSpring for 10/26 samples, on/off torque 1.70 @09:00:45.25 Flushing the Collection Valve::Manifold @09:00:46.75 Pulling 5ml of CSR.flush @09:01:32.89 Purging external Intake @09:02:26.19 Flushing upper manifold @09:04:22.64 Garaging FlushPuck in Collection Clamp @09:04:36.02 Starting stand-alone bac WCR @09:04:36.03 bac wcr sampling at most 300ml @09:04:36.07 Whole Cell Archive sampling 300ml @09:04:36.19 Loading wcr puck from tube 4 into Collection Clamp @09:04:58.26 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.78 @09:05:00.29 collectSample 300ml w/bubble point of 55psi @09:05:00.32 Priming 7ml @09:05:00.70 Calibrating pressure and temperature sensors @09:05:33.28 Sampling 300.0ml @09:06:18.76 upsync @09:13:53.81 Sampled 300.0ml @09:13:53.83 Drying puck before fixing for 4:00 @09:15:17.77 Pumping wcr puck from tube 4 up to 55psi... @09:16:49.37 Fix #1 of 2 (with rnal) for 2:00 @09:16:49.91 Pulling 2ml of CSR.rnal @09:17:19.17 Pumping wcr puck from tube 4 up to 55psi... @09:21:39.95 Fix #2 of 2 (with rnal) for 2:00 @09:21:40.48 Pulling 2ml of CSR.rnal @09:22:09.80 Pumping wcr puck from tube 4 up to 55psi... @09:26:29.90 Storing wcr puck in Collection Clamp to tube 3 @09:26:57.72 Starting finalPurge @09:26:57.74 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @09:27:11.61 Collection Clamp onSpring/offSpring for 8/26 samples, on/off torque 1.70 @09:27:13.61 Flushing the Collection Valve::Manifold @09:27:14.31 Pulling 5ml of CSR.flush @09:28:01.05 Flushing lower manifold's waste2b port @09:28:41.52 Disinfecting external Intake with kill @09:28:42.21 Pulling 8ml of CSR.kill @09:29:38.60 Pulling 5ml of CSR.flush @09:30:37.58 Garaging FlushPuck in Collection Clamp @09:30:51.00 Completed [at('9AM') {archive}] begun 09:00:28 @09:30:51.17 Asleep / Shutdown @09:30:51.80 Shutdown @09:30:51.87
Powering down until 21:00 @09:31:21.97 Sending Email @09:32:30.81 upsync @10:48:24.23PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @10:48:27.54 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @10:48:34.04 Polling Can every 10:00 @10:48:34.26 Cleanly exited at 09:30:51PST26-Jan-20 @10:48:35.02 Clients may connect on TCP port 9999 @10:48:35.04 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @10:48:36.05 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 20.5C, 60% humidity, 14.9psia, 13.66V, 0.29A, 0.288A avg, 3.94W @10:48:36.10 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 20.5C, 60% humidity, 14.9psia, 13.66V, 0.29A, 0.288A avg, 3.94W" @10:48:49.15 upsync @10:48:53.20 Session Begun @10:48:58.32 -> MainThread.exit @10:48:58.43 Session Ended @10:59:32.76PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @10:59:36.82 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @10:59:43.54 Polling Can every 10:00 @10:59:43.75 Cleanly exited at 10:48:58PST26-Jan-20 @10:59:44.53 Clients may connect on TCP port 9999 @10:59:44.56 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @10:59:45.49 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 20.9C, 59% humidity, 14.9psia, 13.66V, 0.26A, 0.258A avg, 3.53W @10:59:45.54 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 20.9C, 59% humidity, 14.9psia, 13.66V, 0.26A, 0.258A avg, 3.53W" @10:59:54.48 Session Begun @10:59:56.43 -> showlog @11:00:01.01 -> MainThread.exit @11:00:10.59 -> exit @11:00:10.66 Session Ended @11:00:11.25 upsync @13:08:01.05PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @13:08:03.98 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @13:08:08.40 Polling Can every 10:00 @13:08:08.51 Cleanly exited at 11:00:11PST26-Jan-20 @13:08:08.90 Clients may connect on TCP port 9999 @13:08:08.92 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @13:08:09.39 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.1C, 57% humidity, 14.9psia, 13.66V, 0.27A, 0.264A avg, 3.69W @13:08:09.43 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.1C, 57% humidity, 14.9psia, 13.66V, 0.27A, 0.264A avg, 3.69W" @13:11:24.85 SocketError in Qmail -- getaddrinfo: Temporary failure in name resolution @13:11:24.87 Retry #1 of 10 after 3:00 @13:15:42.90 Session Begun @13:16:02.29 -> missionLog @13:16:09.41
Resuming Thread after Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.1C, 57% humidity, 14.9psia, 13.66V, 0.27A, 0.264A avg, 3.69W at 13:08:08 @13:16:09.44 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 @13:16:09.60 Shutdown @13:16:09.64
Asleep / Shutdown @13:16:09.71 Powering down until 21:00 @13:16:36.00 upsync @13:16:39.81
Sending Email @13:17:06.15 upsync @16:24:50.65PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @16:24:53.49 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @16:24:59.47 Polling Can every 10:00 @16:24:59.58 Cleanly exited at 13:16:09PST26-Jan-20 @16:24:59.97 Clients may connect on TCP port 9999 @16:24:59.98 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @16:25:00.45 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 20.5C, 59% humidity, 14.9psia, 13.68V, 0.19A, 0.193A avg, 2.64W @16:25:00.47 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 20.5C, 59% humidity, 14.9psia, 13.68V, 0.19A, 0.193A avg, 2.64W" @16:25:09.42 Session Begun @16:25:11.98 -> showlo @16:25:13.55 -> showlog @16:25:18.94 -> MainThread.exit @16:25:24.59 upsync @16:25:24.67 Session Ended @16:47:30.05PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @16:47:32.99 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @16:47:37.49 Polling Can every 10:00 @16:47:37.60 Cleanly exited at 16:25:24PST26-Jan-20 @16:47:38.00 Clients may connect on TCP port 9999 @16:47:38.02 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @16:47:38.47 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.0C, 57% humidity, 14.9psia, 13.68V, 0.21A, 0.211A avg, 2.89W @16:47:38.50 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.0C, 57% humidity, 14.9psia, 13.68V, 0.21A, 0.211A avg, 2.89W" @16:49:26.24 upsync @16:50:47.90 Session Begun @16:51:13.88 Session Begun @16:51:27.68 -> MainThread.exit @16:51:27.85 Session Ended @16:51:27.90 Session Ended @16:53:49.76PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @16:53:52.62 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @16:53:57.12 Polling Can every 10:00 @16:53:57.23 Cleanly exited at 16:51:27PST26-Jan-20 @16:53:57.62 Clients may connect on TCP port 9999 @16:53:57.64 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @16:53:58.12 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.0C, 57% humidity, 14.9psia, 13.66V, 0.26A, 0.264A avg, 3.61W @16:53:58.15 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.0C, 57% humidity, 14.9psia, 13.66V, 0.26A, 0.264A avg, 3.61W" @16:55:04.55 Session Begun @16:55:17.45 -> MainThread.resume @16:55:17.61
Resuming Thread after Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.0C, 57% humidity, 14.9psia, 13.66V, 0.26A, 0.264A avg, 3.61W at 16:53:57 @16:55:18.03 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 @16:55:18.69 Shutdown @16:55:19.01
Asleep / Shutdown @16:55:19.57 Powering down until 21:00 @16:55:49.54 upsync @16:55:49.68
Sending Email @16:56:15.87 upsync @16:56:43.41 MissionError in MAIN -- Power cut failed @16:56:43.48
Polling Can every 10:00 @16:56:43.58 Waiting until 21:00 @16:57:54.63 Session Begun @16:58:01.21 -> showlog 30 @16:58:10.59 -> MainThread.resume @16:58:10.62 Thread::CannotResume in brent -- MAIN is not suspended @16:58:15.65 upsync @16:58:21.81 -> exit @16:58:21.84 Session Ended @16:59:36.63PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @16:59:39.47 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @16:59:44.01 Polling Can every 10:00 @16:59:44.12 Cleanly exited at 16:55:19PST26-Jan-20 @16:59:44.51 Clients may connect on TCP port 9999 @16:59:44.53 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @16:59:45.03 Woken in MAIN -- Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.1C, 57% humidity, 14.9psia, 13.67V, 0.22A, 0.223A avg, 3.05W @16:59:45.05 Waiting to Resume from Checkpoint "Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.1C, 57% humidity, 14.9psia, 13.67V, 0.22A, 0.223A avg, 3.05W" @17:01:56.26 Session Begun @17:02:14.02 -> MainThread.resume @17:02:14.05
Resuming Thread after Wake up call before goMexPrecan20jan 21:00 phase /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 21.1C, 57% humidity, 14.9psia, 13.67V, 0.22A, 0.223A avg, 3.05W at 16:59:44 @17:02:14.13 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 @17:02:14.28 Shutdown @17:02:14.32
Asleep / Shutdown @17:02:14.38 Powering down until 21:00 @17:02:44.43 Sending Email @17:02:54.33 upsync @17:03:19.82 upsync @20:59:00.64PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @20:59:03.49 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @20:59:07.84 Polling Can every 10:00 @20:59:07.96 Cleanly exited at 17:02:14PST26-Jan-20 @20:59:08.35 Clients may connect on TCP port 9999 @20:59:08.36 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @20:59:08.75 Continuing goMexPrecan20jan from /home/esp/esp2/mission/long/goMexPrecan20jan.rb:16 @20:59:08.82 Waiting until 21:00 @21:00:00.06 Powering core bus @21:00:07.04 All dwarf controllers running firmware version 3.85 @21:00:08.71 I2C::Bus::Error in core_reader -- Unexpected message ACK byte: 0x01 @21:00:09.15 I2C::Gateway::Reset in rdyProcessing -- Restarted ESP2 v3.41 I2C Gateway v3.20 @21:00:09.17 Retry #1 of 3 @21:00:10.16 Polling Can every 10:00 @21:00:14.71 I2C::Request::Timeout in MAIN -- No Response to I2C::Servo::Status3Request[13:->26] @21:00:14.72
Retry #1 of 3 @21:00:27.61 I2C::Request::Timeout in rdySampler -- No Response to I2C::Shaft::RotateRequest[12:->27] @21:00:27.70 Retry #1 of 3 @21:00:37.89
Phase [at('9PM') {archive}] @21:00:37.91 Archive #6 on Sunday @21:00:37.93 Starting initialPurge @21:00:37.94 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @21:00:52.44 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.61 @21:00:54.39 Flushing the Collection Valve::Manifold @21:00:55.91 Pulling 5ml of CSR.flush @21:01:42.20 Purging external Intake @21:02:35.48 Flushing upper manifold @21:04:31.55 Garaging FlushPuck in Collection Clamp @21:04:45.36 Starting stand-alone bac WCR @21:04:45.37 bac wcr sampling at most 300ml @21:04:45.40 Whole Cell Archive sampling 300ml @21:04:45.59 Loading wcr puck from tube 4 into Collection Clamp @21:05:07.60 Collection Clamp onSpring/offSpring for 9/25 samples, on/off torque 1.77 @21:05:09.96 collectSample 300ml w/bubble point of 55psi @21:05:10.05 Priming 7ml @21:05:11.79 Calibrating pressure and temperature sensors @21:05:43.73 Sampling 300.0ml @21:06:55.95 upsync @21:14:07.55 Sampled 300.0ml @21:14:07.57 Drying puck before fixing for 4:00 @21:15:31.51 Pumping wcr puck from tube 4 up to 55psi... @21:17:03.87 Fix #1 of 2 (with rnal) for 2:00 @21:17:04.42 Pulling 2ml of CSR.rnal @21:17:33.80 Pumping wcr puck from tube 4 up to 55psi... @21:21:54.47 Fix #2 of 2 (with rnal) for 2:00 @21:21:55.02 Pulling 2ml of CSR.rnal @21:22:24.36 Pumping wcr puck from tube 4 up to 55psi... @21:26:44.83 Storing wcr puck in Collection Clamp to tube 3 @21:26:53.71 Session Begun @21:27:08.79 -> Sampler.volumeSampled @21:27:14.33
Starting finalPurge @21:27:14.36 Loading FlushPuck into Collection Clamp from FlushPuck::Garage @21:27:28.79 Collection Clamp onSpring/offSpring for 9/26 samples, on/off torque 1.74 @21:27:28.97 -> bye! @21:27:31.62
Flushing the Collection Valve::Manifold @21:27:32.49 Pulling 5ml of CSR.flush @21:27:32.54 Errno::EPIPE in brent's_reader -- Broken pipe @21:27:32.63 Session Ended @21:28:18.80
Flushing lower manifold's waste2b port @21:28:59.08 Disinfecting external Intake with kill @21:28:59.77 Pulling 8ml of CSR.kill @21:29:56.33 Pulling 5ml of CSR.flush @21:30:55.51 Garaging FlushPuck in Collection Clamp @21:31:09.23 Completed [at('9PM') {archive}] begun 21:00:37 @21:31:09.35 Asleep after completing goMexPrecan20jan assays @21:31:10.45 Shutdown @21:31:10.57
Asleep / Shutdown @21:31:10.65 Shutdown @21:31:10.71
Powering down indefinitely @21:31:40.78 Sending Email @21:33:09.09 upsync @21:33:34.76 upsync @23:07:31.16PST26-Jan-20
ESP2 v3.41 I2C Gateway v3.20 for core bus @23:07:35.53 Configuration for moe 10/23/19 by maro@mbari.org /home/esp/esp2/type/shallow/moe/configure.rb @23:07:41.61 Polling Can every 10:00 @23:07:41.72 Cleanly exited at 21:31:10PST26-Jan-20 @23:07:42.11 Clients may connect on TCP port 9999 @23:07:42.12 Loading /home/esp/esp2/mission/long/goMexPrecan20jan.rb mission @23:07:43.14 MissionLog::Error in MAIN -- goMexPrecan20jan mission ended at 21:31:09.25PST26-Jan-20 @23:07:43.23 Waiting to Resume from Checkpoint "goMexPrecan20jan mission ended at 21:31:09.25PST26-Jan-20" @23:07:45.13 Session Begun @23:07:50.43 -> MainThread.exit @23:08:12.21 -> showlog