| [11:15:11] | * realityloop has quit (Ping timeout: 272 seconds) |
| [11:16:30] | * realityloopAFK has joined #aegir |
| [11:16:53] | * realityloopAFK is now known as realityloop |
| [11:18:09] | * kvanderw is now known as zz_kvanderw |
| [11:19:21] | * zz_kvanderw is now known as kvanderw |
| [11:43:53] | * christefano has quit (Quit: christefano) |
| [11:46:39] | * Egyptian[Home] has joined #aegir |
| [11:47:00] | * realityloop has quit (Ping timeout: 260 seconds) |
| [11:48:33] | * realityloopAFK has joined #aegir |
| [11:48:55] | * realityloopAFK is now known as realityloop |
| [12:01:57] | * fatguylaughing has joined #aegir |
| [12:01:57] | * fatguylaughing has quit (Client Quit) |
| [12:53:49] | * Egyptian[Home] has quit (Ping timeout: 260 seconds) |
| [12:56:01] | * Egyptian[Home] has joined #aegir |
| [12:56:43] | * joestewart has quit (Quit: No Ping reply in 180 seconds.) |
| [12:59:45] | * joestewart has joined #aegir |
| [13:22:22] | * Egyptian[Home] has quit (Ping timeout: 245 seconds) |
| [13:23:28] | * Egyptian[Home] has joined #aegir |
| [13:51:58] | * zz_cdracars is now known as cdracars |
| [13:53:55] | * Egyptian[Home] has quit (Ping timeout: 272 seconds) |
| [13:55:34] | * Egyptian[Home] has joined #aegir |
| [15:07:36] | * christefano has joined #aegir |
| [15:17:07] | * Egyptian[Home] has quit (Ping timeout: 272 seconds) |
| [15:37:15] | * iribarne has joined #aegir |
| [15:40:45] | * iribarne has quit (Client Quit) |
| [15:47:13] | * cdracars is now known as zz_cdracars |
| [15:52:52] | * jerryitt has quit (Quit: Connection closed for inactivity) |
| [16:05:05] | * benjamin__ has joined #aegir |
| [16:09:37] | * beautifulmind has joined #aegir |
| [16:14:51] | * christefano has quit (Quit: christefano) |
| [16:26:57] | * stijnvbrande has joined #aegir |
| [17:52:04] | * rokk has joined #aegir |
| [18:35:40] | * beautifulmind has quit (Quit: Leaving.) |
| [18:38:35] | * littledynamo has joined #aegir |
| [18:47:32] | * e-anima has joined #aegir |
| [18:58:41] | * ivanjaros has joined #aegir |
| [20:45:35] | * p_stampy has quit (Excess Flood) |
| [20:45:46] | * p_stampy has joined #aegir |
| [20:46:06] | * realityloop has quit (Ping timeout: 467 seconds) |
| [20:46:22] | * realityloopAFK has joined #aegir |
| [20:46:43] | * realityloopAFK is now known as realityloop |
| [21:03:37] | * beautifulmind has joined #aegir |
| [22:03:36] | * Egyptian[Home] has joined #aegir |
| [22:25:01] | * Egyptian[Home] has quit (Ping timeout: 272 seconds) |
| [22:25:55] | * Egyptian[Home] has joined #aegir |
| [22:44:32] | * Egyptian[Home] has quit (Ping timeout: 260 seconds) |
| [22:59:23] | * beautifulmind has quit (Ping timeout: 240 seconds) |
| [23:04:47] | * beautifulmind has joined #aegir |
| [23:06:24] | * beautifulmind has quit (Read error: Connection reset by peer) |
| [23:07:02] | * beautifulmind has joined #aegir |
| [23:45:56] | * zombiebeard has joined #aegir |
| [23:50:05] | * zz_drakythe is now known as drakythe |
| [00:04:25] | * cmoates has quit (Ping timeout: 260 seconds) |
| [00:05:09] | * cmoates has joined #aegir |
| [00:10:09] | * cmoates has quit (Ping timeout: 272 seconds) |
| [00:11:22] | * littledynamo has quit (Ping timeout: 240 seconds) |
| [00:12:01] | * jerryitt has joined #aegir |
| [00:13:44] | * noecc has joined #aegir |
| [00:25:42] | * littledynamo has joined #aegir |
| [00:29:14] | * zombiebeard has quit (Quit: zombiebeard) |
| [00:55:26] | * stijnvbrande has quit (Remote host closed the connection) |
| [00:56:05] | * stijnvbrande has joined #aegir |
| [01:00:20] | * stijnvbrande has quit (Ping timeout: 260 seconds) |
| [01:00:45] | * ivanjaros has quit (Quit: https://drupal.org/user/135190) |
| [01:02:53] | * JeremyR has joined #aegir |
| [01:03:49] | * JeremyR has quit (Client Quit) |
| [01:09:55] | * fatguylaughing has joined #aegir |
| [01:10:10] | * btopro has joined #aegir |
| [01:13:29] | * beautifulmind has quit (Quit: Leaving.) |
| [01:25:42] | * jeremyr has joined #aegir |
| [01:35:17] | * cmoates has joined #aegir |
| [01:39:28] | * ivanjaros has joined #aegir |
| [01:41:42] | * cmoates has quit (Ping timeout: 244 seconds) |
| [01:42:23] | * zz_cdracars is now known as cdracars |
| [01:43:36] | * David_Hernandez has joined #aegir |
| [01:44:47] | * cmoates has joined #aegir |
| [01:47:14] | * zombiebeard has joined #aegir |
| [01:51:45] | * cmoates has quit (Ping timeout: 260 seconds) |
| [01:59:53] | * David_Hernandez has quit (Quit: Leaving) |
| [02:00:31] | * David_Hernandez has joined #aegir |
| [02:06:20] | * cmoates has joined #aegir |
| [02:14:10] | <ergonlogic> | xur1z: In Aegir 3.x the task log should update via ajax |
| [02:14:25] | <ergonlogic> | if you run the task manually, you should see the Drush output |
| [02:14:47] | <ergonlogic> | but otherwise it's captured in the Drush process, and piped back into the front-end |
| [02:15:05] | * Egyptian[Home] has joined #aegir |
| [02:15:24] | * rokk has quit (Quit: rokk) |
| [02:15:25] | <ergonlogic> | I sometimes monitor the state of ongoing tasks using htop, which will show the currently running process tree |
| [02:21:48] | * Egyptian[Home] has quit (Quit: Leaving.) |
| [02:22:23] | * Egyptian[Home] has joined #aegir |
| [02:25:46] | * ratioweb has joined #aegir |
| [02:27:10] | * cmoates has quit (Ping timeout: 244 seconds) |
| [02:28:51] | * cmoates has joined #aegir |
| [02:39:03] | * Egyptian[Home] has quit (Ping timeout: 244 seconds) |
| [02:48:09] | * stijnvbrande has joined #aegir |
| [02:50:52] | * josh_k has joined #aegir |
| [02:58:05] | * stijnvbrande has quit (Remote host closed the connection) |
| [02:58:44] | * stijnvbrande has joined #aegir |
| [03:01:30] | * josh_k has quit (Disconnected by services) |
| [03:01:30] | * josh_k_ has joined #aegir |
| [03:03:07] | * stijnvbrande has quit (Ping timeout: 245 seconds) |
| [03:08:37] | * littledynamo has quit (Ping timeout: 245 seconds) |
| [03:10:26] | * josh_k_ has quit (Remote host closed the connection) |
| [03:10:57] | * josh_k has joined #aegir |
| [03:20:42] | * christefano has joined #aegir |
| [03:28:16] | * David_Hernandez is now known as David_Hdez|Cafe |
| [03:39:39] | * David_Hdez|Cafe is now known as David_Hernandez |
| [03:44:52] | * chertzog has joined #aegir |
| [04:22:42] | * zombiebeard has quit (Read error: Connection reset by peer) |
| [04:41:48] | * gusaus has joined #aegir |
| [04:51:44] | * stijnvbrande has joined #aegir |
| [04:59:43] | * chertzog has quit (Remote host closed the connection) |
| [05:07:06] | * stijnvbrande has quit (Remote host closed the connection) |
| [05:07:45] | * stijnvbrande has joined #aegir |
| [05:12:15] | * stijnvbrande has quit (Ping timeout: 272 seconds) |
| [05:14:41] | * btopro has quit (Quit: Leaving.) |
| [05:21:53] | * joestewart has quit (Quit: No Ping reply in 180 seconds.) |
| [05:25:32] | * joestewart has joined #aegir |
| [05:26:20] | * zombiebeard has joined #aegir |
| [05:31:16] | * josh_k_ has joined #aegir |
| [05:31:16] | * josh_k has quit (Disconnected by services) |
| [05:45:41] | * ratioweb has quit (Quit: Leaving) |
| [05:55:37] | * johnstorey has joined #aegir |
| [06:08:37] | * kvanderw is now known as zz_kvanderw |
| [06:09:23] | * zz_kvanderw is now known as kvanderw |
| [06:13:03] | * noecc has left #aegir ("pax") |
| [06:34:29] | * jeremyr has quit (Quit: Leaving.) |
| [06:50:11] | * David_Hernandez has quit (Quit: Leaving) |
| [07:04:13] | * boshtian has joined #aegir |
| [07:05:19] | * boshtian1 has joined #aegir |
| [07:08:37] | * boshtian has quit (Ping timeout: 245 seconds) |
| [07:12:26] | * rokk has joined #aegir |
| [07:16:50] | * josh_k_ has quit (Remote host closed the connection) |
| [07:17:19] | * josh_k has joined #aegir |
| [07:22:01] | <xur1z> | ergonlogic huh, interesting. so then is it that the drush call is running outside the context of the site, and can't watchdog() to the correct location? |
| [07:22:55] | <xur1z> | guessing there is an architecture reason why we don't see log output, else we'd see some |
| [07:24:50] | <ergonlogic> | you could write to watchdog as part of a drush command run on a site, but we haven't implemented anything like that |
| [07:24:59] | <ergonlogic> | I'm not sure why you'd want to |
| [07:25:46] | <ergonlogic> | but we already capture the drush output and write it to the task log |
| [07:28:43] | * btopro has joined #aegir |
| [07:29:10] | <ergonlogic> | xur1z: I may be missing the point of your question |
| [07:31:15] | <xur1z> | i just tend to sit on logfiles for progress indication |
| [07:31:39] | <xur1z> | so even with pretty ajaxy throbbers, i want to see where it's up to :) |
| [07:32:13] | * DecipheredAFK has quit (Ping timeout: 272 seconds) |
| [07:32:57] | <xur1z> | i'll try hooking into the provision commands and see if i get watchdog output - thanks. totally just a for-interest thing, and to keep me reassured while tasks run |
| [07:34:02] | * DecipheredAFK has joined #aegir |
| [07:34:56] | <ergonlogic> | so, it's probably somewhere in the implementation of the hosting-task Drush command |
| [07:35:28] | <xur1z> | ok |
| [07:36:17] | * rokk has quit (Quit: rokk) |
| [07:36:21] | <ergonlogic> | xur1z: http://api.aegirproject.org/api/aegir/hosting3%21task.hosting.inc/functi... |
| [07:37:21] | <xur1z> | cheers |
| [07:39:15] | * shrop has quit (Ping timeout: 246 seconds) |
| [07:41:31] | <ergonlogic> | so you could probably implement a drush_post_hosting_task() and look in drush_get_context('HOSTING_DRUSH_OUTPUT') |
| [07:41:48] | <ergonlogic> | presumably you could write that to a log file |
| [07:42:20] | <ergonlogic> | it won't exactly be in realtime |
| [07:42:49] | <ergonlogic> | it'd be lumped together by task |
| [07:43:36] | * shrop has joined #aegir |
| [07:44:27] | * benjamin__ has quit (Quit: No Ping reply in 180 seconds.) |
| [07:45:36] | * benjamin__ has joined #aegir |
| [07:45:40] | <ergonlogic> | xur1z: another option would be in Drush itself: http://api.drush.org/api/drush/includes%21drush.inc/function/drush_log/6.x |
| [07:46:23] | <ergonlogic> | it looks like you can set an alternate "drush_get_context('DRUSH_LOG_CALLBACK')" |
| [07:46:55] | <xur1z> | that'd just get back to the eventual command output, not trigger something to watchdog immediately? (i will explore this but can't right now because work!) |
| [07:47:08] | <ergonlogic> | so a better solution might be to intercept the output there |
| [07:47:24] | <ergonlogic> | right, you'd still have to handle writing it to watchdog |
| [07:47:31] | <ergonlogic> | which'd be complicated |
| [07:47:45] | <ergonlogic> | possibly |
| [07:48:18] | <ergonlogic> | I mean, you could write to the site's watchdog, but Aegir's watchdog would be a little tougher |
| [07:49:19] | <ergonlogic> | anyway, I'd just write a wrapper for _drush_print_log(), that writes output to a logfile first |
| [07:49:28] | <ergonlogic> | that way you could just tail the logfile directly |
| [07:49:56] | <ergonlogic> | since putting the output in watchdog is presumably not really necessary, as such |
| [07:50:36] | <ergonlogic> | actually, this is something I've been wishing for myself |
| [07:50:53] | <ergonlogic> | I'll write up a feature request |
| [08:01:51] | <ergonlogic> | xur1z: fyi, https://www.drupal.org/node/2352337 |
| [08:01:51] | <hefring> | https://www.drupal.org/node/2352337 => Implement a system log for Aegir operations [#2352337] => 0 comments, 1 IRC mention |
| [08:02:10] | * rokk has joined #aegir |
| [08:02:15] | <xur1z> | beaut |
| [08:02:53] | * jerryitt has quit (Quit: Connection closed for inactivity) |
| [08:03:14] | <xur1z> | (i suspect this is less of a problem for us since we push all sites to syslog anyway, but it'd be nice to support hostmaster's dblog as well) |
| [08:04:12] | * rokk has quit (Client Quit) |
| [08:04:15] | <ergonlogic> | well, this'd capture all the Drush operations, which is where all the heavy lifting happens |
| [08:04:21] | <xur1z> | cool |
| [08:04:39] | <ergonlogic> | It'd be invaluable in debugging, actually |
| [08:05:10] | <ergonlogic> | we already have it in the task logs, but having it time-stamped and machine processable would be great |
| [08:05:11] | <xur1z> | that's why i figured the issue was architectural - since why else wouldn't it already exist :D |
| [08:05:36] | <ergonlogic> | well, because we have a 'good enough' solution already :) |
| [08:05:49] | <xur1z> | good enough for patient people perhaps :D |
| [08:05:59] | <xur1z> | or running tasks from CLI |
| [08:06:20] | * btopro has quit (Quit: Leaving.) |
| [08:06:25] | <ergonlogic> | my interest is more in being able to correlate load spikes to Aegir operations, and the like |
| [08:06:50] | <ergonlogic> | across multiple systems |
| [08:07:11] | <xur1z> | ok |
| [08:19:17] | * johnstorey has quit (Quit: Nodding off now.) |
| [08:19:47] | <ergonlogic> | anarcat: ping |
| [08:21:28] | <anarcat> | ergonlogic: pong |
| [08:21:57] | <ergonlogic> | anarcat: hey, I'm thinking about adding a system log for aegir's drush operations |
| [08:22:02] | <ergonlogic> | https://www.drupal.org/node/2352337 |
| [08:22:02] | <hefring> | https://www.drupal.org/node/2352337 => Implement a system log for Aegir operations [#2352337] => 0 comments, 2 IRC mentions |
| [08:22:16] | <anarcat> | you mean syslog system log? |
| [08:22:20] | <ergonlogic> | yes |
| [08:22:22] | <anarcat> | log to syslog instead of the db? |
| [08:22:26] | <ergonlogic> | both |
| [08:22:28] | <anarcat> | what a novel idea :p |
| [08:22:29] | <ergonlogic> | no |
| [08:22:31] | <anarcat> | just ditch the db |
| [08:22:39] | <anarcat> | useless overhead :p |
| [08:22:43] | <ergonlogic> | no, I mean, in additions to the task logs |
| [08:22:55] | <anarcat> | then we need to bother with log rotation and al |
| [08:23:10] | <ergonlogic> | but it becomes parseable by logstash |
| [08:23:16] | <ergonlogic> | etc |
| [08:23:17] | <anarcat> | although it's useful to see the failures and progress in the frontend, i'm not sure we should keep the logs on success |
| [08:23:21] | <anarcat> | yep |
| [08:23:30] | <ergonlogic> | and we could tail the log |
| [08:23:35] | <ergonlogic> | in the terminal |
| [08:23:55] | <ergonlogic> | rather than the ajaxy gui |
| [08:24:03] | <anarcat> | yep |
| [08:24:06] | <anarcat> | screw the web! :) |
| [08:24:16] | <ergonlogic> | uh huh |
| [08:24:18] | <ergonlogic> | :p |
| [08:25:06] | <ergonlogic> | drush allows us to override the log callback |
| [08:25:27] | <ergonlogic> | so we could send it to syslog, then pass it along to the default function |
| [08:25:54] | <ergonlogic> | it should have no effect on the regular front-end/back-end communication |
| [08:26:20] | <ergonlogic> | slightly slower, I suppose, because of the disk i/o |
| [08:26:58] | <ergonlogic> | anarcat: presumably, we could target one of the local facilities |
| [08:27:34] | <ergonlogic> | and the .deb could drop a conf file in /etc/rsyslog.d/ |
| [08:27:44] | <anarcat> | and logrotate.d |
| [08:27:48] | <ergonlogic> | right |
| [08:28:56] | <ergonlogic> | I'm not sure if there are conventions on using local0 through local7 |
| [08:29:13] | <ergonlogic> | or if there's some other facility to use |
| [08:29:20] | <ergonlogic> | daemon, maybe? |
| [08:30:36] | <ergonlogic> | looking at /etc/rsyslog.d/20-ufw.conf, it looks like we can filter based on some keyword |
| [08:31:32] | * gusaus has quit (Quit: gusaus) |
| [08:32:04] | <anarcat> | it'd say daemon, debug or info priority for most messages |
| [08:32:14] | <anarcat> | then warn/error for the appropriate messages |
| [08:32:18] | <anarcat> | the key is the message priority |
| [08:32:27] | <ergonlogic> | right |
| [08:32:37] | <ergonlogic> | which drush provides us |
| [08:32:40] | <anarcat> | it could mean a lot of noise in daemon though |
| [08:32:49] | <anarcat> | well, syslog is more granular there i think |
| [08:32:54] | <ergonlogic> | but I mean to get the log into /var/log/aegir.log, or whatever |
| [08:33:24] | <ergonlogic> | I'd rather not spray this stuff all over the place |
| [08:34:01] | <ergonlogic> | last time I looked, there wasn't a way to define our own facility |
| [08:34:20] | <ergonlogic> | though postfix appears to use a socket |
| [08:34:25] | <xur1z> | https://gist.github.com/xurizaemon/050c64cf875588fbbe42 |
| [08:34:45] | <xur1z> | we push everything to syslog from syslog.module or drush | logger -t drush |
| [08:34:53] | <xur1z> | then we split it up in rsyslog |
| [08:35:21] | <xur1z> | my filters there are not perfect but might be a starting point |
| [08:35:42] | <anarcat> | ergonlogic: postfix logs to the mail prio |
| [08:35:57] | <anarcat> | ergonlogic: there are ways to check which process originates the logs |
| [08:36:08] | <anarcat> | i would rather avoid relying on rsyslog |
| [08:36:26] | <xur1z> | you can use syslog prio or message tags, this is just one way to approach it. sure if you are building packages don't depend on rsyslog. |
| [08:36:56] | <anarcat> | geez syslog changed since the old days |
| [08:36:59] | <xur1z> | ( + logger in our case) |
| [08:37:39] | <anarcat> | i thought there was a way to specify "this program goes over here", but i can'T find it through a quick glance at the manpage |
| [08:40:53] | <ergonlogic> | presumably this bit: :syslogtag, contains, "civicrm" |
| [08:41:21] | <ergonlogic> | would map to openlog()'s $ident parameter? |
| [08:41:41] | <xur1z> | echo "to civicrm log" | logger -t civicrm |
| [08:41:46] | <xur1z> | "tags" facility |
| [08:48:01] | <ergonlogic> | destination df_userapp { file("/var/log/userapp.log"); }; |
| [08:48:01] | <ergonlogic> | |
| [08:48:01] | <ergonlogic> | filter f_userapp { program("myapplication"); }; |
| [08:48:01] | <ergonlogic> | |
| [08:48:01] | <ergonlogic> | log { |
| [08:48:03] | <ergonlogic> | source(s_all); |
| [08:48:06] | <ergonlogic> | filter(f_userapp); |
| [08:48:08] | <ergonlogic> | destination(df_userapp); |
| [08:48:11] | <ergonlogic> | } |
| [08:48:39] | <ergonlogic> | something like ^^^ that should filter our stuff into its own logfile |
| [08:48:45] | * josh_k has quit (Disconnected by services) |
| [08:48:45] | * josh_k_ has joined #aegir |
| [08:49:10] | <ergonlogic> | though that might be specific to syslog-ng |
| [08:50:29] | <ergonlogic> | ok, I'm pretty sure about that openlog()'s $ident parameter is a tag |
| [08:51:51] | <ergonlogic> | ... it's always fun to refer to the same thing using different terms... |
| [08:51:53] | <ergonlogic> | bleh |
| [08:51:55] | * josh_k_ has quit (Client Quit) |
| [08:52:06] | <ergonlogic> | anyway, I'll experiment more on it |
| [08:54:20] | <ergonlogic> | hefring: log pointer? |
| [08:54:20] | <hefring> | http://hefring.mig5.net/bot/log/aegir/2014-10-07#T532925 |
| [08:55:41] | * fatguylaughing has quit (Quit: fatguylaughing) |
| [08:57:29] | * DecipheredAFK is now known as Deciphered |
| [08:57:30] | * Deciphered has quit (Changing host) |
| [08:57:30] | * Deciphered has joined #aegir |
| [09:04:14] | * cdracars is now known as zz_cdracars |
| [09:04:54] | * e-anima has quit (Quit: reallife not found) |
| [09:09:37] | * ivanjaros has quit (Quit: https://drupal.org/user/135190) |
| [09:19:48] | * zombiebeard has quit (Quit: zombiebeard) |
| [09:21:25] | * realityloop is now known as realityloopAFK |
| [09:25:30] | * realityloopAFK is now known as realityloop |
| [09:26:17] | * gusaus has joined #aegir |
| [09:35:01] | * zz_cdracars is now known as cdracars |
| [09:42:59] | * jeremyr has joined #aegir |
| [09:45:22] | * jerryitt has joined #aegir |
| [09:56:13] | * gusaus has quit (Ping timeout: 272 seconds) |
| [09:56:44] | * drakythe is now known as zz_drakythe |
| [09:59:55] | * gusaus has joined #aegir |
| [10:20:46] | * jeremyr has quit (Quit: Leaving.) |
| [10:23:18] | * fatguylaughing has joined #aegir |
| [10:25:52] | * fatguylaughing has quit (Read error: Connection reset by peer) |
| [10:26:31] | * fatguylaughing has joined #aegir |
| [10:45:19] | * realityloop has quit (Quit: ZNC - http://znc.in) |
| [10:45:29] | * benjamin__ has quit (Ping timeout: 258 seconds) |
| [10:46:05] | * benjamin__ has joined #aegir |
| [10:49:20] | * realityloopAFK has joined #aegir |
| [10:49:29] | * realityloopAFK is now known as realityloop |
| [10:51:02] | * gusaus has quit (Read error: Connection reset by peer) |
| [10:55:10] | * realityloop is now known as realityloopAFK |
| [10:59:21] | * berniecram has joined #aegir |
