homeauto: service/reasoning/reasoning.py annotate

annotate service/reasoning/reasoning.py @ 1409:e78b8806ad05

actually set put payload this time. add treq dep Ignore-this: b6a05c294d9a5ee6052972cad4ecb5c5 darcs-hash:d41a16eb44db885ff391ddbe64352245b885a838

author	drewp <drewp@bigasterisk.com>
date	Tue, 23 Jul 2019 17:37:24 -0700
parents	69b3f5b3aeda
children	62171aa2bc4e

rev	line source
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	1 #!bin/python
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	2 """
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	3 Graph consists of:
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	4 input/* (read at startup)
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	5 webinput/* (new files are noticed in here)
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	6 any number of remote graphs, specified in the other graph as objects of (:reasoning, :source, *), reread constantly
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	7
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	8 gather subgraphs from various services, run them through a rules
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	9 engine, and make http requests with the conclusions.
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	10
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	11 E.g. 'when drew's phone is near the house, and someone is awake,
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	12 unlock the door when the door's motion sensor is activated'
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	13
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	14 When do we gather? The services should be able to trigger us, perhaps
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	15 with PSHB, that their graph has changed.
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	16 """
1108 8caf62030955 reasoning uses sse_collector drewp <drewp@bigasterisk.com> parents: 1093 diff changeset	17 from crochet import no_setup
8caf62030955 reasoning uses sse_collector drewp <drewp@bigasterisk.com> parents: 1093 diff changeset	18 no_setup()
8caf62030955 reasoning uses sse_collector drewp <drewp@bigasterisk.com> parents: 1093 diff changeset	19
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	20 import json, time, traceback, sys
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	21 from logging import getLogger, DEBUG, WARN
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	22
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	23 from colorlog import ColoredFormatter
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	24 from docopt import docopt
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	25 from rdflib import Namespace, Literal, RDF, Graph
1266 ee5698ef64dd add separate :matchPredicate support. some build and log edits. drewp <drewp@bigasterisk.com> parents: 1197 diff changeset	26 from twisted.internet import reactor, task, defer
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	27 from twisted.internet.defer import inlineCallbacks
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	28 import cyclone.web, cyclone.websocket
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	29
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	30 from greplin import scales
54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	31 from greplin.scales.cyclonehandler import StatsHandler
54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	32
1089 cb7fa2f30df9 rules become simple-looking again; fix the ambiguity in memory after loading them. drewp <drewp@bigasterisk.com> parents: 1088 diff changeset	33 from inference import infer, readRules
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	34 from actions import Actions
1080 4d16fa39d54a refactor inputgraph drewp <drewp@bigasterisk.com> parents: 1070 diff changeset	35 from inputgraph import InputGraph
1089 cb7fa2f30df9 rules become simple-looking again; fix the ambiguity in memory after loading them. drewp <drewp@bigasterisk.com> parents: 1088 diff changeset	36 from escapeoutputstatements import unquoteOutputStatements
1403 69b3f5b3aeda comments and logging drewp <drewp@bigasterisk.com> parents: 1374 diff changeset	37
69b3f5b3aeda comments and logging drewp <drewp@bigasterisk.com> parents: 1374 diff changeset	38 from standardservice.logsetup import log, verboseLogging
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	39
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	40
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	41 ROOM = Namespace("http://projects.bigasterisk.com/room/")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	42 DEV = Namespace("http://projects.bigasterisk.com/device/")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	43
1086 6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	44 NS = {'': ROOM, 'dev': DEV}
1088 0f6128740000 fix input/output statement ambiguity problem by allowing quoted output statements drewp <drewp@bigasterisk.com> parents: 1087 diff changeset	45
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	46 STATS = scales.collection('/web',
1197 d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	47 scales.PmfStat('graphChanged'),
d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	48 scales.PmfStat('updateRules'),
d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	49 )
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	50
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	51 class Reasoning(object):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	52 def __init__(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	53 self.prevGraph = None
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	54
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	55 self.actions = Actions(sendToLiveClients)
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	56
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	57 self.rulesN3 = "(not read yet)"
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	58 self.inferred = Graph() # gets replaced in each graphChanged call
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	59
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	60 self.inputGraph = InputGraph([], self.graphChanged)
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	61 self.inputGraph.updateFileData()
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	62
1197 d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	63 @STATS.updateRules.time()
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	64 def updateRules(self):
1089 cb7fa2f30df9 rules become simple-looking again; fix the ambiguity in memory after loading them. drewp <drewp@bigasterisk.com> parents: 1088 diff changeset	65 rulesPath = 'rules.n3'
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	66 try:
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	67 t1 = time.time()
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	68 self.rulesN3, self.ruleStore = readRules(
1089 cb7fa2f30df9 rules become simple-looking again; fix the ambiguity in memory after loading them. drewp <drewp@bigasterisk.com> parents: 1088 diff changeset	69 rulesPath, outputPatterns=[
1091 352ecf3c9aea more output statement patterns drewp <drewp@bigasterisk.com> parents: 1090 diff changeset	70 # Incomplete. See escapeoutputstatements.py for
352ecf3c9aea more output statement patterns drewp <drewp@bigasterisk.com> parents: 1090 diff changeset	71 # explanation.
352ecf3c9aea more output statement patterns drewp <drewp@bigasterisk.com> parents: 1090 diff changeset	72 (None, ROOM['brightness'], None),
352ecf3c9aea more output statement patterns drewp <drewp@bigasterisk.com> parents: 1090 diff changeset	73 (None, ROOM['playState'], None),
352ecf3c9aea more output statement patterns drewp <drewp@bigasterisk.com> parents: 1090 diff changeset	74 (None, ROOM['powerState'], None),
352ecf3c9aea more output statement patterns drewp <drewp@bigasterisk.com> parents: 1090 diff changeset	75 (None, ROOM['state'], None),
352ecf3c9aea more output statement patterns drewp <drewp@bigasterisk.com> parents: 1090 diff changeset	76 ])
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	77 ruleParseTime = time.time() - t1
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	78 except ValueError:
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	79 # this is so if you're just watching the inferred output,
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	80 # you'll see the error too
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	81 self.inferred = Graph()
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	82 self.inferred.add((ROOM['reasoner'], ROOM['ruleParseError'],
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	83 Literal(traceback.format_exc())))
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	84 raise
a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	85 return [(ROOM['reasoner'], ROOM['ruleParseTime'],
1086 6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	86 Literal(ruleParseTime))], ruleParseTime
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	87
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	88 @STATS.graphChanged.time()
984 5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	89 def graphChanged(self, inputGraph, oneShot=False, oneShotGraph=None):
1090 373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	90 """
373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	91 If we're getting called for a oneShot event, the oneShotGraph
373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	92 statements are already in inputGraph.getGraph().
373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	93 """
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	94 log.info("----------------------")
1197 d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	95 log.info("graphChanged (oneShot=%s %s stmts):",
d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	96 oneShot, len(oneShotGraph) if oneShotGraph is not None else 0)
d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	97 if oneShotGraph:
d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	98 for stmt in oneShotGraph:
d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	99 log.info(" OS-> %r", stmt)
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	100 t1 = time.time()
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	101 oldInferred = self.inferred
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	102 try:
1086 6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	103 ruleStatStmts, ruleParseSec = self.updateRules()
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	104
1093 e3ae71fbd3bd logging and cleanups. Upgrade fuxi to have the cPickle optimization. drewp <drewp@bigasterisk.com> parents: 1092 diff changeset	105 self.inferred, inferSec = self._makeInferred(inputGraph.getGraph())
1088 0f6128740000 fix input/output statement ambiguity problem by allowing quoted output statements drewp <drewp@bigasterisk.com> parents: 1087 diff changeset	106
1089 cb7fa2f30df9 rules become simple-looking again; fix the ambiguity in memory after loading them. drewp <drewp@bigasterisk.com> parents: 1088 diff changeset	107 self.inferred += unquoteOutputStatements(self.inferred)
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	108
1090 373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	109 self.inferred += ruleStatStmts
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	110
984 5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	111 if oneShot:
1090 373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	112 # It's possible a oneShotGraph statement didn't
373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	113 # trigger a rule to do something, but was itself the
373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	114 # output statement. Probably we could just mix in the
373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	115 # whole inputGraph here and not special-case the
373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	116 # oneShotGraph.
373704a3ba0f minor cleanups drewp <drewp@bigasterisk.com> parents: 1089 diff changeset	117 self.inferred += oneShotGraph
984 5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	118
1093 e3ae71fbd3bd logging and cleanups. Upgrade fuxi to have the cPickle optimization. drewp <drewp@bigasterisk.com> parents: 1092 diff changeset	119 t3 = time.time()
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	120 self.actions.putResults(self.inputGraph.getGraph(), self.inferred)
1093 e3ae71fbd3bd logging and cleanups. Upgrade fuxi to have the cPickle optimization. drewp <drewp@bigasterisk.com> parents: 1092 diff changeset	121 putResultsTime = time.time() - t3
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	122 finally:
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	123 if oneShot:
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	124 self.inferred = oldInferred
1093 e3ae71fbd3bd logging and cleanups. Upgrade fuxi to have the cPickle optimization. drewp <drewp@bigasterisk.com> parents: 1092 diff changeset	125 log.info("graphChanged took %.1f ms (rule parse %.1f ms, infer %.1f ms, putResults %.1f ms)" %
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	126 ((time.time() - t1) * 1000,
1086 6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	127 ruleParseSec * 1000,
1093 e3ae71fbd3bd logging and cleanups. Upgrade fuxi to have the cPickle optimization. drewp <drewp@bigasterisk.com> parents: 1092 diff changeset	128 inferSec * 1000,
1045 a328cc370b22 ipv6 fetch support. refactor Actions to new class and file drewp <drewp@bigasterisk.com> parents: 1040 diff changeset	129 putResultsTime * 1000))
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	130
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	131 def _makeInferred(self, inputGraph):
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	132 t1 = time.time()
1093 e3ae71fbd3bd logging and cleanups. Upgrade fuxi to have the cPickle optimization. drewp <drewp@bigasterisk.com> parents: 1092 diff changeset	133
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	134 out = infer(inputGraph, self.ruleStore)
1086 6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	135 for p, n in NS.iteritems():
6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	136 out.bind(p, n, override=True)
1093 e3ae71fbd3bd logging and cleanups. Upgrade fuxi to have the cPickle optimization. drewp <drewp@bigasterisk.com> parents: 1092 diff changeset	137
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	138 inferenceTime = time.time() - t1
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	139 out.add((ROOM['reasoner'], ROOM['inferenceTime'],
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	140 Literal(inferenceTime)))
1093 e3ae71fbd3bd logging and cleanups. Upgrade fuxi to have the cPickle optimization. drewp <drewp@bigasterisk.com> parents: 1092 diff changeset	141 return out, inferenceTime
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	142
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	143
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	144
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	145 class Index(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	146 def get(self):
985 7e99f05c21cd reasoning index page to html drewp <drewp@bigasterisk.com> parents: 984 diff changeset	147 self.set_header("Content-Type", "text/html")
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	148 self.write(open('index.html').read())
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	149
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	150 class ImmediateUpdate(cyclone.web.RequestHandler):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	151 def put(self):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	152 """
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	153 request an immediate load of the remote graphs; the thing we
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	154 do in the background anyway. No payload.
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	155
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	156 Using PUT because this is idempotent and retryable and
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	157 everything.
859 379cefec542e screen out more values that change on every update drewp <drewp@bigasterisk.com> parents: 854 diff changeset	158
379cefec542e screen out more values that change on every update drewp <drewp@bigasterisk.com> parents: 854 diff changeset	159 todo: this should do the right thing when many requests come
379cefec542e screen out more values that change on every update drewp <drewp@bigasterisk.com> parents: 854 diff changeset	160 in very quickly
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	161 """
1108 8caf62030955 reasoning uses sse_collector drewp <drewp@bigasterisk.com> parents: 1093 diff changeset	162 log.warn("immediateUpdate from %s %s - ignored",
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	163 self.request.headers.get('User-Agent', '?'),
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	164 self.request.headers['Host'])
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	165 self.set_status(202)
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	166
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	167 class OneShot(cyclone.web.RequestHandler):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	168 def post(self):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	169 """
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	170 payload is an rdf graph. The statements are momentarily added
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	171 to the input graph for exactly one update.
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	172
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	173 todo: how do we go from a transition like doorclosed-to-open
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	174 to a oneshot event? the upstream shouldn't have to do it. Do
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	175 we make those oneshot events here? for every object change?
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	176 there are probably special cases regarding startup time when
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	177 everything appears to be a 'change'.
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	178 """
984 5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	179 try:
1197 d8acab2b01f5 mqtt has two devices now. various older cleanups. drewp <drewp@bigasterisk.com> parents: 1156 diff changeset	180 log.info('POST to oneShot, headers=%s', self.request.headers)
1086 6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	181 dt = self.settings.reasoning.inputGraph.addOneShotFromString(
6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	182 self.request.body, self.request.headers['content-type'])
6ab5238fc049 refactor drewp <drewp@bigasterisk.com> parents: 1085 diff changeset	183 self.set_header('x-graph-ms', str(1000 * dt))
984 5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	184 except Exception as e:
1120 ba0cec7e1ac9 log oneshot tracebacks drewp <drewp@bigasterisk.com> parents: 1119 diff changeset	185 traceback.print_exc()
984 5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	186 log.error(e)
5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	187 raise
5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	188
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	189 # for reuse
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	190 class GraphResource(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	191 def get(self, which):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	192 self.set_header("Content-Type", "application/json")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	193 r = self.settings.reasoning
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	194 g = {'lastInput': r.inputGraph.getGraph(),
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	195 'lastOutput': r.inferred,
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	196 }[which]
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	197 self.write(self.jsonRdf(g))
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	198
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	199 def jsonRdf(self, g):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	200 return json.dumps(sorted(list(g)))
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	201
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	202 class NtGraphs(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	203 """same as what gets posted above"""
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	204 def get(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	205 r = self.settings.reasoning
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	206 inputGraphNt = r.inputGraph.getGraph().serialize(format="nt")
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	207 inferredNt = r.inferred.serialize(format="nt")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	208 self.set_header("Content-Type", "application/json")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	209 self.write(json.dumps({"input": inputGraphNt,
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	210 "inferred": inferredNt}))
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	211
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	212 class Rules(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	213 def get(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	214 self.set_header("Content-Type", "text/plain")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	215 self.write(self.settings.reasoning.rulesN3)
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	216
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	217 class Status(cyclone.web.RequestHandler):
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	218 def get(self):
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	219 self.set_header("Content-Type", "text/plain")
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	220 g = self.settings.reasoning.inputGraph.getGraph()
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	221 msg = ""
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	222 for badSource in g.subjects(RDF.type, ROOM['FailedGraphLoad']):
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	223 msg += "GET %s failed (%s). " % (
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	224 badSource, g.value(badSource, ROOM['graphLoadError']))
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	225 if not msg:
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	226 self.finish("all inputs ok")
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	227 return
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	228 self.set_status(500)
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	229 self.finish(msg)
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	230
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	231 class Static(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	232 def get(self, p):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	233 self.write(open(p).read())
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	234
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	235 liveClients = set()
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	236 def sendToLiveClients(d=None, asJson=None):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	237 j = asJson or json.dumps(d)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	238 for c in liveClients:
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	239 c.sendMessage(j)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	240
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	241 class Events(cyclone.websocket.WebSocketHandler):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	242
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	243 def connectionMade(self, args, *kwargs):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	244 log.info("websocket opened")
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	245 liveClients.add(self)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	246
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	247 def connectionLost(self, reason):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	248 log.info("websocket closed")
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	249 liveClients.remove(self)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	250
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	251 def messageReceived(self, message):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	252 log.info("got message %s" % message)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	253
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	254 class Application(cyclone.web.Application):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	255 def __init__(self, reasoning):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	256 handlers = [
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	257 (r"/", Index),
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	258 (r"/immediateUpdate", ImmediateUpdate),
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	259 (r"/oneShot", OneShot),
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	260 (r'/(jquery.min.js)', Static),
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	261 (r'/(lastInput\|lastOutput)Graph', GraphResource),
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	262 (r'/ntGraphs', NtGraphs),
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	263 (r'/rules', Rules),
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	264 (r'/status', Status),
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	265 (r'/events', Events),
1092 54de5144900d switch from evtiming to greplin.scales. Optimize rules reader to reuse previous data (400ms -> 0.6ms) drewp <drewp@bigasterisk.com> parents: 1091 diff changeset	266 (r'/stats/(.*)', StatsHandler, {'serverName': 'reasoning'}),
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	267 ]
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	268 cyclone.web.Application.__init__(self, handlers, reasoning=reasoning)
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	269
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	270 def configLogging(arg):
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	271 log.setLevel(WARN)
984 5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	272
1403 69b3f5b3aeda comments and logging drewp <drewp@bigasterisk.com> parents: 1374 diff changeset	273 if arg['-i'] or arg['-r'] or arg['-o'] or arg['-v']:
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	274 log.handlers[0].setFormatter(ColoredFormatter("%(log_color)s%(levelname)-8s %(name)-6s %(filename)-12s:%(lineno)-3s %(funcName)-20s%(reset)s %(white)s%(message)s",
1040 2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	275 datefmt=None,
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	276 reset=True,
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	277 log_colors={
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	278 'DEBUG': 'cyan',
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	279 'INFO': 'green',
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	280 'WARNING': 'yellow',
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	281 'ERROR': 'red',
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	282 'CRITICAL': 'red,bg_white',
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	283 },
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	284 secondary_log_colors={},
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	285 style='%'
2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	286 ))
1266 ee5698ef64dd add separate :matchPredicate support. some build and log edits. drewp <drewp@bigasterisk.com> parents: 1197 diff changeset	287 defer.setDebugging(True)
ee5698ef64dd add separate :matchPredicate support. some build and log edits. drewp <drewp@bigasterisk.com> parents: 1197 diff changeset	288
1040 2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	289
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	290 if arg['-i']:
984 5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	291 import twisted.python.log
5da9200418db reasoning: -v verbose setting, more oneshot support, some custom stuff for mpd commands drewp <drewp@bigasterisk.com> parents: 934 diff changeset	292 twisted.python.log.startLogging(sys.stdout)
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	293
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	294 getLogger('fetch').setLevel(DEBUG if arg['-i'] else WARN)
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	295 log.setLevel(DEBUG if arg['-r'] else WARN)
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	296 getLogger('output').setLevel(DEBUG if arg['-o'] else WARN)
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	297
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	298
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	299 if __name__ == '__main__':
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	300 arg = docopt("""
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	301 Usage: reasoning.py [options]
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	302
1108 8caf62030955 reasoning uses sse_collector drewp <drewp@bigasterisk.com> parents: 1093 diff changeset	303 -i Verbose log on the input phase
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	304 -r Verbose log on the reasoning phase and web stuff
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	305 -o Verbose log on the actions/output phase
1403 69b3f5b3aeda comments and logging drewp <drewp@bigasterisk.com> parents: 1374 diff changeset	306 -v Everywhere verbose
1085 dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	307 """)
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	308
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	309 r = Reasoning()
dda3f1524a52 lots of logging updates (patch may be imprecise) drewp <drewp@bigasterisk.com> parents: 1080 diff changeset	310 configLogging(arg)
1040 2fa7daf06f34 rdflib can parse trig now drewp <drewp@bigasterisk.com> parents: 985 diff changeset	311 reactor.listenTCP(9071, Application(r), interface='::')
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	312 reactor.run()

Mercurial > code > home > repos > homeauto

annotate service/reasoning/reasoning.py @ 1409:e78b8806ad05