homeauto: service/reasoning/reasoning.py annotate

annotate service/reasoning/reasoning.py @ 934:3bb18b7d21df

reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now Ignore-this: 3ab80fee5836817dcd54ce6678a6089d darcs-hash:20131009044224-312f9-b47b461e8872e4ef5c4951703ab8f13d5b848ea3

author	drewp <drewp@bigasterisk.com>
date	Tue, 08 Oct 2013 21:42:24 -0700
parents	4ae49c6adecb
children	0f2ac014d9ea

rev	line source
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	1 #!bin/python
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	2 """
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	3 Graph consists of:
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	4 input/* (read at startup)
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	5 webinput/* (new files are noticed in here)
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	6 any number of remote graphs, specified in the other graph as objects of (:reasoning, :source, *), reread constantly
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	7
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	8 gather subgraphs from various services, run them through a rules
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	9 engine, and make http requests with the conclusions.
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	10
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	11 E.g. 'when drew's phone is near the house, and someone is awake,
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	12 unlock the door when the door's motion sensor is activated'
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	13
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	14 When do we gather? The services should be able to trigger us, perhaps
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	15 with PSHB, that their graph has changed.
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	16 """
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	17
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	18
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	19 from twisted.internet import reactor, task
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	20 from twisted.web.client import getPage
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	21 from twisted.python.filepath import FilePath
934 3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	22 import time, traceback, sys, json, logging, urllib
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	23 from rdflib.Graph import Graph, ConjunctiveGraph
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	24 from rdflib import Namespace, URIRef, Literal, RDF, StringInputSource
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	25 from FuXi.Rete.RuleStore import N3RuleStore
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	26 from cyclone.httpclient import fetch
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	27 import cyclone.web, cyclone.websocket
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	28 from inference import addTrig, infer
853 39857f82922e refactor graph ops drewp <drewp@bigasterisk.com> parents: 852 diff changeset	29 from graphop import graphEqual
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	30
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	31 sys.path.append("../../lib")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	32 from logsetup import log
919 6ee2a90fc816 bugs in async http client. move trig helpers to rdflibtrig, which can work with rdflib 4 drewp <drewp@bigasterisk.com> parents: 917 diff changeset	33 log.setLevel(logging.INFO)
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	34 outlog = logging.getLogger('output')
917 1c3cc9633a6e reasoning turn on debug log drewp <drewp@bigasterisk.com> parents: 916 diff changeset	35 outlog.setLevel(logging.DEBUG)
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	36
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	37 ROOM = Namespace("http://projects.bigasterisk.com/room/")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	38 DEV = Namespace("http://projects.bigasterisk.com/device/")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	39
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	40
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	41 class InputGraph(object):
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	42 def __init__(self, inputDirs, onChange):
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	43 """
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	44 this has one Graph that's made of:
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	45 - all .n3 files from inputDirs (read at startup)
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	46 - all the remote graphs, specified in the file graphs
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	47
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	48 call updateFileData or updateRemoteData to reread those
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	49 graphs. getGraph to access the combined graph.
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	50
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	51 onChange(self) is called if the contents of the full graph
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	52 change (in an interesting way) during updateFileData or
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	53 updateRemoteData. Interesting means statements other than the
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	54 ones with the predicates on the boring list. onChange(self,
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	55 oneShot=True) means: don't store the result of this change
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	56 anywhere; it needs to be processed only once
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	57 """
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	58 self.inputDirs = inputDirs
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	59 self.onChange = onChange
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	60 self._fileGraph = Graph()
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	61 self._remoteGraph = None
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	62 self._combinedGraph = None
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	63 self._oneShotAdditionGraph = None
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	64
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	65 def updateFileData(self):
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	66 """
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	67 make sure we contain the correct data from the files in inputDirs
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	68 """
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	69 # this sample one is actually only needed for the output, but I don't
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	70 # think I want to have a separate graph for the output
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	71 # handling
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	72 log.debug("read file graphs")
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	73 for fp in FilePath("input").walk():
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	74 if fp.isdir():
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	75 continue
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	76 if fp.splitext()[1] != '.n3':
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	77 continue
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	78 log.debug("read %s", fp)
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	79 # todo: if this fails, leave the report in the graph
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	80 self._fileGraph.parse(fp.open(), format="n3")
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	81 self._combinedGraph = None
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	82
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	83 self.onChange(self)
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	84
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	85 def updateRemoteData(self):
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	86 """
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	87 read all remote graphs (which are themselves enumerated within
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	88 the file data)
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	89 """
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	90 log.debug("read remote graphs")
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	91 g = ConjunctiveGraph()
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	92 for source in self._fileGraph.objects(ROOM['reasoning'],
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	93 ROOM['source']):
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	94 try:
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	95 # this part could be parallelized
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	96 fetchTime = addTrig(g, source)
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	97 except Exception, e:
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	98 log.error(" adding source %s: %s", source, e)
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	99 g.add((URIRef(source), ROOM['graphLoadError'], Literal(str(e))))
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	100 g.add((URIRef(source), RDF.type, ROOM['FailedGraphLoad']))
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	101 else:
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	102 g.add((URIRef(source), ROOM['graphLoadSecs'],
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	103 Literal(fetchTime)))
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	104 prevGraph = self._remoteGraph
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	105 self._remoteGraph = g
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	106 self._combinedGraph = None
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	107 if (prevGraph is None or
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	108 not graphEqual(g, prevGraph, ignorePredicates=[
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	109 ROOM.signalStrength,
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	110 ROOM.graphLoadSecs,
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	111 # perhaps anything with a number-datatype for its
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	112 # object should be filtered out, and you have to make
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	113 # an upstream quantization (e.g. 'temp high'/'temp
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	114 # low') if you want to do reasoning on the difference
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	115 URIRef("http://bigasterisk.com/map#lastSeenAgoSec"),
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	116 URIRef("http://bigasterisk.com/map#lastSeenAgo"),
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	117 URIRef("http://projects.bigasterisk.com/room/usingPower"),
859 379cefec542e screen out more values that change on every update drewp <drewp@bigasterisk.com> parents: 854 diff changeset	118 URIRef("http://projects.bigasterisk.com/room/idleTimeMinutes"),
379cefec542e screen out more values that change on every update drewp <drewp@bigasterisk.com> parents: 854 diff changeset	119 URIRef("http://projects.bigasterisk.com/room/idleTimeMs"),
923 4ae49c6adecb errors and logging in reasoning drewp <drewp@bigasterisk.com> parents: 919 diff changeset	120 ROOM.history,
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	121 ])):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	122 log.debug(" remote graph changed")
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	123 self.onChange(self)
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	124 else:
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	125 log.debug(" remote graph is unchanged")
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	126
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	127 def addOneShot(self, g):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	128 """
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	129 add this graph to the total, call onChange, and then revert
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	130 the addition of this graph
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	131 """
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	132 self._oneShotAdditionGraph = g
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	133 self._combinedGraph = None
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	134 try:
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	135 self.onChange(self, oneShot=True)
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	136 finally:
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	137 self._oneShotAdditionGraph = None
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	138 self._combinedGraph = None
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	139
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	140 def getGraph(self):
0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	141 """rdflib Graph with the file+remote contents of the input graph"""
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	142 # this could be much faster with the combined readonly graph
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	143 # view from rdflib
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	144 if self._combinedGraph is None:
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	145 self._combinedGraph = Graph()
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	146 if self._fileGraph:
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	147 for s in self._fileGraph:
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	148 self._combinedGraph.add(s)
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	149 if self._remoteGraph:
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	150 for s in self._remoteGraph:
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	151 self._combinedGraph.add(s)
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	152 if self._oneShotAdditionGraph:
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	153 for s in self._oneShotAdditionGraph:
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	154 self._combinedGraph.add(s)
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	155
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	156 return self._combinedGraph
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	157
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	158 class Reasoning(object):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	159 def __init__(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	160 self.prevGraph = None
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	161 self.lastPollTime = 0
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	162 self.lastError = ""
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	163
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	164 self.rulesN3 = "(not read yet)"
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	165 self.inferred = Graph() # gets replaced in each graphChanged call
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	166
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	167 self.inputGraph = InputGraph([], self.graphChanged)
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	168 self.inputGraph.updateFileData()
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	169
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	170
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	171 def readRules(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	172 self.rulesN3 = open('rules.n3').read() # for web display
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	173 self.ruleStore = N3RuleStore()
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	174 self.ruleGraph = Graph(self.ruleStore)
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	175 self.ruleGraph.parse('rules.n3', format='n3') # for inference
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	176
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	177 def poll(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	178 try:
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	179 self.inputGraph.updateRemoteData()
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	180 self.lastPollTime = time.time()
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	181 except Exception, e:
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	182 log.error(traceback.format_exc())
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	183 self.lastError = str(e)
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	184
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	185 def graphChanged(self, inputGraph, oneShot=False):
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	186 t1 = time.time()
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	187 oldInferred = self.inferred
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	188 try:
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	189 try:
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	190 t1 = time.time()
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	191 self.readRules()
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	192 ruleParseTime = time.time() - t1
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	193 except ValueError, e:
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	194 # this is so if you're just watching the inferred output,
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	195 # you'll see the error too
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	196 self.inferred = Graph()
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	197 self.inferred.add((ROOM['reasoner'], ROOM['ruleParseError'],
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	198 Literal(traceback.format_exc())))
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	199 raise
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	200
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	201 g = inputGraph.getGraph()
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	202 self.inferred = self._makeInferred(g)
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	203 self.inferred.add((ROOM['reasoner'], ROOM['ruleParseTime'],
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	204 Literal(ruleParseTime)))
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	205
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	206 t2 = time.time()
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	207 self.putResults(self.inferred)
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	208 putResultsTime = time.time() - t2
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	209 t3 = time.time()
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	210 self._postToMagma(g)
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	211 postMagmaTime = time.time() - t3
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	212 finally:
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	213 if oneShot:
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	214 self.inferred = oldInferred
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	215 log.info("graphChanged %.1f ms (putResults %.1f ms; postToMagma %.1f ms)" %
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	216 ((time.time() - t1) * 1000,
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	217 putResultsTime * 1000,
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	218 postMagmaTime * 1000))
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	219
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	220 def _makeInferred(self, inputGraph):
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	221 t1 = time.time()
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	222 out = infer(inputGraph, self.ruleStore)
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	223 inferenceTime = time.time() - t1
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	224
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	225 out.add((ROOM['reasoner'], ROOM['inferenceTime'],
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	226 Literal(inferenceTime)))
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	227 return out
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	228
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	229 def _postToMagma(self, inputGraph):
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	230
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	231 inputGraphNt = inputGraph.serialize(format="nt")
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	232 inferredNt = self.inferred.serialize(format="nt")
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	233 body = json.dumps({"input": inputGraphNt,
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	234 "inferred": inferredNt})
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	235 def err(e):
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	236 log.error("while sending changes to magma:")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	237 log.error(e)
851 0d86b3955bcd rewriting reasoning to use graphs for config drewp <drewp@bigasterisk.com> parents: 850 diff changeset	238
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	239 fetch("http://bang:8014/reasoningChange",
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	240 method="POST",
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	241 timeout=2,
919 6ee2a90fc816 bugs in async http client. move trig helpers to rdflibtrig, which can work with rdflib 4 drewp <drewp@bigasterisk.com> parents: 917 diff changeset	242 postdata=body,
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	243 headers={"content-type" : ["application/json"]}).addErrback(err)
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	244
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	245 def _put(self, url, payload):
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	246 def err(e):
934 3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	247 outlog.warn(" put %s failed", url)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	248 outlog.info(" PUT %s payload=%r", url, payload)
919 6ee2a90fc816 bugs in async http client. move trig helpers to rdflibtrig, which can work with rdflib 4 drewp <drewp@bigasterisk.com> parents: 917 diff changeset	249 fetch(url, method="PUT", postdata=payload, timeout=2).addErrback(err)
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	250
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	251 def putResults(self, inferred):
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	252 """
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	253 some conclusions in the inferred graph lead to PUT requests
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	254 getting made
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	255
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	256 if the graph contains (?d ?p ?o) and ?d and ?p are a device
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	257 and predicate we support PUTs for, then we look up
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	258 (?d :putUrl ?url) and (?o :putValue ?val) and call
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	259 PUT ?url <- ?val
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	260
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	261 If the graph doesn't contain any matches, we use (?d
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	262 :zeroValue ?val) for the value and PUT that.
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	263 """
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	264 deviceGraph = self.inputGraph.getGraph()
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	265 self.oneShotPostActions(deviceGraph, inferred)
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	266 for dev, pred in [
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	267 # the config of each putUrl should actually be in the
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	268 # context of a dev and predicate pair, and then that would
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	269 # be the source of this list
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	270 (DEV.theaterDoorLock, ROOM.state),
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	271 (URIRef('http://bigasterisk.com/host/bang/monitor'), ROOM.powerState),
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	272 (URIRef('http://bigasterisk.com/host/dash/monitor'), ROOM.powerState),
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	273 ]:
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	274 url = deviceGraph.value(dev, ROOM.putUrl)
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	275
916 e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	276 if url and dev == DEV.theaterDoorLock: # ew
e8cce78a79d6 switch reasoning from restkit to async cyclone http client drewp <drewp@bigasterisk.com> parents: 882 diff changeset	277 self._put(url+"/mode", payload="output")
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	278
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	279 inferredObjects = list(inferred.objects(dev, pred))
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	280 if len(inferredObjects) == 0:
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	281 self.putZero(deviceGraph, dev, pred, url)
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	282 elif len(inferredObjects) == 1:
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	283 self.putInferred(deviceGraph, dev, pred, url, inferredObjects[0])
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	284 elif len(inferredObjects) > 1:
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	285 log.info("conflict, ignoring: %s has %s of %s" %
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	286 (dev, pred, inferredObjects))
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	287 # write about it to the inferred graph?
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	288
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	289 self.frontDoorPuts(deviceGraph, inferred)
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	290
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	291
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	292 def oneShotPostActions(self, deviceGraph, inferred):
934 3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	293 """
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	294 Inferred graph may contain some one-shot statements. We'll send
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	295 statement objects to anyone on web sockets, and also generate
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	296 POST requests as described in the graph.
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	297
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	298 one-shot statement ?s ?p ?o
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	299 with this in the graph:
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	300 ?osp a :OneShotPost
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	301 ?osp :subject ?s
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	302 ?osp :predicate ?p
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	303 this will cause a post to ?o
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	304 """
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	305 # nothing in this actually makes them one-shot yet. they'll
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	306 # just fire as often as we get in here, which is not desirable
934 3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	307 log.info("oneShotPostActions")
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	308 def err(e):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	309 outlog.warn("post %s failed", postTarget)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	310 for osp in deviceGraph.subjects(RDF.type, ROOM['OneShotPost']):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	311 s = deviceGraph.value(osp, ROOM['subject'])
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	312 p = deviceGraph.value(osp, ROOM['predicate'])
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	313 if s is None or p is None:
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	314 continue
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	315 for postTarget in inferred.objects(s, p):
882 1e2a3f85c61a keep hacking reasoning to handle my output actions drewp <drewp@bigasterisk.com> parents: 869 diff changeset	316 log.info("post target %r", postTarget)
934 3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	317 # this packet ought to have 'oneShot' in it somewhere
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	318 sendToLiveClients({"s":s, "p":p, "o":postTarget})
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	319
934 3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	320 outlog.info(" POST %s", postTarget)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	321 fetch(postTarget, method="POST", timeout=2).addErrback(err)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	322 self.postMpdCommands(inferred)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	323
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	324 def postMpdCommands(self, inferred):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	325 """special case to be eliminated. mpd play urls are made of an
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	326 mpd service and a song/album/playlist uri to be played.
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	327 Ideally the graph rules would assemble these like
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	328 http://{mpd}/addAndPlay?uri={toPlay} or maybe toPlay as the payload
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	329 which would be fairly general but still allow toPlay uris to
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	330 be matched with any player."""
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	331 def post(postTarget):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	332 outlog.info("special mpd POST %s", postTarget)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	333 def err(e):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	334 outlog.warn("post %s failed", postTarget)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	335 fetch(postTarget, method="POST", timeout=2).addErrback(err)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	336 root = "http://bigasterisk.com/music/slash/mpd/"
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	337 rootSkippingAuth = "http://slash:9009/"
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	338 slashMpd = URIRef("http://bigasterisk.com/host/slash/mpd")
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	339 for song in inferred.objects(slashMpd, ROOM['startMusic']):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	340 outlog.info("mpd statement: %r" % song)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	341 assert song.startswith('http://bigasterisk.com/music/')
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	342 post(rootSkippingAuth + "addAndPlay" + urllib.quote(song[len("http://bigasterisk.com/music"):]))
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	343
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	344 for state in inferred.objects(slashMpd, ROOM['playState']):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	345 if state == ROOM['pause']:
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	346 post(rootSkippingAuth + "mpd/pause")
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	347 for vol in inferred.objects(slashMpd, ROOM['audioState']):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	348 if vol == ROOM['volumeStepUp']:
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	349 post(rootSkippingAuth + "volumeAdjust?amount=6&max=70")
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	350 if vol == ROOM['volumeStepDown']:
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	351 post(rootSkippingAuth + "volumeAdjust?amount=-6&min=10")
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	352
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	353 def putZero(self, deviceGraph, dev, pred, putUrl):
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	354 # zerovalue should be a function of pred as well.
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	355 value = deviceGraph.value(dev, ROOM.zeroValue)
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	356 if value is not None:
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	357 outlog.info("put zero (%r) to %s", value, putUrl)
919 6ee2a90fc816 bugs in async http client. move trig helpers to rdflibtrig, which can work with rdflib 4 drewp <drewp@bigasterisk.com> parents: 917 diff changeset	358 self._put(putUrl, payload=str(value))
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	359 # this should be written back into the inferred graph
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	360 # for feedback
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	361
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	362 def putInferred(self, deviceGraph, dev, pred, putUrl, obj):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	363 value = deviceGraph.value(obj, ROOM.putValue)
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	364 if value is not None:
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	365 outlog.info("put %s to %s", value, putUrl)
919 6ee2a90fc816 bugs in async http client. move trig helpers to rdflibtrig, which can work with rdflib 4 drewp <drewp@bigasterisk.com> parents: 917 diff changeset	366 self._put(putUrl, payload=str(value))
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	367 else:
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	368 outlog.warn("%s %s %s has no :putValue" %
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	369 (dev, pred, obj))
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	370
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	371 def frontDoorPuts(self, deviceGraph, inferred):
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	372 # todo: shouldn't have to be a special case
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	373 brt = inferred.value(DEV.frontDoorLcd, ROOM.brightness)
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	374 if brt is None:
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	375 return
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	376 url = deviceGraph.value(DEV.frontDoorLcdBrightness, ROOM.putUrl)
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	377 outlog.info("put lcd %s brightness %s", url, brt)
919 6ee2a90fc816 bugs in async http client. move trig helpers to rdflibtrig, which can work with rdflib 4 drewp <drewp@bigasterisk.com> parents: 917 diff changeset	378 self._put(str(url) + "?brightness=%s" % str(brt), payload='')
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	379
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	380 msg = "open %s motion %s" % (
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	381 inferred.value(DEV['frontDoorOpenIndicator'], ROOM.text),
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	382 inferred.value(DEV['frontDoorMotionIndicator'], ROOM.text))
838 36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	383 # this was meant to be 2 chars in the bottom row, but the
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	384 # easier test was to replace the whole top msg
36dbbb01d689 redo the http PUT request part of the reasoner drewp <drewp@bigasterisk.com> parents: 825 diff changeset	385 #restkit.Resource("http://slash:9080/").put("lcd", message=msg)
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	386
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	387
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	388
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	389 class Index(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	390 def get(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	391 # make sure GET / fails if our poll loop died
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	392 ago = time.time() - self.settings.reasoning.lastPollTime
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	393 if ago > 2:
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	394 self.set_status(500)
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	395 self.finish("last poll was %s sec ago. last error: %s" %
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	396 (ago, self.settings.reasoning.lastError))
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	397 return
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	398 self.set_header("Content-Type", "application/xhtml+xml")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	399 self.write(open('index.html').read())
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	400
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	401 class ImmediateUpdate(cyclone.web.RequestHandler):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	402 def put(self):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	403 """
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	404 request an immediate load of the remote graphs; the thing we
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	405 do in the background anyway. No payload.
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	406
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	407 Using PUT because this is idempotent and retryable and
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	408 everything.
859 379cefec542e screen out more values that change on every update drewp <drewp@bigasterisk.com> parents: 854 diff changeset	409
379cefec542e screen out more values that change on every update drewp <drewp@bigasterisk.com> parents: 854 diff changeset	410 todo: this should do the right thing when many requests come
379cefec542e screen out more values that change on every update drewp <drewp@bigasterisk.com> parents: 854 diff changeset	411 in very quickly
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	412 """
854 1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	413 print self.request.headers
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	414 log.info("immediateUpdate from %s",
1815d2343a3f cleanup drewp <drewp@bigasterisk.com> parents: 853 diff changeset	415 self.request.headers.get('User-Agent', '?'))
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	416 r.poll()
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	417 self.set_status(202)
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	418
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	419 def parseRdf(text, contentType):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	420 g = Graph()
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	421 g.parse(StringInputSource(text), format={
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	422 'text/n3': 'n3',
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	423 }[contentType])
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	424 return g
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	425
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	426 class OneShot(cyclone.web.RequestHandler):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	427 def post(self):
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	428 """
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	429 payload is an rdf graph. The statements are momentarily added
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	430 to the input graph for exactly one update.
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	431
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	432 todo: how do we go from a transition like doorclosed-to-open
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	433 to a oneshot event? the upstream shouldn't have to do it. Do
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	434 we make those oneshot events here? for every object change?
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	435 there are probably special cases regarding startup time when
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	436 everything appears to be a 'change'.
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	437 """
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	438 g = parseRdf(self.request.body, self.request.headers['content-type'])
934 3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	439 if not len(g):
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	440 log.warn("incoming oneshot graph had no statements: %r", self.request.body)
3bb18b7d21df reasoning actions: generalize them a bit but then add a bunch of special cases for mpd for now drewp <drewp@bigasterisk.com> parents: 923 diff changeset	441 return
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	442 self.settings.reasoning.inputGraph.addOneShot(g)
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	443
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	444 # for reuse
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	445 class GraphResource(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	446 def get(self, which):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	447 self.set_header("Content-Type", "application/json")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	448 r = self.settings.reasoning
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	449 g = {'lastInput': r.inputGraph.getGraph(),
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	450 'lastOutput': r.inferred,
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	451 }[which]
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	452 self.write(self.jsonRdf(g))
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	453
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	454 def jsonRdf(self, g):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	455 return json.dumps(sorted(list(g)))
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	456
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	457 class NtGraphs(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	458 """same as what gets posted above"""
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	459 def get(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	460 r = self.settings.reasoning
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	461 inputGraphNt = r.inputGraph.getGraph().serialize(format="nt")
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	462 inferredNt = r.inferred.serialize(format="nt")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	463 self.set_header("Content-Type", "application/json")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	464 self.write(json.dumps({"input": inputGraphNt,
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	465 "inferred": inferredNt}))
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	466
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	467 class Rules(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	468 def get(self):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	469 self.set_header("Content-Type", "text/plain")
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	470 self.write(self.settings.reasoning.rulesN3)
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	471
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	472 class Status(cyclone.web.RequestHandler):
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	473 def get(self):
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	474 self.set_header("Content-Type", "text/plain")
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	475 g = self.settings.reasoning.inputGraph.getGraph()
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	476 msg = ""
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	477 for badSource in g.subjects(RDF.type, ROOM['FailedGraphLoad']):
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	478 msg += "GET %s failed (%s). " % (
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	479 badSource, g.value(badSource, ROOM['graphLoadError']))
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	480 if not msg:
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	481 self.finish("all inputs ok")
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	482 return
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	483 self.set_status(500)
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	484 self.finish(msg)
887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	485
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	486 class Static(cyclone.web.RequestHandler):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	487 def get(self, p):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	488 self.write(open(p).read())
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	489
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	490 liveClients = set()
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	491 def sendToLiveClients(d=None, asJson=None):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	492 j = asJson or json.dumps(d)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	493 for c in liveClients:
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	494 c.sendMessage(j)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	495
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	496 class Events(cyclone.websocket.WebSocketHandler):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	497
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	498 def connectionMade(self, args, *kwargs):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	499 log.info("websocket opened")
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	500 liveClients.add(self)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	501
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	502 def connectionLost(self, reason):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	503 log.info("websocket closed")
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	504 liveClients.remove(self)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	505
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	506 def messageReceived(self, message):
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	507 log.info("got message %s" % message)
15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	508
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	509 class Application(cyclone.web.Application):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	510 def __init__(self, reasoning):
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	511 handlers = [
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	512 (r"/", Index),
852 6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	513 (r"/immediateUpdate", ImmediateUpdate),
6ccd930834d1 scan more input files. oneshot and immediate update features. drewp <drewp@bigasterisk.com> parents: 851 diff changeset	514 (r"/oneShot", OneShot),
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	515 (r'/(jquery.min.js)', Static),
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	516 (r'/(lastInput\|lastOutput)Graph', GraphResource),
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	517 (r'/ntGraphs', NtGraphs),
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	518 (r'/rules', Rules),
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	519 (r'/status', Status),
869 15af9d8c7186 reasoning has a websocket server that broadcasts some events drewp <drewp@bigasterisk.com> parents: 859 diff changeset	520 (r'/events', Events),
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	521 ]
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	522 cyclone.web.Application.__init__(self, handlers, reasoning=reasoning)
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	523
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	524 if __name__ == '__main__':
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	525 r = Reasoning()
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	526 #import twisted.python.log
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	527 #twisted.python.log.startLogging(sys.stdout)
850 887d47682d94 /status page, errors on failed graphs, time reports of successful fetches drewp <drewp@bigasterisk.com> parents: 838 diff changeset	528
825 fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	529 task.LoopingCall(r.poll).start(1.0)
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	530 reactor.listenTCP(9071, Application(r))
fc753b24f69a move reasoning from /my/proj/room, new integration with magma drewp <drewp@bigasterisk.com> parents: diff changeset	531 reactor.run()

Mercurial > code > home > repos > homeauto

annotate service/reasoning/reasoning.py @ 934:3bb18b7d21df