gcalendarwatch: gcalendarwatch.py annotate

annotate gcalendarwatch.py @ 16:a87969972d85

lib updates, auth update and cleanup, reformat

author	drewp@bigasterisk.com
date	Sun, 13 Sep 2020 23:31:25 -0700
parents	72ebd60d640e
children	0af075b62e4a

rev	line source
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	1 """
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	2 sync google calendar into mongodb, return queries from that as
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	3 JSON-LD.
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	4
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	5 gcalendarwatch.conf looks like this:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	6 {
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	7 "minutes_between_polls" : 60
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	8 "mongo" : {"host" : "h1", "port" : 27017, "database" : "dbname", "collection" : "pim"},
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	9 }
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	10
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	11 This should be updated to use
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	12 http://googledevelopers.blogspot.com/2013/07/google-calendar-api-push-notifications.html
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	13 and update faster with less polling
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	14 """
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	15 import datetime
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	16 import json
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	17 import re
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	18 import time
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	19 import traceback
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	20
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	21 import cyclone.web
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	22 import pymongo.collection
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	23 from dateutil.parser import parse
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	24 from dateutil.tz import tzlocal
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	25 from patchablegraph import (
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	26 CycloneGraphEventsHandler,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	27 CycloneGraphHandler,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	28 PatchableGraph,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	29 )
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	30 from calendar_connection import getCalendarService
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	31 from typing import Dict, Any
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	32 from pymongo import MongoClient
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	33 from rdflib import Graph, Literal, Namespace, RDF, URIRef
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	34 from standardservice.logsetup import log, verboseLogging
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	35 from twisted.internet import reactor
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	36
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	37 import docopt
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	38 from prometheus_client import Summary
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	39 from prometheus_client.exposition import generate_latest
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	40 from prometheus_client.registry import REGISTRY
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	41
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	42 UPDATE = Summary('gcalendarwatch_updates', 'update loop calls')
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	43
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	44 EV = Namespace("http://bigasterisk.com/event#")
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	45 """
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	46 example:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	47 {
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	48 'id': 'l640999999999999999999999c',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	49 'summary': 'sec.......',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	50 'start': {'timeZone': 'America/Los_Angeles', 'dateTime': '2014-09-25T16:00:00-07:00'},
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	51 'end': {'timeZone': 'America/Los_Angeles', 'dateTime': '2014-09-25T17:00:00-07:00'},
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	52 'endTimeUnspecified': True,
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	53 'created': '2014-09-08T20:39:00.000Z',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	54 'creator': {'self': True, 'displayName': '...', 'email': '...'},
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	55 'etag': '"2829999999999000"',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	56 'htmlLink': 'https://www.google.com/calendar/event?eid=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbEBt',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	57 'iCalUID': 'l640998888888888888888888888888888com',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	58 'kind': 'calendar#event',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	59 'organizer': {'self': True, 'displayName': '...', 'email': '...'},
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	60 'reminders': {'useDefault': True},
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	61 'sequence': 0,
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	62 'status': 'confirmed',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	63 'updated': '2014-09-17T04:28:56.997Z',
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	64 }"""
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	65
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	66
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	67 def recordFromEv(conf: Dict, calId: str, ev: Dict):
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	68
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	69 def dateOrTime(d):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	70 if 'date' in d:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	71 return d['date']
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	72 return d['dateTime']
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	73
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	74 rec = {
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	75 'uri': conf['event_uri_ns'] + ev['id'],
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	76 'feed': conf['event_uri_ns'] + 'feed/' + calId,
6 9cface2e6b11 don't break on missing summaries drewp@bigasterisk.com parents: 4 diff changeset	77 'title': ev.get('summary', '?'),
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	78 'start': dateOrTime(ev['start']),
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	79 'end': dateOrTime(ev['end']),
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	80 'endTimeUnspecified': ev.get('endTimeUnspecified', False),
11 702f74c3d742 even more optional fields drewp@bigasterisk.com parents: 10 diff changeset	81 'htmlLink': ev.get('htmlLink', ''),
702f74c3d742 even more optional fields drewp@bigasterisk.com parents: 10 diff changeset	82 'creatorEmail': ev.get('creator', {}).get('email', ''),
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	83 }
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	84
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	85 for field, val in [('start', ev['start']), ('end', ev['end'])]:
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	86 if 'date' in val:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	87 rec['%sTime' % field] = parse(val['date']).replace(tzinfo=tzlocal())
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	88 rec['%sDate' % field] = val['date']
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	89 else:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	90 rec['%sTime' % field] = parse(val['dateTime'])
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	91 rec['%sDate' % field] = parse(val['dateTime']).date().isoformat()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	92 return rec
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	93
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	94
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	95 def asJsonLd(events):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	96 ret = {'@graph': []} # type: Dict[Any, Any]
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	97 for ev in events:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	98 ev['startTime'] = ev['startTime'].astimezone(tzlocal()).isoformat()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	99 ev['endTime'] = ev['endTime'].astimezone(tzlocal()).isoformat()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	100 ev['@id'] = ev.pop('uri')
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	101 ret['@graph'].append(ev)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	102
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	103 ret['@context'] = {
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	104 "xsd": "http://www.w3.org/2001/XMLSchema#",
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	105 "ev": "http://bigasterisk.com/event#",
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	106 "startTime": {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	107 "@id": "ev:startTime",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	108 "@type": "xsd:dateTime"
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	109 },
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	110 "endTime": {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	111 "@id": "ev:endTime",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	112 "@type": "xsd:dateTime"
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	113 },
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	114 "startDate": {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	115 "@id": "ev:startDate",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	116 "@type": "xsd:date"
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	117 },
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	118 "endDate": {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	119 "@id": "ev:endDate",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	120 "@type": "xsd:date"
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	121 },
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	122 "title": "ev:title",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	123 "feed": {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	124 "@id": "ev:feed",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	125 "@type": "@id"
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	126 },
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	127 "htmlLink": {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	128 "@id": "ev:htmlLink",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	129 "@type": "@id"
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	130 },
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	131 }
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	132 return ret
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	133
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	134
7 9cf0859441f9 another rdf class for CountdownEvent records drewp@bigasterisk.com parents: 6 diff changeset	135 def asGraph(events, extraClasses=[]):
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	136 graph = Graph()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	137 graph.namespace_manager.bind('ev', EV)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	138 for ev in events:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	139 uri = URIRef(ev['uri'])
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	140
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	141 def add(p, o):
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	142 return graph.add((uri, p, o))
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	143
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	144 add(RDF.type, EV['Event'])
7 9cf0859441f9 another rdf class for CountdownEvent records drewp@bigasterisk.com parents: 6 diff changeset	145 for cls in extraClasses:
9cf0859441f9 another rdf class for CountdownEvent records drewp@bigasterisk.com parents: 6 diff changeset	146 add(RDF.type, cls)
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	147 add(EV['title'], Literal(ev['title']))
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	148 add(EV['start'], Literal(ev['start']))
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	149 add(EV['startDate'], Literal(ev['startDate']))
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	150 add(EV['end'], Literal(ev['end']))
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	151 add(EV['feed'], URIRef(ev['feed']))
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	152 # graph.add((feed, RDFS.label, Literal(ev['feedTitle'])))
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	153 if 'htmlLink' in ev:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	154 add(EV['htmlLink'], URIRef(ev['htmlLink']))
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	155 return graph
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	156
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	157
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	158 def getFirstPageOfCalendars(service):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	159 for row in service.calendarList().list().execute()['items']:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	160 yield row['id']
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	161
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	162
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	163 def dayRange(days):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	164 now = datetime.datetime.now(tzlocal())
4 fb02ad302f2f include more recent-past events drewp@bigasterisk.com parents: 3 diff changeset	165 start = now - datetime.timedelta(hours=12)
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	166 end = now + datetime.timedelta(days=days)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	167 return start, end
1 d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	168
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	169
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	170 def limitDays(recs, days):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	171 start, end = dayRange(days)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	172 start = start - datetime.timedelta(hours=12)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	173 # incomplete
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	174 return [r for r in recs if r['startTime'] < end and r['endTime'] > start]
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	175
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	176
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	177 def starred(graph, ev):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	178 title = graph.value(ev, EV['title'])
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	179 m = re.search(r'(.)\\s*$', title)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	180 if m:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	181 return m.group(1)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	182 else:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	183 return None
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	184
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	185
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	186 def filterStarred(recs, maxCount=15):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	187 recs = sorted(recs, key=lambda r: r['start'])
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	188 out = []
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	189 for rec in recs:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	190 if re.search(r'(.)\\s*$', rec['title']):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	191 out.append(rec)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	192 if len(out) >= maxCount:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	193 break
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	194 return out
1 d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	195
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	196
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	197 class SyncToMongo(object):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	198 """reads gcal, writes to mongodb"""
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	199
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	200 def __init__(self, conf, collection: pymongo.collection.Collection, agendaGraph: PatchableGraph, countdownGraph: PatchableGraph):
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	201 self.conf = conf
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	202 self.service = getCalendarService()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	203 self.collection = collection
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	204 self.agendaGraph = agendaGraph
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	205 self.countdownGraph = countdownGraph
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	206
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	207 @UPDATE.time()
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	208 def update(self, days=30 * 6):
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	209 start, end = dayRange(days)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	210 self.removeEntries(start, end)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	211
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	212 currentRecords = []
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	213 for calId in getFirstPageOfCalendars(self.service):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	214 print('read %s' % calId)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	215 events = self.service.events().list(
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	216 calendarId=calId,
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	217 singleEvents=True,
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	218 timeMin=start.isoformat(),
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	219 timeMax=end.isoformat(),
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	220 showDeleted=False,
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	221 maxResults=1000,
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	222 ).execute()
1 d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	223
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	224 for ev in events['items']:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	225 rec = recordFromEv(self.conf, calId, ev)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	226 self.upsertMongo(rec)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	227 currentRecords.append(rec)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	228
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	229 self.updateGraphs(currentRecords)
1 d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	230
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	231 def removeEntries(self, start, end):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	232 for doc in list(self.collection.find({"startTime": {"$gte": start, "$lte": end}})):
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	233 self.collection.remove({'_id': doc['_id']})
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	234
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	235 def upsertMongo(self, rec):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	236 if self.collection.find_one({"_id": rec['uri']}) is not None:
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	237 log.debug("existing record %s", rec['uri'])
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	238 # this is not yet noticing updates
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	239 return []
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	240 else:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	241 log.debug("new records %s", rec)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	242 d = rec.copy()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	243 d['_id'] = d.pop('uri')
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	244 self.collection.insert(d)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	245 return [rec]
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	246
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	247 def updateGraphs(self, currentRecords):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	248 c = EV['gcalendar']
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	249 currentRecords = list(currentRecords)
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	250 self.agendaGraph.setToGraph([(s, p, o, c) for s, p, o in asGraph(limitDays(currentRecords, days=2))])
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	251 self.countdownGraph.setToGraph([(s, p, o, c) for s, p, o in asGraph(filterStarred(currentRecords, maxCount=15), extraClasses=[EV['CountdownEvent']])])
1 d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	252
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	253
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	254 class ReadMongoEvents(object):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	255 """read events from mongodb"""
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	256
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	257 def __init__(self, collection):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	258 self.collection = collection
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	259
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	260 def getEvents(self, t1, t2):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	261 for doc in self.collection.find({"startTime": {"$gte": t1, "$lt": t2}}).sort([("startTime", 1)]):
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	262 doc['uri'] = doc.pop('_id')
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	263 if 'feedId' in doc:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	264 doc['feed'] = URIRef('old_event')
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	265 yield doc
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	266
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	267
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	268 class Poller(object):
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	269
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	270 def __init__(self, sync, periodSec):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	271 self.sync = sync
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	272 self.lastUpdateTime = time.time()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	273 self.everUpdated = False
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	274 self.periodSec = periodSec
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	275 self.scheduled = reactor.callLater(self.periodSec, self._updateLoop)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	276 self.events = None
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	277
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	278 def updateNow(self):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	279 self.scheduled.cancel()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	280 self._updateLoop()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	281
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	282 def _updateLoop(self):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	283 log.info("updating")
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	284 t1 = time.time()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	285 try:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	286 self.sync.update()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	287 except Exception:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	288 traceback.print_exc()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	289 log.error("updated failed")
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	290 self.lastUpdateTime = t1
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	291 self.everUpdated = True
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	292 took = time.time() - t1
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	293 self.scheduled = reactor.callLater(max(3, self.periodSec - took), self._updateLoop)
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	294
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	295
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	296 class PollNow(cyclone.web.RequestHandler):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	297
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	298 def post(self):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	299 self.settings.poller.updateNow()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	300 self.set_status(202)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	301
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	302
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	303 class Index(cyclone.web.RequestHandler):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	304
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	305 def get(self):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	306 period = self.settings.conf['minutes_between_polls'] * 60
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	307 ago = time.time() - self.settings.poller.lastUpdateTime
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	308 if not self.settings.poller.everUpdated:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	309 msg = "no completed updates %d sec after startup" % ago
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	310 if ago > period * 1.1:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	311 raise ValueError(msg)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	312 else:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	313 msg = "last update was %d sec ago" % ago
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	314 if ago > period * 1.1:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	315 raise ValueError(msg)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	316 self.set_header("content-type", "text/html")
10 c3f5b0236d0f rename to index.html drewp@bigasterisk.com parents: 8 diff changeset	317 self.write(open("index.html").read().replace("MSG", msg))
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	318
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	319
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	320 class EventsPage(cyclone.web.RequestHandler):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	321
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	322 def get(self):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	323 """
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	324 upcoming events as JSON-LD
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	325 """
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	326 arg = self.get_argument
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	327 t1 = parse(arg('t1')) if arg('t1', default=None) else datetime.datetime.now().replace(hour=0, minute=0, second=0)
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	328 t2 = parse(arg('t2')) if arg('t2',
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	329 default=None) else datetime.datetime.now() + datetime.timedelta(days=int(arg('days')) if arg('days', default=None) else 2)
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	330 if 0:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	331 self.set_header("content-type", "application/ld+json")
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	332 self.write(asJsonLd(self.settings.read.getEvents(t1, t2)))
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	333 else:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	334 self.set_header("content-type", "text/n3")
7 9cf0859441f9 another rdf class for CountdownEvent records drewp@bigasterisk.com parents: 6 diff changeset	335 self.write(asGraph(self.settings.read.getEvents(t1, t2)).serialize(format='n3'))
1 d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	336
d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	337
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	338 class Countdowns(cyclone.web.RequestHandler):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	339
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	340 def get(self):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	341 rows = []
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	342 graph = self.settings.countdownGraph._graph
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	343 for ev in graph.subjects(RDF.type, EV['Event']):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	344 starLabel = starred(graph, ev)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	345 if starLabel is not None:
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	346 rows.append({'@type': 'countdown', 'time': graph.value(ev, EV['start']), 'label': starLabel})
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	347 self.set_header("content-type", "application/ld+json")
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	348 self.write(
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	349 json.dumps({
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	350 "@context": {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	351 "countdown": "http://bigasterisk.com/countdown#CountdownEvent",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	352 "label": "http://www.w3.org/2000/01/rdf-schema#label",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	353 "time": {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	354 "@id": "http://bigasterisk.com/event#time",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	355 "@type": "xsd:dateTime"
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	356 },
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	357 "xsd": "http://www.w3.org/2001/XMLSchema#",
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	358 "rdfs": "http://www.w3.org/2000/01/rdf-schema#"
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	359 },
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	360 "@graph": rows,
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	361 }))
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	362
1 d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	363
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	364 class Metrics(cyclone.web.RequestHandler):
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	365
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	366 def get(self):
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	367 self.add_header('content-type', 'text/plain')
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	368 self.write(generate_latest(REGISTRY))
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	369
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	370
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	371 def main():
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	372 args = docopt.docopt('''
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	373 Usage:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	374 gcalendarwatch [options]
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	375
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	376 Options:
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	377 -v, --verbose more logging
3 acb378b62dfd --now feature for testing drewp@bigasterisk.com parents: 2 diff changeset	378 --now don't wait for first update
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	379 ''')
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	380
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	381 verboseLogging(args['--verbose'])
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	382
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	383 agendaGraph = PatchableGraph() # next few days
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	384 countdownGraph = PatchableGraph() # next n of starred events
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	385 conf = json.load(open("gcalendarwatch.conf"))
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	386 m = conf['mongo']
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	387 mongoOut = MongoClient(m['host'], m['port'], tz_aware=True)[m['database']][m['collection']]
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	388 sync = SyncToMongo(conf, mongoOut, agendaGraph, countdownGraph)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	389 read = ReadMongoEvents(mongoOut)
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	390
4 fb02ad302f2f include more recent-past events drewp@bigasterisk.com parents: 3 diff changeset	391 s, e = dayRange(60)
fb02ad302f2f include more recent-past events drewp@bigasterisk.com parents: 3 diff changeset	392 sync.updateGraphs(read.getEvents(s, e))
1 d77ead665ab2 whitespace drewp@bigasterisk.com parents: 0 diff changeset	393
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	394 poller = Poller(sync, conf['minutes_between_polls'] * 60)
3 acb378b62dfd --now feature for testing drewp@bigasterisk.com parents: 2 diff changeset	395 if args['--now']:
acb378b62dfd --now feature for testing drewp@bigasterisk.com parents: 2 diff changeset	396 poller.updateNow()
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	397
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	398 class Application(cyclone.web.Application):
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	399
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	400 def __init__(self):
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	401 handlers = [
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	402 (r"/", Index),
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	403 (r'/events', EventsPage),
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	404 (r'/pollNow', PollNow),
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	405 (r'/graph/calendar/upcoming', CycloneGraphHandler, {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	406 'masterGraph': agendaGraph
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	407 }),
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	408 (r'/graph/calendar/upcoming/events', CycloneGraphEventsHandler, {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	409 'masterGraph': agendaGraph
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	410 }),
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	411 (r'/graph/calendar/countdown', CycloneGraphHandler, {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	412 'masterGraph': countdownGraph
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	413 }),
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	414 (r'/graph/calendar/countdown/events', CycloneGraphEventsHandler, {
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	415 'masterGraph': countdownGraph
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	416 }),
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	417 (r'/countdowns.json', Countdowns),
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	418 (r'/metrics', Metrics),
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	419 ]
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	420 cyclone.web.Application.__init__(
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	421 self,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	422 handlers,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	423 conf=conf,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	424 read=read,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	425 poller=poller,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	426 agendaGraph=agendaGraph,
a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	427 countdownGraph=countdownGraph,
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	428 )
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	429
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	430 reactor.listenTCP(conf['serve_port'], Application())
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	431 reactor.run()
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	432
16 a87969972d85 lib updates, auth update and cleanup, reformat drewp@bigasterisk.com parents: 15 diff changeset	433
0 e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	434 if __name__ == '__main__':
e40034f22c69 moved from pimscreen, upgrade to py3. Redo google auth. drewp@bigasterisk.com parents: diff changeset	435 main()

Mercurial > code > home > repos > gcalendarwatch

annotate gcalendarwatch.py @ 16:a87969972d85