U &dbc<@s,ddlZddlmZddlmZddlmZddlm Z ddl Z ddl m Z ddl m Z ddlmZmZmZdd lmZddlZddlZddlZddlZdd lmZdd lmZddlZd d ddZeeddZ ddgZ!dZ"ddddddZ#dde#$DZ%dddd d!d"d#Z&d$de&$DZ'd%(Z)d&Z*e+d'Z,e+d(Z-e+d)Z.e+d*Z/e+d+Z0e+d,Z1ed Z2e3d-Z4d.d/Z5d0d1Z6dId2d3Z7d4d5Z8d6d7Z9Gd8d9d9Z:eGd:d;d;Z;Gdd?Z=d@dAZ>GdBdCdCZ?ee@eee fdDdEdFZAe?dDdGdHZBe:ZCdS)JN)build)InstalledAppFlow)Request) Credentialsisoparse)datetime)ListOptionalTuple)BytesIO) dataclass)timezoneTzEurope/Amsterdamfuture)ZRETURN_AS_TIMEZONE_AWAREZTIMEZONEZPREFER_DATES_FROMz config.jsonrz%https://www.googleapis.com/auth/drivez)https://www.googleapis.com/auth/documentsZ604b3d9c6745546d9e8be6f1Z604b3da85aa63a1340fc8d9dZ604b3da6fbaeef4d725f1e02Z604b3daae0b0202099873f3dZ604b3dac6709b0875760d298Z604b3db0d55d2e854bbece55)todo promemorieZ inprogressdone cancelledcCsi|]\}}||qSr.0kvrr(/opt/wsgi/lief_notulen/notulenscraper.py "srZ FrederickZMaximZRobinZSamZAnniekZMund)Z6207aa8ca50ed014ea86a841Z604b41197bcdec22c5caeb91Z5eea09dbfac2c6072b623132Z510a1d94181035dc6a0019cdZ608077885d1ae137115c9cf4Z5de634800015827d346548dfcCsi|]\}}||qSrrrrrrr$szSam Robin Anniek Mund FrederickZ605cce8b29fb595d45fe065cz5\s*(?:ACTIE)(?P [^\n:]+)?:\s*(?P.*?)\s*$z<\s*(?:PRO ?MEMORIE)(?P [^\n:]+)?:\s*(?P.*?)\s*$z6\s*(?:ACTIES)(?P [^\n:]*)?:\s*(?P.*?)\s*$z\s*(?:DONE):? ([^\n\r]*)z\s*(?:CANCEL):? ([^\n\r]*)zV^\s*(?P[-~*+^])\s*\[(?P[A-Z]{4})\]\s*(?P[^\n:]+):\s*(?P.*?)\s*$notulenscrapercCsRd\}}t||||}d}tdD]}|tj|d7}|d}q$|dddS)N)i)powrangestringascii_uppercase)npgrestask_id_rrrint_to_task_id=s  r,cCs<|d}t|dkst|ddtks,t|dddS)z6 Extract the task ID from a Trello API card structure customFieldItemsrZ idCustomFieldvaluetext)lenAssertionError CF_TASK_ID)cardfieldsrrrcard_to_task_idGsr5c CsBtd0}t|}t|d|d|}|W5QRSQRXdS)Nztrello_credentials.jsonkeytoken)openjsonloadTrello)get_card_cachefdatatrellorrr get_trelloOs  r@c Csd}tjdrtdt}|r&|js|rD|jrD|jrD| t nt dt}|j dd}tdd}||W5QRXtdd|d}|S) N token.jsoncredentials.jsonrportwdrivev3 credentialsospathexistsrZfrom_authorized_user_fileSCOPESvalidexpiredZ refresh_tokenrefreshrrZfrom_client_secrets_fileZrun_local_serverr8writeto_jsonrcredsZflowr7servicerrr get_serviceVs      rWc Csd}tjdrtdt}|r&|js|rD|jrD|jrD| t nt dt}|j dd}tdd}||W5QRXtdd|d}|S) NrArBrrCrEZdocsv1rHrJrTrrrget_docs_servicegs      rYc@s,eZdZddZddZddZddZd S) TaskIdSourcecCstd|_dS)NF)r@_trelloselfrrr__init__{szTaskIdSource.__init__cCs.|jdtd}t|dd|_dS)N/boards/descznext_id=)r[getTRELLO_BOARD_IDintsplit_id)r]r`rrr __enter__~szTaskIdSource.__enter__cCs|j}|jd7_t|S)Nra)rfr,)r]idrrr__next__szTaskIdSource.__next__cGs&d|j}|jjdt|ddS)Nz# do not edit! next_id=r_)r`)rfr[putrc)r]argsZnew_descrrr__exit__s zTaskIdSource.__exit__N)__name__ __module__ __qualname__r^rgrirlrrrrrZzsrZc@seZdZUeed<eed<eeed<dZeed<dZee ed<dZ eeed<dZ eeed<dZ ee ed <e d d Ze d d ZddZddZddZddZdS)Cardnamelist assigneesN descriptiondue_dater* trello_id last_modifiedc Csbt|dt|dt|d|d|dr>t|dtndt||dt|dtdS) NrqidList idMembersr`duerhZdateLastActivity)rqrrrsrtrur*rvrw)rpTRELLO_ID2LIST_ids_to_assigneesr astimezoneLOCALr5r>rrr deserializes  zCard.deserializecCsttj|SN)mapTRELLO_ID2USERrb)idsrrrr|szCard._ids_to_assigneescCsttj|jSr)rTRELLO_USER2IDrbrsr\rrr_assignees_to_idsszCard._assignees_to_idsc CsV|js ttt|_W5QRX|jt|j||jrB|jnd|j |j|j dS)N)rqrxryrzr`ZtaskIdrh) r*task_id_sourcenextrqTRELLO_LIST2IDrrrru isoformatrtrvr\rrr serializeszCard.serializecCs8t|j}|dkrdS|ttkr&dSd|jdS)Nrrz Iedereen: z, z: )r0rsrjoin)r]Z num_assigneesrrr_format_assigneess   zCard._format_assigneescCsPd}|jr|d|jd7}|||j7}|jrL|d|jdd7}|S)Nr[z] z (op: z%Y-%m-%d))r*rrqrustrftime)r]outputrrr__str__sz Card.__str__)rmrnrostr__annotations__r rtrur rr*rvrw staticmethodrr|rrrrrrrrrps       rpc@steZdZdddZddZddZdd Zdd d Zd dZe e dddZ de e dddZ e dddZd S)r;TcCs(||_||_d|_i|_|r$|dS)Nzhttps://api.trello.com/1)_key_token_base _card_cacheinvalidate_card_cache)r]r6r7r<rrrr^s zTrello.__init__cCsZ|j|jdtddd}|D]0}t|}||jkrJtd|||j|<q$dS)z/ Update the list of cards this instance holds. r_/cardstrue)r-zDuplicate task with ID N)rclearrbrcr5loggerwarning)r]cardsr3r*rrrrs  zTrello.invalidate_card_cachecKs.||j|jdtj|j||ddSNr6r7)paramsr>)updaterrrequestsrbrr9r]endpointkwargsrrrrbsz Trello.getcKs.||j|jdtj|j||ddSr)rrrrpostrr9rrrrrsz Trello.postNcKs.||j|jdtj|j|||dS)Nr)rr9)rrrrrjrr9)r]rr>rrrrrjsz Trello.putcKs.||j|jdtj|j||ddSr)rrrrdeleterr9rrrrrsz Trello.deletereturncCs|j|}|rt|SdSr)rrbrpr)r]r*Z card_datarrrget_cards zTrello.get_cardFcCs |r |dd|jDS)NcSsg|]}t|qSr)rpr)rr>rrr sz$Trello.get_cards..)rrvalues)r]freshrrr get_cardsszTrello.get_cards)r3cCsl|}|dr2|jd|dfddi|n6|jd |}|jd|ddtddd|jiid dS) Nrhz/cards/r>rz /customfield/z/itemr.r/r)r)rrjrr2r*)r]r3r>r)rrr insert_cards " zTrello.insert_card)T)N)F)rmrnror^rrbrrjrr rprr rrrrrrr;s   r;c CsZ|jddddddddd}|d g}|s:td |jd d dd dd|DS)z: Get a list of all minutes ordered by date last modified. z,nextPageToken, files(id, name, modifiedTime)dTzname contains 'Notulen'zmodifiedTime descrFZ0AP7Ynv3qJ_CwUk9PVA)r4ZpageSizeZsupportsAllDrivesqZorderByZcorporaZdriveIdZincludeItemsFromAllDrivesfileszUnable to get file list?cSs t|dS)NZ modifiedTimer)r=rrrzget_minutes..)r6reversecSsg|]}|ddr|qS)rqZNotulen)endswith)rr=rrrr szget_minutes..)rrrexecuterb ValueErrorsort)rVr)Z file_listrrr get_minutess " rcCs(|j|dd}|dddS)Nz text/plain)ZfileIdZmimeTypezutf-8ra)rexportrdecode)rVfile_idr)rrr get_file_text src@s@eZdZdZddZddZddZdd Zd d Zd d Z dS) Transactionz5 A set of modifications to make to the Trello state. cCsg|_g|_g|_dSr)editsmovescreatesr\rrrr^szTransaction.__init__cKs|j|||fdS)z Add an edit, modifying the Card identified by task_id by setting fields to values as specified by kwargs. N)rappend)r]liner*rrrr edit_taskszTransaction.edit_taskcCs|j|||fdSr)rr)r]rr*rrrrr move_to_listszTransaction.move_to_listcKs|j|tf|fdSr)rrrp)r]rrrrr create_task"szTransaction.create_taskcCsg}||jD]L\}}}||jkr:||d|fg7}tdd|Dr||dfg7}q|jD](\}}}||jkrf||d|fg7}qf|S)z= Validate this transaction w.r.t. the given Trello instance. z Unknown card css|]}|tjkVqdSr)rp__dataclass_fields__keys)rfieldrrr .sz'Transaction.validate..zUpdating unknown field!)rrranyrr)r]r?errorsrr* field_changesrrrrrvalidate%s  zTransaction.validatec cs||rtd|jD]<\}}}||}|D]\}}t|||q4d|fVq|jD]$\}}}||}||_d|fVq\|jD]\}}d|fVqdS)z= Returns the set of changes as (type, card_to_insert) pairs. z@There are validation errors, you can't perform this transaction!editmovecreateN) rrrritemssetattrrrrr) r]r?r+r*rr3rrnew_listrrrchanges7s     zTransaction.changesN) rmrnro__doc__r^rrrrrrrrrrsrrc Cstjd|tjd}|s|dfSt}g}|D]\}}|ddkr|tt|d\}}|j }||j kr||j kr|d7}ntt|d\}}}t|||ddd} | t | q.|D](\} }|| d}|d d }|}q||d fS) Nz3((?:deadline:? )?\b((?:\d{4}-)?\d{2}-\d{2})\b.?)\.?)flags-ra;)yearmonthdayhourminuterz  r)refindall IGNORECASErnowcountrrdrerrrrr~localizereplacestrip) r$datesrZdtimesr+daterrrdtimeZ source_daterrrsplit_out_dateKs&      rc Cst}dd}t|D]\}}d|kr6qt|D]\}}}}t|\}} |dkrp|||dq@|dkr|||dq@|dkr|j|||||| d q@|d kr|||d q@|d kr@|||d q@t |D],\}}t|\}} |j ||||| d dqt |D].\}}t|\}} |j ||||| d dqt |D]@\}}||} t|\}} | D]} |j ||| g| d dqvqVt |D]2} | dD]}|}|||dqqt|D]2} | dD]}|}|||dqqq|S)zI Parse the specified minutes for tasks and return a transaction. cSs(|dkrtSdd|dDS)NZiedereencSsg|]}|qSr)rtitle)rsrrrrnsz3parse_minutes....,)rlowerEVERYONEre)r$rrrrnrzparse_minutes..zveranderingen actiepuntenrr~r*)rqrsru+r^r)rqrsrurrr)r enumerate splitlinesr CURTASK_REGEXrrrrPROMEMORIE_REGEXr TASK_REGEX TASKS_REGEX DONE_REGEXrre CANCEL_REGEX) content transactionZ desugar_usersirflagr*namestaskruusersuserZ task_id_listrrr parse_minuteshsJ     r )T)Dos.pathrKZgoogleapiclient.discoveryrZgoogle_auth_oauthlib.flowrZgoogle.auth.transport.requestsrZgoogle.oauth2.credentialsrzipfileZdateutil.parserrrtypingr r r ior rr9r$r dataclassesr pytzrloggingZ DP_SETTINGSr:r8ZCONFIGrNrcrrr{rrrerr2compilerrrrrrr~ getLoggerrr,r5r@rWrYrZrpr;rrrrrr rrrrrsh                  >6 ::