- Dec 11, 2020
-
-
Seok Won authored
Added a test which contains filtering function (it'll filter notices within the array of strings) Made producer more safe and highthroughput. Added old notices remover in producer. Added a little bit of resting time between consuer polling.
-
- Dec 07, 2020
-
-
Seok Won authored
Before: some notices have their name in notices [writer]: [writer] title After: remove writer in titles [writer]: title
-
- Dec 06, 2020
-
-
Seok Won authored
pip install faust
-
Seok Won authored
1시간마다 모든 공지를 불러 {"TITLE": "제목", "DATE": "올린 날", "LINK": "http 주소", "WRITER": "글쓴이"}를 json 형태로 저장한다. 이 json 파일이나 새로운 공지가 있으면 기존 json과 비교해서 새로운 데이터를 Consumer로 보내고, Consumer는 새로운 데이터를 받으면, Slack API를 이용해, "#아주대" 채널에 공지를 올려준다. 마지막 파싱 시간도 기록해 종료 후 다시 불러도 1시간이 지나지 않으면 파싱하지 않는다. 결과) Last parsing: 1972-12-01 07:00:00 Trying to parse new posts... Sending a new post...: 12179 ... Last parsing: 2020-12-04 19:11:42.839219 Trying to parse new posts... No new posts yet... Resting 1 hour... ... Last parsing: 2020-12-06 11:55:35.386262 Wait for 3494 seconds to sync new posts.
-