I have 2 scripts: lets say Worker.py and Monitor.py
Worker.py collects some data and dumps the metrics into some temp file. Monitor.py looks at the temp file and sends the metrics to a remote server running Graphite. Essentially I am trying to create a time-series graph, in real-time, of the data points collected by Worker.py but I am unsure how to coordinate these two scripts or whether this workflow is the most ideal. I was looking into multi-threading and Celery and not sure if those ideas apply to my situation. Any advice guys?
EDIT: the reason I have Monitor.py as a separate script is because I also have Worker1.py Worker2.py ...WorkerN-1.py WorkerN.py etc. So I would like to have the same Monitor script that can be configurable, via command line, to look at different temp files and plot them to different graphs