This website does readability filtering of other pages. All styles, scripts, forms and ads are stripped. If you want your website excluded or have other feedback, use this form.

tool-grid-jobs · tool-grid-jobs

HomePhabricator

Log In Diffusion tool-grid-jobs (master)

Edit tool-grid-jobsActivePublic

Branch: master Actions Clone Download Archive

[tools.wmflabs.org]

tool-grid-jobs (master)

.gitignore COPYING README.md app.py grid_jobs/ requirements.txt templates/ tox.ini

Recent Commits

CommitAuthorDetailsCommitted 24f012796686 bd808 Remove legacy graphite graph Mar 26 2019 36ed86d43ff6 bd808 Update graphite URL Jan 21 2019 c108793c8645 bd808 Update URL for grid status data Jan 6 2019 10b64b2adfe9 bd808 Add toolforge.redirect_to_https and werkzeug ProxyFix Jan 5 2019 332ef0c5f428 bd808 Replace http.client with requests Jan 5 2019 5c31396a1b09 bd808 Update page heading to reference new grid Jan 5 2019 83c3f6eef17b bd808 Guard against malformed accounting lines Jan 5 2019 2ea059d3a698 bd808 README: s/grid-jobs/sge-jobs/g Jan 5 2019 2d1c7cdf5201 bd808 Fix missing "as e" in exception handler Jan 5 2019 370b642127c4 bd808 Ignore .python-version Jan 5 2019 423aa706eaf3 bd808 Update redis.setex argument order Jan 5 2019 a9a0365874e4 bd808 Switch to accounting data for new sge cluster Jan 5 2019 5a35b49d7f33 bd808 Multiple accounting files + https Jan 5 2019 6708b990d542 bd808 Add graphite graph of active jobs over the time period Aug 2 2017 fe4770574722 bd808 Display total active tools Aug 2 2017

README.md

sge-jobs

List tools running on Toolforge Son of Grid Engine exec nodes.

Install

Clone repo and create basic files:

bastion$ become sge-jobs
[email protected]:~$ mkdir -p ~/www/python
[email protected]:~$ git clone https://phabricator.wikimedia.org/source/tool-grid-jobs.git ~/www/python/src

Create virtualenv inside kubernetes:

[email protected]:~$ webservice --backend=kubernetes python shell
[email protected]:~$ python3 -m venv ~/www/python/venv
[email protected]:~$ source ~/www/python/venv/bin/activate
(venv)[email protected]:~$ pip install -U pip
(venv)[email protected]:~$ pip install -r ~/www/python/src/requirements.txt

Back to bastion, start the webservice:

[email protected]:~$ webservice --backend=kubernetes python start

Creating the list is pretty expensive and we don't need it to be a real time display, so a nice thing to do is setup a cron job to collect new data once an hour:

21 * * * * jstart -N update-cache curl 'https://tools.wmflabs.org/sge-jobs/?purge'

License

[GNU GPLv3+](//www.gnu.org/copyleft/gpl.html "GNU GPLv3+")

Forked from precise-tools

Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL