{
  "appeals": 1,
  "budgets": {
    "baseline_limit_s": 600,
    "verification_timeout_s": 600,
    "worker": {
      "max_completion_tokens": 96000,
      "max_turns": 60,
      "max_wall_seconds": 1500.0,
      "prompt_token_budget": 160000
    }
  },
  "issue": "make the cumulative time counter available to clients\nThe `Bot` object should have an attribute `time` where the cumulative time for the team shown in the GUI is made available. This is useful for example when benchmarking different strategies. There's no way at the moment to programmatically access that value, as far as I could see.\r\nOf course the client could time itself, but this has its own pitfalls. So it's better to just make that value available, even if we all know it's not super precise...",
  "source": {
    "image": "docker.io/swerebenchv2/aspp-pelita:798-245a9ca",
    "platform": "linux/amd64",
    "python": "python",
    "setup": [
      "python -c 'import base64; from pathlib import Path; Path('\"'\"'/tmp/receipts-aspp__pelita-798-test.patch'\"'\"').write_bytes(base64.b64decode('\"'\"'ZGlmZiAtLWdpdCBhL3Rlc3QvdGVzdF9uZXR3b3JrLnB5IGIvdGVzdC90ZXN0X25ldHdvcmsucHkKaW5kZXggNzAxZDUzMDcuLjlmY2FjYTdmIDEwMDY0NAotLS0gYS90ZXN0L3Rlc3RfbmV0d29yay5weQorKysgYi90ZXN0L3Rlc3RfbmV0d29yay5weQpAQCAtODgsNiArODgsNyBAQCBkZWYgdGVzdF9zaW1wbGVjbGllbnQoem1xX2NvbnRleHQpOgogICAgICAgICAgICAgICAgICAgICAnZXJyb3JfY291bnQnOiAwLAogICAgICAgICAgICAgICAgICAgICAnZm9vZCc6IFsoMSwgMSldLAogICAgICAgICAgICAgICAgICAgICAnbmFtZSc6ICdkdW1teScsCisgICAgICAgICAgICAgICAgICAgICd0ZWFtX3RpbWUnOiAwLAogICAgICAgICAgICAgICAgIH0sCiAgICAgICAgICAgICAgICAgJ2VuZW15JzogewogICAgICAgICAgICAgICAgICAgICAndGVhbV9pbmRleCc6IDEsCkBAIC05OCw2ICs5OSw3IEBAIGRlZiB0ZXN0X3NpbXBsZWNsaWVudCh6bXFfY29udGV4dCk6CiAgICAgICAgICAgICAgICAgICAgICdib3Rfd2FzX2tpbGxlZCc6IFtGYWxzZV0qMiwKICAgICAgICAgICAgICAgICAgICAgJ2Zvb2QnOiBbKDIsIDIpXSwKICAgICAgICAgICAgICAgICAgICAgJ25hbWUnOiAnb3RoZXIgZHVtbXknLAorICAgICAgICAgICAgICAgICAgICAndGVhbV90aW1lJzogMCwKICAgICAgICAgICAgICAgICAgICAgJ2lzX25vaXN5JzogW0ZhbHNlLCBGYWxzZV0sCiAgICAgICAgICAgICAgICAgICAgICdlcnJvcl9jb3VudCc6IDAKICAgICAgICAgICAgICAgICB9LApkaWZmIC0tZ2l0IGEvdGVzdC90ZXN0X3RlYW0ucHkgYi90ZXN0L3Rlc3RfdGVhbS5weQppbmRleCBhYTJhN2Q2Mi4uNjU0NGVkN2MgMTAwNjQ0Ci0tLSBhL3Rlc3QvdGVzdF90ZWFtLnB5CisrKyBiL3Rlc3QvdGVzdF90ZWFtLnB5CkBAIC0xLDMgKzEsNSBAQAoraW1wb3J0IHRpbWUKKwogaW1wb3J0IHB5dGVzdAogaW1wb3J0IG5ldHdvcmt4CiAKQEAgLTUyMyw2ICs1MjUsMTAzIEBAIGRlZiB0ZXN0X3RlYW1fbmFtZXMoKToKICAgICBhc3NlcnQgc3RhdGVbJ2ZhdGFsX2Vycm9ycyddID09IFtbXSwgW11dCiAKIAorZGVmIHRlc3RfdGVhbV90aW1lKCk6CisgICAgdGVzdF9sYXlvdXQgPSAoCisgICAgIiIiICMjIyMjIyMjIyMjIyMjIyMjIworICAgICAgICAjYSMuICAuICAjIC4gICAgICMKKyAgICAgICAgI2IjIyMjIyAgICAjIyMjI3gjCisgICAgICAgICMgICAgIC4gIyAgLiAgLiN5IworICAgICAgICAjIyMjIyMjIyMjIyMjIyMjIyMgIiIiKQorCisgICAgZGVmIHRlYW1fcGF0dGVybihmbik6CisgICAgICAgICMgVGhlIHBhdHRlcm4gZm9yIGEgbG9jYWwgdGVhbS4KKyAgICAgICAgcmV0dXJuIGYnbG9jYWwtdGVhbSAoe2ZufSknCisKKyAgICAjIE5COiB0aW1lLm1vbm90b25pYygpIG1ha2VzIGh1Z2UgbGVhcHMgb24gd2luZG93cywKKyAgICAjIHdlIG11c3QgdGhlcmVmb3JlIHRlc3Qgd2l0aCA+PSBpbnN0ZWFkIG9mIGp1c3QgPgorICAgICMgYWx0aG91Z2ggdGhpcyBpcyBhIGxpdHRsZSBzdHVwaWQKKworICAgIGNoZWNrID0gW05vbmUsIE5vbmVdCisKKyAgICBkZWYgdGVhbV8xKGJvdCwgc3RhdGUpOgorICAgICAgICBpZiBib3Qucm91bmQgPT0gMSBhbmQgYm90LnR1cm4gPT0gMDoKKyAgICAgICAgICAgIGFzc2VydCBib3QudGVhbV90aW1lID09IDAKKyAgICAgICAgICAgIGFzc2VydCBib3QuZW5lbXlbMF0udGVhbV90aW1lID09IDAKKyAgICAgICAgZWxzZToKKyAgICAgICAgICAgIGFzc2VydCBib3QudGVhbV90aW1lID49IDAKKworICAgICAgICAjIHdlIGZha2UgdGhlIHRpbWUgaW4gcm91bmQgMiEhCisgICAgICAgIGlmIGJvdC5yb3VuZCA9PSAyIGFuZCBib3QudHVybiA9PSAwOgorICAgICAgICAgICAgYXNzZXJ0IGJvdC50ZWFtX3RpbWUgPT0gMS4wCisgICAgICAgICAgICBhc3NlcnQgYm90LmVuZW15WzBdLnRlYW1fdGltZSA9PSAyLjAKKworICAgICAgICBpZiBib3Qucm91bmQgPT0gMiBhbmQgYm90LnR1cm4gPT0gMToKKyAgICAgICAgICAgIGFzc2VydCBib3QudGVhbV90aW1lID49IDEuMAorICAgICAgICAgICAgYXNzZXJ0IGJvdC5lbmVteVswXS50ZWFtX3RpbWUgPj0gMi4wCisKKyAgICAgICAgY2hlY2tbMF0gPSBib3QudGVhbV90aW1lCisKKyAgICAgICAgcmV0dXJuIGJvdC5wb3NpdGlvbgorCisgICAgZGVmIHRlYW1fMihib3QsIHN0YXRlKToKKyAgICAgICAgaWYgYm90LnJvdW5kID09IDEgYW5kIGJvdC50dXJuID09IDA6CisgICAgICAgICAgICBhc3NlcnQgYm90LnRlYW1fdGltZSA9PSAwCisgICAgICAgICAgICBhc3NlcnQgYm90LmVuZW15WzBdLnRlYW1fdGltZSA+PSAwCisgICAgICAgIGVsc2U6CisgICAgICAgICAgICBhc3NlcnQgYm90LnRlYW1fdGltZSA+PSAwCisKKyAgICAgICAgIyB3ZSBmYWtlIHRoZSB0aW1lIGluIHJvdW5kIDIhIQorICAgICAgICBpZiBib3Qucm91bmQgPT0gMiBhbmQgYm90LnR1cm4gPT0gMDoKKyAgICAgICAgICAgIGFzc2VydCBib3QudGVhbV90aW1lID09IDIuMAorICAgICAgICAgICAgYXNzZXJ0IGJvdC5lbmVteVswXS50ZWFtX3RpbWUgPj0gMS4wCisKKyAgICAgICAgaWYgYm90LnJvdW5kID09IDIgYW5kIGJvdC50dXJuID09IDE6CisgICAgICAgICAgICBhc3NlcnQgYm90LnRlYW1fdGltZSA+PSAyLjAKKyAgICAgICAgICAgIGFzc2VydCBib3QuZW5lbXlbMF0udGVhbV90aW1lID49IDEuMAorCisgICAgICAgIGNoZWNrWzFdID0gYm90LnRlYW1fdGltZQorCisgICAgICAgIHJldHVybiBib3QucG9zaXRpb24KKworICAgIHN0YXRlID0gc2V0dXBfZ2FtZShbdGVhbV8xLCB0ZWFtXzJdLCBsYXlvdXRfZGljdD1wYXJzZV9sYXlvdXQodGVzdF9sYXlvdXQpLCBtYXhfcm91bmRzPTMsIGFsbG93X2V4Y2VwdGlvbnM9VHJ1ZSkKKworICAgIHN0YXRlID0gcGxheV90dXJuKHN0YXRlKQorICAgIGFzc2VydCBzdGF0ZVsndGVhbV90aW1lJ11bMF0gPj0gMAorICAgIGFzc2VydCBzdGF0ZVsndGVhbV90aW1lJ11bMV0gPT0gMAorCisgICAgc3RhdGUgPSBwbGF5X3R1cm4oc3RhdGUpCisgICAgYXNzZXJ0IHN0YXRlWyd0ZWFtX3RpbWUnXVswXSA+PSAwCisgICAgYXNzZXJ0IHN0YXRlWyd0ZWFtX3RpbWUnXVsxXSA+PSAwCisKKyAgICAjIHRpbWUgYmVmb3JlIGJvdHMgZ2V0IHVwZGF0ZWQKKyAgICBvbGRfdGltZSA9IGxpc3Qoc3RhdGVbJ3RlYW1fdGltZSddKQorCisgICAgc3RhdGUgPSBwbGF5X3R1cm4oc3RhdGUpCisgICAgc3RhdGUgPSBwbGF5X3R1cm4oc3RhdGUpCisKKyAgICBhc3NlcnQgY2hlY2sgPT0gb2xkX3RpbWUKKworICAgICMgUm91bmQgMi4gV2UgZmFrZSB0aGUgdGltZSBzbyB3ZSBkbyBub3QgaGF2ZSB0byBzbGVlcCEKKyAgICBzdGF0ZVsndGVhbV90aW1lJ10gPSBbMS4wLCAyLjBdCisKKyAgICBzdGF0ZSA9IHBsYXlfdHVybihzdGF0ZSkKKyAgICBzdGF0ZSA9IHBsYXlfdHVybihzdGF0ZSkKKworICAgICMgdGltZSBiZWZvcmUgYm90cyBnZXQgdXBkYXRlZAorICAgIG9sZF90aW1lID0gbGlzdChzdGF0ZVsndGVhbV90aW1lJ10pCisKKyAgICBzdGF0ZSA9IHBsYXlfdHVybihzdGF0ZSkKKyAgICBzdGF0ZSA9IHBsYXlfdHVybihzdGF0ZSkKKworICAgIGFzc2VydCBjaGVjayA9PSBvbGRfdGltZQorCisgICAgIyBjaGVjayB0aGF0IHBsYXllciBkaWQgbm90IGZhaWwKKyAgICBhc3NlcnQgc3RhdGVbJ2Vycm9ycyddID09IFt7fSwge31dCisgICAgYXNzZXJ0IHN0YXRlWydmYXRhbF9lcnJvcnMnXSA9PSBbW10sIFtdXQorICAgIGFzc2VydCBzdGF0ZVsndGVhbV90aW1lJ11bMF0gPj0gMS4wCisgICAgYXNzZXJ0IHN0YXRlWyd0ZWFtX3RpbWUnXVsxXSA+PSAyLjAKKworCiBkZWYgdGVzdF9ib3Rfc3RyX3JlcHIoKToKICAgICB0ZXN0X2xheW91dCA9ICIiIgogICAgICAgICAjIyMjIyMjIyMjIyMjIyMjIyMK'\"'\"'))'",
      "git apply /tmp/receipts-aspp__pelita-798-test.patch"
    ],
    "workdir": "/pelita"
  },
  "spec_paths": [
    "test/test_network.py",
    "test/test_team.py"
  ],
  "spec_tests": [
    "test/test_team.py::test_team_time"
  ],
  "suite_scope": "--no-header -rA --tb=line --color=no -p no:cacheprovider -W ignore::DeprecationWarning test/test_network.py test/test_team.py"
}