{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":733594043,"defaultBranch":"main","name":"FastChat","ownerLogin":"wandb","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2023-12-19T17:18:12.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/26401354?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1716190629.0","currentOid":""},"activityList":{"items":[{"before":null,"after":"6aa8c33b26e2c2bb7ac182cc14e01acaf70b02ce","ref":"refs/heads/prototype_hyper","pushedAt":"2024-05-20T07:37:09.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"nejumi","name":"YuyaYAMAMOTO","path":"/nejumi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/24971026?s=80&v=4"},"commit":{"message":"experimental prototype with vLLM","shortMessageHtmlLink":"experimental prototype with vLLM"}},{"before":"f4e9e5949a50664e2027c35f5d6391cdd52c5a44","after":"803bb1107778b2142517ea5c6431cf151585ef21","ref":"refs/heads/main","pushedAt":"2024-05-17T03:56:23.000Z","pushType":"pr_merge","commitsCount":3,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Merge pull request #27 from cookie-estyle/main\n\nAdd llm-jp adapter","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2301713729\" data-permission-text=\"Title is private\" data-url=\"https://github.com/wandb/FastChat/issues/27\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/wandb/FastChat/pull/27/hovercard\" href=\"https://github.com/wandb/FastChat/pull/27\">#27</a> from cookie-estyle/main"}},{"before":"f4e9e5949a50664e2027c35f5d6391cdd52c5a44","after":"ab32871ad50d3d831794c54bb727252fab4c3fa1","ref":"refs/heads/project_d2","pushedAt":"2024-05-16T04:51:05.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"nejumi","name":"YuyaYAMAMOTO","path":"/nejumi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/24971026?s=80&v=4"},"commit":{"message":"Ensure tokenizer EOS settings override model defaults in mt-bench\n\nThis commit modifies the behavior to prioritize tokenizer's EOS and PAD token settings over the model's default settings when `use_tokenizer_eos` is set to true in the mt-bench configuration. This change ensures consistency between the model and tokenizer configurations during mt-bench executions.","shortMessageHtmlLink":"Ensure tokenizer EOS settings override model defaults in mt-bench"}},{"before":null,"after":"f4e9e5949a50664e2027c35f5d6391cdd52c5a44","ref":"refs/heads/project_d2","pushedAt":"2024-05-16T04:45:03.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"nejumi","name":"YuyaYAMAMOTO","path":"/nejumi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/24971026?s=80&v=4"},"commit":{"message":"Merge pull request #26 from cookie-estyle/main\n\nAdd Swallow adapter","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2286775509\" data-permission-text=\"Title is private\" data-url=\"https://github.com/wandb/FastChat/issues/26\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/wandb/FastChat/pull/26/hovercard\" href=\"https://github.com/wandb/FastChat/pull/26\">#26</a> from cookie-estyle/main"}},{"before":"b0d9ea8a9db76b9436c25660900d5dd6a865a474","after":"a67df9ea56eed827f9a3aed0c856e8fc77c04449","ref":"refs/heads/project_d","pushedAt":"2024-05-15T17:04:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"nejumi","name":"YuyaYAMAMOTO","path":"/nejumi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/24971026?s=80&v=4"},"commit":{"message":"Ensure tokenizer EOS settings override model defaults in mt-bench\n\nThis commit modifies the behavior to prioritize tokenizer's EOS and PAD token settings over the model's default settings when `use_tokenizer_eos` is set to true in the mt-bench configuration. This change ensures consistency between the model and tokenizer configurations during mt-bench executions.","shortMessageHtmlLink":"Ensure tokenizer EOS settings override model defaults in mt-bench"}},{"before":"587c0ec76a51f4ded9565df3168c76f18ea31a54","after":"f4e9e5949a50664e2027c35f5d6391cdd52c5a44","ref":"refs/heads/main","pushedAt":"2024-05-09T22:59:04.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Merge pull request #26 from cookie-estyle/main\n\nAdd Swallow adapter","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2286775509\" data-permission-text=\"Title is private\" data-url=\"https://github.com/wandb/FastChat/issues/26\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/wandb/FastChat/pull/26/hovercard\" href=\"https://github.com/wandb/FastChat/pull/26\">#26</a> from cookie-estyle/main"}},{"before":"b635ccbfa554c1f765addfc5ff089fc37a9783c1","after":"587c0ec76a51f4ded9565df3168c76f18ea31a54","ref":"refs/heads/main","pushedAt":"2024-04-11T06:46:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update common.py\n\nedit anthropic code","shortMessageHtmlLink":"Update common.py"}},{"before":"b0d9ea8a9db76b9436c25660900d5dd6a865a474","after":"b635ccbfa554c1f765addfc5ff089fc37a9783c1","ref":"refs/heads/main","pushedAt":"2024-04-06T21:44:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update common.py\n\nadd claude opus","shortMessageHtmlLink":"Update common.py"}},{"before":null,"after":"b0d9ea8a9db76b9436c25660900d5dd6a865a474","ref":"refs/heads/project_d","pushedAt":"2024-04-03T02:12:38.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"nejumi","name":"YuyaYAMAMOTO","path":"/nejumi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/24971026?s=80&v=4"},"commit":{"message":"Update common.py\n\nupdate anthropic interface","shortMessageHtmlLink":"Update common.py"}},{"before":"1fe23b003384e5d7b961d32121cb80b289b8caea","after":"fde6c2e11d00e164fc0e985ece6b272f16e744b6","ref":"refs/heads/g-leaderboard","pushedAt":"2024-04-01T11:29:51.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Merge pull request #25 from niboshi/g-leaderboard-azure-openai\n\nAdd use_azure option","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2217591168\" data-permission-text=\"Title is private\" data-url=\"https://github.com/wandb/FastChat/issues/25\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/wandb/FastChat/pull/25/hovercard\" href=\"https://github.com/wandb/FastChat/pull/25\">#25</a> from niboshi/g-leaderboard-azure-openai"}},{"before":"c224f8f2efe94ea1c2a08fe951c90aaa928311c1","after":"b0d9ea8a9db76b9436c25660900d5dd6a865a474","ref":"refs/heads/main","pushedAt":"2024-03-30T15:41:14.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update common.py\n\nupdate anthropic interface","shortMessageHtmlLink":"Update common.py"}},{"before":"9905f68893c8f2e59df572e382c07a33c6fc1b85","after":"c224f8f2efe94ea1c2a08fe951c90aaa928311c1","ref":"refs/heads/main","pushedAt":"2024-03-30T01:05:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update README.md\n\nupdate README","shortMessageHtmlLink":"Update README.md"}},{"before":"fcd3facb3b47695ff8713b164d7feae9bc52e6a5","after":"9905f68893c8f2e59df572e382c07a33c6fc1b85","ref":"refs/heads/main","pushedAt":"2024-03-30T01:03:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update README.md\n\nupdate Readme","shortMessageHtmlLink":"Update README.md"}},{"before":"8b6699153ad60bd02635a57ba0662d5b510bea49","after":"fcd3facb3b47695ff8713b164d7feae9bc52e6a5","ref":"refs/heads/main","pushedAt":"2024-03-30T01:03:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"a22f4a2915a8eb01b7055c1c0b2909b6e7b76774","after":"8b6699153ad60bd02635a57ba0662d5b510bea49","ref":"refs/heads/main","pushedAt":"2024-03-30T01:02:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"ffad38ad66ddb9049921b3357876def335fc18d8","after":"a22f4a2915a8eb01b7055c1c0b2909b6e7b76774","ref":"refs/heads/main","pushedAt":"2024-03-30T00:59:36.000Z","pushType":"pr_merge","commitsCount":11,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Merge pull request #24 from wandb/korean\n\nMerge Korean branch","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2216124868\" data-permission-text=\"Title is private\" data-url=\"https://github.com/wandb/FastChat/issues/24\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/wandb/FastChat/pull/24/hovercard\" href=\"https://github.com/wandb/FastChat/pull/24\">#24</a> from wandb/korean"}},{"before":"b077a70733ceb7d5aab11526ca029ae5f4a807e3","after":"ffad38ad66ddb9049921b3357876def335fc18d8","ref":"refs/heads/main","pushedAt":"2024-03-30T00:54:57.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Merge pull request #21 from niboshi/fix-errors\n\nFix errors on running llm-leaderboard","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2175198221\" data-permission-text=\"Title is private\" data-url=\"https://github.com/wandb/FastChat/issues/21\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/wandb/FastChat/pull/21/hovercard\" href=\"https://github.com/wandb/FastChat/pull/21\">#21</a> from niboshi/fix-errors"}},{"before":"12230adb2b7dbd993b36a1d07dc457e8b521ff83","after":"b6da235271f22bb22462b53a294fadc0ced08f50","ref":"refs/heads/korean","pushedAt":"2024-03-29T23:55:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"paul-hyun","name":null,"path":"/paul-hyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39281050?s=80&v=4"},"commit":{"message":"add korean_mt_bench_small","shortMessageHtmlLink":"add korean_mt_bench_small"}},{"before":"f802deb67fd8b72c159d34861a3a9e5098530044","after":"12230adb2b7dbd993b36a1d07dc457e8b521ff83","ref":"refs/heads/korean","pushedAt":"2024-03-28T15:32:35.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update common.py\n\nreverse BedrockChat","shortMessageHtmlLink":"Update common.py"}},{"before":"5c1d911fc9396c0acd64ab27c6f15d9669e19fab","after":"f802deb67fd8b72c159d34861a3a9e5098530044","ref":"refs/heads/korean","pushedAt":"2024-03-28T15:30:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update common.py\n\nupdate bedrock library","shortMessageHtmlLink":"Update common.py"}},{"before":"307fd51975db9ce45afc4e871736ab3f48599ccd","after":"5c1d911fc9396c0acd64ab27c6f15d9669e19fab","ref":"refs/heads/korean","pushedAt":"2024-03-28T15:14:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update common.py","shortMessageHtmlLink":"Update common.py"}},{"before":"83254e57e2be03b4eaf82b1e74c8b96780f1c6cb","after":"307fd51975db9ce45afc4e871736ab3f48599ccd","ref":"refs/heads/korean","pushedAt":"2024-03-21T06:04:06.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"paul-hyun","name":null,"path":"/paul-hyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39281050?s=80&v=4"},"commit":{"message":"Modify for korean leaderboard","shortMessageHtmlLink":"Modify for korean leaderboard"}},{"before":"865816c5094a22aa08b25b2d0b1f6bd7b089034b","after":"83254e57e2be03b4eaf82b1e74c8b96780f1c6cb","ref":"refs/heads/korean","pushedAt":"2024-03-20T15:38:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"paul-hyun","name":null,"path":"/paul-hyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39281050?s=80&v=4"},"commit":{"message":"temp -> temperature","shortMessageHtmlLink":"temp -&gt; temperature"}},{"before":"ccf82f614639c42122b8a5d3ee918b6dd4f1064d","after":"b077a70733ceb7d5aab11526ca029ae5f4a807e3","ref":"refs/heads/main","pushedAt":"2024-03-20T08:39:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update common.py\n\nchange spell \"temperature\"","shortMessageHtmlLink":"Update common.py"}},{"before":"b2dd956b68cf776d93fe1ee9159001ac38f67880","after":"ccf82f614639c42122b8a5d3ee918b6dd4f1064d","ref":"refs/heads/main","pushedAt":"2024-03-19T10:58:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"Update common.py\n\nchange tempature arg","shortMessageHtmlLink":"Update common.py"}},{"before":"c0849d1cf5bf0e6fd7cc86351cddce49f6e82423","after":"865816c5094a22aa08b25b2d0b1f6bd7b089034b","ref":"refs/heads/korean","pushedAt":"2024-03-19T08:42:31.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"paul-hyun","name":null,"path":"/paul-hyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39281050?s=80&v=4"},"commit":{"message":"update question id 92","shortMessageHtmlLink":"update question id 92"}},{"before":"ed0e5256ca0b27e7fe0968721ceed5fb252d5ac0","after":"c0849d1cf5bf0e6fd7cc86351cddce49f6e82423","ref":"refs/heads/korean","pushedAt":"2024-03-19T01:56:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"paul-hyun","name":null,"path":"/paul-hyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39281050?s=80&v=4"},"commit":{"message":"change korean judge prompt","shortMessageHtmlLink":"change korean judge prompt"}},{"before":"42a89f2bcee0390c1bbc06302863872c197fc80f","after":"1fe23b003384e5d7b961d32121cb80b289b8caea","ref":"refs/heads/g-leaderboard","pushedAt":"2024-03-13T02:56:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"olachinkei","name":"Keisuke Kamata","path":"/olachinkei","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/135185730?s=80&v=4"},"commit":{"message":"update interface","shortMessageHtmlLink":"update interface"}},{"before":"b2dd956b68cf776d93fe1ee9159001ac38f67880","after":"ed0e5256ca0b27e7fe0968721ceed5fb252d5ac0","ref":"refs/heads/korean","pushedAt":"2024-03-12T09:51:07.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"paul-hyun","name":null,"path":"/paul-hyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39281050?s=80&v=4"},"commit":{"message":"Merge pull request #22 from kh-kim/korean\n\nadd korean brench","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2178356687\" data-permission-text=\"Title is private\" data-url=\"https://github.com/wandb/FastChat/issues/22\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/wandb/FastChat/pull/22/hovercard\" href=\"https://github.com/wandb/FastChat/pull/22\">#22</a> from kh-kim/korean"}},{"before":null,"after":"b2dd956b68cf776d93fe1ee9159001ac38f67880","ref":"refs/heads/korean","pushedAt":"2024-03-11T06:46:06.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"paul-hyun","name":null,"path":"/paul-hyun","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39281050?s=80&v=4"},"commit":{"message":"Update common.py","shortMessageHtmlLink":"Update common.py"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAETocljQA","startCursor":null,"endCursor":null}},"title":"Activity · wandb/FastChat"}