mlx-community

/

mistral-7B-v0.1

like 11

Follow

MLX Community 2,378

Greetings,
I'm getting failures when running test.py. Any thoughts?

======================================================================
FAIL: test_generate (main.TestMistral)

Traceback (most recent call last):
File "/Users/egs/repos/mlx-examples/llms/mistral/test.py", line 75, in test_generate
self.assertEqual(tokens, expected)
AssertionError: Lists differ: [302, 272, 16762, 9588, 12807, 2867, 2135, 28723, 851[116 chars] 297] != [302, 272, 11843, 11837, 1587, 28723, 851, 349, 865, [108 chars], 13]

First differing element 2:
16762
11843

[302,
272,

• 16762,
• 9588,

• 11843,
• 11837,

• 12807,
  ? ^ -

• 1587,
  ? ^

• 2867,
• 2135,
  28723,
  851,
  349,
  865,
  264,
  1369,
  28723,
  13,
  13,

• 3381,
• 456,
• 654,

• 1014,
• 16762,
• 9588,
• 12807,
• 2867,
• 2135,
• 325,
• 28749,
• 8340,
• 28731,
• 403,
  264,
• 1587,
• 297]

• 1353,
• 11843,
• 28725,
• 368,
• 682,
• 347,
• 2240,
• 767,
• 298,
• 511,
• 28723,
• 13]

Ran 2 tests in 7.400s

FAILED (failures=1)