google

/

gemma-2-2b

like 440

Follow

Google 4,922

Hello, when I try to run the code below, I get the "AttributeError: module 'torch._dynamo' has no attribute 'mark_static_address'" error. Do you have any solutions for this?

transformers 4.43.3
torch 2.0.1

import transformers
model_id = "google/gemma-2-2b"

pipeline = transformers.pipeline(
    "text-generation",
    model=model_id,
    device_map="auto"
)

text = "Any text here"
outputs = pipeline(text, max_new_tokens=1024)
response = outputs[0]["generated_text"]
print(response)