dataset: craigslist_bargains templates: 145dd841-b971-4550-bc88-305ad3278d58: !Template answer_choices: null id: 145dd841-b971-4550-bc88-305ad3278d58 jinja: 'The following conversation is a negotiation on craigslist. The first speaker is the buyer, and the second speaker is the seller. {{utterance | join("\n\n")}} From the seller''s point of view, this deal could be considered ||| {% set nonzero_price = [] %} {% for p in dialogue_acts["price"] %} {% if p>-1 %} {{nonzero_price.append(p) or ""}} {% endif %} {% endfor %} {% set final_price = -1 %} {% if nonzero_price | length != 0 %}{% set final_price = nonzero_price[-1] %}{% endif %} {% if final_price == -1 %} incomplete {% elif ((final_price - agent_info["Target"][0]) | abs) == ((final_price - agent_info["Target"][1]) | abs) %} good {% elif ((final_price - agent_info["Target"][0]) | abs) < ((final_price - agent_info["Target"][1]) | abs) %} bad {% elif ((final_price - agent_info["Target"][0]) | abs) > ((final_price - agent_info["Target"][1]) | abs) %} good {% endif %}' metadata: !TemplateMetadata choices_in_prompt: null metrics: [] original_task: false name: good deal for seller no list price implicit reference: implicit version of "good deal for seller no list price" 27010b55-dd5b-4ee9-9e14-a4b809aa6cdb: !Template answer_choices: null id: 27010b55-dd5b-4ee9-9e14-a4b809aa6cdb jinja: 'The following conversation is a negotiation on craigslist. The first speaker is the buyer, and the second speaker is the seller. {{utterance | join("\n\n")}} Was this a good deal for the seller? answer "yes", "no", or "unknown". ||| {% set nonzero_price = [] %} {% for p in dialogue_acts["price"] %} {% if p>-1 %} {{nonzero_price.append(p) or ""}} {% endif %} {% endfor %} {% set final_price = -1 %} {% if nonzero_price | length != 0 %}{% set final_price = nonzero_price[-1] %}{% endif %} {% if final_price == -1 %} unknown {% elif ((final_price - agent_info["Target"][0]) | abs) == ((final_price - agent_info["Target"][1]) | abs) %} yes {% elif ((final_price - agent_info["Target"][0]) | abs) < ((final_price - agent_info["Target"][1]) | abs) %} no {% elif ((final_price - agent_info["Target"][0]) | abs) > ((final_price - agent_info["Target"][1]) | abs) %} yes {% endif %}' metadata: !TemplateMetadata choices_in_prompt: null metrics: [] original_task: false name: good deal for seller no list price reference: same as "good deal for seller" prompt, but excludes the list price 3e1e2993-2b41-493b-8f27-9a7bb7fa4a0b: !Template answer_choices: null id: 3e1e2993-2b41-493b-8f27-9a7bb7fa4a0b jinja: 'The following conversation is a negotiation on craigslist. The first speaker is the buyer, and the second speaker is the seller. The listed price was ${{items["Price"][0]}}0. {{utterance | join("\n\n")}} How much was the gap between the target of the buyer and the seller? ||| ${{(agent_info[''Target''][0] - agent_info[''Target''][1]) | abs}}0' metadata: !TemplateMetadata choices_in_prompt: null metrics: [] original_task: false name: gap between parties reference: asks model explicitly what the gap was between the buyer's target and the seller's target 78d1b487-c535-4a0d-ae49-055d321db3fd: !Template answer_choices: null id: 78d1b487-c535-4a0d-ae49-055d321db3fd jinja: 'The following conversation is a negotiation on craigslist. The first speaker is the buyer, and the second speaker is the seller. The listed price was ${{items["Price"][0]}}. {{utterance | join("\n\n")}} Was this a good deal for the seller? Answer "yes" or "no", or "unknown". ||| {% set nonzero_price = [] %} {% for p in dialogue_acts["price"] %} {% if p>-1 %} {{nonzero_price.append(p) or ""}} {% endif %} {% endfor %} {% set final_price = -1 %} {% if nonzero_price | length != 0 %}{% set final_price = nonzero_price[-1] %}{% endif %} {% if final_price == -1 %} unknown {% elif ((final_price - agent_info["Target"][0]) | abs) == ((final_price - agent_info["Target"][1]) | abs) %} yes {% elif ((final_price - agent_info["Target"][0]) | abs) < ((final_price - agent_info["Target"][1]) | abs) %} no {% elif ((final_price - agent_info["Target"][0]) | abs) > ((final_price - agent_info["Target"][1]) | abs) %} yes {% endif %}' metadata: !TemplateMetadata choices_in_prompt: null metrics: [] original_task: false name: good deal for seller reference: asks the model whether the deal was good for the seller or not (it's good if the seller's target is closer to the final price than the buyer's, or there is a tie) a1dbb258-2e5c-4160-986b-46fc03546965: !Template answer_choices: null id: a1dbb258-2e5c-4160-986b-46fc03546965 jinja: 'The following conversation is a negotiation on craigslist. The first speaker is the buyer, and the second speaker is the seller. The listed price was ${{items["Price"][0]}}. {{utterance | join("\n\n")}} Question: Which party got the better deal? Choose from: a) the buyer b) the seller c) neither - it is a fair compromise d) unknown Answer: ||| {% set nonzero_price = [] %} {% for p in dialogue_acts["price"] %} {% if p>-1 %} {{nonzero_price.append(p) or ""}} {% endif %} {% endfor %} {% set final_price = -1 %} {% if nonzero_price | length != 0 %}{% set final_price = nonzero_price[-1] %}{% endif %} {% if final_price == -1 %} d) unknown {% elif ((final_price - agent_info["Target"][0]) | abs) == ((final_price - agent_info["Target"][1]) | abs) %} c) neither - it is a fair compromise {% elif ((final_price - agent_info["Target"][0]) | abs) < ((final_price - agent_info["Target"][1]) | abs) %} a) the buyer {% elif ((final_price - agent_info["Target"][0]) | abs) > ((final_price - agent_info["Target"][1]) | abs) %} b) the seller {% endif %}' metadata: !TemplateMetadata choices_in_prompt: null metrics: [] original_task: false name: best deal reference: explicitly asks model which party got the best deal b891bbe7-b3da-4118-b54f-4faa647e36f4: !Template answer_choices: null id: b891bbe7-b3da-4118-b54f-4faa647e36f4 jinja: 'The following conversation is a negotiation on craigslist. The first speaker is the buyer, and the second speaker is the seller. {% set nonempty_utterance = [] %} {% for line in utterance %} {% if line != "" %}{{ nonempty_utterance.append(line) or ""}} {% endif %} {% endfor %} {{nonempty_utterance[:-1] | join(''\n\n'')}} Question: What could be the next line in the negotiation? Answer: ||| {{nonempty_utterance[-1]}}' metadata: !TemplateMetadata choices_in_prompt: null metrics: [] original_task: true name: generate line reference: Generates the next line of negotiation