docs
Browse filesclarity, link to model/paper
app.py
CHANGED
|
@@ -14,9 +14,8 @@ from transformers.generation.logits_process import LogitsProcessor, LogitsProces
|
|
| 14 |
# ======================
|
| 15 |
MODEL_ID = os.getenv("MODEL_ID", "microsoft/UserLM-8b")
|
| 16 |
DEFAULT_SYSTEM_PROMPT = (
|
| 17 |
-
"You are a user who wants to
|
| 18 |
-
"
|
| 19 |
-
"The first two numbers in the sequence are 1 and 1."
|
| 20 |
)
|
| 21 |
|
| 22 |
# ======================
|
|
@@ -270,6 +269,7 @@ The AI plays the **user**, you play the **assistant**. Your messages appear on t
|
|
| 270 |
msg = gr.Textbox(
|
| 271 |
label="Your Reply (assistant)",
|
| 272 |
placeholder="Type your assistant response here…",
|
|
|
|
| 273 |
lines=2,
|
| 274 |
)
|
| 275 |
|
|
@@ -288,8 +288,8 @@ The AI plays the **user**, you play the **assistant**. Your messages appear on t
|
|
| 288 |
with gr.Accordion("Implementation Details", open=False):
|
| 289 |
gr.Markdown(
|
| 290 |
"""
|
| 291 |
-
- Decoding defaults from the model card: `temperature=1.0`, `top_p=0.8`, stop on `<|eot_id|>`, and block `<|endconversation|>`.
|
| 292 |
-
- Guardrails from Appendix C.1: (1) first-token logit filter, (2) block endconversation, (3) 3–25 word length, (4) verbatim repetition filter.
|
| 293 |
"""
|
| 294 |
)
|
| 295 |
|
|
|
|
| 14 |
# ======================
|
| 15 |
MODEL_ID = os.getenv("MODEL_ID", "microsoft/UserLM-8b")
|
| 16 |
DEFAULT_SYSTEM_PROMPT = (
|
| 17 |
+
"You are a user who wants to compute rolling 7-day averages over uneven time stamps. "
|
| 18 |
+
"You are suspicious of resampling magic and will accuse the assistant of witchcraft if it's not explicit."
|
|
|
|
| 19 |
)
|
| 20 |
|
| 21 |
# ======================
|
|
|
|
| 269 |
msg = gr.Textbox(
|
| 270 |
label="Your Reply (assistant)",
|
| 271 |
placeholder="Type your assistant response here…",
|
| 272 |
+
info="Leave blank & press _Generate_ to create the **first user message**.",
|
| 273 |
lines=2,
|
| 274 |
)
|
| 275 |
|
|
|
|
| 288 |
with gr.Accordion("Implementation Details", open=False):
|
| 289 |
gr.Markdown(
|
| 290 |
"""
|
| 291 |
+
- Decoding defaults from [the model card](https://hf.co/microsoft/UserLM-8b): `temperature=1.0`, `top_p=0.8`, stop on `<|eot_id|>`, and block `<|endconversation|>`.
|
| 292 |
+
- Guardrails from Appendix C.1 [of the paper](https://arxiv.org/abs/2510.06552): (1) first-token logit filter, (2) block endconversation, (3) 3–25 word length, (4) verbatim repetition filter.
|
| 293 |
"""
|
| 294 |
)
|
| 295 |
|