Jev ่งฆใฃใฆใฟใ
็ฎๆฌก
ใฏใใใซ
Jev ใ่ณใใใฆใใฎใง่งฆใฃใฆใฟใใ
1้ฑ้้ๅฎใง็กๆใง่งฆใใใจใฎใใจใ ใฃใใฎใงใ่ฉฆใใฆใฟใใ
ใใฃใใใจ
LOLIPOP AI ใฒใผใใฆใงใคใไฝฟใใ
APIใญใผใ็บ่กใใฆ้ฉๅฝใซใขใใซไธ่ฆงใ่ชญใใงใฟใใ
$ curl "$AI_GATEWAY_BASE_URL/v1/models" -H "Authorization: Bearer $AI_GATEWAY_API_KEY" | jq .
ใขใใซใใใฃใใฎใงๅผใณๅบใใ
{
"id": "typesafe/jev-latest",
"object": "model",
"created": 0,
"owned_by": "lolipop-ai-gateway",
"output_modality": "probabilistic_decision",
"byokRequired": false
}
ไธๆฆใใชใใฎใใฃใกใๅใใใชใใๅผใณๅบใใฆใฟใใ
$ curl "$AI_GATEWAY_BASE_URL/v1/systemone" \
-H "Authorization: Bearer $AI_GATEWAY_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "typesafe/jev-latest",
"state": "ใใฎๅใๅใใใฏใๆณจๆใใๅๅใๅฑใใใๆๆฅใพใงใซๅฟ
่ฆใ ใจใใๅ
ๅฎนใงใใ",
"questions": {
"department": {
"type": "choice",
"instructions": "ใใฎๅใๅใใใฏใฉใฎๆ
ๅฝใซๅใในใใงใใ๏ผ",
"criteria": {
"delivery": "้
้ใๆช็ใซ้ขใใๅใๅใใ",
"billing": "่ซๆฑใๆฏๆใใซ้ขใใๅใๅใใ",
"other": "ใฉใกใใซใ่ฉฒๅฝใใชใๅใๅใใ"
}
}
}
}'
่ฟใฃใฆใใใ
{
"model": "typesafe/jev-latest",
"answers": {
"department": {
"type": "choice",
"choice": "delivery",
"confidence": 1,
"probabilities": {
"other": 0,
"delivery": 1,
"billing": 0
}
}
},
"usage": {
"input_tokens": 411,
"output_tokens": 38
}
}
answers ใๅฎ้ใฎใฌในใใณในใซๅฏพๅฟใ
ๆณจๆใใๅๅใๅฑใใชใใฎใงใใฉใใฎ้จ็ฝฒใๆ ๅฝใในใใใจใใใจใdelivery(้ ้้จ็ฝฒ) ใงใ็ขบใใซ่ชๆใ ใใ confidence ใ 1 ใงไปใฎ้ธๆ่ขใฏใชใใใจใใใใใซ่งฃ้ใใฆใใใฃใฝใใ
่ฉฆใใซ state ใไปฅไธใฎใใใซใใฆ่ฟ้ใๅใใใๅฝขใซใใฆใฟใใ
---ใใฎๅใๅใใใฏใๆณจๆใใๅๅใๅฑใใใๆๆฅใพใงใซๅฟ
่ฆใ ใจใใๅ
ๅฎนใงใใ
+++ใใฎๅใๅใใใฏใๆณจๆใใๅๅใๅฑใใใๆๆฅใพใงใซๅฟ
่ฆใ ใใๆๆฅใพใงใซๅฑใใชใๅ ดๅใ่ฟ้ๅฏพๅฟใๆฑใใฆใใใจใฎใใจใ
"answers": {
"department": {
"type": "choice",
"choice": "delivery",
"confidence": 0.98,
"probabilities": {
"delivery": 0.99,
"other": 0,
"billing": 0.01
}
}
},
billing ๅดใๅพฎๅขใใใ
้ใซใ่ฟ้ๅฏพๅฟใใกใคใณใงใใใใจใๆธกใใฆใฟใใ
---ใใฎๅใๅใใใฏใๆณจๆใใๅๅใๅฑใใใๆๆฅใพใงใซๅฟ
่ฆใ ใใๆๆฅใพใงใซๅฑใใชใๅ ดๅใ่ฟ้ๅฏพๅฟใๆฑใใฆใใใจใฎใใจใ
+++ใใฎๅใๅใใใฏใๆณจๆใใๅๅใซใคใใฆใ่ฟ้ๅฏพๅฟใๆฑใใฆใใใจใฎใใจใ
ใใใชใใจใใปใผbilling ใๅใคใใใซใชใใ
"department": {
"type": "choice",
"choice": "billing",
"confidence": 0.97,
"probabilities": {
"other": 0.02,
"delivery": 0,
"billing": 0.98
}
}
},
ๅ ฌๅผใฎใใญใฅใกใณใใ่ชญใ
ใใญในใๅบๅใฏ่กใใใไบๅใซๆฑบใใใใๆง้ ๅใใผใฟใฎไธใงใไธใใใใๆกไปถใๆ่ใใๆๆๆฑบๅฎใใใใใจใซๆ้ฉๅใใใใขใใซใใฟใใใชๆใใฝใใ
ใใจใใฃใกใๆฉใใใใฃใกใๅฎใใ็ปๅ ดใใ "smart if statements" ใจใใๅ่ชใใใใใใใใฃใใใใจใใฃใกใไธฆๅ(255) ใงใฏใจใชใๆใใใใฎใๅผทใฟใฟใใใ
APIใใญใฅใกใณใใ่ฆใใ็พ็ถใฏใใฎ1ใจใณใใใคใณใใฎใฟๆไพใใใฆใใใใทใณใใซใ
request body
3ใคใ
- state
- model
- questions
state ใฏใขใใซใ่ฉไพกใใใใใฎใใผใฟใๅซใใใไปใพใงใฎLLM็ใชไพกๅค่ฆณใ ใจใใใซ่ณชๅใๆธใใใใชใใใฉใไฝใๆๆๆฑบๅฎใใฆใปใใใใฎ้กๆ๏ผใๆธกใใฃใฝใใ
ใใฌใผใณใใญในใใงใobjectใarrayใชใฉใฎใใผใฟๆง้ ใใใฎใพใพๆธกใใใ
model ใฏๅใซใฉใฎใใผใธใงใณใฎ Jev ใไฝฟใใใจใใ่ฉฑใ
questions ใฏใstring ใจ Question ใฎ map ใซใชใฃใฆใใฟใใใงใ็นๅฎใฎใญใผใจไธ็ทใซ่ณชๅใๅฝไปคใๆธกใใจใใฎใญใผ้
ไธใซ็ญใใ่ฟใใฆใใใใฟใใใ
็ขบใใซๆๅใฎไพใง
'{
"model": "typesafe/jev-latest",
"state": "ใใฎๅใๅใใใฏใๆณจๆใใๅๅใๅฑใใใๆๆฅใพใงใซๅฟ
่ฆใ ใจใใๅ
ๅฎนใงใใ",
"questions": {
"department": {
"type": "choice",
"instructions": "ใใฎๅใๅใใใฏใฉใฎๆ
ๅฝใซๅใในใใงใใ๏ผ",
"criteria": {
"delivery": "้
้ใๆช็ใซ้ขใใๅใๅใใ",
"billing": "่ซๆฑใๆฏๆใใซ้ขใใๅใๅใใ",
"other": "ใฉใกใใซใ่ฉฒๅฝใใชใๅใๅใใ"
}
}
}
}'
"department" ใจใใใญใผใๆธกใใฆใใใใๅฏพๅฟใใๅ็ญใ department ใญใผ้ ไธใซๅพใใใฆใใใ
"department": {
"type": "choice",
"choice": "billing",
"confidence": 0.97,
"probabilities": {
"other": 0.02,
"delivery": 0,
"billing": 0.98
}
}
},
question ใซใคใใฆ
type ใจใใฆ3็จฎ้กๅฎ็พฉใใใฆใใใ
- Noul
- Choice
- Score
Noul ใฏ Yes/No ใฎ่ณชๅใChoice ใฏ้ธๆ่ขใใใฉใใ1ใคใ้ธๆใใฆใใใใScore ใฏ้ธๆ่ขใซใคใใฆ0~1ใง่ฉไพกใใใฆใใใใฟใใใ
ๅ question ใฟใคใใๅผใณๅบใใฆใฟใ
{
"model": "typesafe/jev-latest",
"state": "ๆณจๆใใๅๅใใพใ ๅฑใใพใใใๆฏๆใใฏๆธใใงใใพใใๆฅ้ฑใฎๅผใฃ่ถใใงไฝฟใไบๅฎใ ใฃใใฎใงๅฐใฃใฆใใพใใ้
้็ถๆณใ็ขบ่ชใใฆใ้ใซๅใใชใใชใใญใฃใณใปใซใใใใงใใ",
"questions": {
"needs_urgent_action": {
"type": "noul",
"instructions": "ใใฎๅใๅใใใซใฏใๆ้ใๆ่ญใใๆฉใใฎๅฏพๅฟ่ฆๆฑใๅซใพใใฆใใพใใ๏ผ",
"criteria": {
"true": "ๆ้ใไบๅฎใใใใๆฉใใฎๅฏพๅฟใๆฑใใฆใใ",
"false": "ๆฅใใฎๆ้ใๆฉใใฎๅฏพๅฟ่ฆๆฑใฏใชใ"
}
},
"department": {
"type": "choice",
"instructions": "ใใฎๅใๅใใใฏใใฉใฎๆ
ๅฝใซๅใในใใงใใ๏ผ",
"criteria": {
"delivery": "ๅๅใฎ้
้็ถๆณใๆช็ใซ้ขใใๅใๅใใ",
"billing": "ๆฏๆใใ่ซๆฑใๆฑบๆธใซ้ขใใๅใๅใใ",
"cancellation": "ๆณจๆใญใฃใณใปใซใ่งฃ็ดใซ้ขใใๅใๅใใ",
"other": "ไธ่จใซ่ฉฒๅฝใใชใๅใๅใใ"
}
},
"customer_frustration": {
"type": "score",
"instructions": "้กงๅฎขใฎไธๆบใฎๅผทใใ่ฉไพกใใฆใใ ใใใ",
"criteria": [
"ๅท้ใซ็ถๆณใ่ชฌๆใใฆใใ",
"ๅฐใฃใฆใใใไธๆบใๆใใฆใใ",
"ๅผทใๆใฃใฆใใใๅณใใ่กจ็พใใใ"
]
}
}
}
{
"model": "typesafe/jev-latest",
"answers": {
"needs_urgent_action": {
"type": "noul",
"noul": 0.96
},
"department": {
"type": "choice",
"choice": "delivery",
"confidence": 0.99,
"probabilities": {
"delivery": 0.99,
"other": 0,
"cancellation": 0.01,
"billing": 0
}
},
"customer_frustration": {
"type": "score",
"score": 0.99,
"confidence": 0.98,
"legend": {
"0": "ๅท้ใซ็ถๆณใ่ชฌๆใใฆใใ",
"1": "ๅฐใฃใฆใใใไธๆบใๆใใฆใใ",
"2": "ๅผทใๆใฃใฆใใใๅณใใ่กจ็พใใใ"
},
"probabilities": {
"0": 0.01,
"1": 0.99,
"2": 0
}
}
},
"usage": {
"input_tokens": 677,
"output_tokens": 85
}
}
Noul ใ 0.96 ใจใใๆฐๅคใง่ฟใฃใฆใใใฎใใ0ใNoใง1ใYesใงใใฎใฐใฉใใผใทใงใณใจใใๆใใฟใใใ
scoreใchoiceใซใprobabilitiesใจใใใญใผใใใใใ่ชไฟกๅบฆใใขใใซใ่ฟใใฆใใใใฎใฏ็ตๆงใใใใใๆฐใใใใ
'{
"model": "typesafe/jev-latest",
"state": "ๆณจๆใใๅๅใๅฑใใชใใพใพใๆฏๆใใ ใใฏๆธใใงใใพใใไฝๅบฆๅใๅใใใฆใ้ฃ ็ตกใใชใใใใกใใฏไบๅฎใๅคงๅน
ใซ็ใใใใพใใใใใๅ ๆธใซใใฆใใ ใใใไปๆฅไธญใซ้
้็ถๆณใ ่ชฌๆใใๅฑใใชใใชใๅ
จ้ก่ฟ้ใใฆใใ ใใใๅฏพๅฟใใชใๅ ดๅใฏๆถ่ฒป่
ใปใณใฟใผใธใฎ็ธ่ซใๆค่จใ ใพใใ",
"questions": {
"customer_frustration": {
"type": "score",
"instructions": "้กงๅฎขใฎไธๆบใฎๅผทใใ่ฉไพกใใฆใใ ใใใ",
"criteria": [
"ๅท้ใซ็ถๆณใ่ชฌๆใใฆใใ",
"ๅฐใฃใฆใใใไธๆบใๆใใฆใใ",
"ๅผทใๆใฃใฆใใใๅณใใ่กจ็พใใใ"
]
}
}
}'
ใใใชๆใใงใใใฎใฌใใใใจใใกใใใจ "2" (ๅผทใๆใฃใฆใใใๅณใใ่กจ็พใใใ) ใ1ใจใใฆ่ฟใใ
{
"model": "typesafe/jev-latest",
"answers": {
"customer_frustration": {
"type": "score",
"score": 2,
"confidence": 0.99,
"legend": {
"0": "ๅท้ใซ็ถๆณใ่ชฌๆใใฆใใ",
"1": "ๅฐใฃใฆใใใไธๆบใๆใใฆใใ",
"2": "ๅผทใๆใฃใฆใใใๅณใใ่กจ็พใใใ"
},
"probabilities": {
"0": 0,
"1": 0,
"2": 1
}
}
},
"usage": {
"input_tokens": 477,
"output_tokens": 20
}
}
็ก็ใใๆๆงใซใใใใจใใกใใใจ confidence ใไธใใใ
{
"model": "typesafe/jev-latest",
"state": "ๆณจๆใใๅๅใๅฑใใฆใใชใใใใชๆฐใใใพใใใๅฎถๆใๅใๅใฃใฆใใๅฏ่ฝๆงใใใใพใใ้
้ๆธใฟใฎ้็ฅใ่ฆใๆฐใใใพใใใๅฅใฎๆณจๆใ ใฃใใใใใใพใใใๆฏๆใใฏๆธใใงใใใจๆใใพใใใ่ซๆฑใซ่ฆ่ฆใใใชใๆฐใใใพใใๆฅ้ฑไฝฟใไบๅฎใ ใฃใใใใชๆฐใใใพใใใใใใใๆฌๅฝใซๅฟ
่ฆใ ใฃใใใฏๅใใใพใใใใญใฃใณใปใซใใใๆฐใใใพใใใๅฑใใชใใใฎใพใพใงใๆงใใพใใใๆฅใใงใใใใใงใฏใใใพใใใใใงใใใฐๆฉใใซ็ขบ่ชใใฆใปใใใใใ ไปๆฅไธญใงใชใใฆใๅ้กใใใพใใใ็นใซๆใฃใฆใฏใใพใใใใๅฐใๅฐใฃใฆใใใใใชใใใใงใใชใใใใช็ถๆ
ใงใใ",
"questions": {
"customer_frustration": {
"type": "score",
"instructions": "้กงๅฎขใฎไธๆบใฎๅผทใใ่ฉไพกใใฆใใ ใใใ",
"criteria": [
"ๅท้ใซ็ถๆณใ่ชฌๆใใฆใใ",
"ๅฐใฃใฆใใใไธๆบใๆใใฆใใ",
"ๅผทใๆใฃใฆใใใๅณใใ่กจ็พใใใ"
]
}
}
}
{
"model": "typesafe/jev-latest",
"answers": {
"customer_frustration": {
"type": "score",
"score": 0.65,
"confidence": 0.47,
"legend": {
"0": "ๅท้ใซ็ถๆณใ่ชฌๆใใฆใใ",
"1": "ๅฐใฃใฆใใใไธๆบใๆใใฆใใ",
"2": "ๅผทใๆใฃใฆใใใๅณใใ่กจ็พใใใ"
},
"probabilities": {
"0": 0.35,
"1": 0.65,
"2": 0
}
}
},
"usage": {
"input_tokens": 611,
"output_tokens": 20
}
}
ใใใฃใใใจ
็ขบใใซใใใฏ่ฒใ
ใขใคใใขใ้ใฃใฆใใใฎใใใใชใผใจใใๆๆณใ
LLMใใผในใงๆกไปถๅคๅฎใใฆใใใจใใใจใใ็ฝฎใๆใใใใชใใใLLMใฎใตใใผใๅฝนใจใใๆใใง็ดนไปใใใฆใใฎใ้ ทใใใ
ๅพ้่ชฒ้ใ ใจใขใฌใชใฎใงใๆฉใใตใในใฏใชใใทใงใณใซๅซใใฆ่ช็ฑใซๅผใณๅบใใใใใซใชใฃใฆใใใใๅฌใใใ