Coze
Official siteLow-code agent workflow platform for fast automation delivery.
OpenBack to template library
Gemini API Cost and Latency Balanced Query Workflow
OperationsCozeUpdated 2026-04-03
Automatically select Gemini's Flex or Priority inference tier based on budget and latency requirements, ensuring each query is cost‑effective while meeting performance targets.
System Prompt
Use {goal}, {cost_limit}, {latency_threshold}, {query_text} placeholders, not double braces.Variable Dictionary (fill in your AI tool)
This section only explains placeholders. It is not an input form on this website. Copy the prompt, then replace variables in Coze / Dify / ChatGPT.
{goal}The business objective of the query, e.g., "generate product description" or "answer customer question"
Filling hint: replace this with your real business context.
{cost_limit}Maximum allowed cost per request in USD
Filling hint: replace this with your real business context.
{latency_threshold}Desired maximum response latency in milliseconds
Filling hint: replace this with your real business context.
{query_text}The raw text or prompt to send to Gemini
Filling hint: replace this with your real business context.
Quick Variable Filler (Optional)
Fill variables below to generate a ready-to-run prompt in your browser.
{goal}The business objective of the query, e.g., "generate product description" or "answer customer question"
{cost_limit}Maximum allowed cost per request in USD
{latency_threshold}Desired maximum response latency in milliseconds
{query_text}The raw text or prompt to send to Gemini
Generated Prompt Preview
Missing: 4
Use {goal}, {cost_limit}, {latency_threshold}, {query_text} placeholders, not double braces.How to Use This Template
Best for
Teams that need faster operations output with more stable prompt quality.
Problem it solves
Reduces blank-page time, missing constraints, and inconsistent output structure from ad-hoc prompting.
Steps
- Copy the template prompt.
- Paste it into your AI tool (Coze / Dify / ChatGPT).
- Replace placeholder variables using the dictionary above.
- Run and refine constraints based on output quality.
Not ideal when
You need live web retrieval, database writes, or multi-step tool orchestration. Use full workflow automation for that.
Success Case
Input:
{goal: "generate product description", cost_limit: 0.05, latency_threshold: 200, query_text: "Describe a new eco-friendly water bottle."}
Output:
Gemini returns a high‑quality product description with an actual cost of $0.04 and latency of 180 ms.
Boundary Case
Input:
{goal: "generate product description", cost_limit: 0.01, latency_threshold: 50, query_text: "Describe a new eco-friendly water bottle."}
Fix:
Increase cost_limit or latency_threshold, or manually select the Priority inference tier.
What to Try Next
Keep exploring with similar templates and matching tools.
Continue Where You Left Off
No recent items yet.
Workflow Steps
1. Read {cost_limit} and {latency_threshold} to assess budget and performance needs.
2. If {cost_limit} is below the Flex cost threshold and {latency_threshold} is above the Flex latency threshold, choose Flex; otherwise choose Priority.
3. Build the Gemini API request, setting the tier parameter to the selected inference layer.
4. Send the request and wait for the response.
5. Log actual cost and latency; if they exceed thresholds, trigger an alert or automatically downgrade the tier.
Constraints
- cost_limit <= 0
- latency_threshold <= 0
- query_text is empty
Explore More in This Category
Operations
Similar Templates
Recommended Stack
Tools that work well with this template.