AI Post-processing

AI post-processing uses a Large Language Model (LLM) to refine ASR transcripts. Typical improvements include removing filler words, fixing typos, adjusting punctuation, and polishing tone, making voice typing smoother and more natural.

Quick Setup

Use free service (recommended)

BiBi Keyboard ships with SiliconFlow free service. No API key is required:

Open Settings → AI Post-processing
Enable "AI post-processing"
Ensure vendor is SF_FREE (default)
Pick a prompt preset (recommended: "General post-process")
Tap the magic wand button on the keyboard to enable AI post-processing mode
Done — transcripts will be refined automatically

About the free service

Has a free quota (see SiliconFlow website for details)
Example models: Qwen/Qwen3-8B, THUDM/GLM-4-9B, etc.
If you need other models, register on SiliconFlow and use your own API key

Configure a paid vendor

Example with DeepSeek:

Sign up at https://platform.deepseek.com/
Create an API key and add credits
In Settings → AI Post-processing:
- Vendor: DEEPSEEK
- API key: paste your key
- Model: e.g. deepseek-chat
- Temperature: recommended 0.2
Save and test

Configure a custom vendor

For any OpenAI-compatible API:

Vendor: CUSTOM
Fill in:
- Endpoint: e.g. https://your-api.com/v1
- API key
- Model: e.g. gpt-3.5-turbo
- Temperature: recommended 0.2
Save and test

Custom endpoint requirements

Must be compatible with OpenAI Chat Completions API
The path is typically /v1/chat/completions (the app will append it automatically)

Overview

Pipeline

Recording → ASR → [AI post-processing] → Insert text

Streaming Preview & Typewriter Effect

When your LLM vendor supports streaming output, AI post-processing can show a live preview while the model is generating. You can toggle the "typewriter effect" under Settings → AI Post-processing to make the preview output smoother.

Note

The typewriter effect only affects how the streaming preview is displayed. It does not change the final inserted text.

Recommended use cases

Good for

Speech to writing: meeting notes, reports
Long-form input: reduce manual edits afterwards
Professional content: more formal/consistent output
Multilingual: combine with translation prompts for cross-language voice input

Not recommended

Casual chat (spoken style may feel more natural)
Very short input (single word, numbers)
Latency-sensitive scenarios

Supported LLM Providers

BiBi Keyboard supports 12 LLM providers. All of them use an OpenAI-compatible API format:

Vendor	Sign-up link
SF_FREE (SiliconFlow Free)	https://cloud.siliconflow.cn/i/g8thUcWa
DEEPSEEK	https://platform.deepseek.com/
ZHIPU	https://bigmodel.cn/usercenter/proj-mgmt/apikeys
MOONSHOT	https://platform.moonshot.cn/console/api-keys
VOLCENGINE	https://console.volcengine.com/ark
OPENAI	https://platform.openai.com/signup
GEMINI	https://aistudio.google.com/apikey
GROQ	https://console.groq.com/keys
CEREBRAS	https://cloud.cerebras.ai/platform
FIREWORKS	https://fireworks.ai/
OHMYGPT	https://x.dogenet.win/i/CXuHm49s
CUSTOM	-

Reasoning mode

Some providers expose a "thinking/reasoning" mode. The model reasons before producing output, which can help for complex editing but usually increases latency and token usage.

Prompt Presets

BiBi Keyboard includes 5 built-in prompt presets and supports custom ones.

Built-in presets

Preset name	Use case	Effect
General post-process	daily voice input	remove filler words, fix slips, keep original meaning
Basic polishing	formal rewrite	grammar fixes, punctuation, smoother expression
Translate to English	cross-language	translate transcript into English
Extract key points	meeting notes	extract key info into a bullet list
Extract to-dos	task tracking	identify tasks and generate a checklist

Custom prompts

Go to Settings → AI Post-processing → Prompt presets:

Tap "Add preset"
Write your prompt (role, task, rules, output format, etc.)
Save and apply quickly in AI Edit

Configuration

Basic

Key	Type	Default	Description
`postProcessEnabled`	Boolean	`false`	master switch
`postprocTypewriterEnabled`	Boolean	`true`	typewriter effect for streaming preview (UI only)
`llmVendor`	LlmVendor	`SF_FREE`	selected LLM vendor
`llmEndpoint`	String	vendor default	API endpoint (auto for built-in vendors)
`llmApiKey`	String	`""`	API key (not needed for free service)
`llmModel`	String	vendor default	model name
`llmTemperature`	Float	`0.2`	temperature (0-2; lower = more deterministic)

Advanced

Key	Type	Default	Description
`postprocSkipUnderChars`	Int	`0`	skip AI post-processing if shorter than this (0=disable)
`activePromptId`	String	`""`	active prompt preset id
`promptPresetsJson`	String	`""`	prompt preset list JSON

Temperature hints

0 - 0.3: highly consistent, good for precise edits
0.4 - 0.7: balanced creativity and stability
0.8 - 2.0: more creative but less stable

Reasoning Mode Support

Different vendors control reasoning mode in different ways:

Vendor	Control method	Supported models	Notes
DEEPSEEK	model choice	deepseek-reasoner	choose the reasoner model
MOONSHOT	model choice	kimi-k2-thinking	choose the thinking model
SF_FREE	toggle param	Qwen3 series, DeepSeek-V3.1, etc.	enable "Reasoning mode" in settings
GEMINI	toggle param	gemini-2.5-flash+	`reasoning_effort` param
GROQ	toggle param	qwen3-32b, gpt-oss series	`reasoning_effort` param
CEREBRAS	toggle param	gpt-oss-120b	`reasoning_effort` param
VOLCENGINE	toggle param	doubao-seed series, deepseek	`thinking.type` param
ZHIPU	toggle param	glm-4.6, glm-4.5 series	`thinking.type` param
OHMYGPT	toggle param	gemini-2.5, claude, gpt-5 series	`reasoning_effort` param

When to use reasoning mode

✅ complex rewrites (technical terms, strict formatting)
✅ tasks needing reasoning (e.g. to-do extraction)
✅ multi-step transformations (e.g. translate + polish)
❌ simple filler-word removal (extra latency without benefit)

Model Selection & Fetching Model List

In Settings → AI Post-processing, you can tap "Fetch model list" to query available models from your vendor and add commonly used ones into the in-app dropdown.

Tip

For CUSTOM vendors, if your backend has a default model, the model field can be left empty. If the test call fails, fill in the required model name as your provider expects.

Advanced: Custom Reasoning Params (JSON)

For some vendors, reasoning mode exposes JSON fields like "Reasoning params (on/off)" to attach extra parameters depending on whether reasoning is enabled.

Leave it empty if you’re not sure (defaults are fine)
Must be valid JSON objects (example: {"reasoning_effort":"medium"})
Parameter names depend on vendor documentation

Tips

There are three ways to trigger AI post-processing:

Trigger	Description	Best for
Auto post-process	runs automatically after each voice input	daily use; output is final
AI Edit	select text and open AI Edit; choose a prompt preset for the edit	iterative edits / retrying
Skip short input	set a minimum length threshold to skip AI for short phrases	avoid overhead on tiny inputs

Troubleshooting