Under the wave of smart home appliances, air‑conditioners have become a core entry point for whole‑home intelligence.
- ● Noise‑interference recognition failures — wind noise and ambient noise lead to no response even when speaking loudly
- ● Rigid fixed commands — only basic operations such as “turn on/off” or “adjust temperature” are supported; natural‑language expressions like “It’s so hot today” cannot be understood
Traditional offline‑voice solutions can only recognize fixed word lists and cannot comprehend natural‑language input. Pure‑cloud‑based solutions bring high latency, network dependency and privacy risks. A hybrid offline‑online architecture — handling high‑frequency quick commands and pre‑processing voice locally while leveraging cloud‑based large‑language models for complex‑intention processing — emerges as the optimal path for air‑conditioner voice interaction.
Existing Pain Points
- Remote‑control hassle: groping for physical buttons in darkness
- Noise interference: recognition failures under loud ambient noise
- Fixed‑command limitation: only preset phrases can be parsed
- No‑interruption restriction: cannot interrupt ongoing voice announcements
- Cloud‑privacy concerns: continuous audio recording and cloud uploading
Chipintelli Hybrid Offline‑Online LLM Solution
- Wake‑up: direct speech‑driven control
- DNN‑based noise reduction: accurate recognition under heavy noise
- LLM‑powered comprehension: natural‑language interaction
- Real‑time interruption: send new commands while announcements are playing
- On‑device VAD: only valid‑voice segments are uploaded to the cloud
Hybrid Offline‑Online Collaborative Workflow: Balancing Basic Control and Rich Content Generation
This solution is built around the Chipintelli CI1306 neural‑network voice chip, adopting an on‑device processing + cloud LLM hybrid offline‑online architecture.
- The CI1306 chip delivers DNN‑powered local voice wake‑up & recognition, deep‑level noise reduction, voice‑activity detection, custom command‑word learning, acoustic echo cancellation, sound‑source localization. It also supports Speex / Opus audio compression and MP3 streaming playback.
- The CI1306 chip communicates with the Wi‑Fi chip via high‑speed serial ports. The Wi‑Fi chip caches and uploads voice data to the cloud, and receives cloud‑generated replies for downstream delivery.
- Cloud‑based large‑language models undertake natural‑language understanding, complex‑intention resolution and content generation. Synthesized replies are sent back to the voice chip for audio playback. This solution supports integration with mainstream LLMs including Doubao, ChatGPT, ERNIE Bot and DeepSeek, delivering outstanding compatibility.
Five Core Advantages of the CI1306 Chip for Full‑Scenario Household Air‑Conditioner Interaction1. Voice Wake‑up: Remote‑control‑free operation with privacy protection
Built‑in DNN‑driven on‑device VAD algorithms on the CI1306 chip activate air‑conditioner voice interaction upon wake‑word trigger. Only valid‑voice segments get uploaded to the cloud; no recording or uploading occurs during silent periods, fundamentally eliminating privacy risks from persistent recording.
Moreover, the DNN‑VAD algorithm accurately filters various ambient noises including steady‑state noise, non‑steady‑state noise and human‑voice‑like interference, avoiding meaningless cloud‑triggered responses.
2. Real‑time response with zero‑wait interaction
Basic air‑conditioner control commands (power on/off, temperature adjustment, mode switching etc.) are processed locally on CI1306 offline ASR, achieving end‑to‑end latency below 500 ms for instant execution. Only complex natural‑language requests are forwarded to the cloud. On‑device noise suppression and data compression reduce upload payload for faster cloud inference.
3. Accurate recognition in noisy environments
Adopting DNN deep‑noise‑reduction technology, the CI1306 chip separates human speech from air‑conditioner fan noise and background interference. High recognition accuracy is maintained even when the air‑conditioner runs at maximum fan speed.
4. Conversational real‑time interruption
Combining Acoustic Echo Cancellation (AEC) and VAD modules, the CI1306 chip detects user speech during device announcements. Users can interrupt ongoing audio and issue new instructions directly, delivering human‑like conversational experience.
5. User‑direction detection for anti‑blow‑direct‑air function
Supporting dual‑microphone sound‑source localization powered by DNN algorithms, the chip identifies the user’s speaking direction. It amplifies voice signals from the user while suppressing noise from other directions to realize long‑distance high‑accuracy recognition. It can also link with the air‑conditioner hardware to automatically avoid blowing air directly toward users.
Circuit workflow description:
- Audio capture: Dual microphones (MIC_R / MIC_L) feed audio into CI1306 via codec. The codec also provides reference signals for acoustic echo cancellation.
- On‑chip processing: CI1306 completes on‑device tasks including wake‑up, speech recognition, noise reduction and AEC.
- Inter‑module communication: CI1306 exchanges bidirectional data with the Wi‑Fi module over UART TX/UART RX for voice upload and TTS download. It also communicates with the Air‑Conditioner MCU via UART to transmit control commands and report device status.
- Audio output: CI1306 sends reference signals via the HPOUT port through the codec. The PA power amplifier drives the loudspeaker for audio playback.
- Cloud‑model access: The Wi‑Fi module connects with mainstream LLMs such as Doubao, ChatGPT, ERNIE Bot and DeepSeek for flexible deployment.
This solution has been adopted by leading air‑conditioner brands and achieved million‑level sales volume, validated by mass‑production deployment and real‑world user‑scenario tests.
Chipintelli has ten‑year expertise in intelligent‑voice industry. We deliver full‑stack hardware‑and‑software support: hardware reference design, voice‑algorithm firmware, on‑device SDK, cloud‑model integration guidance and more. Air‑conditioner manufacturers can rapidly launch differentiated smart products. Inquiries are welcome.