Search models, users, collections, and posts

Realtime AI Fish (Big Mouth Billy Bass) Backplate

Print Profile(2)

All
P1S
P1P
X1
X1 Carbon
X1E

Raspberry Pi 5
Raspberry Pi 5
Designer
5.5 h
2 plates
5.0(4)

Raspberry Pi Zero2w
Raspberry Pi Zero2w
Designer
5.3 h
2 plates

Open in Bambu Studio
Boost
58
126
8
13
105
32
Released 

Description


This project turns a ‘dumb’ Big Mouth Billy Bass into a real-time conversation partner using a Raspberry Pi 5.
It streams audio conversations to and from OpenAI’s GPT-4o-mini model, turns its head, flaps its tail and moves his mouth in sync with his speech.

 

You can trigger a conversation with Billy by pressing it's button. He’ll play one of the short wake-up phrases (which are also customisable) , then listen to your question or conversation. His personality and backstory can be adjusted via simple configuration files. It also supports MQTT, so you can integrate it with Home Assistant or other systems based on Billy's status (listening, speaking, idle).

In my situation I have an Home Assistant Automation that enables the smart plug which powers Billy when motion is detected and turns the lights in the bathroom blue when Billy is activated. When there is no motion detected in the bathroom HA will send a MQTT command after a few minutes to safely shut down the raspberry pi and turn off the smart plug.
 

Billy can be prompted to play a custom song and if the corresponding folder exists under sounds/songs/, he will:

  • Play the main track via his speaker.
  • Sync his mouth movement using a separate vocals track.
  • Flap his tail in rhythm with a drums track.
  • Optionally move his head at scheduled moments in the song, defined in a metadata.txt file.

⚠️ For more information check out the README  

Printing Instructions:

The project file includes a custom 3D-printed backplate that houses a Raspberry pi 5 (use an active cooler for the Raspberry Pi),  an USB speaker and USB microphone neatly behind Billy in it's original housing. It can be hung up the wall via the french cleat that can be mounted with screws or double sided (mounting) tape. 


I recommend printing in PETG but PLA should also work fine. In that case keep an extra eye out on the temperature of the pi.
To keep somewhat of an airflow going on; don't manually close up the ‘holes’ in the walls of the existing housing.

Build instructions

Bill of Materials:

PartEUGlobal
Big Mouth Billy BassAmazon 
Raspberry Pi 5 (4gb RAM or more recommended)Kiwi Electronics 
Raspberry Pi Power Supply 45WKiwi Electronics 
MicroSD card ( for Raspberry OS Lite)Kiwi Electronics 
Raspberry Pi Active CoolerKiwi Electronics 
1x USB SpeakerAmazonAliExpress
1x USB MicrophoneAmazonAliExpress
1x L298N Motor DriverAmazonAliExpress
Jumper Wires / Dupont CablesAmazonAliExpress
*JST 2.54 4 pin connector (female)AmazonAliExpress


 

Boost Me (for free)

If you'd to support like this project, consider boosting it :)


 

 

Comment & Rating (8)

(0/1000)

License

This user content is licensed under a Standard Digital File License.

You shall not share, sub-license, sell, rent, host, transfer, or distribute in any way the digital or 3D printed versions of this object, nor any other derivative work of this object in its digital or physical format (including - but not limited to - remixes of this object, and hosting on other digital platforms). The objects may not be used without permission in any way whatsoever in which you charge money, or collect fees.