Make songs locally in ComfyUI - and see exactly what the music model is given. Describe a song and a local language model writes it. YuE2 or MiniMax Music 3 performs it, Plenio masters it and exports it with tags, cover art and a record of how it was made. You can also turn an existing recording into a new version of itself, compose the score yourself, split a finished song into stems to rebalance it, or finish and master a file you already have.
Everything runs on your own machine, inside ComfyUI's own nodes: no cloud service, no API key, no extra Python packages. Before a single note is rendered, the Song Sheet shows you the title, style, lyrics and score that the model will receive. You can edit all of them, and your edits are never silently overwritten.
Two short video walkthroughs (about 6 minutes each, English subtitles), recorded in ComfyUI with the real models: one run straight through, then one with both review stops - checking the lyrics, editing the score, approving and rendering.
Tutorial 1 · YuE2 · Song Write a song from a brief, review the lyrics, edit the score in the piano roll, render and master it. |
Tutorial 2 · YuE2 · Cover Turn a recording into a new version: an instrumental cover, then one with the original lyrics and both review stops. |
🎧 Open the demo gallery - 30 songs made with Plenio 0.2.2 and YuE2 (one per genre, straight out of the templates), 35 MiniMax Music 3 songs and 8 cover versions, with search, filters and everything the model received for each track.
🔊 SoundCloud playlist · a sample file with its full prompt report: assets/sound-samples
The demos were made with the same music models by Plenio's predecessor, the Music Production Toolkit (see Coming from the Music Production Toolkit?).
What is new: one clear path per model, and nothing hidden
Plenio is a rewrite from scratch, not a new version of the toolkit. It keeps what worked, the models, the prompt library and the mastering algorithms, and changes how everything fits together:
- One template per music model. YuE2 · Song, YuE2 · Cover and MiniMax · Song each show only the controls that apply to them. There is no model switch that half the nodes ignore.
- Two ways to work, chosen first in the brief. New song every run turns one brief into a whole series: set the number of runs, press Run once, and every run writes and renders a different song. One song, stop to review is for the song you want to get right: the run stops at the Song Sheets so you can check and edit the text and the score before anything is rendered, and every later run is a new take of the approved song.
- The Song Sheet: what you see is what the model gets. Every document that conditions the music (title, style or caption, lyrics, score) passes through one sheet. Each document is automatic, edited or manual. Manual text is never replaced. If the draft changes under an edit, the run stops and asks instead of guessing. When a sheet stops for review, nothing is rendered until you approve exactly what you saw.
- A real score editor. YuE2's score is ABC notation, and the Song Sheet opens it as notation, as a piano roll and as ABC text, with playback. Draw, move and resize notes, set chord symbols in the chord lane, work through the bar inspector (bars, meter, key changes), and export or import MIDI. Every edit is checked by the same parser the model uses; a malformed text is refused with a reason and can be reverted.
- Arrange like in a DAW (0.4.0). Copy, move and delete whole sections in the section list, as on Cubase's arranger track. A cursor in the ruler sets where playback and paste start, and Ctrl+V / Ctrl+Shift+V paste at it, overwriting or inserting time. The Guide track, the lyrics and, in covers, the original words and the source recording's times follow every arrangement. The lyrics stand over the notes they are sung on and are edited right there. The sheet music goes out as MusicXML, and a project file keeps the score, the Guide notes and the lyrics to go on later.
- Or write the score yourself. 5 · YuE2 · DAW is the song template for composing: an all-rest score is built from the brief, you draw the melody and the chords, and YuE2 renders exactly what you approved. The Guide track plays with the sheet but is never sent to the model.
- Covers from the actual music. SheetSage2 reads the score out of your recording and keeps its beat grid. faster-whisper transcribes the sung words and places them into the score's sections. You choose instrumental, original lyrics or new lyrics (written to the phrasing of the original), and whether the harmony stays.
- After the render, before the master. Refine (48 kHz) can extend a band-limited render with a super-resolution model or just resample it; Stems splits a song into vocals, drums, bass and other and mixes them back with a residual that keeps a neutral mix exact. Both are optional blocks in every template, bypassed until you switch them on.
- Finishing built in. Every song template ends in Plenio · Master: a gentle tone match, compression and a true-peak limiter to -14 LUFS / -1 dBTP. Export writes FLAC 24-bit, MP3 V0 or WAV 32-bit float with tags and embedded cover art, the unmastered take, and a release record of the documents, seeds, settings, loudness and model licences.
- Native ComfyUI all the way. Generation, loaders, samplers, loops and downloads are ComfyUI's own nodes. Plenio adds 18 small nodes where ComfyUI has nothing equivalent (the predecessor had 55). ComfyUI manages GPU memory and offers missing model downloads itself.
Open them from ComfyUI's template browser (listed under this package's name):
| Template | For |
|---|---|
| 0 · System Check | versions, GPUs, which model files each template still needs, and a hardware table with your row marked |
| 1 · YuE2 · Song | new songs with YuE2, sung or instrumental, with an editable score (guide) |
| 2 · YuE2 · Cover | a new version of a recording you own or may use: instrumental, original or new lyrics (guide) |
| 3 · MiniMax · Song | new songs with MiniMax Music 3 and its structured caption (guide) |
| 4 · Enhance & Master | EQ, loudness and export for a file you already have; runs on the CPU (guide) |
| 5 · YuE2 · DAW | compose the score yourself: piano roll, chord symbols and the Guide track (guide) |
Every template reads left to right in numbered groups: SONG → WRITE → SHEET → RENDER → FINISH (the DAW template adds DAW and FINISH groups of its own). An About this template note explains the path in a few steps, and optional blocks (Cover Art, the instrumental adapter, Refine, Stems) are marked (optional) and switched off until you want them. All six templates also run as a simple form in ComfyUI's App mode; the Song Sheet buttons work there too, so you can review and edit without the graph.
The first field of the Song Brief (and of the Cover Brief) is the mode:
| Mode | What a run does | Use it for |
|---|---|---|
| new song every run (song default) | writes and renders a different song from the same brief every time - its own title, story and hook - without stopping. Set Number of runs in App mode, or the batch count next to Run, and one click makes a whole series; every song is exported under its own name. | many songs in one style, finding ideas, overnight batches |
| one song, stop to review | stops at the Song Sheets: check or edit title, style, lyrics and (YuE2) the score, press Approve, run again. After that every run is a new take of the same approved song. | the one song you want to get right |
Where the run stands is shown on the nodes: before a run every Song Sheet that will stop carries ⏸ review stop; after a run each Plenio node shows ✓, ⚠ or ✖, and the sheet where the run waits shows ⏸ waiting for your approval with an amber frame (and a message says what to do). The line under the sheet's button says the same in App mode.
The cover template has the same choice (one cover, stop to review is its default; new cover every run writes a new version - title, style and, with new lyrics, the lyrics - on the same transcription every time). The Song Sheets follow the brief (review: as the brief says); you can still set a single sheet to continue or stop for review.
1 · YuE2 · Song: the brief on the left, the writer and the Song Sheets in the middle, render, mastering and export on the right; the model block and the optional Stems, Refine and Cover Art blocks sit below.
App mode - the same templates as a simple form, without the graph:
| 1 · YuE2 · Song | 3 · MiniMax · Song | 4 · Enhance & Master |
|---|---|---|
 |
 |
 |
Since 0.2.2 the apps also show the mode and the Song Sheet buttons, and 2 · YuE2 · Cover has an app too.
- Open 1 · YuE2 · Song or 3 · MiniMax · Song. ComfyUI offers to download missing model files.
- Choose the mode in the Song Brief (see Two ways to work).
- Fill in the brief: pick one of about 240 genre templates or describe your own idea; set mood, tempo, length (1:00 to 6:00), vocals (language, voice, theme) or instrumental.
- Queue. The writer (Gemma 4 through ComfyUI's native text generation) drafts title, style and lyrics; YuE2 plans a score; the Song Sheets show both.
- New song every run: every further run is the next song of the series (set the Draft seed to randomize for even more variety). One song, stop to review: approve the sheets, then every further run is a new take - the take seed changes, the draft and the plan stay cached and your edits stay valid.
- Open 2 · YuE2 · Cover and load the source recording.
- Choose the mode, the target style in the Cover Brief, the vocals (instrumental by default, the instrument plays the vocal melody) and the harmony.
- Queue: with one cover, stop to review the run stops at Song Sheet · Score and later at Song Sheet · Text, so you can inspect and edit the transcribed score and the lyrics before YuE2 renders. With new cover every run it renders straight through, a new version every run.
2 · YuE2 · Cover: source and Cover Brief, then Song Sheet · Score and Song Sheet · Text with their review stops, render, mastering and export.
Open a Song Sheet and choose the score tab. The piano roll draws, moves and resizes notes (Review mode: into rests, Alt to overwrite) and in its Select mode frames several notes at once, the chord lane takes chord symbols, the inspector handles the bar the selection starts in (insert, duplicate, delete, meter, key changes), and the notation and the ABC text stay in sync with the selection. Export MIDI writes the score (and the Guide notes) as a type-1 file; Import MIDI… shows the file's tracks with a role each, its grid and what the import would change before it replaces anything - and can read chord symbols from a Chords track. Undo and redo work, and every result is validated before it is kept.
Since 0.4.0 the editor also arranges. Select sections in the list and duplicate (Ctrl+D), copy, move (Ctrl+↑/↓ or drag; Alt copies) or delete them. Click in the ruler to set the cursor: playback starts there, and Ctrl+V pastes the clipboard there, overwriting the notes of its voices, while Ctrl+Shift+V inserts it and moves what follows. When the song has lyrics, a lyrics lane shows every line over the phrase it is sung on, and a double-click edits it; the notation shows the syllables under the notes. Export MusicXML hands the sheet music to MuseScore, Sibelius, Dorico or Cubase, and Save project / Open project… keeps the score, the Guide notes and the lyrics in one file. See the score editor guide.
The score tab of a Song Sheet in the DAW layout: the piano roll with the chord lane on top (here in Select mode, six framed notes marked in the roll and in the notation), the tracks (Vocal, Instrument, Chords and the Guide track that never reaches YuE2), the notation in sync with the roll, MIDI export and import, and playback with loop and metronome.
Open 5 · YuE2 · DAW, describe the song in the brief and run once: Score Tools builds an empty score in the right length, meter and key, and the run stops at the sheet. Draw the notes, set the chords, split the score into sections - and run again: YuE2 renders exactly the score you approved. The fourth track, Guide, is played with the sheet for timing but never sent to the model (guide).
The same brief and writer, one Song Sheet with the structured caption (Global Metadata, Vocal Details, Arrangement) and the lyrics; the sheet checks the exact 5,000-token prompt budget with the model's own tokenizer before rendering.
3 · MiniMax · Song: one Song Sheet between the writer and the MiniMax Music 3 render.
4 · Enhance & Master: load a file, shape it with the EQ (manual bands with the curve, or tone match), set the loudness target and export with the file's own tags and cover.
Both blocks sit between the render and the master and are bypassed until you switch them on (Ctrl+B selects a block).
- Stems: Separate Stems splits the song into up to four stems (vocals, drums, bass, other) and keeps the residual as the strip rest, so a neutral Stem Mixer returns the song unchanged - separation errors can only affect what you change yourself. The mixer has a fader, mute/solo, compression and reverb/delay sends per strip, you drag muted time ranges directly on the strip's waveform, and save writes a strip as its own 24-bit FLAC. The mixer is inside the block: open it with the icon at the top right of the node. The mixdown is not normalised; Plenio · Master sets the loudness. Needs the BS-RoFormer checkpoint (527 MB,
models/audio_separation). Details - Refine (48 kHz): brings a render to 48 kHz and extends the top octaves with a super-resolution model (UniverSR, 229 MB,
models/audio_sr), keeping everything below the crossover from the original. A preset sets what the model sees, where it takes over and how its result is rolled off in one go; the model runs whenever it is connected, and for material that already reaches the top of the band the report says that only the content above the crossover changed. On by default in 3 · MiniMax · Song, bypassed elsewhere - switch it on for old MP3s or phone recordings in 4 · Enhance & Master. Both stages are experimental: the measurements are in, the owner's listening verdicts are open (see the status §5). Details
The Stem Mixer before its first run: the four documented stems and the residual "rest", each with fader, mute/solo, compression, the two sends and a save switch; the waveform under each strip fills with the separation, and the reverb and delay buses sit below.
- EQ: up to 8 parametric bands edited directly on the response curve - drag a handle for frequency and gain, use the wheel for Q, type exact values into the band strip - with presets, undo/redo and the last run's spectrum behind the curve; or tone match: a gentle tilt (warm, bright) or the long-term spectrum of a reference recording, within a maximum gain you set.
- Loudness & Dynamics: BS.1770-4 loudness, EBU loudness range, 4x oversampled true peak; a soft-knee compressor and a lookahead true-peak limiter. The default target is -14 LUFS / -1 dBTP, and the result is measured and reported. If the target cannot be reached within the gain and limiter budgets, you get the best result within them and a note.
- Export Release: FLAC 24-bit, MP3 V0 (above 48 kHz converted for the MP3 only), WAV 32-bit float; title, artist, album, date, track, genre, comment, album artist and composer, typed or copied from the loaded file. Cover art - from the optional Cover Art block, or copied from the loaded file - is embedded in the FLAC and MP3 files (whichever tag option you choose) and saved next to them as
.jpg; WAV keeps the.jpgonly. Every export also writes a.plenio.jsonrelease record.
The EQ node's panel: each band is a handle on the curve, the strip below lists the bands and opens an inline editor for type, frequency, gain and Q; presets, the gain range, undo/redo and compare sit above the curve.
Details and limits: Mastering and audio formats.
The 0 · System Check template reads your GPU and marks your row. Nothing is switched automatically; you choose the model files in the loaders.
0 · System Check: versions, GPU and memory, which model files each template has or still needs, and the hardware table with this machine's row marked.
| GPU memory | YuE2 | MiniMax Music 3 | Cover Art (FLUX.2 Klein 4B) |
|---|---|---|---|
| below 8 GB | only with heavy offloading (the int8 model alone is 4 GB): very slow, keep songs short | only with heavy offloading: very slow | not practical |
| 8-12 GB | int8 checkpoint (template default); keep songs short | int8 DiT minimax_music3_dit_int8_convrot (2.5 GB) and tiled decode |
flux-2-klein-4b-fp8 with the text encoder qwen_3_4b_fp4_flux2 |
| 12-16 GB | int8 checkpoint (template default) | the defaults may offload; the int8 DiT is the safer choice | fp8 model and fp4 text encoder |
| 16-24 GB | int8 checkpoint with the Gemma 4 E4B writer | template defaults (fp16 DiT, int8 text encoder) | template defaults (bf16) |
| 24 GB and more | the bf16 checkpoint yue2_3b_bf16 (7.8 GB) is possible; int8 stays the faster default |
template defaults | template defaults |
YuE2 is measured on a 16 GB RTX 5060 Ti; the other rows come from model sizes and the predecessor toolkit's ratings. 4 · Enhance & Master needs no GPU. See Models and downloads for every file, folder and size.
Requires ComfyUI 0.37.0 or newer; it provides the native YuE2, SheetSage2, MiniMax Music 3, FLUX.2 and text-generation nodes Plenio builds on.
ComfyUI Manager: open Manager → Custom Nodes Manager, search for Plenio Music Production System and install it. Restart ComfyUI.
Comfy CLI:
comfy node install comfyui-plenio-musicBy hand:
cd ComfyUI/custom_nodes
git clone https://github.com/jplenio/Plenio-Music-Production-SystemRestart ComfyUI, open 0 · System Check from the template browser and run it. Plenio installs no Python packages. One feature is optional and tells you the command when you use it: python -m pip install faster-whisper for covers with lyrics. Model files come through ComfyUI's missing-model dialog when you open a template, or by hand.
Plenio is the successor of the Music Production Toolkit (formerly MiniMax Music Production Toolkit). So much changed that it became a new project. The old name also no longer fit, because MiniMax is one of three music paths, not the whole story.
- New package, new node IDs. Both can be installed side by side, and old workflows keep working with the old toolkit. There is no automatic migration of saved workflows; start from the new templates.
- Carried over deliberately: the prompt template library (re-checked, 239 templates), the EQ and loudness presets, the compressor and limiter (ported and verified sample by sample against the toolkit's output), and the lessons of its cover work.
- Replaced: the llama.cpp LLM node by ComfyUI's native text generation; the model downloader and advisor by ComfyUI's missing-model dialog and the System Check; the cover studio's freedom slider by an editable score and explicit brief choices; FlashSR and the restoration chain are not part of Plenio (the tested takes showed no need for it).
- Users: Getting started · YuE2 Song · YuE2 Cover · YuE2 DAW · MiniMax Song · Enhance & Master · Song Sheet · Brief templates · Score editor · Stems · Refine (48 kHz) · Instrumental · Mastering · App mode · Models · Configuration · Licensing · Troubleshooting
- Contributors: Architecture · Extending Plenio · Testing · Design documents · Decisions · Acceptance review
- Changelog
- YuE2 sometimes renders a take to the length ceiling and stops mid-phrase; render another take. Instrumental is a strong request, not a guarantee: the optional Check Vocals measures the take and keeps the cleanest one.
- The ASR can mishear words. A cover shows unsure words highlighted so you can correct them before rendering.
- SheetSage2 reads one 300-second window at a time; on 16 GB cards, trim longer sources.
- Mastering is whole-song loudness with a gentle tone match. There is no restoration, no fades and no multiband processing.
- Stems and Refine are experimental: their guarantees (a neutral mix returns the input, solo/mute rules, bandwidth before/after, no normalisation) are tested, but how the models sound is decided by the owner's listening checks (L1/L2), not yet done. On the two real takes measured so far, Refine's bandwidth rule counts both as full band: the model runs, but only the content above the crossover changes - see the status §5.
- Plenio's code: Apache-2.0 (LICENSE, NOTICE.md); bundled frontend libraries: THIRD_PARTY.md.
- Model weights have their own licences and are not included. YuE2, YuE2-VAE, SheetSage2 and the instrumental adapter are CC BY-NC 4.0 (non-commercial). MiniMax Music 3 uses the MiniMax-Music3 Community License with commercial conditions. FLUX.2 Klein 4B, the Gemma 4 writer and faster-whisper are Apache-2.0 or MIT. The release record names the licences of the models a song was made with; see Licensing.
Created by Johannes Plenio. This is an independent community project.