Hallo on RunDiffusion

Hallo on RunDiffusion

An in depth tutorial to setup and run Hallo on RunDiffusion

In this guide, we’ll walk you through setting up a ComfyUI server, installing custom nodes, and creating a fun video using the Hallo node by AIFSH. Follow these steps to get started.

Use Cases for Hallo Node

The Hallo node in ComfyUI opens up numerous possibilities for animating portrait images with audio files. Here are some compelling use cases:

    • Animate characters in children’s stories, making them more engaging and interactive for young audiences.
    • Create animated lectures where historical figures explain concepts in their own "voices", making learning more immersive.
    • Use animated portraits for personalized video messages, increasing customer engagement with a more human touch.
    • Generate eye-catching animated portraits for use in social media posts, stories, and advertisements to attract more viewers.
    • Produce animated music videos where the characters in the portraits sing or narrate, providing a unique visual experience.

Step 1: Launch a ComfyUI Server

  1. Launch a ComfyUI Server on Beta:
  • Choose a Large Server for optimal performance.

Step 2: Install Custom Nodes

  1. Click on Manager:
  1. Install Custom Nodes:
  • Click on the "Custom Nodes Manager" button.
  • In the search box, type “Hallo”.
  • Install ComfyUI Hallo by AIFSH and wait for the installation to complete.

Step 3: Restart ComfyUI

  1. Restart the ComfyUI Server:
  • Go to the Server Manager on the left side of the interface.

  • Select "Restart App" to apply the changes.

When at the bottom you see it say "To see the GUI go to:" Hit refresh on your browser.

Step 4: Fix Hallo Node

  1. Go to Manager Again:
  • Click on "Custom Nodes Manager" once more.
  • Type “Hallo” in the search box and click "Try Fix".

Step 5: Restart ComfyUI Again

  1. Restart the Server:
  • Head back to the Server Manager and restart the app again to ensure all changes take effect.

Refresh again just like last time once you see "To see the Gui Go to:"

Step 6: Create the Hallo Workflow

  1. Clear Existing Workflow:
    • Ensure your workflow is clear for a fresh start.

Click OK to clear the workflow.

  1. Load Image:
    • Double-click on the screen, type “LoadImagePath” (no spaces), and select that node.
    • Load a portrait image of your choice.
  1. Add Hallo Node:
    • Double-click again and type “Hallo”, then select the Hallo node.
  1. Load Audio:
    • Double-click and type “Loadaudiopath” to create that node.
    • Connect Drivingpath to driving_audio on the Hallo node.
    • Select the audio file you’d like to use.
  1. Preview Video:
    • Double-click once more and type “Preview video” to create that node.
    • Connect the Hallo video node to the Preview Video node.
  1. Queue and Process:
  • Hit the "Queue" prompt in the top right corner and let the processing begin.

Enjoy your videos!

0:00
/0:07

Conclusion

Following these steps will help you set up and utilize the Hallo node in ComfyUI to create engaging videos. Enjoy experimenting and making fun videos with your new workflow.

For more tips and guides, check out these articles on RunDiffusion:

About the author
Adam Stewart

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to .

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.