Today, we’re excited to launch the long awaited AI Module training feature to Opus tier users.
AI Modules directly influence the behavior and the generations of the AI. You can use the default Modules we provide or you can train your own modules on the training data you provide! For example, you can create a module for the AI to mimic the style of your favorite author, or you can do a module for your favorite novel series to make the AI learn about your favorite characters!
Custom AI Module training arrived exclusive to Opus tier subscribers — but is now trainable, sharable & usable by all tiers.
Our initial plan was to release custom AI Module training as an Opus only feature since was a very resource heavy procedure to provide this feature. After monitoring demand, feedback and suggestions we evaluated the situation and found ways to streamline the training and cost.
This helped us determine a need to provide options for single time purchases and a rollout to lower tiers.
Custom Training is defined and limited through Training Steps. Training steps shows how much of the material text the AI will read/train over.
Each Opus tier subscriber receives 8000 Training Steps a month that will reset on the next billing cycle.
The maximum file limit for your uploaded training material file is 10MB per module.
Examples for default module’s training:
Style: Edgar Allan Poe is trained on his collected works, a 3.6mb file and took around 1000 steps to train.
Theme: 19th Century Romance is trained on 9 files from 6 different authors, at 4.7mb and took around 3000 steps to train.
Inspiration: Crab, Snail, and Monkey is trained on 20 files at 5.8mb and took around 3000 steps to train.
Open the NovelAI menu, select the beaker icon, then click on AI Module Training.
After this, the AI module trainer screen will pop up. Next you should upload your material and select how many steps you want to train for. The default of 1000 steps is a good place to start, don’t forget to give your module a name and description too. Also remember that you can select multiple files!
After done, click Train. If there is people ahead on your queue you will have to wait for that, after it’s your time to train it will show you the progress as percentage.
When this screen comes up, it means your module training is done! Your module is already imported to your modules menu, but if you want to share it with others you should download the model right now, and after that delete your training data.
Important Note: Trained modules are only compatible with the current AI Model, if we change the AI Model in the future they might not work on the new models. So remember to keep your training data handy for future updates!
Every second around 5 steps are processed. This means an average module with 1000 steps would train in ~3 minutes.
Once you have used up your 8000 training steps you will need to wait for the next billing cycle in order to reset.
You can only train one AI module at a time and cancelling the training of a started AI module is not an option.
- Biggest rule of thumb: put in your data formatted the way you want the AI to generate back.
- Plain text in .txt format, avoid formatting tags/markdown or html.
- Use prose.
- One paragraph in one line, no paragraphs split onto multiple lines.
- No empty lines between paragraphs.
- Empty lines could be used for chapter break, but we highly recommend using *** instead.
- No leading/trailing space, tab or other whitespace (easy to clean with programs like Notepad++).
- Ideally, use regular quote and single quote characters “ and ‘ not fancy ones (Easier for on the AI).
- Make sure all included material is focused on what your module should achieve.
- If you want to avoid the leaking of character names/other details, keep the data balanced and include many different stories with different characters.
- If you want the AI to learn character names/other details, train it on specific series.
- Feel free to experiment with short data. Nothing stops you from turning a short prompt into a module, which will require much less steps too.
- Avoid using encyclopedic data unless you plan to generate encyclopedia entries.
Once you have trained your module you will be able to download the file to share it.
Other people can download this module and import it to easily start using it. Training is Opus only, but all the other tiers can import trained modules.
To import, you can drag and drop the module to the story and after doing that it should be visible in the AI modules menu or the dropdown.
You can also use the import button on the right menu to import modules.
Training Data is deleted after training is done and not logged by us.
We have improved these default modules:
- Inspiration: Crab, Snail, and Monkey
- Inspiration: Witch at Level Cap
- Theme: Hunter Gatherer
- Theme: Magic Academy
We’re excited to hear what you think about the custom modules and how we can improve it, you can contact us at:
Discord: https://discord.gg/novelai
Twitter: https://twitter.com/novelaiofficial
Reddit: https://www.reddit.com/r/NovelAi/
Website: https://novelai.net/
Patreon: https://patreon.com/novelai
This post was updated on 9/19/2022 to reflect Module Training updates to all tiers and UI changes of NovelAI.
