ManuBot (Artificial Intelligence software)

[Sharp]

Hi all.
I’m developing some pretty extensive AI software and I wanted to share a small little branch off my main AI project I called ManuBot.



Some of you may have seen the previous version I had named KORG Muse, but given that this AI can be trained on everything from factory maintenance of machines to human resource management of staff, ManuBot seems more fitting for what flavour of the AI I’m going to post here on the forum.

ManuBot is an offline AI Chatbot / technical support assistant that can help you get the most out of any hardware the AI is trained on. You simply ask it a question and it will help you achieve what you are trying to accomplish. Give it’s entirely offline, you can use it as much as you want without getting kicked off like other AI services, and what you said to the AI is completely private.



So, what does this AI know in general?
Well, it knows vast amount of general knowledge. You ask it to write song lyrics, or if you neeed cooking instructions on how to boil an egg, it’s got you covered. From a fined tuned musical instrument point of view and the purpose of posting it here, it has had deep training on these specific products.

ASM Hydrasynth Deluxe.
KORG Nautilus
KORG PA5X
KORG Pa4X
KORG Pa1000
Polyend Tracker Mini

Training it on more products mainly comes down to finding good data to train the AI on. Training the AI on the manuals for the product above was useful, but not entirely ideal. It is better to various sources, so the AI will be better talking about some products than others since the AI was trained on video’s and other tutorials where possible for certain products.

System Requirements.

PC:
i3 or faster.
GPU with 6.4GB of free VRAM.

Mac:
Soon...could do a built right now, but I’ve no Mac to verify my work on that platform right now.

AI Performance Information.
Running Artificial Intelligence offline locally on a computer requires a dedicated GPU with 6.5GB of VRAM free for the AI. If you have this, the AI will type back messages at a rate of 30 to 70 words per second depending on your GPU.

If you don’t have enough VRAM, it may use as much VRAM as you have, and offload the rest to system RAM. This will result in much slower response times. If you have a potato PC, then the AI may not even load.

Download Here (v0.3 Beta)

I’d appreciate any feedback you have. It early days, so I expect there to be issues. Remember, it’s a conversation you are having with an AI. So be clear on what you want it to do for you and chat with it. If you don’t speak English as your first language, tell the AI to only respond in your language and see how that goes for you.

Kind regards
Sharp

[drama1]

Wow !!! You are much too kind. Thanks. Give it a try as soon as I get back from road.

[BlackForest]

I have no active contact with AI as yet, but I suppose the Kronos would be a good candidate to train. There have been so many hacks and DIY solutions, faults and alternative power supplies.. that would be great.

[chelsea4023]

Hi,
Forgive my daft question, but I downloaded version3 and the instructions say load the .exe file. I cannot seem to find the .exe file among the unzipped files.
Obviously it's something I'm missing but any help would be appreciated.
Chris

[Sharp]

Hi Chris.

Just replied to your PM, but I'll stick this here too. This is the exe file you would ahve to run.

Image


Kind regards
Sharp.

[chelsea4023]

Hi,
Thank you James.
Chris

[Sharp]

Note: If anyone is trying to run this AI knowing you don’t have a suitable graphics card, can you please let me know how that goes for you?

Things I’d need to know.....
What’s your CPU.
How much system ram do you have.
How many words per second does the AI reply at.
Does it even load for you.

If I know these things, I might be able to help.

Thanks
Sharp.

[lmatonement]

Thanks for your work on this! I'm excited to see what is in there! Unfortunately, it's not working for me. I downloaded `ManuBot v0.3.zip` and got an error. Then I think I downloaded the "whole folder" which downloaded `Artificial Intelligence1.zip` which I was able to unzip and it just had `ManuBot v0.3.zip` in it which was still corrupt:

```
~/Downloads$ unzip Artificial\ Intelligence1.zip
Archive: Artificial Intelligence1.zip
warning: stripped absolute path spec from /
mapname: conversion of failed
extracting: ManuBot v0.3.zip
~/Downloads$ unzip -l ManuBot\ v0.3.zip
Archive: ManuBot v0.3.zip
warning [ManuBot v0.3.zip]: 1010839278 extra bytes at beginning or within zipfile
(attempting to process anyway)
error [ManuBot v0.3.zip]: start of central directory not found;
zipfile corrupt.
(please check that you have transferred or created the zipfile in the
appropriate BINARY mode and that you have compiled UnZip properly)
~/Downloads$
```

Should I use a different tool to unzip the file? `unzip -h` shows "UnZip 6.00 of 20 April 2009, by Info-ZIP. Maintained by C. Spieler."

[Sharp]

Hello.
Sorry, Dropbox has a horrible user interface.

You clicked on the “Download” button top left, but Dropbox is then trying to Zip my Zip. Don’t click that Download button at all.

Instead hover your mouse over ManuBot v0.3.zip and a download button will appear on the right.

Click that one. That button will directly download the Zip file I uploaded without trying to Zip a Zip file.

Stupid I know, but that's Dropbox for ya.

Kind regards
Sharp,

[DocFingers]

That's it. Just a compliment, and much Gratitude for helping me remain humble.
Awesome!

[MikeMusik]

This is great!
Please keep us posted on the MAC version. Looking forward to it.

[fomalhaut]

Training the AI on the manuals for the product above was useful, but not entirely ideal. It is better to various sources, so the AI will be better talking about some products than others since the AI was trained on video’s and other tutorials where possible for certain products.

Regarding Korg instruments, it would be great if there was some available source of user contributed information, dunno... like a forum or something like that

[Sharp]

If people wish to come together on the forum and start generating usable data, I would be happy to train the AI further on all that data.

Regards
Sharp.

[fomalhaut]

If people wish to come together on the forum and start generating usable data, I would be happy to train the AI further on all that data.

Not sure how Manubot works, but the content is in the SQL forum database itself, and the content (afaik) is public, so I do not think anyone would oppose to that treatment exactly by *you*. I believe the way to go would be setting up a RAG engine on top of the forum contents in addition to user manuals and other more structured resources, although it would be difficult to distribute as a installable package.

PS: Just drop me a DM if you need macOS beta testing.

[Sharp]

ManuBot is a LLM with a RAG so I could in theory feed it the SQL database of the forum and let it vector all that into embeddings. However, the database is only valuable for training the AI on old products we have been talking about for a good while. The AI would gain little to no knowledge from the SQL database on new products simply because we haven't really been talking about them.

I've other versions of this AI I've built for commercial use. This has allowed me to figure out what's the best way to format data for the AI to be trained because I can simply pay someone wages to staff to generate data for me.

Which resulted in this finding in a mark down format.
1: Step by Step operational instructions.
2: Straight paragraphs of clear information.

Type 1 above is now on trial in a pharmaceutical company. One large manual for an entire production line was re-written as step by step instructions for the AI to know how to operate production line. This layout of data has FAR exceeded everyone's expectations as the AI is super accurate in providing support and instruction to staff.


Type 2 above, I'm launching the AI in a museum in the next few weeks where you can talk to a full size character on a large 3X3 meter video wall. You can speak verbally to the AI character on the screen. He knows the history of every item in the museum, it's location and display case number. This has been so successful that further training is taking place to expend his knowledge to surrounding museums and joint ticket prices.

Simply put, that recipe above is the best way to train ManuBot on KORG products. Training on the manuals straight as they are right now does provide usable results, but to exceed that and to get to the level of quality I'm seeing in the commercial trials and install we are doing would require additional data formatted as explained above.

If people wish to offer their time for free, I'm happy train the AI further. Or, would people simply prefer to pay for the software and see that reinvested into paying people generate the data the AI is trained on.

As always, I'll do whatever I can in my spare time either way. Maybe people are happy with the quality the AI is outputting right now.

PS: Just drop me a DM if you need macOS beta testing.

Will do.

Kind regards
Sharp