Private LLM - Local AI Chatbot Customer Service

Private LLM - Local AI Chatbot Positive Reviews

Good tryWell, according to the list of viable machines, my iPad Air 3rd generation should be able to run this. It won't run. It launches, struggles for a minute, and crashes. So, I can't really review this. All I can say is that it won't run on my iPad. EDIT: I was able to run this on my MacBook M2 just fine. Looking forward to seeing it run on my iPad. (I have poor old-person eyesight, and I hope the type is slightly larger on the iPad. It doesn't seem to be adjustable on the Mac.).GitchelVersion: 1.6.7

So much potentialI've been using this app for a couple of months at this point. When it was first released, it was a neat proof of concept, but it only supported 7B models and was overall just too simple to use effectively. With a recent update, a 13B model was released for all macs with 16GB of memory, and it makes such a huge difference! It's not quite at the same level as ChatGPT 3.5T, but it's close enough that I never use 3.5T anymore; this is my go-to. I greatly appreciate the on-device processing (hallelujah privacy!), and it doesn't even use too much power - my battery still lasts for hours and hours. The performance is also great; my base M1 Air powers right through the prompts. I only have two complaints about the app at this point. 1) The 13B model uses about 12GB of memory by itself, which does force the use of swap on a 16GB Air. Not much the dev can do about this, but it is something to keep in mind. You'll want to close out of other programs before launching this. 2) There still is no feature that has separate conversations. If you want to start a new conversation, you need to delete the existing conversation. I'd love it if we could get separate conversations in a future update; it would make this app so much easier to use. Overall, I love it and do not regret buying it at all. I can't wait to see what future updates bring :).N7nathanVersion: 1.4.1

A great tool, with huge potential.Obviously being an offline GPT limits the responses, but the fundamentals for something impressive in future less memory restricted devices eg iPhone 15 and beyond is really exciting. Offline and privacy focused are essential qualities of this app and it works quite well. A good bargain for the price with an active developer. One recommendation/piece of feedback would be to provide information on what the settings TOP-P and temperature do. If we come across an error or weird, reproducible response could you provide an option to email you a log so we can forward you the issue easily? This way you don’t need to embed any privacy violating analytics packages..Universe NZVersion: 1.1.2

Great so farSeems to do most of what I want. I think there just needs to be two main features added, and one of them should be super easy: 1. Allow increasing font size. Right now the font is pretty small on my computer, and the view menu doesn't have an option to increase font size 2. Support LaTeX. I do a lot of math work these days, and I don't want to see math written without LaTeX. ChatGPT has this feature, which has been super helpful for me when studying.LeChatParleVersion: 1.5

Great appThis app is pretty great for when you don’t have internet, but want access to ChatGPT. It’s not as powerful as the online version, but the fact that this is a one-time price of $10 is awesome! The only issue I’ve encountered with it so far is that it reloads every time you leave the app even for a moment. I’d love to see a History feature to see previous conversations and maybe Shortcut support, but it’s overall a really great app!.ArcaneTrainVersion: 1.1.3

Gemma 2B just made this a killer app.With the recent addition of Gemma 2B which is based of Google Gemni this has just become a killer app for me this has been the best LLM model that provides the best answer I hope to see 7B support in the future and I hope this comes Gemma comes to iPhone and iPad soon. Not only is ther the best performing model but it's all done on device which make this even better. Thank you!.UniqueAirStreamVersion: 1.7.7

Works well but needs some improvementThe 7B model constantly crashes on 14 Pro even though the prompt says that the phone can handle it. Downgrading to the 3B seems to work much better..Jingumistrad33246Version: 1.6.1

Great little local run chat botThis is a good little chat bot to play around with when you don’t have internet access. I only have an iPhone 12, so it won’t run the bigger model, but it’s still enjoyable. For a feature request, it’d be nice to have the ability to customize the system prompt..HaxleRoseVersion: 1.6.6

Simply Incredible!I cannot believe that I can run a model similar to GPT 3.5 on my iPhone 12 mini! It is a bit slow, but really impressive. The purchase allowed me to install on my MacBook Pro M1 Max 32GB and it is faster than GPT 4. Really excited to see how this app continues to develop and the models get better..Jfbloom22Version: 1.6.2

Missing features.We need the ability to set the system message, considering the price we should be able to load our own models. —— Changed to 5 star for now, if the dev delivers on what they said this app should be great!.Johnny5AliveNowVersion: 1.6.7

Great tool. Looking forward to future features.What as easy way to work with LLMs. You can download multiple different models and you can share the application with your family. That's a deal that is hard to beat..Fuel PumpVersion: 1.6

Good app with a privacy oriented focusThis is a very important app and concept in this day and age. Although as a suggestion in order to improve the AI users should be allowed to "opt in" to submitting data to better refine the model. Thank you for everything you do!.ManicCoderVersion: 1.6.4

A great packageWorth the $10. Obviously not as useful as Bard/GPT but it undeniably meets all expectations, and I have yet to see anything comparable. With outstanding email support, a Discord support server, and devs that continually work to improve the app for all platforms- this is a must buy for anyone interested..Phantm-Version: 1.5

Great Support So FarLove the additional models, this is what I was hoping to see when I paid for an app. It's easy enough to find a free client, so this type of support is just what I hope to see continue!.GrdinicVersion: 1.6

So far so good!Okay… THIS APP IS AMAZING. I am using this on my iPhone 12 Pro Max and wow, pretty fast reply. I am still playing around with this app but I am very impressed with it. I wonder if new models from huggingface could be downloaded, if that’s possible..JunayetVersion: 1.6.2

App very buggy but has potentialOnly load their custom model. Struggles to download 7B I only give this app 3 stars for its shortcuts integration, pretty neat idea to string custom LLM to Siri the rest of the app is lacking badly and isn’t being maintained or updated don’t waste your money I’ll be requesting a refund may repurchase if updated more like LLM farm.Hackerlocal.usVersion: 1.6.7

Please allow LLM choicePlease allow us to pick our LLM the same way we do in text-generation-ui by providing hugging face name. I realize not all models can run on iOS, but I was hoping to mostly use this for CodeLlama..Triplet97Version: 1.5.1

App is actually not so bad but could be improvedI’m currently using the 3b model on a iPhone 12 and it’s pretty rough. It’d be great to see it worked on some more even if the 7b model is the priority..Wwefan2013Version: 1.6.5

Helpful but not an end-all problem solverGives solid basic advice. Can handle smaller projects and concerns. Not 100% there. Not 100% stable. Can tell some creepy stories that are unsolicited. Definitely needs a safety team..DjsjsjebebrkrmzVersion: 1.1.4

Love Being able to run a powerfull LLM locallyI cannot believe it is as easy as a few clicks to install an LLM like ChatGPT and it is running entirely on my Mac! No internet required, no monthly fee for a plus version. awesome!.Jfbloom22Version: 1.5

A good startThis app is fun, but being able to use other models and configure them would make this app 10 times more useful. I’m hoping the dev adds support for model selection (mistral, pls) and setting the role of the AI..MrcssccoVersion: 1.6.2

Great app! More features pls! :)This app is awesome for offline use! I would like to be able to download other models from hugging face though. Please make this a feature!.ItsTheLoafManVersion: 1.6.5

There should be an option to use 13B model. (feature request)UI is great and all but 7B model is not that powerful for any useful work, adding an option for Mac users to choose a bigger model will be useful..OlaJobsVersion: 1.2.1

GreatFeature suggestion: the ability to edit the REPLIES that the LLM gives. This way you can influence it better..AvavielVersion: 1.6.2

Great approachHaving option to load own models will be wonderful. Eg Llama 2 or others..AhstaninVersion: 1.3

Getting there!UPDATE: app is much faster now. Still waiting on a prompt library which would be awesome, but the speed and quality is increasing seemingly by the day. There was a small period of time where it didn’t work on the 13 mini but that has been fixed. I’m happy with the amount of work the devs are putting in and I’m hopeful for more features in the future. MLC chat is comparable in speed and quality but this app is looking to widen the gap by adding more features in the (hopefully near) future. Old review: In comparison to MLC chat (free and open source) this app is lacking. MLC chat offers the ability to install additional models, and the default is on par or better than this apps responses (like gpt 3 level, lots of incorrect information and it kinda goes wild when explaining things). Additionally, performance is abysmal comparatively for better quality responses on MLC chat. It’s a great idea but lacks the ability to fine tune. Being able to change the temperature and other settings for the model would be great. Would also be cool if we could create a starting prompt (or a library to choose from) for the AI so it can be used for things like role playing or DND. Kinda bummed that it’s $5 since I was expecting a lot more than MLC AIs app for the pricing. Instead I’ll be uninstalling and checking back later for new features and possible performance increases. If you’re reading this and thinking about buying it, you should probably check out MLC chat for now and just wait for more features and performance updates..ChaosmouseVersion: 1.1.1

FantasticI run LLMs on Colab and other cloud providers. Private LLM let's me have fun running decent smaller models on my Mac and on my iPad Pro, Recommended!.Reader fanatic MarkVersion: 1.6

This is crazy-good, running on my *phone*!Nice for Shortcuts that need to “think” a little!!!.GeraldShudyVersion: 1.6.2

Wish there will be a local api compatible to openai, and different chatboxesGreat app.Etty__Version: 1.3

Works well would be nice to integrate with iOS shortcutsIt works well and quick. Would be nice if it integrated into iOS shortcuts..LoyalekoinuVersion: 1.0.3

Easy to use and truly private and offline.Unlike almost every other offering on the App Store, Personal GPT was designed to provide a local, private GPT for you to use offline with no data being sent to third parties. It includes a limited LLM that works reasonably, given its size. The developer is clearly very passionate about this project and they are constantly updating and refining it. The more memory you have on your device the better this app performs..Universe NZVersion: 1.0.2

I like it a lotAs in it meets , maybe exceeds, my privacy expectations, works on all my ios devices WHEN OFF LINE. Emphasis mine, country internet is unreliable. ;-( Developer seems commited, saw this with the guy from the Applo app, hoping for good things, 10 bucks aint bad for what I see so far.OleMichnerdVersion: 1.0.2

Needs to be fasterDownloaded this for a flight and although it works, it’s very buggy and slow. I’m sure this can be fixed and improved on with time. Happy to pay the cost of this but wish it worked flawlessly. Hope my feedback helps.JdhfcnggVersion: 1.0.1

One of the best apps out there!I have always loved AI. I got into ChatGPT opening day and have used it religiously since day 1. That being said, it still requires internet access to use, and I’ve gone as far as debating creating my own AI to store locally on my iPhone just in case I’m ever in need of it when I have no internet. There are tons of use cases for this too. What if I’m on a home stranded and I need survival help? What if I’m on a plane that doesn’t have internet? I could go on and on. But I came across a YouTube video that shared this app and I figured, “eh, it’s only a couple bucks and I have storage to spare, why not?” I can safely say it’s one of the best investments I’ve made. Knowing I have a locally stored AI that doesn’t require internet access but still delivers most of what ChatGPT can, at the cost of a couple bucks and a couple gigabytes, is just awesome. I have even stress tested it, thinking maybe the lack of internet access would negatively impact the results, but nope! It works perfectly. There are a couple kinks here and there. But nothing that would make me reconsider downloading the app. For example: Sometimes it won’t remember things we just talked about, so I have to repeat the context. There are some formatting things where it’ll just give you massive blocks of text instead of easily digestible paragraphs. Sometimes it’ll start typing nonsense (but that’d be expected from any locally stored AI). And so on. But there’s no way these things would ever stop me from using it. This is what AI should’ve been from the beginning! A locally stored assistant that can help you with or without internet access. Trust me. It’s more than worth it..LinxCEOVersion: 1.6.7

Great app.Would love to be able to download different models. If not from an in app catalogue, perhaps putting in a url from hugging face? Otherwise pretty neat..DtlnxVersion: 1.6.1

Reasonable ExpectationsThe developer has given easy access to a usable information source, disconnected from the tentacles of big tech. This is to be applauded. But expectations are important here. You can't compare a solo effort with that of an organization with billion-dollar funding. Just contextualize this with pre-ChatGPT tech and you may find this a tool to have (in situations where yes.. you are disconnected from the internet or you don't want big tech operators to hoover your brain for free). Docs on if or how to do do supervised instruction of the model would be welcome or how to tweak this. Read the vendor warnings. These are known industry limitations of this type of offering..KuutanaVersion: 1.0.2

Good startWhile I purchased the app out of curiosity, I am reasonably happy with the app so far. The reason I only gave 3 stars for now is due to its occasional inaccuracy and less-than-stellar performance when compared to other online GPTs out there. I hope that the developer improves the app’s UI and provides an option to view and select downloaded models. Right now, downloading and applying the new language model is pretty unstable..BobtoriVersion: 1.6.7

Better and BetterThe developer is doing a wonderful job at updating the models the app uses, and it’s really noticeable..LumalayVersion: 1.6.5

Cool but not useful, yet.Very cool that it is an off-line LLM, that is an accomplishment on it’s own. Unfortunately, it often produces nonsensical or inaccurate answers making it not very useful. I was using the 7B model and found a lot of hallucination in the answers and in longer responses it would often contradict or change things it had just stated. I am hoping this improves as it would be awesome to have a useful offline LLM..CwilmsVersion: 1.6.2

3B model is great!Nice at coding too.SurajP1729Version: 1.6.2

Free International Money Transfer 💸Enjoy high maximum transfers into more than 20 currencies while saving up to 90% over local banks! The cheap, fast way to send money abroad. Free transfer up to 500 USD!AdvertorialVersion: 1.6.7

Private LLM - Local AI Chatbot Negative Reviews

Literally a Open Assistant knockoffI’m not against a developer using open source work, but this is a very thin wrapper around someone else’s work with credit given. It’s just sad. I found out this was open assistant after letting the app chat with itself till it mentioned its name was open assistant. Ask it that question in the beginning and it will tell you it’s personal GPT..Deibele1Version: 1.1.3

Missing some key features.Would love to have the ability to include default custom instructions like ChatGPT has. Would also like the option to redo the ai’s chat. Otherwise it’s nice to see this working on a phone..Gordo vacaVersion: 1.6.2

Needs one featureYou need the ability to make the AI response start with “Certainly!” so that the uncensored model actually works. Without that feature it’s useless.FladoodleVersion: 1.6.5

Disappointed with Inaccurate AI App - Seeking RefundI bought Personal GPT hoping for accurate and reliable results. However, I've been let down by the app's highly inaccurate output. I know AI technology is complex and evolving, but I expected better..Sun*flowers*Version: 1.1.3

Doesn’t work on iPhone 13 miniNo other apps open, this is what the app shows “Error: this iPhone does not have 3GB of free memory. Please try closing any memory intensive apps running in the background and restart Personal GPT.”.Mpt27Version: 1.1

7b crashes, 3b is trash7b crashes on iPhone 14 pro. 3b isn’t worth using, can’t list the presidents..Funnyfinn13Version: 1.6.1

Wait awhile for it to be improvedI've got some experience with local large language models such as this one. This app is intended to be a reasonably compact, private chatbot you can use on a Mac with 8 gb of ram. I purchased it, experimented with it, and in my opinion it's not ready for release. The developer provided a prompt and thoughtful response to my inquiry. It may be that this will work better in a couple of weeks. In the meantime, I requested a refund..Johnny NimbusVersion: 1.0.2

Don’t waste your moneyAlthough the software calls itself, an LLM, it’s pretty useless since it hallucinates, and provides a ton of inaccurate information. It has no access to real time information, even when connected to the Internet. it pretends to have capabilities (booking calendar entries), but it can’t do any of it. not sure where somebody would find the suffer useful..Edward.kVersion: 1.6.7

ChatGPT Provides much better answersI have ChatGPT on my phone. The answers from Personal GPT sound like they're written by a teenager, and the ones I recieve from ChatGPT are very professional and much more informative. ChatGPT was free, so you may understand my frustration when having paid for a service that is far underperforming what I can get out of a free applicaiton on my cellphone..JustMyOpinionCANADAVersion: 1.0.2

Basically a scamI don't usually give 1 star reviews. A simple "hi" will give you a response that tells you it doesn't know what it's talking about. Tell it to be more concise it'll tell you it doesn't know what you're talking about. It will get very simple things just blatantly wrong, and overall will sound like a word salad being vomitted all over your screen. I saw the Reddit advertisement and this seemed promising, but honestly this is borderline insulting to install on my computer..NoeazeVersion: 1.0.2

Payoneer 💰Payoneer is an online payment platform that lets you transfer money from any corner of the world! A best and must have payment service for every blogger, traveler, freelancer, affiliate marketer, consultant, virtual assistant, business person, online sellers, and receivers. Earn $25 for free by joining Payoneer. Sign Up Now!AdvertorialVersion: 1.6.7