Open source large language models are now available for anyone to use, these models are trained on publicly available data and can be used via an android app. This means that people who don’t have access to specialized hardware can still create and interact with AI models that can seemingly understand human language and respond in a way that is natural and conversational.
For example, a person could use an Android app to talk to a model of a chatbot, the model would be able to understand what was being said and respond in a way that was similar to how a human would respond. This type of technology has many potential applications such as customer service, language translation, and content generation. It can be like an audio book that you can talk with.
This technology also opens up new opportunities for people who want to utilize LLM’s on prem. A way to utilize open source large language model is Ollama which can be part of an on prem LLM chatbot setup that uses natural language processing and machine learning algorithms to understand and respond to user input in a conversational way.
In the not too distant future, one could have a laptop in a car, which is running the model, and the perhaps via Bluetooth, an Android phone app could connect with the laptop and allow one to have conversations with the LLM (handsfree) while driving. This could be done in an audio mode. No internet connection would be needed. One can already utilize a conversation mode in Open WebUI when utilizing models like Code Llama.
Building an Android app that could connect with a decently powerful consumer grade laptop running the LLM in a car to enable an interactive audiobook like experience (in conversating with the LLM) seems like something that is likely technologically quite possible with the current technology that exists.
