Differences

This shows you the differences between two versions of the page.

--- ai:faq [2023/11/27 20:41] – I said FRIENDLIER! naptastic
+++ ai:faq [2023/12/19 22:10] (current) – [1. WHAT MODEL DO I USE?!] ref controversy about HF leaderboard naptastic
@@ Line 27: / Line 27: @@
   * [[https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard|HuggingFace leaderboard]] contains all kinds of scores you might care about.
-  * [[https://www.reddit.com/user/WolframRavenwolf/|u/WolframRavenwolf]] is the only Redditor I see posting in-depth comparisons of models.
+    * **NOTE**: There is currently (2023-12) controversy about how useful the leaderboard is. This has to do with model contamination. (TODO: add "contamination" to the glossary and maybe make a page about it)
+  * [[https://www.reddit.com/user/WolframRavenwolf/|u/WolframRavenwolf]] is the only Redditor I see posting in-depth comparisons of models. Their testing has a narrow focus and might not match your use case.
   * [[https://nsfw-chatbot-rankings.web.app/#/|NSFW Chatbot Leaderboard]] exists
@@ Line 63: / Line 64: @@
 **Know your goals.** It is **critical** that you know what you want your AI to do for you. Even better if you have it written down.
-==What can't AI do?==
+===What Things Can AI Do Right Now?===
-(At least not yet, or not well)
+  * LLMs generate text and code
-    * Arithmetic, including counting
+    * They can integrate with... (fill this in plz)
+  * Diffusers generate images
+    * Upscaling
+    * Fill-in and fill-out
+    * Video
+    * (anything else?)
+  * Data format conversions
+    * OCR ("optical character recognition", which is just a fancy way of saying "image-to-text".)
+    * Speech-to-text (partially a classification problem; might be better served with other tools.)
+    * text-to-speech (though this might be better served by other tools)
+  * **lots of other stuff.**
-==What's the best ____?==
+===What CAN'T AI do right now?===
-This is really not an answerable question. TODO this needs a fuller/better explanation.
+  * LLMs are still pretty bad with math.
+  * Music generation is in its infancy.
+  * OCR for music transcription is still a hilariously impractical idea.
+  * **lots of other stuff.**
-==What kind of hardware do I need?==
+===What kind of hardware should I buy?===
-    * see [[formats-faq]] for now; this deserves its own page
+It depends. (I know, I know... I hate that answer too but it's the truth.)
-==What software do I need?==
+Buying a CPU for inference is folly. The only advantage a CPU has is that it usually has more DRAM than the GPU has VRAM, so it can load larger models. The difference in inference speed is at least an order of magnitude. Choosing a GPU, the most important factor is how much VRAM it has.
-    * Different software is useful for different goals. See the Applications section below for more detailed information about each application.
-==What do all these terms mean?==
+  * For maximum ease and speed, buy Nvidia GPUs. They are really expensive, though.
+  * For a reduced cost, more headaches, and fewer applications that currently support it, buy AMD. They're still pretty expensive.
+  * Intel GPUs have the best price/VRAM ratio of the bunch, but there is almost no support. Getting them to work is (mostly) almost impossible even for experienced system administrators.
+===What do all these terms mean?===
 (nap definitely needs help with this)
     * need a glossary
-==How do I do the thing?==
+===How do I do the thing?===
   * Start with <nowiki>README.MD</nowiki> for the software you want to use. Seriously.
   * Links to how-to's
-==How do I get help with the thing?==
+===How do I get help with the thing?===
     * Read <nowiki>README.MD</nowiki> for the software you want to use again. Seriously.
     * Discord servers